Communication application for conducting conversations including multiple media types in either a real-time mode or a time-shifted mode

• US 8,509,123 B2
• Filed: 03/01/2013
• Issued: 08/13/2013
• Est. Priority Date: 02/08/2008
• Status: Active Grant

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Lai, Andrew
• Assistant Examiner(s): LEE, ANDREW CHUNG CHEUNG
• Application Number:
  US13/782,834
• Publication Number:
  US 20130176911A1
• Time in Patent Office: 165 Days
• Field of Search: 370/260, 370/276, 370353-356, 370/395.52, 370/468, 370/470, 370/494, 709/223, 709/234, 709/235, 455/456.1, 455/456.2, 455/456.3, 455/556.1, 455/556.2
• US Class Current: 370/276
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

A communication application configured to support a conversation among participants over a communication network. The communication application is configured to (i) support one or more media types within the context of the conversation, (ii) interleave the one or more media types in a time-indexed order within the context of the conversation, (iii) enable the participants to render the conversation including the interleaved one or more media types in either a real-time rendering mode or time-shifted rendering mode, and (iv) seamlessly transition the conversation between the two modes so that the conversation may take place substantially live when in the real-time rendering mode or asynchronously when in the time-shifted rendering mode.

Claims

1. A non-transitory computer readable medium including computer code intended for execution on a communication device connected to a network, the code configured to perform the following when executed on the communication device:

enable the communication device to participate in a conversation conducted over the network with a remote participant, the conversation including a bi-directional exchange between the participants of incoming and outgoing messages that include voice media;

progressively store the incoming and outgoing messages of the conversation on the communication device;

(a) as the voice media of the outgoing messages is created on the communication device; and

(b) as the voice media of the incoming messages is received over the network from the remote participant of the conversation;

display on the communication device the message history of the conversation, the message history including visual representations corresponding to the incoming and outgoing messages respectively;

provide rendering options on the communication device to selectively render the incoming messages of the conversation in a near real-time mode as the voice media of the incoming messages is progressively received over the network and out of storage in a time-shifted mode;

selectively transition participation in the conversation between the near real-time mode when progressively rendering the voice media of the incoming messages as the voice media is progressively received over the network and in the time-shifted messaging mode when rendering the voice media of the incoming messages out of storage; and

provide a select-to-talk function for generating the outgoing messages of the conversation on the communication device, the select-to-talk function, when implemented, configured to;

(c) generate one of the outgoing messages pertaining to the conversation; and

(d) progressively transmit the voice media of the one outgoing message to the remote participant of the conversation as the voice media is created and progressively stored on the communication device.

2. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to transmit the voice media of the one outgoing message at a rate commensurate with the bandwidth capacity on the network when the voice media is created.

3. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to transmit the voice media of the one outgoing message from storage on the communication device if :

(e) the voice media of one outgoing message is created when the communication device was disconnected from the network; and

(f) after the communication device reconnects to the network.

4. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to transmit the voice media of the one outgoing message from storage on the communication device, at a rate as fast as conditions on the network permit, when conditions on the network do not permit the transmission of the voice media as it is created.

5. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to use a transmission protocol capable of:

(i) supporting near real-time communication so that the remote participant of the conversation may selectively review the voice media of the one outgoing message in near real-time; and

(ii) guaranteeing the delivery of the voice media of the one outgoing message to the remote participant of the conversation.

6. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to use a transmission protocol that guarantees delivery of a complete copy of the voice media of the one outgoing message to the remote participant of the conversation.

7. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to use media packets embedded into transport packets to transport the voice media of the outgoing messages to the remote participant of the conversation.

8. The non-transitory computer readable medium including the computer code of claim 7, wherein the transport packets comprise Internet Protocol (IP) packets.

9. The non-transitory computer readable medium including the computer code of claim 1, wherein the incoming and outgoing messages of the conversation are associated by an attribute, the attribute comprising one of the following:

(i) a name of a participant of the conversation;

(ii) a topic of the conversation;

(iii) a subject defining the conversation;

or

(iv) a group identifier identifying the participants of the conversation.

10. The non-transitory computer readable medium including the computer code of claim 1, further configured to display a list of active conversations on the communication device.

11. The non-transitory computer readable medium including the computer code of claim 10, further configured to enable a user of the communication device to select the conversation among the list of active conversations for participation.

12. The non-transitory computer readable medium including the computer code of claim 1, wherein the visual representations of the incoming and outgoing messages in the conversation history are displayed in the time order in which the incoming and outgoing messages were created and added to the conversation respectively.

13. The non-transitory computer readable medium including the computer code of claim 1, wherein the visual representations each include a date and time indicator indicative of when the voice media of the corresponding incoming and outgoing messages were created respectively.

14. The non-transitory computer readable medium including the computer code of claim 1, wherein the visual representations each include an indicator indicative of the name of the participant of the conversation that created the voice media of the incoming and outgoing messages respectively.

15. The non-transitory computer readable medium including the computer code of claim 1, wherein the incoming and the outgoing messages of the conversation are further configured to include video media.

16. The non-transitory computer readable medium including the computer code of claim 1, further configured to display in the message history text messages that are exchanged during the conversation.

17. The non-transitory computer readable medium including the computer code of claim 1, further configured to display in the message history photos that are exchanged during the conversation.

18. The non-transitory computer readable medium including the computer code of claim 1, further configured to include in the message history video exchanged during the conversation.

19. The non-transitory computer readable medium including the computer code of claim 1, further configured to support synchronous communication among the participants of the conversation.

20. The non-transitory computer readable medium including the computer code of claim 1, further configured to support asynchronous communication among the participants of the conversation.

21. The non-transitory computer readable medium including the computer code of claim 1, further configured to operate in a full-duplex mode when transmitting an outgoing message and receiving an incoming message at approximately the same time.

22. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is further configured to address the one outgoing message to the remote participant of the conversation by using an identifier embedded in the message and associated with the remote participant.

23. The non-transitory computer readable medium including the computer code of claim 1, wherein the one outgoing message is addressed to the remote participant by a user of the communication device using a human-readable identifier.

24. The non-transitory computer readable medium including the computer code of claim 22, wherein the identifier is a non-IP address identifier that is resolved into an IP-address that corresponds to a remote communication device associated with the remote participant of the conversation.

25. The non-transitory computer readable medium including the computer code of claim 24, wherein the IP-address is resolved into a physical address for delivery of the one outgoing message over the network to the remote communication device.

26. The non-transitory computer readable medium including the computer code of claim 1, wherein the select-to-talk function is implemented by selecting a push-to-talk feature on the communication device.

27. The non-transitory computer readable medium including the computer code of claim 26, wherein the push-to-talk feature is implemented by selecting a push-to-talk icon on a display screen on the communication device.

28. The non-transitory computer readable medium including the computer code of claim 1, further comprising code for generating a text icon on a display screen of the communication device, the text icon enabling the contribution of text-based messages to the conversation when selected.

29. The non-transitory computer readable medium including the computer code of claim 1, further comprising code for generating a photo or video icon on a display screen of the communication device, the photo or video icon enabling the contribution of a photo or video to the conversation respectively.

30. The non-transitory computer readable medium including the computer code of claim 1, wherein the communication device configured to execute the code comprises one of the following:

(i) a land-line phone;

(ii) a wireless phone;

(iii) a cellular phone;

(iv) a mobile phone;

(v) a satellite phone;

(vi) a computer;

(vii) a radio;

(viii) a tactical radio;

or

(ix) a satellite radio.