Communication application for conducting conversations including multiple media types in either a real-time mode or a time-shifted mode

• US 8,321,582 B2
• Filed: 09/02/2009
• Issued: 11/27/2012
• Est. Priority Date: 02/08/2008
• Status: Active Grant

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Gauthier, Gerald
• Assistant Examiner(s): King, Simon
• Application Number:
  US12/552,985
• Publication Number:
  US 20090327422A1
• Time in Patent Office: 1,182 Days
• Field of Search: 379/260, 379/93.01, 379/90.12, 379/88.17, 370/468, 370/470, 709/231, 709/234, 709/235
• US Class Current: 709/234
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

A communication application configured to support a conversation among participants over a communication network. The communication application is configured to (i) support one or more media types within the context of the conversation, (ii) interleave the one or more media types in a time-indexed order within the context of the conversation, (iii) enable the participants to render the conversation including the interleaved one or more media types in either a real-time rendering mode or time-shifted rendering mode, and (iv) seamlessly transition the conversation between the two modes so that the conversation may take place substantially live when in the real-time rendering mode or asynchronously when in the time-shifted rendering mode.

Claims

1. Computer code embedded in a non-transitory computer readable medium and intended to run on a communication device connected to a network, comprising:

code configured to support a conversation conducted over the network among participants, the conversation including a bi-directional exchange between the participants of incoming and outgoing messages that include media that changes with respect to time, the code further configured to;

(i) progressively store the incoming and outgoing messages of the conversation on the communication device;

(a) as the media of the outgoing messages is created on the communication device; and

(b) as the media of the incoming messages is received over the network from the other participants;

(ii) display on the communication device the message history of the conversation including message bubbles each representative of the incoming and outgoing messages respectively;

(iii) provide rendering options on the communication device to progressively render the messages of the conversation in real-time as the media of the incoming messages is received over the network and out of storage; and

(iv) selectively transition participation in the conversation between a real-time mode when rendering the media of the incoming messages in real-time as the media is received over the network and in a time-shifted messaging mode when rendering the media of the incoming messages out of storage.

2. The code of claim 1, wherein the code uses media packets to transport the media of the messages exchanged between the participants of the conversation, the media packets capable of transporting different types of the media.

3. The code of claim 2, wherein the media packets include the following fields:

(i) a payload field for carrying the different types of the media;

(ii) a time stamp field for including the time when the media carried in the media payload field is created;

(iii) a length field for storing information indicative of the length of the media packet;

(iv) a message ID field for storing a message identifier for associating the media of the payload with a specific message; and

(v) a media type field containing information pertaining to the type of media contained in the payload field.

4. The code of claim 1, wherein the code is configured to define packets that transport the media of the messages of the conversation, the packets configured to be embedded into transport packets used on the network.

5. The code of claim 4, wherein the transport packets comprise one or more of the following types of transport packets:

Ethernet packets, UDP packets, or the Internet protocol (IP) packets.

6. The code of claim 1, wherein the messages of the conversation are associated by an attribute, the attribute selected from one of the following:

(i) a name of a participant of the conversation;

(ii) a topic of the conversation;

(iii) a subject defining the conversation;

or

(iv) a group identifier identifying group of participants in the conversation.

7. The code of claim 1, wherein the code is further configured to display a list of active conversations on the communication device.

8. The code of claim 7, wherein the code is further configured to enable a user of the communication device to select the conversation among the list of active conversations for participation.

9. The code of claim 1, wherein each of the one or more media bubbles of the conversation is displayed in the time order in which the one or more messages represented by the one or more media bubbles were created and added to the conversation respectively.

10. The code of claim 9, wherein each of the one or more media bubbles includes one or more of the following:

(i) a media type indicator;

(ii) a date and time indicator indicative of when the media represented by the media bubble was created; and

(iii) a name indicator indicative of the name of the participant of the conversation that created the media represented by the bubble.

11. The code of claim 1, wherein the code is further configured to support synchronous communication among the participants of conversation.

12. The code of claim 1, wherein the code is further configured to support asynchronous communication among the participants of the conversation.

13. The code of claim 1, wherein the media that changes with respect to time comprises one or more of the following:

(i) voice;

(ii) video;

(iii) GPS data; and

(iv) sensor data.

14. The code of claim 1, wherein the message history of the conversation displayed on the communication device further comprises:

(i) text message bubbles; and

(ii) bubbles containing photos.

15. The code of claim 1, wherein the communication device configured to run the code comprises one of the following:

(i) a land-line phone;

(ii) a wireless phone;

(iii) a cellular phone;

(iv) a mobile phone;

(v) a satellite phone;

(vi) a computer;

(vii) a radio;

(viii) a server;

(ix) a tactical radio;

(x) a satellite radio;

or

(xi) a tactical radio.

16. The code of claim 1, wherein the network used for conducting the conversation between the participants comprises one of the following:

(i) the Internet;

(ii) the PSTN;

(iii) a circuit-based network;

(iv) a mobile communication network;

(v) a cellular network;

(vi) a wired network;

(vii) a wireless network;

(viii) a satellite network;

or

(ix) any combination of (i) through (viii).

17. A communication device connected to a network, the communication device comprising:

a conversation element configured to support a conversation conducted over the network among participants, the conversation including a bi-directional exchange between the participants of incoming and outgoing messages that include media that changes with respect to time, the conversation element further configured to;

(i) progressively store the incoming and outgoing messages of the conversation on the communication device;

(a) as the media of the outgoing messages is created on the communication device; and

(b) as the media of the incoming messages is received over the network from the other participants;

(ii) display on the communication device the message history of the conversation including message bubbles each representative of the incoming and outgoing messages respectively;

(iii) provide rendering options on the communication device to progressively render the messages of the conversation in real-time as the media of the incoming messages is received over the network and out of storage; and

(iv) selectively transition participation in the conversation between a real-time mode when rendering the media of the incoming messages in real-time as the media is received over the network and in a time-shifted messaging mode when rendering the media of the incoming messages out of storage.

18. The communication device of claim 17, wherein the communication device uses media packets to transport the media of the messages exchanged between the participants of the conversation, the media packets capable of transporting different types of the media.

19. The communication device of claim 18, wherein the media packets include the following fields:

(i) a payload field for carrying the different types of the media;

(ii) a time stamp field for including the time when the media carried in the media payload field is created;

(iii) a length field for storing information indicative of the length of the media packet;

(iv) a message ID field for storing a message identifier for associating the media of the payload with a specific message; and

(v) a media type field containing information pertaining to the type of media contained in the payload field.

20. The communication device of claim 17, wherein the communication device is configured to define packets that transport the media of the messages of the conversation, the packets configured to be embedded into transport packets used on the network.

21. The communication device of claim 20, wherein the transport packets comprise one or more of the following types of transport packets:

Ethernet packets, UDP packets, or the Internet protocol (IP) packets.

22. The communication device of claim 17, wherein the messages of the conversation are associated by an attribute, the attribute selected from one of the following:

(i) a name of a participant of the conversation;

(ii) a topic of the conversation;

(iii) a subject defining the conversation;

or

(iv) a group identifier identifying group of participants in the conversation.

23. The communication device of claim 17, wherein the communication device is further configured to display a list of active conversations on the communication device.

24. The communication device of claim 23, wherein the communication device is further configured to enable a user of the communication device to select the conversation among the list of active conversations for participation.

25. The communication device of claim 17, wherein each of the one or more media bubbles of the conversation is displayed in the time order in which the one or more messages represented by the one or more media bubbles were created and added to the conversation respectively.

26. The communication device of claim 25, wherein each of the one or more media bubbles includes one or more of the following:

(i) a media type indicator;

(ii) a date and time indicator indicative of when the media represented by the media bubble was created; and

(iii) a name indicator indicative of the name of the participant of the conversation that created the media represented by the bubble.

27. The communication device of claim 17, wherein the communication device is further configured to support synchronous communication among the participants of conversation.

28. The communication device of claim 17, wherein the communication device is further configured to support asynchronous communication among the participants of the conversation.

29. The communication device of claim 17, wherein the media that changes with respect to time comprises one or more of the following:

(i) voice;

(ii) video;

(iii) GPS data; and

(iv) sensor data.

30. The communication device of claim 17, wherein the message history of the conversation displayed on the communication device further comprises:

(i) text message bubbles; and

(ii) bubbles containing photos.

31. The communication device of claim 17, wherein the communication device comprises one of the following:

(i) a land-line phone;

(ii) a wireless phone;

(iii) a cellular phone;

(iv) a mobile phone;

(v) a satellite phone;

(vi) a computer;

(vii) a radio;

(viii) a server;

(ix) a tactical radio;

(x) a satellite radio;

or

(xi) a tactical radio.

32. The communication device of claim 17, wherein the network used for conducting the conversation between the participants comprises one of the following:

(i) the Internet;

(ii) the PSTN;

(iii) a circuit-based network;

(iv) a mobile communication network

(v) a cellular network;

(vi) a wired network;

(vii) a wireless network;

(viii) a satellite network;

or

(ix) any combination of (i) through (viii).

33. A method performed on a communication device, the method comprising:

establishing a conversation conducted over a network using the communication device, the conversation including incoming and outgoing messages that include media that changes with respect to time and that are exchanged between the participants over the network,

participating in the conversation on the communication device by;

(i) progressively storing the incoming and outgoing messages of the conversation on the communication device;

(a) as the media of the outgoing messages is created on the communication device; and

(b) as the media of the incoming messages is received over the network from the other participants;

(ii) displaying on the communication device the message history of the conversation including message bubbles each representative of the incoming and outgoing messages respectively; and

(iii) selectively transitioning participation in the conversation between a real-time mode when rendering the media of the incoming messages in real-time as the media is received over the network and in a time-shifted messaging mode when rendering the media of the incoming messages out of storage.

34. The method of claim 33, further comprising transporting the media of the messages exchanged between the participants of the conversation using media packets capable of transporting different types of the media.

35. The method of claim 34, wherein the media packets include the following fields:

(i) a payload field for carrying the different types of the media;

(ii) a time stamp field for including the time when the media carried in the media payload field is created;

(iii) a length field for storing information indicative of the length of the media packet;

(iv) a message ID field for storing a message identifier for associating the media of the payload with a specific message; and

(v) a media type field containing information pertaining to the type of media contained in the payload field.

36. The method of claim 33, further comprising using packets that transport the media of the messages of the conversation by embedding the packets into transport packets used on the network.

37. The method of claim 36, wherein the transport packets comprise one or more of the following types of transport packets:

Ethernet packets, UDP packets, or the Internet protocol (IP) packets.

38. The method of claim 33, further comprising associating the messages of the conversation by an attribute, the attribute selected from one of the following:

(i) a name of a participant of the conversation;

(ii) a topic of the conversation;

(iii) a subject defining the conversation;

or

(iv) a group identifier identifying group of participants in the conversation.

39. The method of claim 33, further comprising displaying a list of active conversations on the communication device.

40. The method of claim 39, further comprising selecting the conversation among the list of active conversations for participation.

41. The method of claim 33, further comprising displaying the one or more media bubbles of the conversation in the time order in which the one or more messages represented by the one or more media bubbles were created and added to the conversation respectively.

42. The method of claim 41, wherein each of the one or more media bubbles includes one or more of the following:

(i) a media type indicator;

(ii) a date and time indicator indicative of when the media represented by the media bubble was created; and

(iii) a name indicator indicative of the name of the participant of the conversation that created the media represented by the bubble.

43. The method of claim 33, further comprising engaging in synchronous communication with the participants of conversation.

44. The method of claim 33, further comprising engaging in asynchronous communication with the participants of the conversation.

45. The method of claim 33, wherein the media that changes with respect to time comprises one or more of the following:

(i) voice;

(ii) video;

(iii) GPS data; and

(iv) sensor data.

46. The method of claim 33, wherein displaying the message history of the conversation on the communication device further comprises displaying:

(i) text message bubbles; and

(ii) bubbles containing photos.

47. The method of claim 33, wherein the communication device for performing the method comprises one of the following:

(i) a land-line phone;

(ii) a wireless phone;

(iii) a cellular phone;

(iv) a mobile phone;

(v) a satellite phone;

(vi) a computer;

(vii) a radio;

(viii) a server;

(ix) a tactical radio;

(x) a satellite radio;

or

(xi) a tactical radio.

48. The method of claim 33, wherein the network used for conducting the conversation between the participants comprises one of the following:

(i) the Internet;

(ii) the PSTN;

(iii) a circuit-based network;

(iv) a mobile communication network;

(v) a cellular network;

(vi) a wired network;

(vii) a wireless network;

(viii) a satellite network;

or

(ix) any combination of (i) through (viii).