Communication application for conducting conversations including multiple media types in either a real-time mode or a time-shifted mode

• US 9,054,912 B2
• Filed: 07/12/2013
• Issued: 06/09/2015
• Est. Priority Date: 02/08/2008
• Status: Active Grant

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Lai, Andrew
• Assistant Examiner(s): LEE, ANDREW CHUNG CHEUNG
• Application Number:
  US13/941,422
• Publication Number:
  US 20130301482A1
• Time in Patent Office: 697 Days
• Field of Search: 370/276, 370/468, 370/470, 709/234, 709/235
• US Class Current: 1/1
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

Computer code is configured to support a conversation among participants over a communication network. The computer code is configured to (i) progressively store the incoming and outgoing messages of a conversation on a communication device, (ii) display the message history of the conversation on the communication device, (iii) provide rendering options on the communication device, (iv) selectively transition participation in the conversation between a real-time mode and a time-shifted mode and (v) designate an interrupt mode for the conversation.

Claims

1. A non-transitory computer readable medium including computer code embedded therein, the computer code configured to run on a communication device connected to a network and to cause the communication device to:

enable a conversation conducted over the network among participants, the conversation including a bi-directional exchange between the participants of incoming and outgoing messages that include voice media, the conversation enabled by;

(i) progressively storing the incoming and outgoing messages of the conversation on the communication device;

(a) as the voice media of the outgoing messages is created on the communication device; and

(b) as the voice media of the incoming messages is received over the network from a remote participant of the conversation;

(ii) displaying on the communication device a message history of the conversation, the message history including visual representations corresponding to the incoming and outgoing messages respectively;

(iii) providing rendering options on the communication device to selectively render the incoming messages of the conversation in a near real-time mode as the voice media of the incoming messages is progressively received over the network and out of storage in a time-shifted mode;

(iv) selectively enabling participation in the conversation between the near real-time mode when progressively rendering the voice media of the incoming messages as the voice media is progressively received over the network and in the time-shifted messaging mode when rendering the voice media of the incoming messages out of storage;

(v) providing a select-to-talk function for generating the outgoing messages of the conversation on the communication device, the select-to-talk function, when implemented, configured to;

(c) generate one of the outgoing messages pertaining to the conversation; and

(d) progressively transmit the voice media of the one outgoing message to the remote participant of the conversation as the voice media is created and progressively stored on the communication device; and

(vi) designating an interrupt mode for the conversation, the interrupt mode causing the automatic rendering of a received message of the conversation.

2. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein:

the computer code is in an application; and

the interrupt mode causes the automatic rendering of the received message when the message is received while the application is closed.

3. The non-transitory computer readable medium embedded with the computer code of claim 2, wherein the application is a Push To Talk application and the incoming and the outgoing messages are PTT messages.

4. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the interrupt mode causes the automatic rendering of the received message when the received message pertains to a conversation not selected for participation.

5. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the interrupt mode causes the automatic rendering of the received message when the interrupt mode has been designated for a sender of the received message.

6. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises progressively rendering media associated with the received message as the media is progressively received over the network.

7. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises:

receiving media associated with the received message at the communication device;

storing the media associated with the received message on the communication device; and

automatically rendering the received message as the media associated with the message is received and stored on the communication device.

8. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises rendering voice media contained in the received message.

9. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises rendering text media contained in the received message.

10. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises

performing a text-to-voice translation for text media contained in the received message;

and

rendering the translated voice media.

11. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises

performing a voice-to-text translation for voice media contained in the received message;

and

rendering the translated text media.

12. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises rendering an image or photo contained in the received message.

13. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein automatically rendering the received message in the interrupt mode further comprises rendering video media contained in the received message.

14. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to queue a plurality of received messages for rendering in the interrupt mode.

15. The non-transitory computer readable medium embedded with the computer code of claim 14, further configured to render the plurality of messages in the queue using one of the following protocols:

(i) first-in, first out;

(ii) by conversation priority;

or

(iii) by sender priority.

16. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the computer code is further configured to transmit a reply message created by a user of the communication device in response to the automatic rendering of the received message in the interrupt mode.

17. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the received message is a voice message that blares out of a headset speaker coupled to the communication device when automatically rendered in the interrupt mode.

18. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the computer code is further configured to forward the received message to a second rendering device for rendering on a second communication device.

19. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the computer code is further configured to activate the interrupt mode for a plurality of conversations.

20. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to:

receive a plurality of voice messages for rendering in the interrupt mode;

queue the plurality of voice messages for rendering in the interrupt mode; and

automatically render the voice messages in the queue in the interrupt mode.

21. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to:

enable a user of the communication device to selectively participate in a selected conversation;

activate the interrupt mode for the selected conversation;

store a received voice message pertaining to the selected conversation on the communication device; and

automatically render the received voice message in the interrupt mode when the selected conversation is not selected for participation.

22. The non-transitory computer readable medium embedded with the computer code of claim 21, further configured to generate a notification for the received voice message, but not automatically render the received voice message, when the interrupt mode is not activated for the selected conversation.

23. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the computer code is an application intended for execution on the computing device, the application when executed further configured to:

enable a user of the communication device to selectively open or close the application;

enable the user to selectively participate in the conversation when the application is open;

activate an interrupt mode for the conversation; and

automatically render a received voice message pertaining to the conversation in the interrupt mode when (i) the interrupt mode is activated for the conversation and (ii) the application is closed.

24. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the computer code is an application intended for execution on the computing device, the application when executed further configured to:

automatically render a received voice message in the interrupt mode when;

(i) the application is closed when the voice message is received; and

(ii) the interrupt mode has been designated for a sender of the voice message.

25. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is further configured to transmit the voice media of the one outgoing message at a rate commensurate with the bandwidth capacity on the network when the voice media is created.

26. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is further configured to transmit the voice media of the one outgoing message from storage on the communication device if:

(e) the voice media of the one outgoing message is created when the communication device was disconnected from the network; and

(f) after the communication device reconnects to the network.

27. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is further configured to transmit the voice media of the one outgoing message from storage on the communication device, at a rate as fast as conditions on the network permit, when conditions on the network do not permit the transmission of the voice media as it is created.

28. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is further configured to use a transmission protocol capable of:

(i) supporting near real-time communication so that the remote participant of the conversation may selectively review the voice media of the one outgoing message in near real-time; and

(ii) guaranteeing the delivery of the voice media of the one outgoing message to the remote participant of the conversation.

29. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is further configured to use a transmission protocol that guarantees delivery of a complete copy of the voice media of the one outgoing message to the remote participant of the conversation.

30. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is further configured to address the one outgoing message to the remote participant of the conversation by using an identifier embedded in the message and associated with the remote participant.

31. The non-transitory computer readable medium embedded with the computer code of claim 30, wherein the identifier is a human-readable identifier.

32. The non-transitory computer readable medium embedded with the computer code of claim 31, wherein the identifier is a non-IP address identifier that is resolved into an IP-address that corresponds to a remote communication device associated with the remote participant of the conversation.

33. The non-transitory computer readable medium embedded with the computer code of claim 32, wherein the IP-address is resolved into a physical address for delivery of the one outgoing message over the network to the remote communication device.

34. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the select-to-talk function is implemented by selecting a push-to-talk feature on the communication device.

35. The non-transitory computer readable medium embedded with the computer code of claim 34, wherein the push-to-talk feature is implemented by selecting a push-to-talk icon on a display screen on the communication device.

36. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the incoming and outgoing messages of the conversation are associated by an attribute, the attribute comprising one of the following:

(i) a name of a participant of the conversation;

(ii) a topic of the conversation;

(iii) a subject defining the conversation;

or

(iv) a group identifier identifying the participants of the conversation.

37. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the code is further configured to display a list of active conversations on the communication device.

38. The non-transitory computer readable medium embedded with the computer code of claim 37, wherein the code is further configured to enable a user of the communication device to select any conversation among the list of active conversations for participation.

39. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the visual representations of the incoming and outgoing messages in the conversation history are displayed in the time order in which the incoming and outgoing messages were created and added to the conversation respectively.

40. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the visual representations each include an indicator indicative of the name of the participant of the conversation that created the the incoming and outgoing messages respectively.

41. The non-transitory computer readable medium embedded with the computer code of claim 1, wherein the incoming and the outgoing messages of the conversation are further configured to include video media.

42. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to display in the message history text messages that are exchanged during the conversation.

43. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to display in the message history photos that are exchanged during the conversation.

44. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to include in the message history video exchanged during the conversation.

45. The non-transitory computer readable medium embedded with the computer code of claim 1, further configured to operate in a full-duplex mode when transmitting an outgoing message and receiving an incoming message at the same time.

46. The non-transitory computer readable medium embedded with computer code of claim 1, wherein the communication device configured to execute the code comprises one of the following:

(i) a land-line phone;

(ii) a wireless phone;

(iii) a cellular phone;

(iv) a mobile phone;

(v) a satellite phone;

(vi) a computer;

(vii) a radio;

(viii) a tactical radio;

or

(ix) a satellite radio.