Telecommunication and multimedia management method and apparatus

• US 8,130,921 B2
• Filed: 04/25/2008
• Issued: 03/06/2012
• Est. Priority Date: 06/28/2007
• Status: Active Grant

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US12/110,221
• Publication Number:
  US 20090003557A1
• Time in Patent Office: 1,411 Days
• Field of Search: 379/93.01, 379/90.01, 379/67.1, 379/69, 379/85, 379/88.04, 379/88.07, 379/88.08, 379/88.11, 379/88.12, 379/88.13, 379/88.17, 709204-206, 715/758
• US Class Current: 379/93.01
• CPC Class Codes: E04H 3/126 Foldable, retractable or tiltable tribunes E04H3/123 takes precedence
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/226 Delivery according to priorities
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 61/2503 Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/54 Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
• CPC Class Codes: H04M 1/64 Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations centralised dictation systems H04M11/10
• CPC Class Codes: H04M 11/00 Telephonic communication systems specially adapted for combination with other electrical systems
• CPC Class Codes: H04M 3/53 Centralised arrangements for recording incoming messages , i.e. mailbox systems
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements

Abstract

A communication device capable of participating in a conversation over a network. The communication device includes an encoder to receive and encode media locally created using the communication device and associated with the conversation and a transmitter to transmit over the network the locally created media to one or more participants of the conversation. The communication device also includes a receiver to receive media from the one or more participants of the conversation over the network and a time-shifting buffer to store in a time-based format both the media received over the communication network and the locally created media. The time-shifting buffer enables the communication device to either (i) render the media received over the network in a near real-time mode or (ii) render both the media received over the network and the locally created media in a time-shifted mode by retrieving the stored media from the time-shifting buffer. A conversation management system enables the communication device to transition rendering of the media of the conversation between the time-shifted mode and the near real-time mode without interrupting the ongoing storage of the media of the conversation received at the communication device over the network into the time-shifting buffer. By associating the locally created media and the media received over the network, the conversation is constituted.

Claims

1. A computer readable application embedded in a non-transitory computer readable medium and intended to run on a first communication device, the application comprising:

a messaging module configured to progressively generate an outgoing message intended for a recipient as media associated with the outgoing message is created using the first communication device;

a transmission module configured to progressively transmit the outgoing message to the recipient as the media of the outgoing message is created over a network without first establishing a connection over the network with a second communication device associated with the recipient; and

a storage module configured to progressively store the media of the outgoing message in storage on the first communication device as the media is created and progressively transmitted to the second communication device associated with the recipient.

2. The application of claim 1, wherein the transmission module is further configured so that:

(a) the recipient may selectively render the media of the outgoing message in near real-time on the second communication device; and

(b) a complete copy of the media of the outgoing message is delivered to the second communication device of the recipient.

3. The application of claim 2, wherein the transmission module is further configured to use a transmission protocol capable of supporting near real-time communication, while guaranteeing delivery of the complete copy of the media of the outgoing message to the recipient.

4. The application of claim 1, wherein the transmission module is further configured to:

(i) segment the media of the outgoing message into message units as the media of the outgoing message is created;

(ii) insert the message units into transports packets supported by the network; and

(iii) transmit the transport packets over the network to the second communication device associated with the recipient.

5. The application of claim 1, wherein the transmission module is further configured to progressively transmit the media associated with the outgoing message at or below the available bit rate on a connection between the first communication device and the network as the media associated with the outgoing message is created.

6. The application of claim 1, wherein the transmission module is further configured to:

(i) ascertain if the first communication device is disconnected from the network as the media associated with the outgoing message is created; and

(ii) transmit the media associated with the outgoing message from storage when the first communication device re-connects to the network.

7. The application of claim 1, wherein the transmission module is further configured to transmit the media associated with the outgoing message from storage if the available bit rate on a connection between the first communication device and the network is insufficient to progressively transmit the media associated with the outgoing message as the media is created.

8. The application of claim 1, further comprising a receive module configured to progressively receive over the network media associated with a received message from the second communication device associated with the recipient.

9. The application of claim 8, wherein the transmission module and the receive module are further configured to transmit and receive the outgoing and received messages over different paths across the network between the first communication device and the second communication device associated with the recipient.

10. The application of claim 8, further comprising a render module configured to selectively render the media associated with the received message both:

(i) progressively as the media of the message is progressively received at the first communication device; and

(ii) progressively by retrieving from storage and progressively rendering the retrieved media associated with the received message sometime after the media was received and stored.

11. The application of claim 10, wherein the render module is further configured to selectively transition the rendering of the media associated with the received message from (i) to (ii) or from (ii) to (i).

12. The application of claim 10, wherein the render module may selectively render the media associated with the outgoing message and the received message from storage, regardless if the first communication device is connected to the network or not.

13. The application of claim 8, wherein the application is further configured to enable the first communication device to engage in both synchronous and asynchronous communication with the second communication device.

14. The application of claim 1, wherein the storage module is further configured to progressively store the media of a received message in storage on the first communication device as the media is progressively received at the first communication device.

15. The application of claim 14, wherein the storage module is further configured to progressively store the media associated with the outgoing and received messages in a format where the media may be retrieved in the time-order in which the media was created.

16. The application of claim 1, further comprising a conversation module configured to associate one or more outgoing messages and one or more received messages sharing a common attribute into a conversation.

17. The application of claim 16, wherein the common attribute comprises one or more of the following:

a conversation topic, a conversation name, a name of one or more of the participants in the conversation, or a designated time.

18. The application of claim 16, wherein the conversation module is further configured to string together the one or more outgoing and the one or more received messages of the conversation in the time-order in which the messages were created.

19. The application of claim 1, wherein the media of the outgoing message comprises one or more of the following types of streaming media:

voice, video, sensor data, radio signals, position or GPS information, or a combination thereof.

20. The application of claim 1, wherein the first communication device configured to run the application comprises one of the following:

a land-line phone, a wireless phone, cellular phone, a mobile phone, a computer, a radio, a satellite phone, a satellite radio, a tactical radio, or a tactical phone.

21. A first communication device, comprising:

a messaging element configured to progressively generate an outgoing message intended for a recipient as media associated with the outgoing message is created using the first communication device;

a transmission element configured to progressively transmit the outgoing message to the recipient as the media of the outgoing message is created over a network without first establishing a connection over the network with a second communication device associated with the recipient; and

a storage element configured to progressively store the media of the outgoing message in storage on the first communication device as the media is created and progressively transmitted to the second communication device associated with the recipient.

22. The first communication device of claim 21, wherein the transmission element is further configured so that:

(a) the recipient may selectively render the media of the outgoing message in near real-time on the second communication device associated with the recipient; and

(b) a complete copy of the media of the outgoing message is delivered to the second communication device associated with the recipient.

23. The first communication device of claim 22, wherein the storage element is further configured to progressively store the media of a received message in the storage element on the first communication device as the media is progressively received at the first communication device.

24. The first communication device of claim 23, wherein the storage element is further configured to progressively store the media associated with the outgoing and received messages in a format where the media may be retrieved in the time-order in which the media was created.

25. The first communication device of claim 21, wherein the transmission element is further configured to:

(i) segment the media of the outgoing message into message units as the media of the outgoing message is created;

(ii) insert the message units into transports packets supported by the network; and

(iii) transmit the transport packets over the network to the second communication device associated with the recipient.

26. The first communication device of claim 21, wherein the transmission element is further configured to progressively transmit the media associated with the outgoing message at or below the available bit rate on a connection between the first communication device and the network as the media associated with the outgoing message is created.

27. The first communication device of claim 21, wherein the transmission element is further configured to:

(i) ascertain if the first communication device is disconnected from the network as the media associated with the outgoing message is created; and

(ii) transmit the media associated with the outgoing message from storage when the first communication device re-connects to the network.

28. The first communication device of claim 21, wherein the transmission element is further configured to transmit the media associated with the outgoing message from storage if the available bit rate on a connection between the first communication device and the network is insufficient to progressively transmit the media associated with the outgoing message as the media is created.

29. The first communication device of claim 21, further comprising a receive element configured to progressively receive over the network media associated with a received message from the second communication device associated with the recipient.

30. The first communication device of claim 29, wherein the transmission element and the receive element are further configured to transmit and receive the outgoing and received messages over different paths across the network between the first communication and the second communication device associated with the recipient.

31. The first communication device of claim 29, further comprising a render element configured to selectively render the media associated with the received message both:

(i) progressively as the media of the message is progressively received at the first communication device; and

(ii) progressively by retrieving from storage and progressively rendering the retrieved media associated with the received message sometime after the media was received and stored.

32. The first communication device of claim 31, wherein the render element is further configured to selectively transition the rendering of the media associated with the received message from (i) to (ii) or from (ii) to (i).

33. The first communication device of claim 31, wherein the render element may selectively render the media associated with the outgoing message and the received message from storage, regardless if the first communication device is connected to the network or not.

34. The first communication device of claim 31, wherein the first communication device is further configured to selectively engage in both synchronous and asynchronous communication with the second communication device.

35. The first communication device of claim 21, further comprising a conversation element configured to associate one or more outgoing messages and one or more received messages sharing a common attribute into a conversation.

36. The first communication device of claim 35, wherein the common attribute comprises one or more of the following:

a conversation topic, a conversation name, a name of one or more of the participants in the conversation, or a designated time.

37. The first communication device of claim 35, wherein the conversation element is further configured to string together the one or more outgoing and the one or more received messages of the conversation in the time-order in which the messages were created.

38. The first communication device of claim 21, wherein the media of the outgoing message comprises one or more of the following types of streaming media:

voice, video, sensor data, radio signals, position or GPS information, or a combination thereof.

39. The first communication device of claim 21, wherein the first communication device comprises one of the following:

a land-line phone, a wireless phone, cellular phone, a mobile phone, a computer, a radio, a satellite phone, a satellite radio, a tactical radio, or a tactical phone.

40. The first communication device of claim 21, wherein the transmission element is further configured to use a transmission protocol capable of supporting near real-time communication, while guaranteeing delivery of the complete copy of the media of the outgoing message to the recipient.

41. A method performed on a first communication device, comprising:

progressively generating an outgoing message intended for a recipient as media associated with the outgoing message is created using the first communication device;

progressively transmitting the outgoing message to the recipient as the media of the outgoing message is created over an network without first establishing a connection over the network with a second communication device associated with the recipient; and

progressively storing the media of the outgoing message in storage on the first communication device as the media is created and progressively transmitted to the second communication device associated with the recipient.

42. The method of claim 41, wherein progressively transmitting further comprises progressively transmitting so that:

(a) the recipient may selectively render the media of the outgoing message in near real-time on the second communication device associated with the recipient; and

(b) a complete copy of the media of the outgoing message is delivered to the second communication device associated with the recipient.

43. The method of claim 41, wherein progressively transmitting further comprises:

(i) segmenting the media of the outgoing message into message units as the media of the outgoing message is created;

(ii) inserting the message units into transports packets supported by the network; and

(iii) transmitting the transport packets over the network to the second communication device associated with the recipient.

44. The method of claim 41, wherein progressively transmitting further comprises:

progressively transmitting the media associated with the outgoing message at or below the available bit rate on a connection between the first communication device and the network as the media associated with the outgoing message is created.

45. The method of claim 41, wherein progressively transmitting further comprises:

(i) ascertaining if the first communication device is disconnected from the network as the media associated with the outgoing message is created; and

(ii) transmitting the media associated with the outgoing message from storage when the first communication device re-connects to the network.

46. The method of claim 41, wherein progressively transmitting further comprises transmitting the media associated with the outgoing message from storage if the available bit rate on a connection between the first communication device and the network is insufficient to progressively transmit the media associated with the outgoing message as the media is created.

47. The method of claim 41, further comprising progressively receiving over the network media associated with a received message from the second communication device associated with the recipient.

48. The method of claim 47, wherein transmitting and receiving further comprise transmitting and receiving the outgoing and received messages over different paths across the network between the first communication device and the second communication device associated with the recipient.

49. The method of claim 47, further comprising selectively rendering the media associated with the received message both:

(i) progressively as the media of the message is progressively received at the first communication device; and

(ii) progressively by retrieving from storage and progressively rendering the retrieved media associated with the received message sometime after the media was received and stored.

50. The method of claim 49, wherein rendering further comprises selectively transitioning the rendering of the media associated with the received message from (i) to (ii) or from (ii) to (i).

51. The method of claim 49, wherein rendering further comprises selectively rendering the media associated with the outgoing message and the received message from storage regardless if the first communication device is connected to the network or not.

53. The method of claim 41, further comprising progressively storing the media of a received message in storage on the first communication device as the media is progressively received at the first communication device.

54. The method of claim 53, wherein storing further comprises progressively storing the media associated with the outgoing and received messages in a format where the media may be retrieved in the time-order in which the media was created.

55. The method of claim 41, further comprising associating one or more outgoing messages and one or more received messages sharing a common attribute into a conversation.

56. The method of claim 55, wherein the common attribute comprises one or more of the following:

a conversation topic, a conversation name, a name of one or more of the participants in the conversation, or a designated time.

57. The method of claim 55, further comprising stringing together the one or more outgoing and the one or more received messages of the conversation in the time-order in which the messages were created.

58. The method of claim 41, wherein the media of the outgoing message comprises one or more of the following types of streaming media:

voice, video, sensor data, radio signals, position or GPS information, or a combination thereof.

59. The method of claim 41, wherein the method is performed on one of the following types of first communication devices:

a land-line phone, a wireless phone, cellular phone, a mobile phone, a computer, a radio, a satellite phone, a satellite radio, a tactical radio, or a tactical phone.

60. The method of claim 41, wherein progressively transmitting further comprises progressively transmitting so that the media of the outgoing message is transmitted using a transmission protocol capable of supporting near real-time communication, while guaranteeing delivery of the complete copy of the media of the outgoing message to the recipient.

52. The method of 47, further comprising selectively engaging on the first communication device in both synchronous and asynchronous communication with the second communication device.