Telecommunication and multimedia management method and apparatus

• US 8,180,030 B2
• Filed: 02/15/2008
• Issued: 05/15/2012
• Est. Priority Date: 06/28/2007
• Status: Active Grant

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US12/032,426
• Publication Number:
  US 20090003339A1
• Time in Patent Office: 1,551 Days
• Field of Search: 379/93.01, 379/90.01, 379/88.04, 379/88.06, 379/88.07, 379/88.08, 379 8822- 8828, 379/93.24, 709204-206
• US Class Current: 379/93.01
• CPC Class Codes: E04H 3/126 Foldable, retractable or tiltable tribunes E04H3/123 takes precedence
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/226 Delivery according to priorities
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 61/2503 Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/54 Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
• CPC Class Codes: H04M 1/64 Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations centralised dictation systems H04M11/10
• CPC Class Codes: H04M 11/00 Telephonic communication systems specially adapted for combination with other electrical systems
• CPC Class Codes: H04M 3/53 Centralised arrangements for recording incoming messages , i.e. mailbox systems
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements

Abstract

A telecommunication and multimedia management apparatus and method that supports voice and other media communications and that enables users to: (i) participate in multiple conversation modes, including live phone calls, conference calls, instant voice messaging or tactical communications; (ii) review the messages of conversations in either a live mode or a time-shifted mode and to seamlessly transition back and forth between the two modes; (iii) participate in multiple conversations either concurrently or simultaneously; (iv) archive the messages of conversations for later review or processing; and (v) persistently store media either created or received on the communication devices of users. The latter feature enables users to generate or review media when either disconnected from the network or network conditions are poor and to optimize the delivery of media over the network based on network conditions and the intention of the users participating in conversations.

Claims

1. A computer readable application embedded in a non-transitory computer readable medium and intended to run on a communication device, the application comprising:

a storage module configured to progressively and persistently store streaming media created using the communication device as the streaming media is created;

a transmission module configured to progressively transmit the streaming media over a network as the streaming media is created and persistently stored;

a network receive module cooperating with the storage module to progressively and persistently store streaming media received over the network from a remote communication device as the streaming media is received; and

a rendering module configured to provide rendering options to selectively render the received streaming media, for the first time, in both a real-time mode as the streaming media is received over the network and in a time-shifted mode by retrieving and rendering the retrieved streaming media from persistent storage.

2. The application of claim 1, wherein the transmission module and the rendering module further cooperate to transmit the created media streams and render the received media streams synchronously with respect to one another.

3. The application of claim 1, wherein the transmission module and the rendering module further cooperate to transmit the created media streams and render the received media streams asynchronously with respect to one another.

4. The application of claim 1, wherein the transmission module, the network receive module, and the rendering module further cooperate to enable the communication device to participate in both synchronous and asynchronous communication with the remote communication device.

5. The application of claim 1, further comprising an encoder module configured to progressively encode the streaming media into indexed media payloads as the streaming media is created.

6. The application of claim 1, wherein the storage module is further configured to persistently store the streaming media in the form of indexed media payloads as the streaming media is created.

7. The application of claim 1, wherein the transmission module is further configured to progressively transmit the streaming media in the form of indexed media payloads as the streaming media is created.

8. The application of claim 1, wherein the storage module is further configured to persistently store both the transmitted and received streaming media in the form of indexed media payloads.

9. The application of claim 1, further comprising a messaging module configured to (i) segment the transmitted streaming media into messages and (ii) receive the streaming media in the form of messages.

10. The application of claim 9, wherein the messaging module is further configured to thread together the transmitted and received messages sharing a common attribute.

11. The application of claim 9, wherein the messaging module threads together the messages sharing the common attribute in the time order in which the messages were created.

12. The application of claim 1, wherein the transmission module and the storage module further cooperate to transmit the created streaming media out of persistent storage in the event the streaming media is created when the communication device is disconnected from the network.

13. The application of claim 12, wherein the transmission module is further configured to:

(i) ascertain if the communication device is disconnected from the network when the streaming media is created, wherein disconnected from the network is defined as the inability to transmit the streaming media; and

(ii) transmit the streaming media out of persistent storage when the communication device re-connects to the network, wherein connected is defined as the ability to transmit the streaming media.

14. The application of claim 1, wherein the rendering module is further configured to selectively render the received streaming media, after the first time, one or more subsequent times out of persistent storage.

15. The application of claim 1, wherein the rendering module is further configured to selectively render the transmitted streaming media out of persistent storage.

16. The application of claim 1, wherein the rendering module is further configured to transition the rendering of the received media streams from (i) the real-time mode to the time-shifted mode and (ii) from the time-shifted mode to the real-time mode.

17. A communication device, comprising:

a storage element configured to progressively and persistently store streaming media created using the communication device as the streaming media is created;

a transmission element configured to progressively transmit the streaming media over a network as the streaming media is created and persistently stored;

a network receive element cooperating with the storage element to progressively and persistently store streaming media received over the network from a remote communication device as the streaming media is received; and

a rendering element configured to provide rendering options to selectively render the received streaming media, for the first time, in both a real-time mode as the streaming media is received over the network and in a time-shifted mode by retrieving and rendering the retrieved streaming media from persistent storage.

18. The device of claim 17, wherein the transmission element and the rendering element further cooperate to transmit the created media streams and render the received media streams synchronously with respect to one another.

19. The device of claim 17, wherein the transmission element and the rendering element further cooperate to transmit the created media streams and render the received media streams asynchronously with respect to one another.

20. The device of claim 17, wherein the transmission element, the network receive element, and the rendering element further cooperate to enable the communication device to participate in both synchronous and asynchronous communication with the remote communication device.

21. The device of claim 17, further comprising an encoder element configured to progressively encode the streaming media into indexed media payloads as the streaming media is created.

22. The device of claim 17, wherein the storage element is further configured to persistently store the streaming media in the form of indexed media payloads as the streaming media is created.

23. The device of claim 17, wherein the transmission element is further configured to progressively transmit the streaming media in the form of indexed media payloads as the streaming media is created.

24. The device of claim 17, wherein the storage element is further configured to persistently store both the transmitted and received streaming media in the form of indexed media payloads.

25. The device of claim 17, further comprising a messaging element configured to (i) segment the transmitted streaming media into messages and (ii) receive the streaming media in the form of messages.

26. The device of claim 25, wherein the messaging element is further configured to thread together transmitted and received messages sharing a common attribute.

27. The device of claim 25, wherein the messaging element threads together the messages sharing the common attribute in the time order in which the messages were created.

28. The device of claim 17, wherein the transmission element and the storage element further cooperate to transmit the created streaming media out of persistent storage in the event the streaming media is created when the communication device is disconnected from the network.

29. The device of claim 28, wherein the transmission element is further configured to:

(i) ascertain if the communication device is disconnected from the network when the streaming media is created, wherein disconnected from the network is defined as the inability to transmit the streaming media; and

(ii) transmit the streaming media out of persistent storage when the communication device re-connects to the network, wherein connected is defined as the ability to transmit the streaming media.

30. The device of claim 17, wherein the rendering element is further configured to selectively render the received streaming media, after the first time, one or more subsequent times out of persistent storage.

31. The device of claim 17, wherein the rendering element is further configured to selectively render the transmitted streaming media out of persistent storage.

32. The device of claim 17, wherein the rendering element is further configured to transition the rendering of the received media streams from (i) the real-time mode to the time-shifted mode and (ii) from the time-shifted mode to the real-time mode.

33. A communication method for communicating using a communication device, comprising:

progressively and persistently storing streaming media created using the communication device as the streaming media is created;

progressively transmitting the streaming media over a network as the streaming media is created and persistently stored;

progressively and persistently storing streaming media received over the network from a remote communication device as the streaming media is received; and

selectively rendering, for the first time, the received streaming media using one of two rendering options, the two rendering options including both (i) a real-time mode as the streaming media is received over the network and (ii) a time-shifted mode by retrieving and rendering the retrieved streaming media from persistent storage.

34. The method of claim 33, further comprising transmitting the created media streams and rendering the received media streams synchronously with respect to one another.

35. The method of claim 33, further comprising transmitting the created media streams and the rendering of the received media streams asynchronously with respect to one another.

36. The method of claim 33, further comprising transitioning communication with the remote communication device between synchronous and asynchronous communication.

37. The method of claim 33, further comprising progressively encoding the streaming media into indexed media payloads and progressively and persistently storing the indexed media payloads as the streaming media is created.

38. The method of claim 33, wherein progressively transmitting the streaming media further comprises progressively transmitting indexed media payloads as the streaming media is created, encoded, and persistently stored.

39. The method of claim 33, wherein progressively and persistently storing streaming media received over the network further comprises progressively and persistently storing indexed media payloads received over the network.

40. The method of claim 33, further comprising:

segmenting the transmitted streaming media into messages; and

receiving the streaming media in the form of messages.

41. The method of claim 40, further comprising threading together the transmitted and received messages sharing a common attribute.

42. The method of claim 41, further comprising sequencing the threaded messages together in the time order in which they were created.

43. The method of claim 33, further comprising transmitting the created streaming media out of persistent storage in the event the streaming media is created when the communication device is disconnected from the network.

44. The method of claim 43, wherein transmitting the created streaming media out of persistent storage further comprises:

(i) ascertaining if the communication device is disconnected from the network when the streaming media is created, wherein disconnected from the network is defined as the inability to transmit the streaming media; and

(ii) transmitting the streaming media out of persistent storage when the communication device re-connects to the network, wherein connected is defined as the ability to transmit the streaming media.

45. The method of claim 33, further comprising selectively rendering the received media streams, after the first time, one or more subsequent times from persistent storage.

46. The method of claim 33, further comprising selectively rendering the transmitted media streams, after transmission, one or more subsequent times from persistent storage.

47. The method of claim 33, wherein selectively rendering the received media streams further comprises transitioning the rendering of the received media streams from the real-time mode to the time-shifted mode.

48. The method of claim 33, wherein selectively rendering the received media streams further comprises transitioning the rendering of the received media streams from the time-shifted mode to the real-time mode.