Multi-media messaging method, apparatus and applications for conducting real-time and time-shifted communications

• US 8,565,149 B2
• Filed: 03/05/2008
• Issued: 10/22/2013
• Est. Priority Date: 06/28/2007
• Status: Active Grant

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Hamza, Faruk
• Assistant Examiner(s): PHAM, TITO Q
• Application Number:
  US12/042,987
• Publication Number:
  US 20090003544A1
• Time in Patent Office: 2,057 Days
• Field of Search: None
• US Class Current: 370/328
• CPC Class Codes: E04H 3/126 Foldable, retractable or tiltable tribunes E04H3/123 takes precedence
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/226 Delivery according to priorities
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 61/2503 Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/54 Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
• CPC Class Codes: H04M 1/64 Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations centralised dictation systems H04M11/10
• CPC Class Codes: H04M 11/00 Telephonic communication systems specially adapted for combination with other electrical systems
• CPC Class Codes: H04M 3/53 Centralised arrangements for recording incoming messages , i.e. mailbox systems
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements

Abstract

A telecommunication and multimedia management apparatus and method that supports voice and other media communications and that enables users to: (i) participate in multiple conversation modes, including live phone calls, conference calls, instant voice messaging or tactical communications; (ii) review the messages of conversations in either a live mode or a time-shifted mode and to seamlessly transition back and forth between the two modes; (iii) participate in multiple conversations either concurrently or simultaneously; (iv) archive the messages of conversations for later review or processing; and (v) persistently store media either created or received on the communication devices of users. The latter feature enables users to generate or review media when either disconnected from the network or network conditions are poor and to optimize the delivery of media over the network based on network conditions and the intention of the users participating in conversations.

Claims

1. A method of providing and operating a progressive, store and forward, messaging system capable of supporting near real-time communication, the method comprising:

providing a first communication application, configured to be embedded in a first non-transitory computer readable medium on a first communication device, the first communication application including a first progressive, store and forward, messaging module that progressively stores and progressively transmits over a network media of a first message created using the first communication device as the media of the first message is created;

providing a second communication application, configured to be embedded in a second non-transitory computer readable medium on a second communication device, the second communication application including a second progressive, store and forward, messaging module that progressively stores and progressively transmits over the network media of a second message created using the second communication device as the media of the second message is created; and

operating a communication services infrastructure on the network by;

(a) progressively storing the media of the first message on the communication services infrastructure as the media of the first message is progressively received over the network from the first communication device and (b) progressively transmitting the media of the first message to the second communication device as the media of the first message is progressively received and stored on the communication services infrastructure; and

(c) progressively storing the media of the second message on the communication services infrastructure as the media of the second message is progressively received over the network from the second communication device and (d) progressively transmitting the media of the second message to the first communication device as the media of the second message is progressively received and stored on the communication services infrastructure,

wherein the first communication application is further configured to progressively transmit the first message over the network using a transmission protocol capable of supporting near real-time communication, while guaranteeing delivery of a complete copy of the media of the first message.

2. The method of claim 1, wherein the provided first communication application is further configured to progressively transmit the media of the first message out of storage located on the first communication device when conditions on a network connection connecting the first communication device to the network are inadequate for transmitting the media of the first message as the media is created.

3. The method of claim 1, wherein the communication services infrastructure is further configured to progressively transmit the media of the first message out of storage located on the communication services infrastructure when conditions on a network connection connecting the second communication device to the network are inadequate for transmitting the media of the first message as the media is received at the communication services infrastructure.

4. The method of claim 1, wherein the provided first communication application is further configured to progressively transmit the media of the first message out of storage located on the first communication device if the first communication device is disconnected from the network when the media of the first message is created and after the first communication device reconnects to the network.

5. The method of claim 1, wherein the communication services infrastructure is further configured to progressively transmit the first message out of storage if:

(i) the second communication device is disconnected from the network when the media of the first message is received at and stored on the communication services infrastructure; and

(ii) after the second communication device reconnects to the network.

6. The method of claim 1, wherein the communication services infrastructure is further configured to progressively transmit the media of the first message to the second communication device using a transmission protocol capable of supporting near real-time communication, while delivering a complete copy of the media of the first message to the second communication device.

7. The method of claim 1, wherein the provided first communication application is further configured to retransmit, in response to requests for retransmission, the media of the first message designated as missing and/or defective, the retransmissions guaranteeing delivery of a complete copy of the media of the first message to the communication services infrastructure.

8. The method of claim 1, wherein the communication services infrastructure is further configured to retransmit, in response to requests for retransmission, the media of the first message designated as missing and/or defective, the retransmissions guaranteeing delivery of a complete copy of the media of the first message to the second communication device.

9. The method of claim 1, wherein the communication services infrastructure is further configured to send to the first communication device requests for retransmission of media of the first message designated as missing and/or defective.

10. The method of claim 1, wherein the second communication device is further configured to send to the communication services infrastructure requests for retransmission of media of the first message designated as missing and/or defective.

11. The method of claim 1, wherein the provided first communication application is further configured to progressively transmit the media of the first message at a bit rate commensurate with the available bit rate on a network connection connecting the first communication device to the communication services infrastructure.

12. The method of claim 1, wherein the communication services infrastructure is further configured to progressively transmit the media of the first message to the second communication device at a bit rate commensurate with the available bit rate on a network connection connecting the second communication device to the communication services infrastructure.

13. The method of claim 1, wherein the first progressive, store and forward, messaging module further comprises a first storage module for progressively storing on the first communication device (i) the media of the first message as the media is created using the first communication device and (ii) the media of the second message as the media of the second message is progressively received at the first communication device.

14. The method of claim 1, wherein the first progressive, store and forward, messaging module further comprises a first storage module for:

(i) progressively storing the media of the second message as the media of the second message is progressively received at the first communication device;

(ii) requesting retransmission of missing and/or defective media of the second message; and

(iii) storing a complete copy of the second message as the retransmission requests are satisfied.

15. The method of claim 1, wherein the second progressive, store and forward, messaging module further comprises a second storage module for progressively storing on the second communication device (i) the media of the second message as the media is created using the second communication device and (ii) the media of the first message as the media of the first message is progressively received at the second communication device.

16. The method of claim 1, wherein the second progressive, store and forward, messaging module further comprises a second storage module for:

(i) progressively storing the media of the first message as the media of the first message is progressively received at the second communication device;

(ii) requesting retransmission of missing and/or defective media of the first message; and

(iii) storing a complete copy of the second message as the retransmission requests are satisfied.

17. The method of claim 1, wherein the first progressive, store and forward, messaging module further comprises a first render module configured to selectively render the media of the second message for the first time (i) in a near real-time rendering mode by progressively rendering the media of the second message as the media is progressively received over the network and (ii) in a time-shifted mode by retrieving and progressively rendering the media of the second message out of storage on the first communication device.

18. The method of claim 17, wherein the first render module is further configured to selectively render the media of the second message from storage in the time-shifted mode when the first communication device is disconnected from the network.

19. The method of claim 1, wherein the second progressive, store and forward, messaging module further comprises a second render module configured to selectively render the media of the first message for the first time (i) in a near real-time rendering mode by progressively rendering the media of the first message as the media is progressively received over the network and (ii) in a time-shifted mode by retrieving and progressively rendering the media of the first message out of storage on the second communication device.

20. The method of claim 19, wherein the second render module is further configured to selectively render the media of the first message from storage in the time-shifted mode when the second communication device is disconnected from the network.

21. The method of claim 1, wherein the communication services infrastructure is further configured to support live communication when the first message and the second message are created, transmitted, and rendered at substantially the same time with respect to one another.

22. The method of claim 1, wherein the communication services infrastructure is further configured to support asynchronous messaging communication between the first communication device and the second communication device.

23. The method of claim 1, further comprising progressively storing the media of the first message and the media of the second message on the first communication device, the second communication device, and the communication services infrastructure in an indexed format.

24. The method of claim 1, wherein the first and the second progressive, store and forward, messaging modules each further comprise a conversation module configured to thread together transmitted and received messages sharing a common attribute into a conversation.

25. The method of claim 1, wherein the media of the first and the second messages comprise one or more of the following types of streaming media:

voice, video, sensor data, radio signals, position or GPS information, or any combination thereof.

26. The method of claim 1, wherein operating the communication services infrastructure on the network further comprises operating one or more servers coupled to the network.

27. The method of claim 1, further comprising progressively forwarding the media of the first message over the communication services infrastructure to the second communication device as the media of the first message is transmitted so that the media of the first message may selectively be rendered in near real-time on the second communication device.

28. The method of claim 1, further comprising retransmitting missing and/or defective media of the first message across the communication services infrastructure as necessary to ensure that the second communication device receives and stores a complete copy of the first message.

29. The method of claim 1, further comprising progressively forwarding the media of the second message over the communication services infrastructure to the first communication device as the media of the second message is transmitted so that the media of the second message may selectively be rendered in near real-time on the first communication device.

30. The method of claim 1, further comprising retransmitting missing and/or defective media of the second message across the communication services infrastructure as necessary to ensure that the first communication device receives and stores a complete copy of the second message.

31. The method of claim 1, wherein providing the first application further comprises inserting a non-IP address identifier into the first message, the non-IP address identifier identifying a user of the second communication device.

32. The method of claim 1, wherein operating the communication services infrastructure further comprises:

(i) resolving the non-IP address identifier into an IP address associated with the second communication device; and

(ii) progressively transmitting the media of the first message to a physical location of the second communication device after the IP address is resolved.