Telecommunication and multimedia management method and apparatus

• US 8,345,836 B2
• Filed: 04/25/2008
• Issued: 01/01/2013
• Est. Priority Date: 06/28/2007
• Status: Expired due to Fees

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US12/110,219
• Publication Number:
  US 20090003554A1
• Time in Patent Office: 1,712 Days
• Field of Search: 379/93.01, 379/90.01, 379/67.1, 379/69, 379/85, 379/88.04, 379/88.07, 379/88.08, 379/88.11, 379/88.12, 379/88.13, 379/88.17, 709204-206, 715/758
• US Class Current: 379/93.01
• CPC Class Codes: E04H 3/126 Foldable, retractable or tiltable tribunes E04H3/123 takes precedence
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 51/226 Delivery according to priorities
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 61/2503 Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/54 Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
• CPC Class Codes: H04M 1/64 Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations centralised dictation systems H04M11/10
• CPC Class Codes: H04M 11/00 Telephonic communication systems specially adapted for combination with other electrical systems
• CPC Class Codes: H04M 3/53 Centralised arrangements for recording incoming messages , i.e. mailbox systems
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements

Abstract

A communication device configured to receive messages containing media over a communication network and to receive locally created messages containing media created using the communication device. The device also includes a time-shifting buffer to store in a time-based format the media contained in both the messages received over the communication network and the locally created messages. The time-shifting buffer enables on the communication device to either (i) render the media received over the network in a near real-time mode; or (ii) render both the media received over the network and the locally created media in a time-shifted mode by retrieving the stored media from the time-shifting buffer. The communication device also includes a message management system, which enables the communication device to transition the rendering of the media between the time-shifted mode and the near real-time mode without interrupting the ongoing storage of media of received messages into the time-shifting buffer.

Claims

1. Computer code embedded in a non-transient computer readable medium and intended to be executed on a communication device connected to a network, the code configured to:

generate an outgoing message addressed to a recipient and containing voice media created using the communication device;

receive status information indicative of the availability of the recipient on the network;

progressively transmit the voice media of the outgoing message, as the voice media is created, when the status information is indicative that the recipient is available on the network;

progressively receive an incoming message containing voice media as the voice media is received over the network from the recipient;

progressively store the voice media of;

(i) the outgoing message as the voice media is created and progressively transmitted; and

(ii) the incoming message as the voice media is progressively received over the network; and

selectively and progressively render the voice media of the incoming message, for the first time, both;

(iii) in near real-time as the time-base media is progressively received over the network; and

(iv) out of storage by retrieving the voice media of the message from storage.

2. The computer code of claim 1, wherein the outgoing message and the incoming message are both asynchronous messages.

3. The computer code of claim 1, wherein the outgoing message is addressed to the recipient using a human-readable identifier associated with the recipient.

4. The computer code of claim 3, wherein the human-readable identifier is resolved into an IP address associated with a second communication device associated with the recipient.

5. The computer code of claim 4, wherein the IP address is resolved into a physical address on the network associated with the second communication device.

6. The computer code of claim 1, further configured to update the presence status information of the recipient to not available when the recipient is not available on the network.

7. The computer code of claim 1, further comprising sharing the network availability status of the communication device with one or more remote communication devices.

8. The computer code of claim 1, further configured to operate the communication device in a full-duplex mode when transmitting the outgoing message and receiving the incoming message at approximately the same time.

9. The computer code of claim 1, further configured to operate the communication device in a time-shifting messaging mode when the outgoing message and the incoming message are transmitted and received at discrete times with respect to one another.

10. The computer code of claim 1, further configured to support synchronous communication on the communication device when progressively transmitting the voice media of the outgoing message at approximately the same time the voice media of the incoming message is progressively received and rendered in near real-time.

11. The computer code of claim 1, further configured to progressively transmit the voice media of the outgoing message without the need of first establishing a dedicated circuit connection over the network with a remote communication device associated with the recipient.

12. The computer code of claim 1, further configured to transmit the voice media of the outgoing message as fast as conditions on the network permit.

13. The computer code of claim 1, further configured to:

ascertain if the communication device is disconnected from the network when the voice media of the outgoing message is created; and

transmit the voice media of the outgoing message from storage when the communication device reconnects to the network.

14. The computer code of claim 1, further configured to:

ascertain if the communication device is unable to transmit the voice media of the outgoing message as the voice media is created due to poor connectivity to the network; and

transmit the voice media of the outgoing message from storage when network connectivity improves.

15. The computer code of claim 1, further configured to progressively transmit the voice media of the outgoing message, during a transmission session, using a transmission protocol that:

(i) supports near-real-time communication so that the voice media of the outgoing message is delivered in near real-time to a second communication device associated with the recipient; and

(ii) guarantees delivery of the voice media of the outgoing message to the second communication device.

16. The computer code of claim 15, further configured to guarantee the delivery of the voice media of the outgoing message, during the transmission session, without the need for a second transmission session.

17. The computer code of claim 15, further configured to guarantee delivery by retransmitting voice media of the outgoing message designated as missing and/or defective so that both the communication device and the second communication device associated with the recipient have identical stored copies of the voice media of the outgoing message.

18. The computer code of claim 1, further configured to note missing and/or defective voice media of the incoming message and to generate requests for retransmission of the noted time-base media so that a complete copy of the voice media of the incoming message, as transmitted, is stored on the communication device when the retransmission requests are satisfied.

19. The computer code of claim 1, further configured to associate outgoing messages and incoming messages sharing a common attribute into a conversation thread.

20. The computer code of claim 19, wherein the common attribute comprises one of the following:

(i) a conversation name;

(ii) a conversation subject;

(iii) a name of a participant of the conversation;

or

(iv) a name of a group of participants of the conversation.

21. The computer code of claim 19, wherein the conversation thread is capable of including, in addition to voice messages, messages including one or more of the following time-based media types:

(i) audio;

(ii) video

(iii) GPS or positional data;

(iv) sensor data.

22. The computer code of claim 19, wherein the conversation thread further includes one or more of the following:

(i) text messages; and

(ii) photos.

23. The computer code of claim 1, further providing tools to manage and participate in a plurality of conversation threads.

24. The computer code of claim 1, further providing rendering options for rendering the voice media of the incoming message, the rendering options including one or more of the following:

play, play faster, play slower, jump back, jump forward, catch-up-to-live, jump to the start of the incoming message, and jump to the head of the incoming and jump to the head of the message.

25. The computer code of claim 1, further comprising progressively transmitting the voice media of the outgoing message using an identifier that identifies the recipient on the network.

26. The computer code of claim 25, wherein the identifier is a non-IP address identifier.

27. The computer code of claim 25, wherein the identifier is used to ascertain a delivery route over the network to one or more second communication device(s) associated with the recipient.

28. The computer code of claim 1, further comprising progressively transmitting the voice media of the outgoing message using a transmission protocol that:

(i) enables the recipient to review the voice media of the outgoing message in near real-time; and

(ii) delivers a complete copy of the voice media of the outgoing message to the recipient.

29. The computer code of claim 1, further comprising transmitting the voice media of the outgoing message to two or more recipients.

30. The computer code of claim 1, wherein the network availability status of the recipient is at least partially determined by if a second communication device, associated with the recipient, is connected to the network.

31. A communication method, comprising:

distributing first computer code to a first user for execution on a first communication device associated with the first user;

distributing second computer code to a second user for execution on a second communication device associated with the second user;

maintaining at a server the availability status of the first user on the network;

sharing the availability status of the first user with the second user using the second communication device; and

enabling the second user of the second communication device, executing the second computer code, to;

generate an outgoing message addressed to the first user and containing voice media created using the second communication device;

progressively transmit the voice media of the outgoing message, as the voice media is created, when the availability status indicates that the first user is available on the network;

progressively receive an incoming message from the first user and generated using the first communication device, the incoming message containing voice media as the voice media is received over the network;

progressively store on the second communication device the voice media of;

(i) the outgoing message as the voice media is created and progressively transmitted; and

(ii) the incoming message as the voice media is progressively received over the network; and

selectively and progressively render the voice media of the incoming message, for the first time, both;

(iii) in near real-time as the time-base media is progressively received over the network; and

(iv) out of storage by retrieving the voice media of the message from storage.

32. The method of claim 31, further comprising resolving a human-readable identifier used to address the outgoing message to the first user into an IP address associated with the first communication device.

33. The method of claim 32, further comprising resolving the IP address into a physical address on the network for the first communication device.

34. The method of claim 31, further comprising updating at the server the availability status of the first user to available when the first communication device is connected to and available on the network.

35. The method of claim 31, further comprising updating at the server the availability status of the first user to not available when the first communication device is not connected to and not available the network.

36. The method of claim 31, further comprising updating at the server the availability status of the first user to available when any one of multiple first communication devices associated with the first user is/are connected to and available on the network.

37. The method of claim 31, further comprising facilitating the transmission and receipt of the outgoing and incoming messages between the first and the second communication devices at least partially based on the availability status of the first and the second users respectively.

38. The method of claim 31, wherein the incoming and the outgoing messages further comprise video media.