Displaying visual representation of voice messages

• US 9,560,683 B1
• Filed: 09/14/2012
• Issued: 01/31/2017
• Est. Priority Date: 03/23/2007
• Status: Active Grant

• Current Assignee: Smith Micro Software Incorporated
• Original Assignee: Smith Micro Software Incorporated
• Inventors: Othmer, Konstantin, Jordan, Albert
• Primary Examiner(s): Batista, Marcos
• Application Number:
  US13/618,769
• Time in Patent Office: 1,600 Days
• Field of Search: 455/466, 370/338
• US Class Current: 1/1
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: H04M 1/72433 for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 2203/252 where a voice mode is enhanced with visual information
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 3/53358 Message preview
• CPC Class Codes: H04W 76/14 Direct-mode setup
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals

Abstract

Messages, such as voice messages, are received at a server and processed to generate extracted data that includes text from the message, envelope information, or contact information. The extracted data is transmitted to a device that displays a visual representation that includes some of the extracted data. The visual representation (e.g., an icon) enables the user to visually see what is in a voice message. By selecting a particular visual representation, the corresponding message can be retrieved from the message server and played at the device. In some instances, the message server also transmits an initial segment to the device that can be played by the device as well.

Claims

1. In a system that includes a device with access to a network, a method of accessing a voice message on a device, the method comprising:

receiving, at a device, an initial segment of a message and a reference, the reference pointing to a complete version of the message stored on a message server able to communicate with the device;

locally storing at the device both the initial segment of the message and the reference pointing to the complete version of the message stored on the message server;

presenting a visual representation of the message on a user interface of the device;

receiving user input at the device that selects the visual representation on the device and indicates the message should be played;

in response to receiving user input selecting the visual representation;

commencing playing the locally stored initial segment of the message; and

during playback of the locally stored initial segment of the message;

establishing a network connection between the device and the message server;

sending to the message server the reference to the complete version of the message and a request for at least an additional segment of the message; and

receiving the additional segment of the message from the server; and

immediately upon the locally stored initial segment having been completely played back and without interruption, automatically playing the additional segment of the message received from the server such the locally stored initial segment and the additional segment are played sequentially, continuously, and without interruption;

wherein the length of the initial segment of the message is chosen to either;

cover the latency of establishing a network connection and transmitting the rest of the voice message;

or cover the latency of establishing a network connection plus the amount of time it takes to stream the remainder of the message.

2. The method of claim 1, wherein the visual representation of the message indicates that only the initial segment of the message is currently on the device.

3. The method of claim 1, wherein the initial segment of the message comprises the first five to ten seconds or more of the voice message.

4. The method of claim 1, wherein presenting a visual representation further comprises presenting, in the visual representation, one or more of:

text that has been transcribed from the message;

envelope information from the message;

a phone number associated with a sender of the message;

contact information of the sender;

a picture of the sender; and

an avatar that represents the sender.

5. The method of claim 1, further comprising a plurality of visual representations, each visual representation corresponding to a different message, wherein the plurality of visual representations enable the corresponding messages to be accessed in a non-sequential manner.

6. The method of claim 1, further comprising receiving input from a user selecting the visual representation.

7. The method of claim 6, further comprising playing the initial segment stored on the device in response to the selection of the visual representation.

8. The method of claim 7, further comprising:

accessing a message server to retrieve the message in its entirety; and

playing the entire message at the device.

9. The method of claim 7, further comprising:

retrieving the message from the message server; and

playing the message beginning at a point where the initial segment ends such that the message plays as if it were entirely stored on the device.

10. The method of claim 7, further comprising managing memory of the device to accommodate additional segments associated with additional messages.

11. The method of claim 7, further comprising requesting an initial segment for each message for a device from a message server.

12. The method of claim 11, further comprising requesting data from the message server that can be included in the visual representation, the data including text that has been obtained using a voice-to-text module.

13. The method of claim 12, further comprising presenting the visual representation as an icon, the icon including the text or presenting the visual representation in lines, each line representing a message and each line including one of text from the message and contact information.

14. In a system that includes a device with access to a network, a method of accessing a voice message on the device, the method comprising:

receiving, at a device, an initial segment of a message and a reference, the reference pointing to a complete version of the message stored on a message server able to communicate with the device;

locally storing at the device both the initial segment of the message and the reference pointing to a complete version of the message stored on the message server;

presenting a visual representation on a user interface of the device, the visual representation associated with the initial segment of the message;

deleting from the device some or all of the initial segment of the message to free device memory while retaining the reference at the device; and

retaining at the device the reference to the message stored on the message server such that, upon user selection of the visual representation;

any portion of the initial segment of the message remaining on the device commences playing; and

,

during playing of the any portion;

the reference pointing to a complete version of the message and a request for at least an additional segment of the message is sent to the server; and

the message is retrieved from the server such that the device is enabled to automatically play, without interruption, the any portion of the initial segment of the message remaining on the device and the additional portion of the message retrieved from the server such the any portion and the additional portion are played sequentially, continuously, and without interruption;

wherein the length of the initial segment of the message is chosen to either;

cover the latency of establishing a network connection and transmitting the rest of the voice message;

or cover the latency of establishing a network connection plus the amount of time it takes to stream the remainder of the message.

15. The method of claim 14, wherein presenting a visual representation further comprises presenting, in the visual representation, one or more of:

text that has been transcribed from the message;

envelope information from the message;

a phone number associated with a sender of the message;

contact information of the sender;

a picture of the sender; and

an avatar that represents the sender.

16. The method of claim 14, further comprising presenting a plurality of visual representations, each visual representation corresponding to a different message, wherein the plurality of visual representations enable the corresponding messages to be accessed in a non-sequential manner.

17. The method of claim 16, wherein a corresponding message is accessed by one or more of the following means:

retrieving the initial segment from device memory;

using the reference to request the message or a remaining portion of the message from the message server;

receiving the message or a remaining segment of the message from the message server over a data channel; and

receiving the message or a remaining segment of the message from the message server over a voice channel.

18. The method of claim 14, further comprising receiving input from a user selecting the visual representation.

19. The method of claim 18, further comprising playing any undeleted portion of the initial segment stored on the device in response to the selection of the visual representation.

20. The method of claim 19, further comprising:

accessing a message server to retrieve the message in its entirety; and

playing the entire message at the device.

21. The method of claim 19, further comprising:

retrieving the message from the message server; and

if an undeleted portion of an initial segment remains stored on the device, playing the message beginning at a point where the undeleted portion of the initial segment ends such that the message plays as if it were entirely stored on the device;

or

if the initial segment has been completely deleted, playing the message from its beginning.

22. The method of claim 19, further comprising requesting an initial segment for each message for a device from a message server.

23. The method of claim 22, further comprising requesting data from the message server that can be included in the visual representation, the data including text that has been obtained using a voice to text module.

24. The method of claim 23, further comprising presenting the visual representation as an icon, the icon including the text or presenting the visual representation in lines, each line representing a message and each line including one of text from the message and contact information.