Genius button secondary commands

• US 9,111,538 B2
• Filed: 05/24/2011
• Issued: 08/18/2015
• Est. Priority Date: 09/30/2009
• Status: Active Grant

• Current Assignee: T-Mobile USA, Inc. (Deutsche Telekom AG)
• Original Assignee: T-Mobile USA, Inc. (Deutsche Telekom AG)
• Inventors: Lau, Kevin, Smith, Desmond
• Primary Examiner(s): Hashem, Lisa
• Application Number:
  US13/114,923
• Publication Number:
  US 20110223893A1
• Time in Patent Office: 1,547 Days
• Field of Search: 455/563, 455/415, 455/414.4, 455/567, 455/41.2, 455/412.2
• US Class Current: 1/1
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72442 for playing music files
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04M 3/42034 Calling party identification service
• CPC Class Codes: H04M 3/42127 Systems providing several special services or facilities from groups H04M3/42008 - H04M3/58
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/541 based on information specified by the calling party
• CPC Class Codes: H04W 4/025 using location based information parameters
• CPC Class Codes: H04W 4/14 Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]

Abstract

Methods, systems and articles for receiving, by a telecommunication device, audio input through a unified audio interface are disclosed herein. The telecommunication device is further configured to perform at least one of a dictation action, an incoming message processing action, a navigation action, a content lookup action, or a contact lookup action while continuously or substantially continuously receiving voice commands from a user. In some aspects, the telecommunications device may continuously receive and process voice command while operating in a driving mode, which may be initiated by the telecommunications device.

Claims

1. A method implemented in a telecommunication device, the method comprising:

receiving a text-based message;

audibly announcing a name of a contact associated with the received text-based message;

receiving, via an audio recognition module, a continuous string of audio input from a user through a unified audio interface of the telecommunication device;

performing, via the audio recognition module, a text translation of the audio input received from the user of the telecommunication device;

analyzing, via an audio routing module, at least a portion of the continuous string of audio input from the text translation to determine to handle the audio input as at least one of a process of the telecommunication device, a request of a telecommunication device application, or a network search request;

determining, via the audio routing module, that the audio input is associated with a command to perform an action that is understood by the telecommunication device or the telecommunication device application;

identifying, via the audio routing module, the action as a dictation action that is associated with the received text message;

initiating, via the audio routing module, the dictation action while continuing to receive the continuous string of audio input from the user; and

performing, via the audio routing module, the dictation action by generating text via a voice-to-text conversion of at least part of the continuous string of audio input received from the user.

2. The method of claim 1, further comprising:

reading back, using a text-to-voice converter, at least a portion of the text to the user to allow the user to verify whether the generated text is correct.

3. The method of claim 2, further comprising:

verifying with the user that the at least a portion of the continuous string of audio input is intended to be the command; and

executing the command upon verification of the command.

4. The method of claim 2, wherein the reading back the at least a portion of the text is triggered by at least one of a pause in receipt of the continuous string of audio input from the user, a predetermined amount of words of the generated text or a predetermined duration of time.

5. The method of claim 1, further comprising:

receiving another audio input as an additional command to handle the text-based message; and

executing the additional command to process the text-based message.

6. The method of claim 5, wherein the additional command includes at least one of a command to cause audible output of the text-based message to the user or a command to save the text-based message.

7. The method of claim 1, further comprising:

receiving a contact name of a person as at least a portion of the continuous string of audio input from the user;

receiving a requested command associated with the contact name;

locating the contact name using the telecommunication device;

retrieving a phone number or a messaging address associated with the contact name based at least in part on the requested command; and

establishing a communication with the person using the phone number or messaging address.

8. The method of claim 7, wherein the locating the contact name using the telecommunication device includes searching documents to locate a name of the person and retrieve the phone number or the messaging address associated with the name in one of the documents.

9. The method as recited in claim 1, wherein the text-based message is at least one of an electronic mail (email) message or an instant messaging message.

10. A telecommunication device comprising:

a processor;

a module operable by the processor and configured to receive an incoming transmission that is a text-based message and announce a contact associated with the incoming transmission;

an audio recognition module operable by the processor and configured to recognize a continuous string of audio input captured on a substantially continuous basis by an audio capture process; and

an audio routing module operable by the processor that receives the text translation of the audio input from the audio recognition module and is configured to evaluate the continuous string of audio input to;

analyze at least a portion of the continuous string of audio input to determine to handle the audio input as at least one of a process of the telecommunication device, a request of a telecommunication device application, or a network search request a command;

determine that the audio input is associated with a command to perform a dictation action that is understood by the telecommunication device or the telecommunication device application;

determine to handle the continuous string of audio input as the dictation action to reply to the received text-based message;

initiate the dictation action while the audio recognition module is configured to continuously receive the continuous string of audio input from a user; and

perform the dictation action by generating text via a voice-to-text conversion of at least part of the continuous string of audio input received from the user.

11. The telecommunication device of claim 10, wherein the audio routing module further performs acts comprising:

reading back, using a text-to-voice converter, at least a portion of the text to the user to allow the user to verify whether the generated text is correct;

identifying at least a portion of the continuous string of audio input to contain a command to reply to the text-based message with the generated text;

verifying with the user that the portion of the continuous string of audio input is intended to be the command; and

executing the command upon verification of the command.

12. The telecommunication device of claim 10, wherein the text-based message includes an electronic mail (email) application message.

13. The telecommunication device of claim 10, wherein the text-based message includes an instant messaging application message.

14. The telecommunication device of claim 10, wherein the text-based message includes a text messaging application message.

15. A method comprising:

receiving, by a telecommunication device, a text-based message;

audibly announcing a contact associated with the received text-based message;

receiving, via an audio recognition module, a continuous string of audio input from a user via a unified audio interface of the telecommunication device;

performing, via the audio recognition module, a text translation of the audio input received from the user of the telecommunication device;

analyzing, via an audio routing module, at least a portion of the continuous string of audio input from the text translation to determine to handle the audio input as at least one of a process of the telecommunication device, a request of a telecommunication device application, or a network search request;

determining, via the audio routing module, that the audio input is associated with a command that is understood by the telecommunication device or the telecommunication device application, wherein the command is a dictation command to receive dictation from the user to provide dictated text in reply to the received text-based message;

converting, via the audio routing module, at least another portion of the continuous string of audio input into the dictated text; and

transmitting, by the telecommunication device, the dictated text as a reply text-based message to at least the contact associated with the received text-based message.

16. The method as recited in claim 15, further comprising causing audible output, after text-to-speech conversion, of content of the received text-based message.

17. The method as recited in claim 15, wherein the text-based message includes an electronic mail (email) message.

18. The method as recited in claim 15, wherein the text-based message includes an instant messaging message.

19. The method as recited in claim 15, wherein the text-based message includes a text messaging message.

20. The method as recited in claim 15, wherein the text-based message includes a social network message.