Real-time voice recognition on a handheld device

• US 9,009,033 B2
• Filed: 12/01/2010
• Issued: 04/14/2015
• Est. Priority Date: 12/01/2009
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Hon-Anderson, Eric
• Primary Examiner(s): JACKSON, JAKIEDA R
• Application Number:
  US12/958,021
• Publication Number:
  US 20110161075A1
• Time in Patent Office: 1,595 Days
• Field of Search: 704/275, 704/200
• US Class Current: 704/200
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A method and apparatus for implementation of real-time speech recognition using a handheld computing apparatus are provided. The handheld computing apparatus receives an audio signal, such as a user'"'"'s voice. The handheld computing apparatus ultimately transmits the voice data to a remote or distal computing device with greater processing power and operating a speech recognition software application. The speech recognition software application processes the signal and outputs a set of instructions for implementation either by the computing device or the handheld apparatus. The instructions can include a variety of items including instructing the presentation of a textual representation of dictation, or a function or command to be executed by the handheld device (such as linking to a website, opening a file, cutting, pasting, saving, or other file menu type functionalities), or by the computing device itself.

Claims

1. A method for implementation of real-time audio recognition, comprising:

receiving an audio signal at a handheld computing apparatus instructing execution of a functional command from a command set to be executed by the handheld computing apparatus;

the handheld computing apparatus comprising a speech recognition interface software application for converting, in real-time, the audio signal into audio digital data representing the audio signal;

transmitting, in real-time, the audio digital data from the speech recognition interface software application of the handheld computing apparatus to a speech recognition engine of a speech recognition software application of a computing device separately situated from the handheld computing apparatus, wherein the computing device has more processing power than the handheld computing apparatus, and further wherein the computing device is operating a selected profile of a plurality of profiles, the selected profile having an audio source of the handheld computing apparatus;

receiving, in real-time, a set of computer readable instructions at the speech recognition interface software application of the handheld computing apparatus from the speech recognition software application of the computing device, the set of computer readable instructions instructing the functional command from the command set to be executed by the handheld computing apparatus,wherein the set of computer readable instructions are based on the selected profile of the plurality of profiles for the handheld computing apparatus and the audio digital data transmitted to the speech recognition engine of the speech recognition software application of the computing device; and

the speech recognition interface software application of the handheld computing apparatus executing the set of computer readable instructions in real-time by executing the functional command on the handheld computing apparatus.

2. The method of claim 1, wherein the handheld computing apparatus comprises a wireless mobile device.

3. The method of claim 1, wherein the audio signal comprises voice.

4. The method of claim 1, further comprising compressing the audio digital data prior to transmission.

5. The method of claim 1, wherein the step of transmitting the audio digital data comprises the speech recognition interface software application of the handheld computing apparatus wirelessly transmitting the audio digital data.

6. The method of claim 1, wherein the step of transmitting the audio digital data comprises the speech recognition interface software application of the handheld computing apparatus wirelessly transmitting the audio digital data using a cellular network or a wireless local area network.

7. The method of claim 1, wherein executing the set of computer readable instructions results in communication of a status to the speech recognition interface software application of the handheld computing apparatus.

8. The method of claim 1, wherein executing the set of computer readable instructions results in communication of a status to the speech recognition interface software application of the handheld computing apparatus of the handheld computing apparatus, of the computing device, or of a task.

9. The method of claim 1, wherein executing the set of computer readable instructions results in communication of information to the speech recognition interface software application of the handheld computing apparatus.

10. The method of claim 1, wherein executing the set of computer readable instructions results in modification of one or more settings on the handheld computing apparatus.

11. The method of claim 1, wherein executing the set of computer readable instructions results in implementation of an editing function on the handheld computing apparatus.

12. The method of claim 1, wherein executing the set of computer readable instructions results in implementation of a navigation function on the handheld computing apparatus.

13. The method of claim 1, wherein executing the set of computer readable instructions results in execution of a task on the handheld computing apparatus.

14. The method of claim 1, wherein executing the set of computer readable instructions results in execution of a task on the handheld computing apparatus, the task being one or more operation of a list of operations comprising editing, sending, deleting, opening, saving, selecting, copying, pasting, or moving text or a message.

15. The method of claim 1, wherein executing the set of computer readable instructions results in modification of a view in a display on the handheld computing apparatus.

16. The method of claim 1, wherein executing the set of computer readable instructions results in displaying alternative options to a user of the handheld computing apparatus.

17. The method of claim 1, wherein executing the set of computer readable instructions results in the handheld computing apparatus navigating to a predetermined address or location.

18. The method of claim 1, wherein the set of computer readable instructions include a numeric code followed by additional operational data.

19. A method for implementation of real-time audio recognition, comprising:

a computing device receiving audio digital data representing an audio signal in real-time instructing execution of a functional command from a command set to be executed by a handheld computing apparatus, wherein the computing device comprises a speech recognition software application having a speech recognition engine;

the speech recognition engine operating on the computing device processing the audio digital data and converting, in real-time, the audio digital data into a set of computer readable instructions using speech recognition;

the speech recognition software application of the computing device transmitting, in real-time, the set of computer readable instructions to a speech recognition interface software application of the handheld computing apparatus separately situated from the computing device for execution by the speech recognition interface software application of the handheld computing apparatus, wherein the computing device has more processing power than the handheld computing apparatus; and

the speech recognition interface software application of the handheld computing apparatus executing the set of computer readable instructions in real-time by executing the functional command on the handheld computing apparatus;

wherein the computing device is operating a selected profile of a plurality of profiles, the selected profile having an audio source of the handheld computing apparatus, and

wherein the set of computer readable instructions instruct the functional command from the command set to be executed by the handheld computing apparatus.

20. A computer readable, non-transitory, medium for storing executable instructions directed to a method of implementation of real-time audio recognition, the method comprising:

receiving an audio signal at a handheld computing apparatus instructing execution of a functional command from a command set to be executed by the handheld computing apparatus;

the handheld computing apparatus comprising a speech recognition interface software application for converting, in real-time, the audio signal into audio digital data representing the audio signal;

transmitting, in real-time, the audio digital data from the speech recognition interface software application of the handheld computing apparatus to a speech recognition engine of a speech recognition software application of a computing device separately situated from the handheld computing apparatus, wherein the computing device has more processing power than the handheld computing apparatus, and further wherein the computing device is operating a selected profile of a plurality of profiles, the selected profile having an audio source of the handheld computing apparatus;

receiving, in real-time, a set of computer readable instructions at the speech recognition interface software application of the handheld computing apparatus from the speech recognition software application of the computing device, the set of computer readable instructions instructing the functional command from the command set to be executed by the handheld computing apparatus, wherein the set of computer readable instructions are based on the selected profile of the plurality of profiles for the handheld computing apparatus and the audio digital data transmitted to the speech recognition engine of the speech recognition software application of the computing device; and

the speech recognition interface software application of the handheld computing apparatus executing the set of computer readable instructions in real-time by executing the functional command on the handheld computing apparatus.