Method and apparatus for multi-level distributed speech recognition

• US 6,898,567 B2
• Filed: 12/29/2001
• Issued: 05/24/2005
• Est. Priority Date: 12/29/2001
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Balasuriya, Senaka
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): HARPER, V PAUL
• Application Number:
  US10/034,542
• Publication Number:
  US 20030139924A1
• Time in Patent Office: 1,242 Days
• Field of Search: 704/275, 704/270, 704/270.1, 704/255, 704/251, 704/246, 704/244, 704/240, 704/235, 704/231, 379/88.03, 379/88.02, 379/88.01
• US Class Current: 704/231
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

A system and method for multi-level distributed speech recognition includes a terminal (122) having a terminal speech recognizer (136) coupled to a microphone (130). The terminal speech recognizer (136) receives an audio command (37), generating at least one terminal recognized audio command having a terminal confidence value. A network element (124) having at least one network speech recognizer (150) also receives the audio command (149), generating a at least one network recognized audio command having a network confidence value. A comparator (152) receives the recognized audio commands, comparing compares the speech recognition confidence values. The comparator (152) provides an output (162) to a dialog manager (160) of at least one recognized audio command, wherein the dialog manager then executes an operation based on the at least one recognized audio command, such as presenting the at least one recognized audio command to a user for verification or accessing a content server.

Claims

1. A method for multi-level distributed speech recognition between a terminal device and a network device comprising:

providing an audio command to a first speech recognition engine in the terminal device wirelessly providing the audio command to at least one second speech recognition engine in the network device;

recognizing the audio command within the first speech recognition engine to generate at least one first recognized audio command, wherein the at least one first recognized audio command has a corresponding first confidence value;

recognizing the audio command within the at least one second speech recognition engine, independent of recognizing the audio command by the first speech recognition engine, to generate at least one second recognized audio command, wherein the at least one second recognized audio command has a corresponding second confidence value;

wirelessly transmitting the at least one first recognized audio command to a comparator;

transmitting the at least one second recognized audio command to the comparator; and

selecting at least one recognized audio command having a recognized audio command confidence value from the at least one first recognized audio command and the at least one second recognized audio command based on the at least one first confidence value and the at least one second confidence value.

2. The method of claim 1 further comprising:

accessing an external content server in response to the at least one recognized audio command to retrieve encoded information therefrom.

3. The method of claim 2 further comprising:

receiving the encoded information from the content server; and

decoding the encoded information.

4. The method of claim 3 further comprising:

prior to selecting at least one recognized audio command, weighting the at least one first confidence value by a first weight factor and weighting the at least one second confidence values by a second weight factor.

5. The method of claim 3 further comprising:

prior to accessing the content server, executing at least one operation based on the at least one recognized audio command.

6. The method of claim 5 further comprising:

verifying The at least one recognized audio command.

7. The method of claim 1 further comprising:

generating an error notification when the at least one first confidence value and the at least one second confidence values are below a minimum confidence level.

8. A method for multi-level distributed speech recognition comprising:

providing an audio command to a terminal speech recognition engine;

wirelessly providing the audio command to at least one network speech recognition engine;

recognizing the audio command within the terminal speech recognition engine to generate at least one terminal recognized audio command, wherein the at least one terminal recognized audio command has a corresponding terminal confidence value;

recognizing the audio command within the at least one network speech recognition engine to generate at least one network recognized audio command, wherein the at least one network recognized audio command has a corresponding network confidence value;

wirelessly transmitting the at least one terminal recognized audio command to a comparator;

transmitting the at least one network recognized audio command to the comparator; and

selecting at least one recognized audio command having a recognized audio command confidence value from the at least one terminal recognized audio command and the at least one network recognized audio command;

inserting the at least one recognized audio command within a form; and

accessing an external content server in response to the at least one recognized audio command to retrieve encoded information therefrom.

9. The method of claim 8 further comprising:

prior to accessing a content server, generating an error notification when the at least one terminal confidence value and the at least one network confidence value are below a minimum confidence level.

10. The method of claim 8 further comprising:

prior to selecting the at least one recognized audio command, weighting the at least one terminal confidence value by a terminal weight factor and the at least one network confidence value by a network weight factor.

11. The method of claim 8 further comprising:

filtering the at least one recognized audio command based on the at least one recognized audio command confidence value; and

executing an operation based on the recognized audio command having the highest recognized audio command confidence value.

12. The method of claim 8 further comprising:

verifying the at least one recognized audio command to generate a verified recognized audio command; and

executing an operation based on the verified recognized audio command.

13. A system for multi-level distributed speech recognition between a terminal device and a network device comprising:

a terminal speech recognition engine operably coupled to a microphone and coupled to receive an audio command and generate at least one terminal recognized audio command, wherein the at least one terminal recognized audio command has a corresponding terminal confidence value;

at least one network speech recognition engine operably coupled to the microphone and coupled to receive the audio command across a wireless transmission from the terminal device to the network device and generate at least one network recognized audio command, independent of the terminal speech recognition engine, wherein the at least one network recognized audio command has a corresponding network confidence value;

a comparator disposed on the terminal device, operably coupled to the terminal speech recognition engine operative to receive the at least one terminal recognized audio command from a wireless transmission and further operably coupled to the at least one network speech recognition engine operably coupled to receive the at least one network recognized audio command; and

a dialog manager operably coupled to the comparator, wherein the comparator selects at least one recognized audio command having a recognized confidence value from the at least one terminal recognized audio command and the at least one network recognized audio command based on the at least one terminal confidence value and the at least one network confidence value, wherein the selected at least one recognized audio command is provided to the dialog manager.

14. The system of claim 13 further comprising:

a dialog manager audio command determined by the dialog manager from the at least one recognized audio commands based on the at least one recognized audio command confidence levels such that the dialog manager inserts the dialog manager command within a form; and

the dialog manager being operably coupleable to an external content server such that the operation executed by the dialog manager includes accessing the external content server to retrieve encoded information therefrom.

15. The system of claim 14 further comprising:

wherein the dialog manager retrieves the encoded information from the content server in response to the dialog manager audio command.

16. The system of claim 15 further comprising:

a speech synthesis engine operably coupled to the dialog manager, wherein the speech synthesis engine receives speech encoded information from the dialog manager and generates speech formatted information; and

a speaker operably coupled to the speech synthesis engine, wherein the speaker receives the speech formatted information and provides an output message.