System and method for mobile automatic speech recognition

• US 8,082,147 B2
• Filed: 10/08/2010
• Issued: 12/20/2011
• Est. Priority Date: 01/09/2004
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Parthasarathy, Sarangarajan, Rose, Richard Cameron
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US12/901,016
• Publication Number:
  US 20110029307A1
• Time in Patent Office: 438 Days
• Field of Search: 704/275, 704/233, 704/246, 704/231, 704/244, 704/238, 704/205, 704/270, 704/270.1, 704/251, 704/201, 455/563, 455/418, 455/414.1, 455/408, 455/409, 455/420, 455/432.3, 455/569.1, 455/569.2, 701/200, 701/207, 379 8801- 8804, 379/88.05, 379/88.17, 379/88.16, 379 8823- 8825
• US Class Current: 704/231
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/007 characterised by the process used

Abstract

A system and method of updating automatic speech recognition parameters on a mobile device are disclosed. The method comprises storing user account-specific adaptation data associated with ASR on a computing device associated with a wireless network, generating new ASR adaptation parameters based on transmitted information from the mobile device when a communication channel between the computing device and the mobile device becomes available and transmitting the new ASR adaptation data to the mobile device when a communication channel between the computing device and the mobile device becomes available. The new ASR adaptation data on the mobile device more accurately recognizes user utterances.

Claims

1. A method of processing speech, the method comprising:

deriving automatic speech recognition adaptation parameters on a first device based at least in part on automatic speech recognition data provided from a second device used for speech recognition; and

transmitting the automatic speech recognition adaptation parameters to the second device for use in recognizing speech on the second device.

2. The method of claim 1, wherein the automatic speech recognition adaptation parameters are further derived on the first device from stored user specific adaptation data.

3. The method of claim 1, wherein the second device is a mobile device.

4. The method of claim 1, wherein the automatic speech recognition data provided from the second device comprises at least one of:

an environment of the second device and multi-modal data associates with multi-modal input from the user.

5. The method of claim 1, wherein the automatic speech recognition data is an audio data gathered by the second device during automatic speech recognition with the user.

6. The method of claim 1, wherein the first device is remote from the second device.

7. A system for processing speech, the system comprising:

a processor;

a first module configured to control a processor to derive automatic speech recognition parameters on a first device based at least in part on automatic speech recognition data provided from a second device used for speech recognition; and

a second module configured to control the processor to transmit the automatic speech recognition adaptation parameters to the second device for use in recognizing speech on the second device.

8. The system of claim 7, wherein the automatic speech recognition adaptation parameters are further derived on the first device from stored user specific adaptation data.

9. The system of claim 7, wherein the second device is a mobile device.

10. The system of claim 7, wherein the automatic speech recognition data provided from the second device comprises at least one of:

an environment of the second device and multi-modal data associates with multi-modal input from the user.

11. The system of claim 7, wherein the automatic speech recognition data is an audio data gathered by the second device during automatic speech recognition with the user.

12. The system of claim 7, wherein the first device is remote from the second device.

13. A non-transitory computer-readable storage media storing instructions for processing speech, the instructions comprising:

deriving automatic speech recognition adaptation parameters on a first device based at least in part on automatic speech recognition data provided from a second device used for speech recognition; and

transmitting the automatic speech recognition adaptation parameters to the second device for use in recognizing speech on the second device.

14. The non-transitory computer-readable storage media of claim 13, wherein the automatic speech recognition adaptation parameters are further derived on the first device from stored user specific adaptation data.

15. The non-transitory computer-readable storage media of claim 13, wherein the second device is a mobile device.

16. The non-transitory computer-readable storage media of claim 13, wherein the automatic speech recognition data provided from the second device comprises at least one of:

an environment of the second device and multi-modal data associates with multi-modal input from the user.

17. The non-transitory computer-readable storage media of claim 13, wherein the automatic speech recognition data is an audio data gathered by the second device during automatic speech recognition with the user.

18. The non-transitory computer-readable media of claim 13, wherein the first device is remote from the second device.