System and method for mobile automatic speech recognition

• US 7,822,603 B1
• Filed: 05/05/2008
• Issued: 10/26/2010
• Est. Priority Date: 01/09/2004
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Parthasarathy, Sarangarajan, Rose, Richard Cameron
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US12/115,034
• Time in Patent Office: 904 Days
• Field of Search: 704270-275, 704/251, 704/231, 704/201, 379/88.17, 379/88.16, 379 8801- 8804, 379 8823- 8825
• US Class Current: 704/231
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/007 characterised by the process used

Abstract

A system and method of updating automatic speech recognition parameters on a mobile device are disclosed. The method comprises storing user account-specific adaptation data associated with ASR on a computing device associated with a wireless network, generating new ASR adaptation parameters based on transmitted information from the mobile device when a communication channel between the computing device and the mobile device becomes available and transmitting the new ASR adaptation data to the mobile device when a communication channel between the computing device and the mobile device becomes available. The new ASR adaptation data on the mobile device more accurately recognizes user utterances.

Claims

1. A method of performing automatic speech recognition on a device, the method comprising:

receiving speech from a user on the device; and

recognizing the received speech using automatic speech recognition adaptation parameters transmitted from a remote device, the automatic speech recognition adaptation parameters being derived at the remote device based at least in part on automatic speech recognition data provided from the device.

2. The method of claim 1, wherein the automatic speech recognition adaptation parameters are further derived from stored user specific adaptation data.

3. The method of claim 1, wherein the device is a mobile device.

4. The method of claim 1, wherein the automatic speech recognition data provided from the device comprises at least one of:

an environment of the device and multi-modal data associates with multi-modal input from the user.

5. The method of claim 1, wherein the automatic speech recognition data is an audio data gathered by the device during automatic speech recognition with the user.

6. A device of performing automatic speech recognition automatic speech recognition, the device comprising:

a processor;

a first module controlling the processor to received speech from a user of a device; and

a second module controlling the processor to recognize the received speech using automatic speech recognition adaptation parameters transmitted from a remote device, the automatic speech recognition adaptation parameters being derived at the remote device based at least in part on automatic speech recognition data provided from the device.

7. The device of claim 6, wherein the automatic speech recognition adaptation parameters are further derived from stored user specific adaptation data.

8. The device of claim 6, wherein the device is a mobile device.

9. The device of claim 6, wherein the automatic speech recognition data provided from the device comprises at least one of:

an environment of the device and multi-modal data associates with multi-modal input from the user.

10. The device of claim 6, wherein the automatic speech recognition data is an audio data gathered by the device during automatic speech recognition with the user.

11. A computer readable medium storing instruction for controlling a device to perform automatic speech recognition, the instruction comprising:

receiving, via a processor, speech from a user on a device; and

recognizing, via a processor, the received speech using automatic speech recognition adaptation parameters transmitted from a remote device, the automatic speech recognition adaptation parameters being derived at the remote device based at least in part on automatic speech recognition data provided from the device.

12. The computer readable medium of claim 11, wherein the automatic speech recognition adaptation parameters are further derived from stored user specific adaptation data.

13. The computer readable medium of claim 11, wherein the device is a mobile device.

14. The computer readable medium of claim 11, wherein the automatic speech recognition data provided from the device comprises at least one of:

an environment of the device and multi-modal data associates with multi-modal input from the user.

15. The computer readable medium of claim 11, wherein the automatic speech recognition data is an audio data gathered by the device during ASR with the user.