System and method for mobile automatic speech recognition

• US 8,688,444 B2
• Filed: 10/22/2012
• Issued: 04/01/2014
• Est. Priority Date: 01/09/2004
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Parthasarathy, Sarangarajan, Rose, Richard Cameron
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/657,090
• Publication Number:
  US 20130117023A1
• Time in Patent Office: 526 Days
• Field of Search: 704/275, 704/233, 704/246, 704/231, 704/244, 704/238, 704/205, 704/270, 704/270.1, 704/251, 704/201, 455/563, 455/418, 455/414.1, 455/408, 455/409, 455/420, 455/432.3, 455/569.1, 455/569.2, 701/200, 701/207, 379/88.05, 379/88.17, 379/88.16, 379 8801- 8804, 379 8823- 8825
• US Class Current: 704/231
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/007 characterised by the process used

Abstract

A system and method of updating automatic speech recognition parameters on a mobile device are disclosed. The method comprises storing user account-specific adaptation data associated with ASR on a computing device associated with a wireless network, generating new ASR adaptation parameters based on transmitted information from the mobile device when a communication channel between the computing device and the mobile device becomes available and transmitting the new ASR adaptation data to the mobile device when a communication channel between the computing device and the mobile device becomes available. The new ASR adaptation data on the mobile device more accurately recognizes user utterances.

Claims

1. A method comprising:

transmitting automatic speech recognition data from a first device to a second device, wherein the first device performs speech recognition using automatic speech recognition parameters based on the automatic speech recognition data;

receiving, at the first device, a new set of automatic speech recognition adaptation parameters from the second device, wherein the new set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data; and

using the new set of automatic speech recognition adaptation parameters to update the automatic speech recognition adaptation parameters on the first device.

2. The method of claim 1, wherein the new set of automatic speech recognition adaptation parameters is also based on stored user specific adaptation data.

3. The method of claim 1, wherein the automatic speech recognition data comprises one of:

an environment of the first device and multi-modal data associated with a multi-modal input from a user.

4. The method of claim 1, wherein the first device is remote from the second device.

5. The method of claim 1, wherein the automatic speech recognition data comprises an automatic speech recognition output from the first device.

6. The method of claim 1, wherein the first device is a mobile device.

7. The method of claim 1, wherein the automatic speech recognition data comprises audio data gathered by the first device during automatic speech recognition with a user.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored for controlling the processor to perform operations comprising;

transmitting automatic speech recognition data from a first device to a second device, wherein the first device performs speech recognition using automatic speech recognition parameters based on the automatic speech recognition data;

receiving, at the first device, a new set of automatic speech recognition adaptation parameters from the second device, wherein the new set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data; and

using the new set of automatic speech recognition adaptation parameters to update the automatic speech recognition adaptation parameters on the first device.

9. The system of claim 8, wherein the system is a mobile device.

10. The system of claim 8, wherein the new set of automatic speech recognition adaptation parameters is also based on stored user specific adaptation data.

11. The system of claim 8, wherein the automatic speech recognition data comprises one of:

an environment of the system and multi-modal data associated with a multi-modal input from a user.

12. The system of claim 8, wherein the system is remote from the second device.

13. The system of claim 8, wherein the automatic speech recognition data comprises an automatic speech recognition output from the system.

14. The system of claim 8, wherein the automatic speech recognition data comprises audio data gathered by the system during automatic speech recognition with a user.

15. A computer-readable storage medium having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

transmitting automatic speech recognition data from a first device to a second device, wherein the first device performs speech recognition using automatic speech recognition parameters based on the automatic speech recognition data;

receiving, at the first device, a new set of automatic speech recognition adaptation parameters from the second device, wherein the new set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data; and

using the new set of automatic speech recognition adaptation parameters to update the automatic speech recognition adaptation parameters on the first device.

16. The computer-readable storage medium of claim 15, wherein the new set of automatic speech recognition adaptation parameters is also based on stored user specific adaptation data.

17. The computer-readable storage medium of claim 15, wherein the computing device is remote from the second device.

18. The computer-readable storage medium of claim 15, wherein the automatic speech recognition data comprises one of:

an environment of the computing device and multi-modal data associated with a multi-modal input from a user.

19. The computer-readable storage medium of claim 15, wherein the computing device is a mobile device.

20. The computer-readable storage medium of claim 15, wherein the automatic speech recognition data comprises an automatic speech recognition output.