System and method for mobile automatic speech recognition

• US 8,296,138 B2
• Filed: 11/22/2011
• Issued: 10/23/2012
• Est. Priority Date: 01/09/2004
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Parthasarathy, Sarangarajan, Rose, Richard Cameron
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/302,352
• Publication Number:
  US 20120072212A1
• Time in Patent Office: 336 Days
• Field of Search: 704/275, 704/233, 704/246, 704/231, 704/244, 704/238, 704/205, 704/270, 704/270.1, 704/251, 704/201, 455/563, 455/418, 455/414.1, 455/408, 455/409, 455/420, 455/432.3, 455/569.1, 455/569.2, 701/200, 701/207, 379/88.05, 379/88.17, 379/88.16, 379 8801- 8804, 379 8823- 8825
• US Class Current: 704/231
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/007 characterised by the process used

Abstract

A system and method of updating automatic speech recognition parameters on a mobile device are disclosed. The method comprises storing user account-specific adaptation data associated with ASR on a computing device associated with a wireless network, generating new ASR adaptation parameters based on transmitted information from the mobile device when a communication channel between the computing device and the mobile device becomes available and transmitting the new ASR adaptation data to the mobile device when a communication channel between the computing device and the mobile device becomes available. The new ASR adaptation data on the mobile device more accurately recognizes user utterances.

Claims

1. A method comprising:

receiving, at a first device, automatic speech recognition data from a second device used for speech recognition, wherein the automatic speech recognition data comprises information associated with at least one of a speaker, an environment, an utterance, and a transducer;

analyzing the automatic speech recognition data to yield automatic speech recognition adaptation parameters; and

transmitting the automatic speech recognition adaptation parameters to the second device for use in recognizing speech on the second device.

2. The method of claim 1, wherein the second device is a mobile device.

3. The method of claim 1, wherein the automatic speech recognition data comprises at least one of:

a representation of an environment of the second device and multi-modal data associated with a multi-modal input from a user.

4. The method of claim 1, wherein the automatic speech recognition data comprises an automatic speech recognition output from the second device.

5. The method of claim 1, wherein the first device is remote from the second device.

6. The method of claim 1, wherein the automatic speech recognition adaptation parameters are based on the automatic speech recognition data and stored user specific adaptation data.

7. The method of claim 1, wherein the automatic speech recognition data comprises audio data gathered by the second device during automatic speech recognition with a user.

8. A system comprising:

a processor; and

a memory storing instructions for controlling the processor to perform steps comprising;

receiving, at a first device, automatic speech recognition data from a second device used for speech recognition, wherein the automatic speech recognition data comprises information associated with at least one of a speaker, an environment, an utterance, and a transducer;

analyzing the automatic speech recognition data to yield automatic speech recognition adaptation parameters; and

transmitting the automatic speech recognition adaptation parameters to the second device for use in recognizing speech on the second device.

9. The system of claim 8, wherein the automatic speech recognition data comprises at least one of:

a representation of an environment of the second device and multi-modal data associated with a multi-modal input from a user.

10. The system of claim 8, wherein the first device is remote from the second device.

11. The system of claim 8, wherein the second device is a mobile device.

12. The system of claim 8, wherein the automatic speech recognition data comprises an automatic speech recognition output from the second device.

13. The system of claim 8, wherein the automatic speech recognition adaptation parameters are based on the automatic speech recognition data and stored user specific adaptation data.

14. The system of claim 8, wherein the automatic speech recognition data comprises audio data gathered by the second device during automatic speech recognition with a user.

15. A non-transitory computer-readable storage medium storing instructions which, when executed by a computing device, cause the computing device to perform steps comprising:

receiving, at a first device, automatic speech recognition data from a second device used for speech recognition, wherein the automatic speech recognition data comprises a representation of at least one of a speaker, an environment, an utterance, and a transducer;

analyzing the automatic speech recognition data to yield automatic speech recognition adaptation parameters; and

transmitting the automatic speech recognition adaptation parameters to the second device for use in recognizing speech on the second device.

16. The non-transitory computer-readable storage medium of claim 15, wherein the automatic speech recognition data comprises at least one of:

a representation of an environment of the second device and multi-modal data associated with a multi-modal input from a user.

17. The non-transitory computer-readable storage medium of claim 15, wherein the first device is remote from the second device.

18. The non-transitory computer-readable storage medium of claim 15, wherein the second device is a mobile device.

19. The non-transitory computer-readable storage medium of claim 15, wherein the automatic speech recognition data comprises an automatic speech recognition output from the second device.

20. The non-transitory computer-readable storage medium of claim 15, wherein the automatic speech recognition adaptation parameters are based on the automatic speech recognition data and stored user specific adaptation data.