System and Method for Mobile Automatic Speech Recognition

• US 20130117023A1
• Filed: 10/22/2012
• Published: 05/09/2013
• Est. Priority Date: 01/09/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Parthasarathy, Sarangarajan, Rose, Richard Cameron
• Granted Patent: US 8,688,444 B2
• Time in Patent Office: Days
• US Class Current: 704/244
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/007 characterised by the process used

Abstract

A system and method of updating automatic speech recognition parameters on a mobile device are disclosed. The method comprises storing user account-specific adaptation data associated with ASR on a computing device associated with a wireless network, generating new ASR adaptation parameters based on transmitted information from the mobile device when a communication channel between the computing device and the mobile device becomes available and transmitting the new ASR adaptation data to the mobile device when a communication channel between the computing device and the mobile device becomes available. The new ASR adaptation data on the mobile device more accurately recognizes user utterances.

Claims

1. A method comprising:

transmitting automatic speech recognition data from a first device used for speech recognition to a second device;

receiving, at the first device, a first set of automatic speech recognition adaptation parameters from the second device, wherein the first set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data; and

using the first set of automatic speech recognition adaptation parameters to update a second set of automatic speech recognition adaptation parameters on the first device.

2. The method of claim 1, wherein the first set of automatic speech recognition adaptation parameters is also based on stored user specific adaptation data.

3. The method of claim 1, wherein the automatic speech recognition data comprises at least one of:

an environment of the first device and multi-modal data associated with a multi-modal input from a user.

4. The method of claim 1, wherein the first device is remote from the second device.

5. The method of claim 1, wherein the automatic speech recognition data comprises an automatic speech recognition output from the first device.

6. The method of claim 1, wherein the first device is a mobile device.

7. The method of claim 1, wherein the automatic speech recognition data comprises audio data gathered by the first device during automatic speech recognition with a user.

8. A system comprising:

a processor; and

a computer-readable storage medium storing instructions for controlling the processor to perform a method comprising;

transmitting automatic speech recognition to a second device;

receiving a first set of automatic speech recognition adaptation parameters from the second device, wherein the first set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data; and

using the first set of automatic speech recognition adaptation parameters to update a second set of automatic speech recognition adaptation parameters.

9. The system of claim 8, wherein the system is a mobile device.

10. The system of claim 8, wherein the first set of automatic speech recognition adaptation parameters is also based on stored user specific adaptation data.

11. The system of claim 8, wherein the automatic speech recognition data comprises at least one of:

an environment of the system and multi-modal data associated with a multi-modal input from a user.

12. The system of claim 8, wherein the system is remote from the second device.

13. The system of claim 8, wherein the automatic speech recognition data comprises an automatic speech recognition output from the system.

14. The system of claim 8, wherein the automatic speech recognition data comprises audio data gathered by the system during automatic speech recognition with a user.

15. A computer-readable storage medium storing instructions which, when executed by a computing device, cause the computing device to perform a method comprising:

transmitting automatic speech recognition to a second device;

receiving a first set of automatic speech recognition adaptation parameters from the second device, wherein the first set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data; and

using the first set of automatic speech recognition adaptation parameters to update a second set of automatic speech recognition adaptation parameters.

16. The computer-readable storage medium of claim 15, wherein the first set of automatic speech recognition adaptation parameters is also based on stored user specific adaptation data.

17. The computer-readable storage medium of claim 15, wherein the computing device is remote from the second device.

18. The computer-readable storage medium of claim 15, wherein the automatic speech recognition data comprises at least one of:

an environment of the computing device and multi-modal data associated with a multi-modal input from a user.

19. The computer-readable storage medium of claim 15, wherein the computing device is a mobile device.

20. The computer-readable storage medium of claim 15, wherein the automatic speech recognition data comprises an automatic speech recognition output.