System and method for mobile automatic speech recognition

• US 9,892,728 B2
• Filed: 03/16/2016
• Issued: 02/13/2018
• Est. Priority Date: 01/09/2004
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Parthasarathy, Sarangarajan, Rose, Richard Cameron
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US15/071,645
• Publication Number:
  US 20160196822A1
• Time in Patent Office: 699 Days
• Field of Search: 704270, 7042701, 704257, 704231, 704251, 704201, 704244, 704256, 704246, 704241, 379 8817, 379 8816, 379 8823, 379 8813, 379 8825, 379 671, 379 8818, 455563, 455418, 4555501, 455557, 4554141, 4555691, 455 6711, 4555562, 455527
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/007 characterised by the process used

Abstract

A system and method of updating automatic speech recognition parameters on a mobile device are disclosed. The method comprises storing user account-specific adaptation data associated with ASR on a computing device associated with a wireless network, generating new ASR adaptation parameters based on transmitted information from the mobile device when a communication channel between the computing device and the mobile device becomes available and transmitting the new ASR adaptation data to the mobile device when a communication channel between the computing device and the mobile device becomes available. The new ASR adaptation data on the mobile device more accurately recognizes user utterances.

Claims

1. A method comprising:

accessing, by a system including a processor, automatic speech recognition data associated with a speech recognition system, wherein the speech recognition system performs speech recognition using automatic speech recognition parameters based on the automatic speech recognition data; and

transmitting, by the system and to the speech recognition system, a set of automatic speech recognition adaptation parameters that enable updating the automatic speech recognition parameters of the speech recognition system, wherein the set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data.

2. The method of claim 1, wherein the set of automatic speech recognition parameters is further based on stored, user specific, adaptation data.

3. The method of claim 2, wherein the automatic speech recognition data comprises an environment of the speech recognition system or multi-modal input from a user associated with the speech recognition system.

4. The method of claim 1, wherein the automatic speech recognition data comprises an automatic speech recognition output from the speech recognition system.

5. The method of claim 1, wherein the automatic speech recognition data comprises audio data gathered by the speech recognition system during automatic speech recognition with a user.

6. The method of claim 1, further comprising normalizing the automatic speech recognition data using frequency warping.

7. The method of claim 6, wherein the frequency warping is performed by selecting a singular linear warping function using normalized automatic speech recognition data.

8. A system comprising:

at least one processor; and

at least one computer-readable storage medium having instructions stored which, when executed by the at least one processor, cause the at least one processor to perform operations comprising;

accessing automatic speech recognition data associated with a speech recognition system, wherein the speech recognition system performs speech recognition using automatic speech recognition parameters based on the automatic speech recognition data; and

transmitting, to the speech recognition system, a set of automatic speech recognition adaptation parameters that are utilized in updating the automatic speech recognition parameters of the speech recognition system, wherein the set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data.

9. The system of claim 8, wherein the set of automatic speech recognition parameters is further based on stored, user specific, adaptation data.

10. The system of claim 9, wherein the automatic speech recognition data comprises an environment of the speech recognition system or multi-modal input from a user associated with the speech recognition system.

11. The system of claim 8, wherein the automatic speech recognition data comprises an automatic speech recognition output from the speech recognition system.

12. The system of claim 8, wherein the automatic speech recognition data comprises audio data gathered by the speech recognition system during automatic speech recognition with a user.

13. The system of claim 8, wherein the operations further comprise normalizing the automatic speech recognition data using frequency warping.

14. The system of claim 13, wherein the frequency warping is performed by selecting a singular linear warping function using normalized automatic speech recognition data.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

accessing automatic speech recognition data associated with a speech recognition system, wherein the speech recognition system performs speech recognition using automatic speech recognition parameters based on the automatic speech recognition data; and

transmitting, to the speech recognition system, a set of automatic speech recognition adaptation parameters that facilitate updating the automatic speech recognition parameters of the speech recognition system, wherein the set of automatic speech recognition adaptation parameters is based on the automatic speech recognition data.

16. The computer-readable storage device of claim 15, wherein the set of automatic speech recognition parameters is further based on stored, user specific, adaptation data.

17. The computer-readable storage device of claim 16, wherein the automatic speech recognition data comprises an environment of the speech recognition system or multi-modal input from a user associated with the speech recognition system.

18. The computer-readable storage device of claim 15, wherein the automatic speech recognition data comprises an automatic speech recognition output from the speech recognition system.

19. The computer-readable storage device of claim 15, wherein the automatic speech recognition data comprises audio data gathered by the speech recognition system during automatic speech recognition with a user.

20. The computer-readable storage device of claim 15, wherein the operations further comprise normalizing the automatic speech recognition data using frequency warping.