USING SPEECH RECOGNITION RESULTS BASED ON AN UNSTRUCTURED LANGUAGE MODEL IN A MOBILE COMMUNICATION FACILITY APPLICATION

• US 20090030684A1
• Filed: 08/01/2008
• Published: 01/29/2009
• Est. Priority Date: 03/07/2007
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Vlingo Corporation (Microsoft Corporation)
• Inventors: Phillips, Michael S., Nguyen, John N., Shu, Han, Mischke, Alexandra Beth, Cerra, Joseph P.
• Granted Patent: US 8,886,540 B2
• Time in Patent Office: Days
• US Class Current: 704/236
• CPC Class Codes: G10L 15/16 using artificial neural networks
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A method and system for entering information into a software application resident on a mobile communication facility is provided. The method and system may include recording speech presented by a user using a mobile communication facility resident capture facility, transmitting the recording through a wireless communication facility to a speech recognition facility, transmitting information relating to the software application to the speech recognition facility, generating results utilizing the speech recognition facility using an unstructured language model based at least in part on the information relating to the software application and the recording, transmitting the results to the mobile communications facility, loading the results into the software application and simultaneously displaying the results as a set of words and as a set of application results based on those words.

Claims

1. A method of entering information into a software application resident on a mobile communication facility comprising:

recording speech presented by a user using a mobile communication facility resident capture facility;

transmitting the recording through a wireless communication facility to a speech recognition facility;

transmitting information relating to the software application to the speech recognition facility;

generating results utilizing the speech recognition facility using an unstructured language model based at least in part on the information relating to the software application and the recording;

transmitting the results to the mobile communications facility;

loading the results into the software application; and

simultaneously displaying the results as a set of words and as a set of application results based on those words.

2. The method of claim 1, further comprising the step of allowing the user to alter the set of words.

3. The method of claim 2, further comprising the step of updating the application results based on the altered set of words.

14. The method of claim 1, further comprising using user feedback to adapt the unstructured language model.

15. The method of claim 1, further comprising selecting the language model based on the nature of the application.

4-13. -13. (canceled)

16. A method of entering information into a software application resident on a device comprising:

recording speech presented by a user using a device-resident capture facility;

transmitting the recording through a wireless communication facility to a speech recognition facility;

transmitting information relating to the software application to the speech recognition facility;

generating results utilizing the speech recognition facility using an unstructured language model based at least in part on the information relating to the software application and the recording;

transmitting the results to the device;

loading the results into the software application; and

simultaneously displaying the results as a set of words and as a set of application results based on those words.

17. The method of claim 16, further comprising the step of allowing the user to alter the set of words.

18. The method of claim 17, further comprising the step of updating the application results based on the altered set of words.

19. The method of claim 17, wherein the updating of application results is performed in response to a user action.

20. The method of claim 17, wherein the updating of application results is performed automatically.

21. The method of claim 20, wherein the automatic update is performed after a predefined amount of time after the user alters the set of words.

22. The method of claim 16, wherein the application is an application which is searching for information or content based on the set of words.

29. The method of claim 16, further comprising using user feedback to adapt the unstructured language model.

30. The method of claim 16, further comprising selecting the language model based on the nature of the application.

23-28. -28. (canceled)

31-36. -36. (canceled)

37. A system of entering information into a software application resident on a device comprising:

a device-resident capture facility for recording speech presented by a user;

a wireless communication facility for transmitting the recording and information relating to the software application to a speech recognition facility;

the speech recognition facility for generating results using an unstructured language model based at least in part on the information relating to the software application and the recording;

the wireless communication facility, further for transmitting the results to the device;

the software application for receiving the results; and

a device display for simultaneously displaying the results as a set of words and as a set of application results based on those words.

38. The system of claim 37, further comprising the step of allowing the user to alter the set of words, and further comprising an updating facility for updating the application results based on the altered set of words.

39. The system of claim 38, wherein the updating of application results is performed in response to a user action.

40. The system of claim 37, wherein the application is an application which is searching for information or content based on the set of words.

41. The system of claim 40, wherein the application result is a set of relevant search matches for the set of words.

42. The system of claim 37, further comprising a selecting facility for selecting the language model based on the nature of the application.