ADAPTING AN UNSTRUCTURED LANGUAGE MODEL SPEECH RECOGNITION SYSTEM BASED ON USAGE

• US 20090030687A1
• Filed: 08/01/2008
• Published: 01/29/2009
• Est. Priority Date: 03/07/2007
• Status: Abandoned Application

• Current Assignee: Vlingo Corporation (Microsoft Corporation)
• Original Assignee: Vlingo Corporation (Microsoft Corporation)
• Inventors: Mischke, Alexandra Beth, Micali, Christopher Michael, Phillips, Michael S., Nguyen, John N., Shu, Han, Cerra, Joseph P.
• Application Number:
  US12/184,282
• Publication Number:
  US 20090030687A1
• Time in Patent Office: Days
• US Class Current: 704/243
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

A user may control a mobile communication facility through recognized speech provided to the mobile communication facility. Speech that is recorded by a user using a mobile communication facility resident capture facility is transmitted through a wireless communication facility to a speech recognition facility. The speech recognition facility generates results using an unstructured language model based at least in part on information relating to the recording. The results are transmitted to the mobile communications facility where an action is performed on the mobile communication facility based on the results and adapting the speech recognition facility based on usage.

Claims

1. A method of allowing a user to control a mobile communication facility comprising:

recording speech presented by a user using a mobile communication facility resident capture facility;

transmitting the recording through a wireless communication facility to a speech recognition facility;

generating results utilizing the speech recognition facility using an unstructured language model based at least in part on the information relating to the recording;

transmitting the results to the mobile communications facility;

performing an action on the mobile communications facility based on the results; and

adapting the speech recognition facility based on usage.

2. The method of claim 1, wherein the performing an action includes at least one of;

placing a phone call, answering a phone call, entering text, sending a text message, sending an email message, starting an application resident on the mobile communication facility, providing an input to an application resident on the mobile communication facility, changing an option on the mobile communication facility, setting an option on the mobile communication facility, adjusting a setting on the mobile communication facility, interacting with content on the mobile communication facility, and searching for content on the mobile communication facility.

3. The method of claim 1, wherein the performing an action on the mobile communication facility based on results includes providing the words the user spoke to an application which will perform the action.

4. The method of claim 3, wherein the user is given the opportunity to alter the words provided to the application.

5. The method of claim 3, wherein the user is given the opportunity to alter the action to be performed based on the results.

9. The method of claim 3, wherein the user is given the opportunity to alter the application to which the words will be provided.

13. The method of claim 1, wherein the speech recognition facility selects at least one language model based at least in part on the information relating to an application.

14. The method of claim 13, wherein the at least one selected language model is at least one of a general language model for messages, a general language model for names, a general language model for phone numbers, a general language model for email addresses, a language model for the user'"'"'s address book or contact list, a language model for phone commands, and a language model for likely messages from the user.

15. The method of claim 13, wherein the at least one selected language model is based on the usage history of the user.

6-8. -8. (canceled)

10-12. -12. (canceled)

16. A system comprising:

a mobile communication device capable of recording speech and running a resident software module;

a speech recognition facility remote from a mobile communication facility;

a communications facility for transmitting recorded speech and information relating to the software module to the speech recognition facility;

wherein the speech recognition facility generates results by processing the recorded speech using an unstructured language model and based at least in part on the information related to recording.

17. A system of allowing a user to control a mobile communication facility comprising:

a mobile communication facility resident capture facility for recording speech presented by a user;

a wireless communication facility for transmitting the recording to a speech recognition facility;

the speech recognition facility for generating results using an unstructured language model based at least in part on the information relating to the recording;

the wireless communication facility further for transmitting the results to the mobile communications facility;

an action performed on the mobile communications facility based on the results; and

an adapting facility for adapting the speech recognition facility based on usage.

18. The system of claim 17, wherein the action performed includes at least one of, placing a phone call, answering a phone call, entering text, sending a text message, sending an email message, starting an application resident on the mobile communication facility, providing an input to an application resident on the mobile communication facility, changing an option on the mobile communication facility, setting an option on the mobile communication facility, adjusting a setting on the mobile communication facility, interacting with content on the mobile communication facility, and searching for content on the mobile communication facility.

19. The system of claim 17, wherein an action performed on the mobile communication facility based on results includes providing the words the user spoke to an application which will perform the action.

20. The system of claim 19, wherein the user is given the opportunity to alter the words provided to the application.

21. The system of claim 19, wherein the user is given the opportunity to alter the action to be performed based on the results.

25. The system of claim 19, wherein the user is given the opportunity to alter the application to which the words will be provided.

26. The system of claim 17, wherein the wireless communication facility further facilitates transmitting information relating to at least one of content and applications resident on the mobile communication facility to the speech recognition facility and the speech recognition facility further generates the results based at least in part on this information.

27. The system of claim 26, wherein the transmitted information includes at least one of an identity of the currently active application, an identity of an application resident on the mobile communication facility, an identity of a text box within an application, contextual information within an application, an identity of content resident on the mobile communication facility, an identity of the mobile communication facility, and an identity of the user.

28. The system of claim 27, wherein contextual information includes at least one of the usage history of at least one application on the mobile communication facility, information from a user'"'"'s favorites list, information about the user'"'"'s address book or contact list, content of the user'"'"'s inbox, content of the user'"'"'s outbox, the user'"'"'s location, and information currently displayed in an application.

29. The system of claim 26, wherein the speech recognition facility selects at least one language model based at least in part on the information relating to an application.

22-24. -24. (canceled)

30-31. -31. (canceled)