INTERNAL AND EXTERNAL SPEECH RECOGNITION USE WITH A MOBILE COMMUNICATION FACILITY

• US 20100106497A1
• Filed: 10/21/2009
• Published: 04/29/2010
• Est. Priority Date: 03/07/2007
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Vlingo Corporation (Microsoft Corporation)
• Inventors: Phillips, Michael S.
• Granted Patent: US 8,949,130 B2
• Time in Patent Office: Days
• US Class Current: 704/231
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context

Abstract

In embodiments of the present invention improved capabilities are described for a user interacting with a mobile communication facility, where speech presented by the user is recorded using a mobile communication facility resident capture facility. The recorded speech may be recognized using an external speech recognition facility to produce an external output and a resident speech recognition facility to produce an internal output, where at least one of the external output and the internal output may be selected based on a criteria.

Claims

1. A method of interacting with a mobile communication facility comprising:

recording, at a mobile communication facility resident capture facility, speech of a user;

recognizing the speech, at an external speech recognition facility, to produce an external output;

recognizing the speech, at a resident speech recognition facility, to produce an internal output;

selecting, based on a criteria, a selected output that includes at least one of the external output and the internal output; and

using the selected output to perform a function on the mobile communication facility.

2. The method of claim 1 wherein the criteria is a confidence score.

3. The method of claim 1 wherein the criteria is based on an amount of time to receive the external output.

4. The method of claim 1, wherein the internal output is selected based on the criteria.

5. The method of claim 4, wherein the recognizing the speech using the external speech recognition facility is aborted when the internal output is selected.

6. The method of claim 4, wherein the resident speech recognition facility is constrained by a grammar and the external speech recognition facility is not constrained by the grammar.

7. The method of claim 4, wherein the criteria is based in part on information from the resident speech recognition facility.

8. The method of claim 7, wherein the information from the resident speech recognition facility includes a score which indicates a confidence that results provided by the resident speech recognition facility correctly represents the speech.

9. The method of claim 4, wherein the resident speech recognition facility is adapted based on information about the user.

10. The method of claim 9, where the information about the user includes a usage history of the user.

11. The method of claim 9, wherein this adaptation is performed externally.

12. The method of claim 9, wherein this adaptation is performed on the mobile communication facility.

13. The method of claim 4, wherein selecting the selected output is based in part on an amount of time taken by the external speech recognition facility and on information from the resident speech recognition facility, when the selected output includes the internal output.

14. The method of claim 13, wherein the resident speech recognition facility is constrained by a grammar and the external speech recognition facility is not constrained by the grammar.

15. The method of claim 13, wherein the resident speech recognition facility is adapted based on information about the user.

16. The method of claim 15, where the information about the user includes a usage history of the user.

17. The method of claim 15, wherein this adaptation is performed externally.

18. The method of claim 15, wherein this adaptation is performed on the mobile communication facility.

19. The method of claim 1, wherein the resident speech recognition facility is adapted based on information about the user.

20. The method of claim 19, where the information about the user includes a usage history of the user.

21. The method of claim 19, wherein this adaptation is performed externally.

22. The method of claim 19, wherein this adaptation is performed on the mobile communication facility.

23. A method of interacting with a mobile communication facility comprising:

recording, at a mobile communication facility resident capture facility, speech of a user;

communicating the speech to an external speech recognition facility to produce an external output;

recognizing the speech, at a resident speech recognition facility, to produce an internal output;

selecting the external output based on the timely receiving of the external output at the mobile communication facility; and

using the external output to perform a function on the mobile communication facility.

24. A system for interacting with a mobile communication facility comprising:

a mobile communication facility resident capture facility for recording speech of a user;

an external speech recognition facility for recognizing the speech to produce an external output;

a resident speech recognition facility for recognizing the speech to produce an internal output; and

a resident selecting facility to select a selected output that includes at least one of the external output and the internal output based on a criteria, wherein the selected output by the resident selecting facility performs a function on the mobile communication facility.

25. The system of claim 24, wherein the internal output is selected based on the criteria.

26. The system of claim 25, wherein the internal output is selected based in part on an amount of time taken by the external speech recognition facility.

27. The system of claim 26, wherein a first amount of time taken by the external speech recognition facility is greater than a second amount of time for the resident speech recognition facility because the resident speech recognition facility is constrained by a grammar and the external speech recognition facility is not constrained by the grammar.

28. The system of claim 25, wherein selecting the selected output is based in part on an amount of time taken by the external speech recognition facility and on information from the resident speech recognition facility, when the selected output includes the internal output.