Dealing with switch latency in speech recognition

• US 8,886,545 B2
• Filed: 01/21/2010
• Issued: 11/11/2014
• Est. Priority Date: 03/07/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Vlingo Corporation (Microsoft Corporation)
• Inventors: Meisel, William S., Phillips, Michael S., Nguyen, John N.
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US12/691,504
• Publication Number:
  US 20100185448A1
• Time in Patent Office: 1,755 Days
• Field of Search: 704/270, 704/275
• US Class Current: 704/275
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

In embodiments of the present invention improved capabilities are described for interacting with a mobile communication facility comprising receiving a switch activation from a user to initiate a speech recognition recording session, wherein the speech recognition recording session comprises a voice command from the user followed by the speech to be recognized from the user; recording the speech recognition recording session using a mobile communication facility resident capture facility; recognizing at least a portion of the voice command as an indication that user speech for recognition will begin following the end of the at least a portion of the voice command; recognizing the recorded speech using a speech recognition facility to produce an external output; and using the selected output to perform a function on the mobile communication facility.

Claims

1. A method of interacting with a mobile communication facility comprising:

receiving a switch activation from a user to initiate a speech recognition recording session, wherein the speech recognition recording session comprises a voice command from the user followed by the speech to be recognized from the user, wherein the voice command is an application name;

recording the speech recognition recording session using a mobile communication facility resident capture facility;

storing a dictionary representation including multiple partial pronunciations of the application name at one or more of the mobile communication facility and a speech recognition facility;

determining that a first portion of the application name was clipped as a result of the user providing the command before the mobile communication facility resident capture facility was ready to receive;

recognizing a second portion of the application name as an indication that user speech for recognition will begin following the end of the second portion of the application name, wherein recognizing the second portion of the application name is through analysis of the dictionary representation, wherein the second portion of the application name is a portion of the application name that was not clipped off during the speech recognition recording session wherein recognizing the second portion of the application name is performed internal to the mobile communication facility;

recognizing the recorded speech using a speech recognition facility to produce an external output wherein recognizing the recorded speech is performed external to the mobile communications facility; and

using the selected output to perform a function on the mobile communication facility.

2. The method of claim 1, wherein the voice command is a single word.

3. The method of claim 1, wherein the voice command is multiple words.

4. The method of claim 1, wherein the switch is a physical switch on the mobile communication facility.

5. The method of claim 1, wherein the switch is a virtual switch displayed on the mobile communications facility.

6. The method of claim 1, wherein the voice command is pre-defined.

7. The method of claim 1, wherein the voice command is user selectable.

8. The method of claim 7, wherein the user inputs the voice command by voice input.

9. The method of claim 7, wherein the user inputs the voice command by typing.

10. The method of claim 1, wherein the voice command is verified by characteristics of the user'"'"'s voice.

11. The method of claim 1, wherein the at least a portion of the voice command is a portion of the command that was not clipped off during the speech recognition recording session as a result of user providing the command before the mobile communication facility resident capture facility was ready to receive.

12. The method of claim 1, wherein the recognizing at least a portion of the voice command is through language modeling.

13. The method of claim 12, wherein the language modeling involves collecting examples of portions of the voice command as spoken by a plurality of users.

14. The method of claim 1, wherein the recognizing at least a portion of the voice command is through acoustic modeling.

15. The method of claim 14, wherein the acoustic modeling creates a statistical model that can be used in Hidden Markov Model processing to fit a sound of the at least a portion of the voice command.

16. The method of claim 15, wherein the at least a portion of the voice command is an individual sound.

17. The method of claim 15, wherein the at least a portion of the voice command is a plurality of sounds.

18. The method of claim 14, wherein the acoustic modeling involves collecting examples of sounds for the voice command as spoken by a plurality of users.

19. The method of claim 1, wherein the speech recognition facility is internal to the mobile communication facility.

20. The method of claim 1, wherein the speech recognition facility is external to the mobile communication facility.

21. The method of claim 1, wherein the recognizing at least a portion of the voice command is performed internal to the mobile communication facility, and recognizing the recorded speech is performed external to the mobile communications facility.

22. A method of interacting with a mobile communication facility comprising:

receiving a switch activation from a user to initiate a speech recognition recording session, wherein the speech recognition recording session comprises a voice command from the user followed by the speech to be recognized from the user, wherein the voice command is an application name;

recording the speech recognition recording session using a mobile communication facility resident capture facility;

recognizing the voice command as an indication that user speech for recognition will begin following the end of the voice command;

storing a dictionary representation including multiple partial pronunciations of the voice command at one or more of the mobile communication facility and a speech recognition facility;

determining that a first portion of the application name was clipped as a result of the user providing the command before the mobile communication facility resident capture facility was ready to receive;

analyzing clipping associated with the application name, based upon, at least in part, an analysis of the dictionary representation of a second portion of the application name, wherein the second portion of the application name is a portion of the application name that was not clipped off during the speech recognition recording session wherein recognizing the second portion of the application name is performed internal to the mobile communication facility;

recognizing the recorded speech using a speech recognition facility to produce an external output wherein recognizing the recorded speech is performed external to the mobile communications facility; and

using the selected output to perform a function on the mobile communication facility.