Dealing with switch latency in speech recognition

• US 9,495,956 B2
• Filed: 11/10/2014
• Issued: 11/15/2016
• Est. Priority Date: 03/07/2007
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Meisel, William S., Phillips, Michael S., Nguyen, John N.
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US14/537,418
• Publication Number:
  US 20150073802A1
• Time in Patent Office: 736 Days
• Field of Search: 704/270, 704/275
• US Class Current: 1/1
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

In embodiments of the present disclosure, capabilities are described for interacting with a mobile communication facility, which may include receiving a switch activation from a user to initiate a speech recognition recording session, recording the speech recognition recording session using a mobile communication facility resident capture facility, recognizing a portion of the voice command as an indication that user speech for recognition will begin following the end of the portion of the voice command, recognizing the recorded speech using a speech recognition facility to produce an external output, and using the selected output to perform a function on the mobile communication facility. The speech recognition recording session may include a voice command from the user followed by the speech to be recognized from the user.

Claims

1. A method of interacting with a mobile communication facility comprising:

generating a plurality of clipped versions of a voice command, wherein the plurality of the clipped versions of the voice command is simulated from a complete voice command;

receiving a switch activation from a user to initiate a speech recognition recording session, wherein the speech recognition recording session comprises the voice command from the user followed by speech to be recognized from the user;

recording the speech recognition recording session using a mobile communication facility resident capture facility;

detecting a first portion of the voice command as clipped and a second portion of the voice command as a portion of the command that was not clipped off during the speech recognition recording session, wherein the first portion is determined as being clipped as a result of the user providing the command before the mobile communication facility resident capture facility was ready to receive is based in part on the plurality of clipped versions of the voice command;

recognizing the first portion of the voice command as an indication that user speech for recognition will begin following the end of the first portion of the voice command;

recognizing the recorded speech in the second portion of the voice command using a speech recognition facility to produce an external output; and

using the selected output to perform a function on the mobile communication facility.

2. The method of claim 1, wherein the voice command is a single word.

3. The method of claim 1, wherein the voice command is multiple words.

4. The method of claim 1, wherein the switch is a physical switch on the mobile communication facility.

5. The method of claim 1, wherein the switch is a virtual switch displayed on the mobile communications facility.

6. The method of claim 1, wherein the voice command is pre-defined.

7. The method of claim 1, wherein the voice command is an application name.

8. The method of claim 1, wherein the voice command is user selectable.

9. The method of claim 8, wherein the user inputs the voice command by voice input.

10. The method of claim 8, wherein the user inputs the voice command by typing.

11. The method of claim 1, wherein the voice command is verified by characteristics of the user'"'"'s voice.

12. The method of claim 1, wherein the at least a portion of the voice command is a portion of the command that was not clipped off during the speech recognition recording session as a result of user providing the command before the mobile communication facility resident capture facility was ready to receive.

13. The method of claim 1, wherein the recognizing at least a portion of the voice command is through language modeling.

14. The method of claim 13, wherein the language modeling involves collecting examples of portions of the voice command as spoken by a plurality of users.

15. The method of claim 1, wherein the recognizing at least a portion of the voice command is through dictionary representation.

16. The method of claim 1, wherein the recognizing at least a portion of the voice command is through acoustic modeling.

17. The method of claim 16, wherein the acoustic modeling creates a statistical model that can be used in Hidden Markov Model processing to fit a sound of the at least a portion of the voice command.

18. The method of claim 17, wherein the at least a portion of the voice command is an individual sound.

19. The method of claim 17, wherein the at least a portion of the voice command is a plurality of sounds.

20. The method of claim 16, wherein the acoustic modeling involves collecting examples of sounds for the voice command as spoken by a plurality of users.

21. The method of claim 1, wherein the speech recognition facility is internal to the mobile communication facility.

22. The method of claim 1, wherein the speech recognition facility is external to the mobile communication facility.

23. The method of claim 1, wherein the recognizing at least a portion of the voice command is performed internal to the mobile communication facility, and recognizing the recorded speech is performed external to the mobile communications facility.

24. A method of interacting with a mobile communication facility comprising:

generating a plurality of clipped versions of a voice command, wherein the plurality of the clipped versions of the voice command is simulated from a complete voice command;

receiving a switch activation from a user to initiate a speech recognition recording session, wherein the speech recognition recording session comprises the voice command from the user followed by speech to be recognized from the user;

recording the speech recognition recording session using a mobile communication facility resident capture facility;

detecting a first portion of the voice command as entirely clipped and a second portion of the voice command as a portion of the command that was not clipped off during the speech recognition recording session, wherein the first portion is determined as being clipped as a result of the user providing the command before the mobile communication facility resident capture facility was ready to receive is based in part on the plurality of clipped versions of the voice command;

recognizing the first portion of the voice command as an indication that user speech for recognition will begin following the end of the first portion of the voice command;

recognizing the recorded speech in the second portion of the voice command using a speech recognition facility to produce an external output; and

using the selected output to perform a function on the mobile communication facility.