Systems And Methods For Continual Speech Recognition And Detection In Mobile Computing Devices

• US 20130085755A1
• Filed: 09/15/2012
• Published: 04/04/2013
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bringert, Bjorn Erik, Pietryka, Pawel, Hodgson, Peter John, Tickner, Simon, Penha, Henrique, Cohen, Richard Zarek, Zanolin, Luca, Burke, Dave
• Granted Patent: US 8,452,597 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 15/285 Memory allocation or algorithm optimisation to reduce hardware requirements
• CPC Class Codes: G10L 17/02 Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G10L 21/10 Transforming into visible information

Abstract

The present application describes systems, articles of manufacture, and methods for continuous speech recognition for mobile computing devices. One embodiment includes determining whether a mobile computing device is receiving operating power from an external power source or a battery power source, and activating a trigger word detection subroutine in response to determining that the mobile computing device is receiving power from the external power source. In some embodiments, the trigger word detection subroutine operates continually while the mobile computing device is receiving power from the external power source. The trigger word detection subroutine includes determining whether a plurality of spoken words received via a microphone includes one or more trigger words, and in response to determining that the plurality of spoken words includes at least one trigger word, launching an application corresponding to the at least one trigger word included in the plurality of spoken words.

Claims

1. A method comprising:

determining whether a mobile computing device is receiving operating power from an external power source, wherein the mobile computing device has a trigger word detection subroutine that is activatable by a user input and automatically in response to determining that the mobile computing device is receiving external power; and

in response to determining that the mobile computing device is receiving operating power from the external power source, activating a trigger word detection subroutine, wherein the trigger word detection subroutine includes;

receiving spoken input via a microphone of the mobile computing device, based on speech recognition performed on the spoken input, obtaining text, determining whether the text includes one or more trigger words, and in response to determining that the text includes at least one trigger word,

launching an application corresponding to the at least one trigger word.

2. The method of claim 1, further comprising:

executing the trigger word detection routine continually until it is deactivated.

3. The method of claim 1, further comprising:

deactivating the trigger word detection subroutine in response to determining that the mobile computing device is receiving operating power from one or more batteries.

4. The method of claim 1, further comprising:

receiving the user input; and

activating the trigger word detection subroutine in response to receiving the user input regardless of whether the mobile computing device is receiving operating power from the external power source.

5. The method of claim 1, wherein the launched application corresponding to the at least one trigger word is a voice command prompt application configured to receive a voice command from a user.

6. The method of claim 5, wherein the voice command comprises one or more of an action, and object of the action, one or more parameters associated with the action, and one or more parameters associated with the object of the action.

7. The method of claim 1, further comprising:

receiving a voice input for the launched application, wherein the voice input includes one or more of an action, and object of the action, one or more parameters associated with the action, and one or more parameters associated with the object of the action.

8. The method of claim 1, wherein the application corresponding to the set of one or more trigger words is a communications application, a multimedia application, or an application for configuring settings of the mobile computing device.

9. The method of claim 1, wherein the external power source is one of a charger associated with the mobile computing device and a docking station for the mobile computing device.

10. The method of claim 1, wherein one or more of the determining step, the activating step, and the trigger word detection subroutine are components of a mobile computing device operating system.

11. A mobile computing device comprising:

a sound detector;

a power selector configured to selectively power the mobile computing device from one of either an external power source or one or more batteries; and

one or more processors configured to (i) continually execute a trigger word detection subroutine when the power selector is powering the mobile computing device from the external power source and (ii) halt execution of the trigger word detection subroutine when the power selector is powering the mobile computing device from the one or more batteries.

12. The mobile computing device of claim 11, wherein when the trigger word detection subroutine comprises (i) determining whether a plurality of spoken words received via the sound detector includes at least one trigger word of a set of one or more trigger words, and (ii) in response to determining that the plurality of spoken words includes at least one trigger word, launching an application corresponding to at least one trigger word.

13. The mobile computing device of claim 12, further comprising:

a user interface configured to receive an input from a user to activate the trigger word detection subroutine when the power selector is powering the mobile computing device from the one or more batteries.

14. The mobile computing device of claim 12, wherein the application corresponding to the at least one trigger word is a voice command prompt application configured to receive a voice command from a user via the sound detector.

15. The mobile computing device of claim 14, wherein the voice command comprises a string of one or more words identifying at least an action and an object of the action.

16. The mobile computing device of claim 11, wherein the application corresponding to the at least one trigger word is one of a communications application, a multimedia application, or an application for configuring settings of the mobile computing device.

17. A computer readable medium having stored therein executable instructions that, when executed by a computing device having at least one processor, causes the computing device to perform functions comprising:

determining whether a mobile computing device is receiving operating power from either an external power source or an internal battery source; and

activating a trigger word detection subroutine in response to determining that the mobile computing device is receiving power from the external power source, wherein the trigger word detection subroutine comprises continually determining whether a plurality of spoken words received via a microphone includes at least one of a set of one or more trigger words and, in response to determining that the plurality of spoken words includes at least one trigger word, launching an application corresponding to the at least one trigger word.

18. The computer readable medium of claim 17, wherein the functions further comprise:

deactivating the trigger word detection subroutine in response to determining that the mobile computing device is receiving operating power from the internal battery source.

19. The computer readable medium of claim 17, wherein the functions further comprise:

receiving a user input; and

in response to receiving the user input, activating the trigger word detection subroutine regardless of whether the mobile computing device is receiving operating power from the external power source or the internal battery source.

20. The computer readable medium of claim 17, wherein the launched application corresponding to the at least one trigger words is one of a voice command prompt application, a communications application, a multimedia application, or an application for configuring settings of the mobile computing device.