Low power detection of a voice control activation phrase

• US 10,115,397 B2
• Filed: 09/08/2017
• Issued: 10/30/2018
• Est. Priority Date: 02/27/2015
• Status: Active Grant

• Current Assignee: Imagination Technologies Limited (Imagination Technologies Group Ltd.)
• Original Assignee: Imagination Technologies Limited (Imagination Technologies Group Ltd.)
• Inventors: Kerr, Benjamin James
• Primary Examiner(s): Lora, William A Jerez
• Application Number:
  US15/699,190
• Publication Number:
  US 20170372698A1
• Time in Patent Office: 417 Days
• Field of Search: 381 56, 381 58, 381100
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

Methods of low power detection of an activation phrase are described. A microphone system comprises dedicated hardware logic for detecting a pre-defined activation phrase in an audio stream received via a microphone. If the pre-defined activation phrase is detected, the hardware logic sends a trigger signal to activate a module, such as a main speech detection module, which is external to the microphone system and which may be in a low power standby state.

Claims

1. A microphone system comprising a microphone and hardware logic configured to compare an audio stream received via the microphone with a pre-defined phrase and in response to detecting the pre-defined phrase in the audio stream, to send a trigger signal to activate a module external to the microphone system, and, in response to partially detecting the pre-defined phrase in the audio stream, to adapt the operation of the microphone system based on a number of partial matches which are detected.

2. The microphone system according to claim 1, wherein adapting the operation of the microphone system in response to partially detecting the pre-defined phrase in the audio stream comprises sending a signal to at least one of an amplifier and an analogue to digital converter to adjust at least one of a gain parameter, a sample rate, and a sample resolution based on the number of partial matches which are detected.

3. The microphone system according to claim 1, further comprising an audio buffer arranged to store a second portion of the audio stream received via the microphone after a first portion of the audio stream comprising the pre-defined phrase.

4. The microphone system according to claim 1, wherein the hardware logic is configured to divide a portion of detected audio into one or more component parts and to compare the component parts to one or more stored component parts of the pre-defined phrase.

5. The microphone system according to claim 1, further comprising an amplifier configured to amplify the audio stream received via the microphone according to a gain parameter and to output the amplified audio stream to the hardware logic which is configured to detect the pre-defined phrase, and wherein the hardware logic is further configured, in response to detecting the pre-defined phrase, to send a signal to the amplifier to increase a value of the gain parameter.

6. The microphone system according to claim 5, wherein the hardware logic is further configured to send a signal to the amplifier to reduce the value of the gain parameter in response to the module external to the microphone system entering a low power mode.

7. The microphone system according to claim 1, further comprising an analogue to digital converter configured to convert the audio stream received via the microphone into a digital audio stream by sampling the received audio stream at a sample rate and a sample resolution and to output the digital audio stream to the hardware logic which is configured to detect the pre-defined phrase and wherein the hardware logic is further configured, in response to detecting the pre-defined phrase, to send a signal to increase the sample rate and/or sample resolution.

8. The microphone system according to claim 7, wherein the hardware logic is further configured to send a signal to reduce the sample rate and/or sample resolution in response to the module external to the microphone system entering a low power mode.

9. The microphone system according to claim 1, wherein the hardware logic is further configured, in response to partially detecting the pre-defined phrase, to send a portion of the audio stream comprising the partially detected pre-defined phrase to the module external to the microphone system.

10. The microphone system according to claim 1, wherein the hardware logic is further configured, in response to partially detecting the pre-defined phrase in a first portion of the audio stream, to:

determine if a previous portion of the audio stream comprising a partially detected pre-defined phrase was stored;

in response to determining that the previous portion of the audio stream comprising a partially detected pre-defined phrase was not stored, to store the first portion of the audio stream;

in response to determining that the previous portion of the audio stream comprising a partially detected pre-defined phrase was stored, to compare the first portion of the audio stream and he stored previous portion of the audio stream; and

in response to detecting a match between the first portion of the audio stream and the stored previous portion of the audio stream, to send a trigger signal to activate the module external to the microphone system.

11. The microphone system according to claim 1, wherein the pre-defined phrase is a sample of a contextual sound.

12. The microphone system according to claim 1, wherein the pre-defined phrase comprises one or more spoken words.

13. The microphone system according to claim 12, wherein the pre-defined phrase is an activation phrase for a voice controlled computing device.

14. The microphone system according to claim 13, wherein the module external to the microphone system is a main speech detection module and the main speech detection module is implemented by a processor in the voice controlled computing device.

15. The microphone system according to claim 12, wherein the microphone system comprises two modes of operation and wherein

in a first mode of operation, the hardware logic is configured to detect a pre-defined phrase in an audio stream received via the microphone by dividing a portion of detected audio into one or more component parts and comparing the component parts to one or more stored component parts of the pre-defined phrase and in response to detecting the pre-defined phrase, to send a trigger signal to activate a first module external to the microphone system;

and

in a second mode of operation, the hardware logic is configured to divide a portion of detected audio into one or more component parts and to provide the component parts to a second module external to the microphone system.

16. The microphone system according to claim 15, wherein the first module external to the microphone system and the second module external to the microphone system are the same and the module is a main speech detection module.

17. The microphone system according to claim 15, wherein the first module external to the microphone system is a main speech detection module and the second module external to the microphone system is a communications interface arranged to transmit the component parts to a remote phrase detection and recognition system.

18. The microphone system according to claim 1, wherein the hardware logic is configured to continuously analyse the audio stream received via the microphone to detect the pre-defined phrase.

19. A method of operating a microphone system comprising:

detecting an audio stream from a microphone in the microphone system;

comparing the detected audio stream with a pre-defined phrase stored in dedicated hardware in the microphone system,

in response to detecting the pre-defined phrase in the detected audio stream, sending a trigger signal to activate a module external to the microphone system, and

in response to detecting a partial match for the pre-defined phrase in the detected audio steam, adapting the operation of the microphone system based on a number of partial matches which are detected.

20. The method of operating a microphone system according to claim 19, wherein adapting the operation of the microphone system in response to detecting a partial match for the pre-defined phrase in the detected audio stream comprises sending a signal to at least one of an amplifier and an analogue to digital converter to adjust at least one of a gain parameter, a sample rate and a sample resolution based on the number of partial matches which are detected.