LOW POWER ALWAYS-ON VOICE TRIGGER ARCHITECTURE

• US 20150112690A1
• Filed: 10/22/2013
• Published: 04/23/2015
• Est. Priority Date: 10/22/2013
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Guha, Sudeshna, Bulusu, Ravi
• Application Number:
  US14/060,367
• Publication Number:
  US 20150112690A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/74 operating in dual or compartmented mode, i.e. at least one secure mode
• CPC Class Codes: G06F 21/81 by operating on the power supply, e.g. enabling or disabling power-on, sleep or resume operations
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G10L 25/84 for discriminating voice from noise
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The description is directed to systems and methods for a low-power, hands-free voice triggering of a main processing complex of a computing system to wake from a suspended state. An always-on voice activity detection module samples output received from a microphone in the computing system and determines whether a portion of the sampled output potentially contains a triggering keyphrase. A special purpose audio processing engine is turned on to confirm the presence of the triggering keyphrase in the sampled output before triggering the main processing complex of the computing system to wake from the suspended state.

Claims

1. In a computing system with a main processing complex, a method for hands-free voice triggering the main processing complex to wake from a suspended state, comprising:

suspending operation of the main processing complex;

sampling output received from a microphone of the computing system to thereby yield a sampled output;

determining whether a portion of the sampled output contains a preliminary indication of a triggering keyphrase;

triggering, if the portion of the sampled output does contain the preliminary indication, wakeup of a special-purpose audio processing engine;

determining, with the special-purpose audio processing engine, whether the portion of the sampled output contains a confirmatory indication of the triggering keyphrase; and

waking the main processing complex from the suspended state if the sampled output contains the confirmatory indication of the triggering keyphrase.

2. The method of claim 1, where determining whether the portion of the sampled output contains the preliminary indication includes comparing the portion of the sampled output to a volume threshold.

3. The method of claim 1, where determining whether the portion of the sampled output contains the preliminary indication includes discerning between vocalization and non-vocalization noise.

4. The method of claim 1, where determining whether the portion of the sampled output contains the preliminary indication includes determining whether the portion matches a characteristic of the triggering keyphrase.

5. The method of claim 1, where determining whether the portion of the sampled output contains the preliminary indication includes determining whether the portion matches a characteristic of a voice of an authorized user.

6. The method of claim 1, further comprising, after waking the main processing complex, using the main processing complex to analyze and substantively respond to voice commands.

7. The method of claim 1, where the main processing complex and special-purpose audio processing engine are on different supply rails.

8. The method of claim 1, where the sampling of microphone output and the determining whether the portion of the sampled output contains the preliminary indication are performed by an always-on voice detection module.

9. The method of claim 8, where the always-on voice detection module, special-purpose audio processing engine, and main processing complex are all on different supply rails.

10. The method of claim 1, further comprising providing a user confirmation in response to determining that the portion of the sampled output does contain the confirmatory indication.

11. A computing system configured to wake from a suspended state in response to an audio trigger, comprising:

a main processing complex;

a microphone;

an always-on voice detection module configured to (i) sample output from the microphone and thereby obtain a sampled output, and (ii) determine whether a portion of the sampled output contains a preliminary indication of a triggering keyphrase; and

a special-purpose audio processing engine configured to (i) wake up in response to the always-on voice detection module determining that the portion of the sampled output contains the preliminary indication, and (ii) determine whether the portion of the sampled output contains a confirmatory indication of the triggering keyphrase, where the main processing complex is configured to wake from a suspended state if the portion of the sampled output contains the confirmatory indication of the triggering keyphrase.

12. The computing system of claim 11, where the always-on voice detection module is configured to determine whether the portion of the sampled output contains the preliminary indication by comparing the portion of the sampled output to a volume threshold.

13. The computing system of claim 11, where the always-on voice detection module is configured to determine whether the portion of the sampled output contains the preliminary indication by discerning between vocalization and non-vocalization noise.

14. The computing system of claim 11, where the always-on voice detection module is configured to determine whether the portion of the sampled output contains the preliminary indication by determining whether the portion matches a characteristic of the triggering keyphrase.

15. The computing system of claim 11, where the always-on voice detection module is configured to determine whether the portion of the sampled output contains the preliminary indication by determining whether the portion matches a characteristic of a voice of an authorized user.

16. The computing system of claim 11, where the main processing complex, special-purpose audio processing engine, and always-on voice detection module are on different supply rails.

17. In a computing system with a main processing complex on a first supply rail, a special-purpose audio processing engine on a second supply rail, and an always-on voice detection module on a third supply rail, a method for hands-free voice triggering the main processing complex to wake from a suspended state, comprising:

suspending operation of the main processing complex;

sampling, with the always-on voice detection module, output received from a microphone of the computing system to thereby yield a sampled output;

determining, with the always-on voice detection module, whether a portion of the sampled output contains a preliminary indication of a triggering keyphrase;

triggering, if the portion of the sampled output does contain the preliminary indication, wakeup of the special-purpose audio processing engine;

determining, with the special-purpose audio processing engine, whether the portion of the sampled output contains a confirmatory indication of the triggering keyphrase; and

waking the main processing complex from the suspended state if the sampled output contains the confirmatory indication of the triggering keyphrase.

18. The method of claim 17, further comprising, after waking the main processing complex, using the main processing complex to analyze and substantively respond to voice commands.

19. The method of claim 17, further comprising providing a user confirmation in response to determining that the portion of the sampled output does contain the confirmatory indication.

20. The method of claim 17, where the triggering keyphrase is programmable by a user.