MECHANISM AND APPARATUS FOR SEAMLESS VOICE WAKE AND SPEAKER VERIFICATION

• US 20150245154A1
• Filed: 07/11/2013
• Published: 08/27/2015
• Est. Priority Date: 07/11/2013
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Dadu, Saurabh, Krishnamurthy, Lakshman, Tharappel, Francis M., Datta, Prabhakar R., Peebler, Bryan R., Deisher, Michael E., Shah, Saurin, Vogel, Brian K., Joshi, Mandar S.
• Granted Patent: US 9,445,209 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/3287 by switching off individual functional units in the computer system
• CPC Class Codes: G06F 1/3293 by switching to a less power-consuming processor, e.g. sub-CPU
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/285 Memory allocation or algorithm optimisation to reduce hardware requirements
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 19/0018 Speech coding using phonetic or linguistical decoding of the source; Reconstruction using text-to-speech synthesis
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 29/004 for microphones H04R29/007 takes precedence
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Technologies are described herein that allow a user to wake up a computing device operating in a low-power state and for the user to be verified by speaking a single wake phrase. Wake phrase recognition is performed by a low-power engine. In some embodiments, the low-power engine may also perform speaker verification. In other embodiments, the mobile device wakes up after a wake phrase is recognized and a component other than the low-power engine performs speaker verification on a portion of the audio input comprising the wake phrase. More than one wake phrases may be associated with a particular user, and separate users may be associated with different wake phrases. Different wake phrases may cause the device transition from a low-power state to various active states.

Claims

1-23. -23. (canceled)

24. A computing device, comprising:

a microphone; and

a low-power engine to;

recognize a wake phrase in audio input provided by a user to the microphone while the computing device is in a low-power state;

verify the user based at least in part on a portion of the audio input comprising the wake phrase while the computing device is in the low-power state; and

cause the computing device to transition from the low-power state to an active state.

25. The computing device of claim 24 wherein the low-power engine is to cause the computing device to transition from a low-power state to an active state after recognizing a wake phrase in the audio input provided by a user to the microphone while the computing device is in a low-power state and after verifying a user based at least in part on a portion of the audio input comprising the wake phrase while the computing device is in the low-power state.

26. The computing device of claim 24 wherein the low-power engine is to cause the computing device to transition from a low-power state to an active state after recognizing a wake phrase in the audio input provided by a user to the microphone while the computing device is in a low-power state and after verification of a user based at least in part on a portion of the audio input comprising the wake phrase while the computing device is in the low-power state has failed;

the computing device further comprising a command interpretation module to interpret a second portion of the audio input as a command to be executed by the computing device and to instruct the computing device to execute the command if the command is a user agnostic command, the second portion of the audio input not comprising the wake phrase.

27. The computing device of claim 24, further comprising a command interpretation module to interpret the portion of the audio input comprising the wake phrase as a command to be performed by the computing device.

28. The computing device of claim 24, wherein the active state is based at least in part on the wake phrase.

29. The computing device of claim 24, wherein the low-power engine is included in an audio capture pipeline of the computing device when the computing device is in the low-power state and the low-power engine is removed from the audio capture pipeline when the computing device is in the active state.

30. A computing device, comprising:

a microphone;

a low-power engine to;

recognize a wake phrase in audio input provided by a user to the microphone while the computing device is in a low-power state; and

cause the computing device to transition from the low-power state to an active state; and

a speaker verification module to verify the user based at least in part on a portion of the audio input comprising the wake phrase, the speaker verification module being enabled when the computing device is in the active state and being disabled when the computing device is in the low-power state.

31. The computing device of claim 30, further comprising a command interpretation module to interpret the portion of the audio input comprising the wake phrase as a command to be performed by the computing device.

32. A method of waking a computing device, comprising:

while the computing device is in a low-power state;

receiving audio input from a user at the computing device; and

determining that the audio input comprises a wake phrase;

transitioning the computing device from the low-power state to an active state; and

verifying the user based at least in part on a portion of the audio input comprising the wake phrase.

33. The method of claim 32, wherein the transitioning the computing device from the low-power state to the active state occurs prior to the verifying the user based at least in part on the portion of the audio input comprising the wake phrase.

34. The method of claim 32, wherein the wake phrase is one of a plurality of wake phrases that may be used to verify a plurality of users, the plurality of wake phrases comprising a first wake phrase that may be used to verify a first user and a second wake phrase that may be used to verify a second user, the first wake phrase being different from the second wake phrase.

35. The method of claim 32, wherein the determining that the audio input comprises a wake phrase is performed by a low-power engine of the computing device, and the verifying the user is performed by one or more components of the computing device other than the low-power engine.

36. The method of claim 32, further comprising:

interpreting the audio input comprising the wake phrase as a command to be executed by the computing device; and

performing the command at the computing device.

37. One or more computer-readable storage media storing computer-executable instructions for causing a computing device to perform a method, the method comprising:

while the computing device is in a low-power state;

receiving audio input from a user at the computing device; and

determining that the audio input comprises a wake phrase;

transitioning the computing device from the low-power state to an active state; and

verifying the user based at least in part on a portion of the audio input comprising the wake phrase.

38. The one or more computer-readable storage media of claim 37, wherein the verifying is performed while the computing device is in the low-power state and the transitioning is performed if the audio input comprises a wake phrase and a user has been verified based at least in part on the portion of the audio input comprising the wake phrase.

39. The one or more computer-readable storage media of claim 37, wherein the verifying is performed while the computing device is in the low-power state and the transitioning is performed if the audio input comprises a wake phrase and a user has not been verified based at least in part on the portion of the audio input comprising the wake phrase;

the method further comprising;

interpreting a second portion of the audio input as a command to be executed by the computing device, the second portion of the audio input not comprising the wake phrase; and

performing the command at the computing device if the command is a user agnostic command.

40. The one or more computer-readable storage media of claim 37, wherein the transitioning the computing device from the low-power state to the active state occurs prior to the verifying the user based at least in part on the portion of the audio input comprising the wake phrase.

41. The one or more computer-readable storage media of claim 37, wherein the wake phrase is one of a plurality of wake phrases that may be used to verify the user.

42. The one or more computer-readable storage media of claim 37, wherein the wake phrase is one of a plurality of wake phrases that may be used to verify a plurality of users, the plurality of wake phrases comprising a first wake phrase that may be used to verify a first user and a second wake phrase that may be used to verify a second user, the first wake phrase being different from the second wake phrase.

43. The one or more computer-readable storage media of claim 37, wherein the determining that the audio input comprises a wake phrase is performed by a low-power engine of the computing device, and the verifying the user is performed by one or more components of the computing device other than the low-power engine.

44. The one or more computer-readable storage media of claim 37, wherein:

the transitioning the computing device from the low-power state to the active state comprises transitioning one or more second components of the computing device to an active state;

the verifying the user is performed by the one or more second components; and

the transitioning the computing device from the low-power state to the active state further comprises transitioning one or more third components of the computing device from a low-power state to an active state.

45. The one or more computer-readable storage media of claim 37, further comprising:

interpreting the audio input comprising the wake phrase as a command to be executed by the computing device; and

performing the command at the computing device.

46. The one or more computer-readable storage media of claim 37, wherein the transitioning comprises transitioning to an active state based at least in part on the wake phrase.

47. The one or more computer-readable storage media of claim 37, wherein the low-power engine is to cause the computing device to transition from a low-power state to an active state after recognizing a wake phrase in the audio input provided by a user to the microphone while the computing device is in a low-power state and after verifying a user based at least in part on a portion of the audio input comprising the wake phrase while the computing device is in the low-power state.

48. The one or more computer-readable storage media of claim 37, wherein the low-power engine is to cause the computing device to transition from a low-power state to an active state after recognizing a wake phrase in the audio input provided by a user to the microphone while the computing device is in a low-power state and after verification of a user based at least in part on a portion of the audio input comprising the wake phrase while the computing device is in the low-power state has failed;

the computing device further comprising a command interpretation module to interpret a second portion of the audio input as a command to be executed by the computing device and to instruct the computing device to execute the command if the command is a user agnostic command, the second portion of the audio input not comprising the wake phrase.