VOICE TRIGGER FOR A DIGITAL ASSISTANT

• US 20140222436A1
• Filed: 02/07/2014
• Published: 08/07/2014
• Est. Priority Date: 02/07/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: GRUBER, Thomas R., BINDER, Justin, POST, Samuel D., TACKIN, Onur
• Granted Patent: US 10,199,051 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 17/24 the user being prompted to utter a password or a predefined phrase
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 21/16 Transforming into a non-visible representation devices or methods enabling ear patients to replace direct auditory perception by another kind of perception A61F11/04
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G10L 25/84 for discriminating voice from noise

Abstract

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Claims

1. A method for operating a voice trigger, performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors, the method comprising:

receiving a sound input;

determining whether at least a portion of the sound input corresponds to a predetermined type of sound;

upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content; and

upon a determination that the sound input includes the predetermined content, initiating a speech-based service.

2. The method of claim 1, wherein said determining whether the sound input corresponds to a predetermined type of sound is performed by a first sound detector, wherein said determining whether the sound input includes predetermined content is performed by a second sound detector, and wherein the first sound detector consumes less power while operating than the second sound detector.

3. The method of claim 2, wherein the second sound detector is initiated in response to a determination by the first sound detector that the sound input corresponds to the predetermined type.

4. The method of claim 2, wherein the second sound detector is operated for at least a predetermined amount of time after a determination by the first sound detector that the sound input corresponds to the predetermined type.

5. The method of claim 1, wherein the predetermined type is a human voice and the predetermined content is one or more words.

6. The method of claim 1, wherein the predetermined content is one or more predetermined phonemes.

7. The method of claim 6, wherein the one or more predetermined phonemes constitute at least one word.

8. The method of claim 1, further comprising, prior to determining whether the sound input corresponds to a predetermined type of sound, determining whether the sound input satisfies a predetermined condition.

9. The method of claim 8, wherein the predetermined condition is an amplitude threshold.

10. The method of claim 8, wherein said determining whether the sound input satisfies a predetermined condition is performed by a third sound detector, wherein the third sound detector consumes less power while operating than the first sound detector.

11. The method of claim 1, further comprising:

storing at least a portion of the sound input in memory; and

providing the portion of the sound input to the speech-based service once the speech-based service is initiated.

12. The method of claim 1, further comprising determining whether the sound input corresponds to a voice of a particular user.

13. The method of claim 12, wherein the speech-based service is initiated upon a determination that the sound input includes the predetermined content and that the sound input corresponds to the voice of the particular user.

14. The method of claim 13, wherein the speech-based service is initiated in a limited access mode upon a determination that the sound input includes the predetermined content and that the sound input does not correspond to the voice of the particular user.

15. The method of claim 13, further comprising, upon a determination that the sound input corresponds to the voice of the particular user, outputting a voice prompt including a name of the particular user.

16. The method of claim 1, further comprising

determining whether the electronic device is in a predetermined orientation;

and

upon a determination that the electronic device is in the predetermined orientation, activating a predetermined mode of the voice trigger.

17. A method for operating a voice trigger, performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors, the method comprising:

operating a voice trigger in a first mode;

determining whether the electronic device is in a substantially enclosed space by detecting that one or more of a microphone and a camera of the electronic device is occluded; and

upon a determination that the electronic device is in a substantially enclosed space, switching the voice trigger to a second mode.

18. The method of claim 17, wherein the second mode is a standby mode.

19. The method of any of claim 17, wherein the first mode is a listening mode.

20. A method for operating a voice trigger, performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors, the method comprising:

determining whether the electronic device is in a predetermined orientation; and

upon a determination that the electronic device is in the predetermined orientation, activating a predetermined mode of a voice trigger.

21. The method of claim 20, wherein the predetermined orientation corresponds to a display screen of the device being substantially horizontal and facing down, and the predetermined mode is a standby mode.

22. The method of claim 20, wherein the predetermined orientation corresponds to a display screen of the device being substantially horizontal and facing up, and the predetermined mode is a listening mode.

23. A computer-readable storage medium, storing one or more programs for execution by one or more processors of an electronic device, the one or more programs including instructions for:

receiving a sound input;

determining whether at least a portion of the sound input corresponds to a predetermined type of sound;

upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content; and

upon a determination that the sound input includes the predetermined content, initiating a speech-based service.

24. An electronic device, comprising:

a sound receiving unit configured to receive sound input; and

a processing unit coupled to the sound receiving unit, the processing unit configured to;

determine whether at least a portion of the sound input corresponds to a predetermined type of sound;

upon a determination that at least a portion of the sound input corresponds to the predetermined type, determine whether the sound input includes predetermined content; and

upon a determination that the sound input includes the predetermined content, initiate a speech-based service.

25. The electronic device of claim 24, the processing unit further configured to, prior to determining whether the sound input corresponds to a predetermined type of sound, determine whether the sound input satisfies a predetermined condition.