VISUAL INDICATION OF A RECOGNIZED VOICE-INITIATED ACTION

• US 20150261496A1
• Filed: 04/01/2014
• Published: 09/17/2015
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Faaborg, Alexander, Kaplan, Joshua Robin, Sonoda, Gustavo
• Granted Patent: US 9,430,186 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

A computing device is described that outputs, for display, an initial speech recognition graphical user interface (GUI) having at least one element. The computing device receives audio data and determines, based on the audio data, a voice-initiated action. Responsive to determining the voice-initiated action, the computing device outputs, for display, an updated speech recognition GUI having an animation of a change in a position of the at least one element to indicate that the voice-initiated action has been determined.

Claims

1. A method comprising:

outputting, by a computing device and for display, an initial speech recognition graphical user interface (GUI) including at least one element;

receiving, by the computing device, initial audio data indicating an initial portion of voice input;

generating, by the computing device, based at least in part on the initial audio data, a transcription of the initial audio data;

determining, by the computing device and based at least in part on a comparison of at least one a word from the transcription to a preconfigured set of actions, a voice-initiated action associated with the initial portion of the voice input; and

responsive to determining the voice-initiated action and while receiving additional audio data indicating a second portion of the voice input, outputting, by the computing device and for display, an updated speech recognition GUI including an animation of a change in a position of the at least one element from the initial speech recognition GUI to indicate that the voice-initiated action has been determined based on the initial audio data.

3. The method of claim 1, wherein the updated speech recognition GUI including the animation of the change in the position of the at least one element is output, for display, prior to executing the voice-initiated action based on the initial audio data.

4. The method of claim 1, wherein:

outputting the initial speech recognition GUI for display comprises outputting, by the computing device and for display, the at least one element at an initial location of the initial speech recognition GUI, and

outputting the updated speech recognition GUI for display comprises;

after outputting the at least one element for display at a first location of the updated speech recognition GUI, outputting, by the computing device, for display at a second location of the updated speech recognition GUI, the at least one element; and

after outputting the at least one element for display at the second location of the updated speech recognition GUI, outputting, by the computing device, for display at the initial location, the at least one element, wherein the first location is above the initial location, wherein the second location is below the first location and the initial location.

5. The method of claim 1, wherein the animation of the change in the position of the at least on element to indicate that the voice-initiated action has been determined is a first animation, the method further comprising:

determining, by the computing device and based on the initial audio data, an absence of the voice-initiated action; and

responsive to determining the absence of the voice-initiated action;

refraining from outputting, by the computing device and for display, the updated speech recognition GUI including the first animation of the change in the position of the at least one element to indicate that the voice-initiated action has been determined; and

outputting, by the computing device and for display, the updated speech recognition GUI including a second animation of the change in the position of the at least one element to indicate that the absence of the voice-initiated action has been determined, wherein the second animation is different from the first animation.

6. The method of claim 5, wherein:

outputting the initial speech recognition GUI for display comprises outputting, by the computing device and for display, the at least one element at an initial location of the initial speech recognition GUI, and

outputting the updated speech recognition GUI for display comprises;

after outputting the at least one element for display at a first location of the updated speech recognition GUI, outputting, by the computing device, for display at a second location of the updated speech recognition GUI, the at least one element; and

after outputting the at least one element for display at the second location of the updated speech recognition GUI, outputting, by the computing device, for display at the initial location, the at least one element, wherein the first location is positioned left or right of the initial location, wherein the second location is positioned opposite the first location and left or right of the initial location.

8. The method of claim 1, wherein determining the voice-initiated action further comprises:

identifying, by the computing device, at least one verb in the transcription; and

comparing, by the computing device, the at least one verb to one or more verbs from a set of verbs, each verb in the set of verbs corresponding to at least one action from a plurality of actions including the voice-initiated action.

9. The method of claim 1, wherein determining the voice-initiated action further comprises:

determining, by the computing device and based at least in part on data from the computing device, a context; and

determining, by the computing device and based at least in part on the context, the voice-initiated action.

10. The method of claim 1, wherein outputting, for display, the updated speech recognition GUI comprises:

ceasing outputting, by the computing device and for display, the initial speech recognition GUI; and

outputting, by the computing device and for display, the updated speech recognition GUI.

21. The method of claim 1, wherein the updated speech recognition GUI including the animation of the change in the position of the at least one element is output, for display, prior to completing execution of the voice initiated-action based on the second portion of the voice input.

2. (canceled)

7. (canceled)

11. A computing device comprising:

at least one processor; and

at least one module operable by the at least one processor to;

output, for display, an initial speech recognition graphical user interface (GUI) including at least one element;

receive initial audio data indicating an initial portion of voice input;

generate, based at least in part on the initial audio data, a transcription of the initial audio data;

determine, based at least in part on a comparison of at least one a word from the transcription to a preconfigured set of actions, a voice-initiated action associated with the initial portion of the voice input; and

responsive to determining the voice-initiated action and while receiving additional audio data indicating a second portion of the voice input, output, for display, an updated speech recognition GUI including an animation of a change in a position of the at least one element from the initial speech recognition GUI to indicate that the voice-initiated action has been determined based on the initial audio data.

13. The computing device of claim 11, wherein the animation of the change in the position of the at least one element includes at least one of a bounce animation, a shake animation, a fold animation, a crinkle animation, a rotation animation, a zoom animation, or a morph-in-shape animation.

14. The computing device of claim 11, wherein the at least one module is further operable by the at least one processor to:

prior to determining the voice-initiated action, output, for display, the at least one element having a first visual format; and

after determining the voice-initiated action, output, for display, the at least one element having a second visual format, different from the first visual format, to further indicate that the voice-initiated action has been determined.

22. The computing device of claim 11, wherein the second portion of the voice input includes one or more parameters of the voice-initiated action.

12. (canceled)

15. (canceled)

16. A non-transitory computer-readable storage medium comprising instructions that, when executed, configure at least one processor to:

output, for display, an initial speech recognition graphical user interface (GUI) including at least one element;

receive initial audio data indicating an initial portion of voice input;

generate, based at least in part on the initial audio data, a transcription of the initial audio data;

determine, based at least in part on a comparison of at least one a word from the transcription to a preconfigured set of actions, a voice-initiated action associated with the initial portion of the voice input; and

responsive to determining the voice-initiated action and while receiving additional audio data indicating a second portion of the voice input, output, for display, an updated speech recognition GUI including an animation of a change in a position of the at least one element from the initial speech recognition GUI to indicate that the voice-initiated action has been determined based on the initial audio data.

18. The non-transitory computer-readable storage medium of claim 16, wherein:

the computer-readable storage medium comprises additional instructions that, when executed, configure the at least one processor to output the initial speech recognition GUI for display by at least outputting, for display, the at least one element having an image representative of a speech recognition mode of the computing device, and

the computer-readable storage medium comprises additional instructions that, when executed, configure the at least one processor to output the updated speech recognition GUI for display by at least outputting, for display, the at least one element having an image representative of the voice-initiated action.

19. The non-transitory computer-readable storage medium of claim 16, wherein the animation of the change in the position of the at least one element comprises a morph animation of the image representative of the speech recognition mode changing into the image representative of the voice-initiated action.

20. The non-transitory computer-readable storage medium of claim 16, wherein the computer-readable storage medium comprises additional instructions that, when executed, configure the at least one processor to:

responsive to determining the voice-initiated action based on the initial audio data, performing, by the computing device, the voice-initiated action.

23. The non-transitory computer-readable storage medium of claim 16, wherein the second portion of the voice input compliments the voice-initiated action and completes the voice-initiated action.

17. (canceled)