Editing voice input

• US 9,111,539 B1
• Filed: 10/24/2013
• Issued: 08/18/2015
• Est. Priority Date: 08/06/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: LeBeau, Michael J., Jitkoff, John Nicholas, Byrne, William J.
• Primary Examiner(s): VO, HUYEN X
• Application Number:
  US14/062,537
• Time in Patent Office: 663 Days
• Field of Search: 704/251, 704/255, 704/257, 704/275, 704 1- 10, 704/231, 704/235, 704/270, 704/277
• US Class Current: 1/1
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/0638 Interactive procedures
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A computer-implemented method of generating a voice command to perform an action includes receiving a voice request to perform the action, wherein the voice request comprises first audio information for one or more first data fields associated with the action; generating a GUI that when rendered on a display device comprises a prompt message prompting a user to speak second audio information for one or more second data fields associated with the action; and inserting into the one or more second data fields data indicative of one or more of (i) the first audio information, and (ii) the second audio information.

Claims

1. A computer-implemented method comprising:

receiving audio data that encodes an utterance;

obtaining a transcription of the utterance;

determining that one or more portions of the transcription identify a voice command;

identifying syntax information that is associated with the voice command; and

before executing the voice command, providing a user interface that includes at least (i) a representation of the voice command, and (ii) a selectable representation of the syntax information that is associated with the voice command;

receiving data indicating a selection of a selectable representation of a particular piece of the syntax information that is associated with the voice command; and

providing an updated user interface that includes at least (i) the representation of the voice command, (ii) the selectable representation of the particular piece of the syntax information that is associated with the voice command, (iii) a field through which to enter or edit a value for the particular piece of the syntax information that is associated with the voice command.

2. The method of claim 1, comprising:

determining that one or more other portions of the transcription correspond to a particular piece of syntax information associated with the voice command, wherein the user interface further includes a representation of the one or more other portions.

3. The method of claim 1, further comprising:

determining that no other portion of the transcription corresponds to a particular piece of syntax information associated with the voice command, wherein the user interface further includes a control for initiating input of a value associated with the particular piece of syntax information.

4. The method of claim 1, wherein determining that one or more portions of the transcription identify a voice command comprises:

comparing the transcription of the utterance to one or more syntax rules; and

determining a syntax action based on the comparison to the one or more syntax rules.

5. The method of claim 1, wherein providing a user interface that includes at (i) a representation of the voice command, and (ii) a selectable representation of the syntax information that is associated with the voice command comprises providing a visual representation of the syntax fields.

6. The method of claim 1, wherein the user interface includes a field for entering or editing a value for a particular piece of syntax information.

7. The method of claim 6, further comprising:

receiving data indicating a selection of the field;

receiving a value for the particular piece of the syntax information; and

providing an updated user interface that includes at least (i) the representation of the voice command, (ii) the selectable representation of the syntax information that is associated with the voice command, (iii) the received value for the particular piece of syntax information, and (iv) a field for editing the value for the particular piece of syntax information.

8. A system comprising:

one or more computers and one or more non-transitory storage devices storing instructions that are operable, when executed by the one or more computer, to cause the one or more computers to perform operations comprising;

receiving audio data that encodes an utterance;

obtaining a transcription of the utterance;

determining that one or more portions of the transcription identify a voice command;

identifying syntax information that is associated with the voice command; and

before executing the voice command, providing a user interface that includes at least (i) a representation of the voice command, and (ii) a selectable representation of the syntax information that is associated with the voice command;

receiving data indicating a selection of a selectable representation of a particular piece of the syntax information that is associated with the voice command; and

providing an updated user interface that includes at least (i) the representation of the voice command, (ii) the selectable representation of the particular piece of the syntax information that is associated with the voice command, (iii) a field through which to enter or edit a value for the particular piece of the syntax information that is associated with the voice command.

9. The system of claim 8, wherein the operations comprise:

determining that one or more other portions of the transcription correspond to a particular piece of syntax information associated with the voice command, wherein the user interface further includes a representation of the one or more other portions.

10. The system of claim 8, wherein the operations further comprise:

determining that no other portion of the transcription corresponds to a particular piece of syntax information associated with the voice command, wherein the user interface further includes a control for initiating input of a value associated with the particular piece of syntax information.

11. The system of claim 8, wherein determining that one or more portions of the transcription identify a voice command comprises:

comparing the transcription of the utterance to one or more syntax rules; and

determining a syntax action based on the comparison to the one or more syntax rules.

12. The system of claim 8, wherein the operations comprise providing a user interface that includes at (i) a representation of the voice command, and (ii) a selectable representation of the syntax information that is associated with the voice command comprises providing a visual representation of the syntax fields.

13. The system of claim 8, wherein the user interface includes a field for entering or editing a value for a particular piece of syntax information.

14. The system of claim 13, wherein the operations further comprise:

receiving data indicating a selection of the field;

receiving a value for the particular piece of syntax information; and

providing an updated user interface that includes at least (i) the representation of the voice command, (ii) the selectable representation of the syntax information that is associated with the voice command, (iii) the received value for the particular piece of syntax information, and (iv) a field for editing the value for the particular piece of syntax information.

15. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving audio data that encodes an utterance;

obtaining a transcription of the utterance;

determining that one or more portions of the transcription identify a voice command;

identifying syntax information that is associated with the voice command; and

before executing the voice command, providing a user interface that includes at least (i) a representation of the voice command, and (ii) a selectable representation of the syntax information that is associated with the voice command;

receiving data indicating a selection of a selectable representation of a particular piece of the syntax information that is associated with the voice command; and

providing an updated user interface that includes at least (i) the representation of the voice command, (ii) the selectable representation of the particular piece of the syntax information that is associated with the voice command, (iii) a field through which to enter or edit a value for the particular piece of the syntax information that is associated with the voice command.

16. The medium of claim 15, wherein the operations comprise:

determining that one or more other portions of the transcription correspond to a particular piece of syntax information associated with the voice command, wherein the user interface further includes a representation of the one or more other portions.

17. The medium of claim 15, wherein the operations further comprise:

determining that no other portion of the transcription corresponds to a particular piece of syntax information associated with the voice command, wherein the user interface further includes a control for initiating input of a value associated with the particular piece of syntax information.

18. The medium of claim 15, wherein determining that one or more portions of the transcription identify a voice command comprises:

comparing the transcription of the utterance to one or more syntax rules; and

determining a syntax action based on the comparison to the one or more syntax rules.

19. The medium of claim 15, wherein the operations comprise providing a user interface that includes at least (i) a representation of the voice command, and (ii) a selectable representation of the syntax information that is associated with the voice command comprises providing a visual representation of the syntax fields.

20. The medium of claim 15, wherein the user interface includes a field for entering or editing a value for a particular piece of syntax information.