Editing voice input

• US 8,224,654 B1
• Filed: 08/06/2010
• Issued: 07/17/2012
• Est. Priority Date: 08/06/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: LeBeau, Michael J., Jitkoff, John Nicholas, Byrne, William J.
• Primary Examiner(s): Vo, Huyen X.
• Application Number:
  US12/851,894
• Time in Patent Office: 711 Days
• Field of Search: 704 1- 10, 704/251, 704/252, 704/253, 704/254, 704/255, 704/257, 704/270, 704/246, 704/231, 704/235, 704/275, 715/225
• US Class Current: 704/275
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/0638 Interactive procedures
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A computer-implemented method of generating a voice command to perform an action includes receiving a voice request to perform the action, wherein the voice request comprises first audio information for one or more first data fields associated with the action; generating a GUI that when rendered on a display device comprises a prompt message prompting a user to speak second audio information for one or more second data fields associated with the action; and inserting into the one or more second data fields data indicative of one or more of (i) the first audio information, and (ii) the second audio information.

Claims

1. A method comprising:

receiving audio information associated with an action;

determining that the audio information comprises an incomplete syntax for the action;

generating, based on determining the incomplete syntax, one or more training actions to train a user to speak a complete syntax for the action;

identifying, by a processing device, data fields associated with the action;

populating a portion of the data fields with textual information corresponding to the audio information;

determining, based on populating, an incomplete data field;

generating information for a GUI that when rendered on a display device renders;

a visual representation of the incomplete data field, with the visual representation juxtaposed to a plurality of controls;

wherein a first control, from the plurality, is associated with a first mode of communication for populating the incomplete data field;

wherein a second control, from the plurality, is associated with a second mode of communication for populating the incomplete data field; and

wherein the second mode differs from the first mode;

receiving information indicative of a selection of the first control; and

populating, following the selection, the incomplete data field with information input using the first mode.

2. The method of claim 1, further comprising:

determining that the audio information comprises a partial set of information for the data fields.

3. The method of claim 1, further comprising:

determining that the audio information and the information input using the first mode comprise a complete set of information for the data fields.

4. The method of claim 1, further comprising:

retrieving a syntax for the action;

wherein identifying the data fields comprises;

identifying, based on the syntax, the data fields.

5. The method of claim 1, further comprising:

retrieving a syntax for the action; and

generating, based on the syntax and the audio information, syntax information;

wherein populating the portion of the data fields comprises;

populating the portion of the data fields with the syntax information.

6. The method of claim 1, wherein at least one of the one or more training actions comprises an action to generate information for the GUI that when rendered on the display device renders:

a highlighted visual representation of incomplete data field.

7. The method of claim 1, wherein the first mode comprises one or more of an audio mode and a written mode.

8. One or more non-transitory machine-readable media configured to store instructions that are executable by one or more processing devices to perform operations comprising:

receiving audio information associated with an action;

determining that the audio information comprises an incomplete syntax for the action;

generating, based on determining the incomplete syntax, one or more training actions to train a user to speak a complete syntax for the action;

identifying data fields associated with the action;

populating a portion of the data fields with textual information corresponding to the audio information;

determining, based on populating, an incomplete data field;

generating information for a GUI that when rendered on a display device renders;

a visual representation of the incomplete data field, with the visual representation juxtaposed to a plurality of controls;

wherein a first control, from the plurality, is associated with a first mode of communication for populating the incomplete data field;

wherein a second control, from the plurality, is associated with a second mode of communication for populating the incomplete data field; and

wherein the second mode differs from the first mode;

receiving information indicative of a selection of the first control; and

populating, following the selection, the incomplete data field with information input using the first mode.

9. The one or more non-transitory machine-readable media of claim 8, wherein the operations further comprise:

determining that the audio information comprises a partial set of information for the data fields.

10. The one or more non-transitory machine-readable media of claim 8, wherein the operations further comprise:

determining that the audio information and the information input using the first mode comprise a complete set of information for the data fields.

11. The one or more non-transitory machine-readable media of claim 8, wherein the operations further comprise:

retrieving a syntax for the action;

wherein identifying the data fields comprises;

identifying, based on the syntax, the data fields.

12. The one or more non-transitory machine-readable media of claim 8, wherein the operations further comprise:

retrieving a syntax for the action; and

generating, based on the syntax and the audio information, syntax information;

wherein populating the portion of the data fields comprises;

populating the portion of the data fields with the syntax information.

13. The one or more non-transitory machine-readable media of claim 8, wherein at least one of the one or more training actions comprises an action to generate information for the GUI that when rendered on the display device renders:

a highlighted visual representation of the incomplete data field.

14. The one or more non-transitory machine-readable media of claim 8, wherein the first mode comprises one or more of an audio mode and a written mode.

15. An electronic system comprising:

one or more processing devices; and

one or more non-transitory machine-readable media configured to store instructions that are executable by the one or more processing devices to perform operations comprising;

receiving audio information associated with an action;

determining that the audio information comprises an incomplete syntax for the action;

generating, based on determining the incomplete syntax, one or more training actions to train a user to speak a complete syntax for the action;

identifying data fields associated with the action;

populating a portion of the data fields with textual information corresponding to the audio information;

determining, based on populating, an incomplete data field;

generating information for a GUI that when rendered on a display device renders;

a visual representation of the incomplete data field, with the visual representation juxtaposed to a plurality of controls;

wherein a first control, from the plurality, is associated with a first mode of communication for populating the incomplete data field;

wherein a second control, from the plurality, is associated with a second mode of communication for populating the incomplete data field; and

wherein the second mode differs from the first mode;

receiving information indicative of a selection of the first control; and

populating, following the selection, the incomplete data field with information input using the first mode.

16. The electronic system of claim 15, wherein the operations further comprise:

determining that the audio information comprises a partial set of information for the data fields.

17. The electronic system of claim 15, wherein the operations further comprise:

determining that the audio information and the information input using the first mode comprise a complete set of information for the data fields.

18. The electronic system of claim 15, wherein the operations further comprise:

retrieving a syntax for the action;

wherein identifying the data fields comprises;

identifying, based on the syntax, the data fields.

19. The electronic system of claim 15, wherein the operations further comprise:

retrieving a syntax for the action; and

generating, based on the syntax and the audio information, syntax information;

wherein populating the portion of the data fields comprises;

populating the portion of the data fields with the syntax information.

20. The electronic system of claim 15, wherein at least one of the one or more training actions comprises an action to generate information for the GUI that when rendered on the display device renders:

a highlighted visual representation of incomplete data field.

21. The electronic system of claim 15, wherein the first mode comprises one or more of an audio mode and a written mode.

22. An electronic system comprising:

a processing device configured to perform operations comprising;

receiving audio information associated with an action;

determining that the audio information comprises an incomplete syntax for the action;

generating, based on determining the incomplete syntax, one or more training actions to train a user to speak a complete syntax for the action;

identifying data fields associated with the action;

populating a portion of the data fields with textual information corresponding to the audio information;

determining, based on populating, an incomplete data field;

generating information for a GUI that when rendered on a display device renders;

a visual representation of the incomplete data field, with the visual representation juxtaposed to a plurality of controls;

wherein a first control, from the plurality, is associated with a first mode of communication for populating the incomplete data field;

wherein a second control, from the plurality, is associated with a second mode of communication for populating the incomplete data field; and

wherein the second mode differs from the first mode;

receiving information indicative of a selection of the first control; and

means for populating, following the selection, the incomplete data field with information input using the first mode.

23. The electronic system of claim 22, wherein at least one of the one or more training actions comprises an action to generate information for the GUI that when rendered on the display device renders:

a highlighted visual representation of the incomplete data field.