Directing dictation into input fields

• US 8,255,218 B1
• Filed: 09/26/2011
• Issued: 08/28/2012
• Est. Priority Date: 09/26/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Cohen, Richard Zarek, Zanolin, Luca, Foster, Marcus Alexander
• Primary Examiner(s): RIDER, JUSTIN W
• Application Number:
  US13/245,698
• Time in Patent Office: 337 Days
• Field of Search: None
• US Class Current: 704/248
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

In general, this disclosure describes techniques to direct textual characters converted from vocal input into selected graphical user interface input fields. Vocal input may be received. Textual characters may be identified based on the vocal input. A first portion of the textual characters corresponding to a first portion of the vocal input may be graphically inputted into a first input field of a GUI. While receiving the vocal input, a selection by of a second input field in the GUI may be accepted after the first portion of the vocal input has been received. After accepting the selection of the second input field, a second portion of the textual characters corresponding to a second portion of the vocal input received after the selection of the second input field may be inputted into the second input field.

Claims

1. A method performed by a computing device having one or more processors, memory, a microphone, and a display capable of displaying a graphical user interface (GUI), the method comprising:

receiving a request from a user to activate a voice input capability of the computing device;

activating the voice input capability;

while the voice input capability is active, performing, by the computing device, the steps of;

receiving vocal input from the user, wherein at least a portion of the vocal input is intended for input into a first input field of the GUI displayed on the display;

during the receiving of the vocal input, receiving a selection by the user of a second input field of the GUI displayed on the display;

identifying vocal input received prior to the selection of the second input field as first vocal input intended for the first input field;

identifying vocal input received after the selection of the second input field as second vocal input intended for the second input field;

detecting that vocal input from the user has concluded; and

deactivating the voice input capability;

graphically inputting a first text portion in the first input field, wherein the first text portion is based upon conversion of the first vocal input into textual characters by an automatic speech recognition (ASR) engine; and

graphically inputting a second text portion in the second input field, wherein the second text portion is based upon conversion of the second vocal input into textual characters by the ASR engine.

2. The method of claim 1, wherein the ASR engine executes on the one or more processors.

3. The method of claim 1, wherein the ASR engine executes on a remote computing device.

4. The method of claim 1, further comprising:

displaying a status message in the second input field prior to graphically inputting the second text portion in the second input field.

5. The method of claim 1, wherein the detecting further comprises:

receiving a selection by the user of a control of the GUI.

6. The method of claim 1, wherein the detecting further comprises:

detecting a pause within the vocal input having a duration that exceeds a threshold time.

7. The method of claim 1, wherein:

if the vocal input received concurrent to receiving a selection by the user of a second input field of the GUI is not a pause within the vocal input, identifying, as a part of first vocal input intended for the first input field, a portion of the vocal input including the vocal input received concurrent to receiving the selection by the user of the second input and ending at a pause within the vocal input.

8. The method of claim 1, further comprising:

during the receiving of the vocal input, receiving a selection by the user of a third input field of the GUI displayed on the display after receiving the selection by the user of the second input field;

identifying vocal input received after the selection of the third input field as third vocal input intended for the third input field;

graphically inputting a third text portion in the third input field, wherein the third text portion is based upon conversion of the third vocal input into textual characters by the ASR engine.

9. The method of claim 8, wherein graphically inputting the first text portion in the first input field occurs after receiving the selection by the user of the third input field.

10. The method of claim 1, wherein graphically inputting the first text portion in the first input field occurs after receiving the selection by the user of the second input field.

11. The method of claim 1, wherein receiving the selection by the user of the second input field comprises:

detecting contact with an area of a touch-sensitive display of the computing device representing the second input field.

12. The method of claim 1, wherein receiving the selection by the user of the second input field comprises:

detecting contact with a touch-sensitive display of the computing device, the contact corresponding with a gesture.

13. A method performed by a computing device having one or more processors, memory, a microphone, and a display capable of displaying a graphical user interface (GUI), the method comprising:

receiving vocal input from the user, wherein at least a portion of the vocal input is intended for input into a first input field of the GUI displayed on the display;

during the receiving of the vocal input, receiving a selection by the user of a second input field of the GUI displayed on the display;

identifying vocal input received prior to the selection of the second input field as first vocal input intended for the first input field;

identifying vocal input received after the selection of the second input field as second vocal input intended for the second input field;

graphically inputting a first text portion in the first input field, wherein the first text portion is based upon conversion of the first vocal input into textual characters by an automatic speech recognition (ASR) engine; and

graphically inputting a second text portion in the second input field, wherein the second text portion is based upon conversion of the second vocal input into textual characters by the ASR engine.

14. The method of claim 13, wherein the ASR engine executes on the one or more processors.

15. The method of claim 13, wherein the ASR engine executes on a remote computing device.

16. The method of claim 13, further comprising:

displaying a status message in the second input field prior to graphically inputting the second text portion in the second input field.

17. The method of claim 13, wherein:

if the vocal input received concurrent to receiving a selection by the user of a second input field of the GUI is not a pause within the vocal input, identifying, as a part of first vocal input intended for the first input field, a portion of the vocal input including the vocal input received concurrent to receiving the selection by the user of the second input and ending at a pause within the vocal input.

18. The method of claim 13, further comprising:

during the receiving of the vocal input, receiving a selection by the user of a third input field of the GUI displayed on the display after receiving the selection by the user of the second input field;

identifying vocal input received after the selection of the third input field as third vocal input intended for the third input field;

graphically inputting a third text portion in the third input field, wherein the third text portion is based upon conversion of the third vocal input into textual characters by the ASR engine.

19. The method of claim 18, wherein graphically inputting the first text portion in the first input field occurs after receiving the selection by the user of the third input field.

20. The method of claim 13, wherein graphically inputting the first text portion in the first input field occurs after receiving the selection by the user of the second input field.

21. The method of claim 13, wherein receiving the selection by the user of the second input field comprises:

detecting contact with an area of a touch-sensitive display of the computing device representing the second input field.

22. The method of claim 13, wherein receiving the selection by the user of the second input field comprises:

detecting contact with a touch-sensitive display of the computing device, the contact corresponding with a gesture.

23. A computing device comprising:

an output device configured to display a graphical user interface (GUI) including a first input field and a second input field;

a microphone configured to receive vocal input from a user, wherein at least a portion of the vocal input is intended for input into the first input field;

an input device configured to receive a selection by the user of the second input field;

an audio conversion module configured to identify vocal input received prior to the selection of the second input field as first vocal input intended for the first input field, and to identify vocal input received after the selection of the second input field as second vocal input intended for the second input field; and

a input field module configured to graphically input a first text portion in the first input field, wherein the first text portion is based upon conversion of the first vocal input into textual characters by an automatic speech recognition (ASR) engine, and to graphically input a second text portion in the second input field, wherein the second text portion is based upon conversion of the second vocal input into textual characters by the ASR engine.

24. The computing device of claim 23, wherein:

the output device configured to display the GUI including a third input field;

the input device is configured to receive a selection by the user of the third input field;

the audio conversion module configured to identify vocal input received after the selection of the third input field as third vocal input intended for the third input field; and

the text module is configured to graphically input a third text portion in the third input field, wherein the third text portion is based upon conversion of the third vocal input into textual characters by the ASR engine.

25. The computing device of claim 24, wherein:

the input field module is configured to graphically input the first portion of the textual characters into the first input field after the input device accepts the selection of the third input field by the user.

26. The computing device of claim 23, wherein:

the input field module is configured to graphically input the first portion of the textual characters into the first input field after the input device accepts the selection of the second input field by the user.

27. A non-transitory computer-readable medium comprising instructions for causing a programmable processor to perform operations comprising:

receiving vocal input from a user, wherein at least a portion of the vocal input is intended for input into a first input field of a graphical user interface (GUI) displayed on a display;

during the receiving of the vocal input, receiving a selection by the user of a second input field of the GUI displayed on the display;

identifying vocal input received prior to the selection of the second input field as first vocal input intended for the first input field;

identifying vocal input received after the selection of the second input field as second vocal input intended for the second input field;

graphically inputting a first text portion in the first input field, wherein the first text portion is based upon conversion of the first vocal input into textual characters by an automatic speech recognition (ASR) engine; and

graphically inputting a second text portion in the second input field, wherein the second text portion is based upon conversion of the second vocal input into textual characters by the ASR engine.

28. The non-transitory computer-readable medium of claim 27, wherein the instructions cause the processor to perform further operations comprising:

during the receiving of the vocal input, receiving a selection by the user of a third input field of the GUI displayed on the display after receiving the selection by the user of the second input field;

identifying vocal input received after the selection of the third input field as third vocal input intended for the third input field;

graphically inputting a third text portion in the third input field, wherein the third text portion is based upon conversion of the third vocal input into textual characters by the ASR engine.

29. The non-transitory computer-readable medium of claim 28, wherein the instructions that cause the processor to graphically input the first text portion in the first input field include instructions that cause the processor to graphically input the first text portion in the first input field after receiving the selection by the user of the third input field.

30. The non-transitory computer-readable medium of claim 27, wherein the instructions that cause the processor to graphically input the first text portion in the first input field include instructions that cause the processor to graphically input the first text portion in the first input field after receiving the selection by the user of the second input field.