Word-level correction of speech input

• US 10,672,394 B2
• Filed: 12/21/2017
• Issued: 06/02/2020
• Est. Priority Date: 01/05/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: LeBeau, Michael J., Byrne, William J., Jitkoff, John Nicholas, Ballinger, Brandon M., Kristjansson, Trausti T.
• Primary Examiner(s): Guerra-Erazo, Edgar X
• Application Number:
  US15/849,967
• Publication Number:
  US 20180114530A1
• Time in Patent Office: 894 Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/137 Hierarchical processing, e.g. outlines
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

The subject matter of this specification can be implemented in, among other things, a computer-implemented method for correcting words in transcribed text including receiving speech audio data from a microphone. The method further includes sending the speech audio data to a transcription system. The method further includes receiving a word lattice transcribed from the speech audio data by the transcription system. The method further includes presenting one or more transcribed words from the word lattice. The method further includes receiving a user selection of at least one of the presented transcribed words. The method further includes presenting one or more alternate words from the word lattice for the selected transcribed word. The method further includes receiving a user selection of at least one of the alternate words. The method further includes replacing the selected transcribed word in the presented transcribed words with the selected alternate word.

Claims

1. A computer-implemented method comprising:

providing a transcription of an utterance in a region of a touch-sensitive display;

receiving data indicating single touch selection of a particular word in the transcription of the utterance in the region of the touch-sensitive display;

determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a particular type of touch selection; and

in response to determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is the particular type of touch selection, providing an updated transcription of the utterance in the region of the touch-sensitive display.

2. The method of claim 1, wherein determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a particular type of touch selection comprises determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a long press touch selection.

3. The method of claim 1, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing a new transcription of the utterance in which the particular word is removed.

4. The method of claim 1, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing a new transcription of the utterance in which the particular word is replaced with a different word.

5. The method of claim 1, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing the updated transcription of the utterance without displaying an alternates list.

6. The method of claim 1, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises a new transcription in which a multi-word phrase that includes the particular word is replaced with a different multi-word phrase that does not include the particular word.

7. The method of claim 1, comprising:

obtaining a word lattice based on performing automated speech recognition on audio data; and

selecting the transcription based on the word lattice.

8. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

providing a transcription of an utterance in a region of a touch-sensitive display;

receiving data indicating single touch selection of a particular word in the transcription of the utterance in the region of the touch-sensitive display;

determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a particular type of touch selection; and

in response to determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is the particular type of touch selection, providing an updated transcription of the utterance in the region of the touch-sensitive display.

9. The system of claim 8, wherein determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a particular type of touch selection comprises determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a long press touch selection.

10. The system of claim 8, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing a new transcription of the utterance in which the particular word is removed.

11. The system of claim 8, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing a new transcription of the utterance in which the particular word is replaced with a different word.

12. The system of claim 8, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing the updated transcription of the utterance without displaying an alternates list.

13. The system of claim 8, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises a new transcription in which a multi-word phrase that includes the particular word is replaced with a different multi-word phrase that does not include the particular word.

14. The system of claim 8, wherein the operations comprise:

obtaining a word lattice based on performing automated speech recognition on audio data; and

selecting the transcription based on the word lattice.

15. A computer-readable non-transitory medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

providing a transcription of an utterance in a region of a touch-sensitive display;

receiving data indicating single touch selection of a particular word in the transcription of the utterance in the region of the touch-sensitive display;

determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a particular type of touch selection; and

in response to determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is the particular type of touch selection, providing an updated transcription of the utterance in the region of the touch-sensitive display.

16. The medium of claim 15, wherein determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a particular type of touch selection comprises determining that the single touch selection of the particular word in the transcription of the utterance in the region of the touch-sensitive display is a long press touch selection.

17. The medium of claim 15, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing a new transcription of the utterance in which the particular word is removed.

18. The medium of claim 15, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing a new transcription of the utterance in which the particular word is replaced with a different word.

19. The medium of claim 15, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises providing the updated transcription of the utterance without displaying an alternates list.

20. The medium of claim 15, wherein providing the updated transcription of the utterance in the region of the touch-sensitive display comprises a new transcription in which a multi-word phrase that includes the particular word is replaced with a different multi-word phrase that does not include the particular word.