Incremental multi-word recognition

• US 9,798,718 B2
• Filed: 09/14/2016
• Issued: 10/24/2017
• Est. Priority Date: 10/16/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Zhai, Shumin, Ouyang, Yu, Wakasa, Ken, Kataoka, Satoshi
• Primary Examiner(s): Nguyen, Kevin
• Application Number:
  US15/264,876
• Publication Number:
  US 20170003869A1
• Time in Patent Office: 405 Days
• Field of Search: 715773, 715780, 715763-765
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates

Abstract

In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

Claims

1. A method comprising:

outputting, by a computing device, for display at a display device, a graphical user interface including a committed-text region, a text-suggestion region, and a graphical keyboard comprising a plurality of keys;

determining, by the computing device, a first single-touch gesture detected at a first region of a presence-sensitive input device that corresponds to a first location of the display device at which a first key of the plurality of keys is displayed and a second single-touch gesture detected at a second region of the presence-sensitive input device that corresponds to a second location of the display device at which a second key of the plurality of keys is displayed, wherein a first character is associated with the first key and a second character is associated with the second key;

determining, by the computing device, based on the first single-touch gesture and the second single-touch gesture, a first candidate word of a candidate phrase and a second candidate word of the candidate phrase, wherein the first candidate word comprises the first character and the second candidate word comprises the second character;

outputting, by the computing device, for display in the committed-text region of the graphical user interface, the first candidate word and the second candidate word; and

outputting, by the computing device and for display in the text-suggestion region of the graphical user interface, at least one next word that is subsequent to the first candidate word and the second candidate word in the candidate phrase.

2. The method of claim 1, further comprising:

prior to outputting the first candidate word and the second candidate word for display in the committed-text region of the graphical user interface, outputting, for display in the text-suggestion region, the first candidate word, the second candidate word, and the at least one next word,

wherein outputting the at least one next word for display in the text-suggestion region comprises outputting the at least one next word for display in the text-suggestion region such that the first candidate word and the second candidate word are no longer output for display in the text-suggestion region.

3. The method of claim 2, further comprising:

outputting the at least one next word is output for display in the text-suggestion region such that the first candidate word and the second candidate word are no longer output for display in the text-suggestion region is in response to determining that a phrase-level token associated with the first single-touch gesture and the second single-touch gesture no longer includes a character string associated with the first candidate word and the second candidate word.

4. The method of claim 1, further comprising:

selecting, by the computing device and based at least in part on the first single-touch gesture and the second single touch gesture, the first key and the second key of the plurality of keys;

determining, by the computing device and based at least in part on the first key, a word-level token comprising a single string of a plurality of predicted characters;

determining, by the computing device, that the word-level token represents the first candidate word; and

responsive to determining that the word-level token represents the first candidate word, determining, by the computing device, a phrase-level token based at least in part on the word-level token and the second key, wherein the phrase-level token comprises a plurality of character strings including the first candidate word, the second candidate word, and the at least one next word.

5. The method of claim 4, further comprising:

determining, by the computing device, the candidate phrase based at least in part on the phrase-level token.

6. The method of claim 1, wherein at least one of:

the committed-text region is positioned, within the graphical user interface, above the graphical keyboard;

or

the suggested-text region is positioned, within the graphical user interface, above the graphical keyboard.

7. The method of claim 1, wherein the suggested-text region is positioned, within the graphical user interface, between the committed-text region and the graphical keyboard.

8. The method of claim 1, wherein:

the first single-touch gesture is one of a first plurality of single-touch gestures detected at the presence-sensitive input device;

the second single-touch gesture is one of a second plurality of single-touch gestures detected at the presence-sensitive input device;

the first candidate word is further determined based at least in part on the first plurality of single-touch gestures; and

the second candidate word is further determined based at least in part on the second plurality of single-touch gestures.

9. A computing device comprising:

at least one processor;

a presence-sensitive display; and

a memory configured to store instructions that, when executed, cause the at least one processor to;

output, for display at the presence-sensitive display, a graphical user interface including a committed-text region, a text-suggestion region, and a graphical keyboard comprising a plurality of keys;

determine a first single-touch gesture detected at a first region of the presence-sensitive display at which a first key of the plurality of keys is displayed and a second single-touch gesture detected at a second region of the presence-sensitive display at which a second key of the plurality of keys is displayed, wherein a first character is associated with the first key and a second character is associated with the second key;

determine, based on the first single-touch gesture and the second single-touch gesture, a first candidate word of a candidate phrase and a second candidate word of the candidate phrase, wherein the first candidate word comprises the first character and the second candidate word comprises the second character;

output, for display in the committed-text region of the graphical user interface, the first candidate word and the second candidate word; and

output, for display in the text-suggestion region of the graphical user interface, at least one next word that is subsequent to the first candidate word and the second candidate word in the candidate phrase.

10. The computing device of claim 9,

wherein the instructions, when executed, further cause the at least one processor to, prior to outputting the first candidate word and the second candidate word for display in the committed-text region of the graphical user interface, output, for display in the text-suggestion region, the first candidate word, the second candidate word, and the at least one next word, and

wherein the instructions, when executed, further cause the at least one processor to output the at least one next word for display in the text-suggestion region by at least outputting the at least one next word for display in the text-suggestion region such that the first candidate word and the second candidate word are no longer output for display in the text-suggestion region.

11. The computing device of claim 10, wherein the instructions, when executed, cause the at least one processor to output the at least one next word for display in the text-suggestion region such that the first candidate word and the second candidate word are no longer output for display in the text-suggestion region in response to determining that a phrase-level token associated with the first single-touch gesture and the second single-touch gesture no longer includes a character string associated with the first candidate word and the second candidate word.

12. The computing device of claim 9, wherein the instructions, when executed, further cause the at least one processor to:

select, based at least in part on the first single-touch gesture and the second single touch gesture, the first key and the second key of the plurality of keys;

determine, based at least in part on the first key, a word-level token comprising a single string of a plurality of predicted characters;

determine that the word-level token represents the first candidate word; and

in response to determining that the word-level token represents the first candidate word, determine a phrase-level token based at least in part on the word-level token and the second key, wherein the phrase-level token comprises a plurality of character strings including the first candidate word, the second candidate word, and the at least one next word.

13. The computing device of claim 9, wherein the instructions, when executed, further cause the at least one processor to determine the candidate phrase based at least in part on the phrase-level token.

14. The computing device of claim 9, wherein at least one of:

the committed-text region is positioned, within the graphical user interface, above the graphical keyboard;

the suggested-text region is positioned, within the graphical user interface, above the graphical keyboard;

or

the suggested-text region is positioned, within the graphical user interface, between the committed-text region and the graphical keyboard.

15. A non-transitory computer-readable storage medium comprising instructions that, when executed, cause at least one processor of a computing device to:

output, for display at a presence-sensitive display of the computing device, a graphical user interface including a committed-text region, a text-suggestion region, and a graphical keyboard comprising a plurality of keys;

determine a first single-touch gesture detected at a first region of the presence-sensitive display at which a first key of the plurality of keys is displayed and a second single-touch gesture detected at a second region of the presence-sensitive display at which a second key of the plurality of keys is displayed, wherein a first character is associated with the first key and a second character is associated with the second key;

determine, based on the first single-touch gesture and the second single-touch gesture, a first candidate word of a candidate phrase and a second candidate word of the candidate phrase, wherein the first candidate word comprises the first character and the second candidate word comprises the second character;

output, for display in the committed-text region of the graphical user interface, the first candidate word and the second candidate word; and

output, for display in the text-suggestion region of the graphical user interface, at least one next word that is subsequent to the first candidate word and the second candidate word in the candidate phrase.

16. The non-transitory computer-readable storage medium of claim 15,

wherein the instructions, when executed, further cause the at least one processor to, prior to outputting the first candidate word and the second candidate word for display in the committed-text region of the graphical user interface, output, for display in the text-suggestion region, the first candidate word, the second candidate word, and the at least one next word, and

wherein the instructions, when executed, further cause the at least one processor to output the at least one next word for display in the text-suggestion region by at least outputting the at least one next word for display in the text-suggestion region such that the first candidate word and the second candidate word are no longer output for display in the text-suggestion region.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions, when executed, cause the at least one processor to output the at least one next word for display in the text-suggestion region such that the first candidate word and the second candidate word are no longer output for display in the text-suggestion region in response to determining that a phrase-level token associated with the first single-touch gesture and the second single-touch gesture no longer includes a character string associated with the first candidate word and the second candidate word.

18. The non-transitory computer-readable storage medium of claim 15, wherein the instructions, when executed, further cause the at least one processor to:

select, based at least in part on the first single-touch gesture and the second single touch gesture, the first key and the second key of the plurality of keys;

determine, based at least in part on the first key, a word-level token comprising a single string of a plurality of predicted characters;

determine that the word-level token represents the first candidate word; and

in response to determining that the word-level token represents the first candidate word, determine a phrase-level token based at least in part on the word-level token and the second key, wherein the phrase-level token comprises a plurality of character strings including the first candidate word, the second candidate word, and the at least one next word.

19. The non-transitory computer-readable storage medium of claim 15, wherein the instructions, when executed, further cause the at least one processor to determine the candidate phrase based at least in part on the phrase-level token.

20. The non-transitory computer-readable storage medium of claim 15, wherein at least one of:

the committed-text region is positioned, within the graphical user interface, above the graphical keyboard;

the suggested-text region is positioned, within the graphical user interface, above the graphical keyboard;

or

the suggested-text region is positioned, within the graphical user interface, between the committed-text region and the graphical keyboard.