Incremental multi-word recognition

• US 10,489,508 B2
• Filed: 09/13/2017
• Issued: 11/26/2019
• Est. Priority Date: 10/16/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Zhai, Shumin, Ouyang, Yu, Wakasa, Ken, Kataoka, Satoshi
• Primary Examiner(s): Nguyen, Cao H
• Application Number:
  US15/703,820
• Publication Number:
  US 20180018314A1
• Time in Patent Office: 804 Days
• Field of Search: 715715, 715750, 715763-765
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates

Abstract

In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

Claims

1. A method comprising:

displaying a graphical user interface including a committed-text region, a text-suggestion region, and a graphical keyboard comprising a plurality of keys;

detecting, at regions of a presence-sensitive input device that correspond to locations of a display device at which at least two different keys from the plurality of keys are displayed, a single continuous gesture;

determining, by a computing device, based on the single continuous gesture, a candidate phrase comprising at least two candidate words, a first candidate word from the at least two candidate words comprising a first character associated with a first key from the at least two different keys and a second candidate word from the at least two candidate words comprising a second character associated with a second key from the at least two different keys;

displaying, in the committed-text region of the graphical user interface, a respective character associated with each key from the plurality of keys that is selected by the single continuous gesture; and

displaying, in the text-suggestion region of the graphical user interface, each word in the candidate phrase separated by a space character.

2. The method of claim 1, wherein the candidate phrase comprises one or more characters that are not associated with any keys from the plurality of keys that are selected by the single continuous gesture.

3. The method of claim 1, wherein displaying the respective character associated with each key from the plurality of keys that is selected by the single continuous gesture comprises displaying a respective character associated with each key from the plurality of keys that is displayed at a region of the presence-sensitive input device that corresponds to a location of the display device at which the single continuous gesture is detected.

4. The method of claim 1, further comprising:

determining, by the computing device and based at least in part on the first key, a word-level token comprising a single string of a plurality of predicted characters;

determining, by the computing device, that the word-level token represents the first candidate word; and

responsive to determining that the word-level token represents the first candidate word, determining, by the computing device, a phrase-level token based at least in part on the word-level token and the second key, wherein the phrase-level token comprises a plurality of character strings including the first candidate word and the second candidate word.

5. The method of claim 4, further comprising:

determining, by the computing device, the candidate phrase based at least in part on the phrase-level token.

6. The method of claim 1, wherein at least one of:

the committed-text region is positioned, within the graphical user interface, above the graphical keyboard;

the suggested-text region is positioned, within the graphical user interface, above the graphical keyboard;

or

the suggested-text region is positioned, within the graphical user interface, between the committed-text region and the graphical keyboard.

7. The method of claim 1, wherein no spacebar key from the plurality of keys is selected by the single continuous gesture.

8. The method of claim 1, wherein detecting the single continuous gesture comprises detecting only a single lift-off event at the presence-sensitive input device.

9. A computing device comprising:

a display device;

a presence-sensitive input device; and

at least one processor configured to;

output, for display at the display device, a graphical user interface including a committed-text region, a text-suggestion region, and a graphical keyboard comprising a plurality of keys;

detect, at regions of a presence-sensitive input device that correspond to locations of a display device at which at least two different keys from the plurality of keys are displayed, a single continuous gesture;

determine, based on the single continuous gesture, a candidate phrase comprising at least two candidate words, a first candidate word from the at least two candidate words comprising a first character associated with a first key from the at least two different keys and a second candidate word from the at least two candidate words comprising a second character associated with a second key from the at least two different keys;

output, for display in the committed-text region of the graphical user interface, a respective character associated with each key from the plurality of keys that is selected by the single continuous gesture; and

output, for display in the text-suggestion region of the graphical user interface, each word in the candidate phrase separated by a space character.

10. The computing device of claim 9, wherein the candidate phrase comprises one or more characters that are not associated with any keys from the plurality of keys that are selected by the single continuous gesture.

11. The computing device of claim 9, wherein the at least one processor is configured to output the respective character associated with each key from the plurality of keys that is selected by the single continuous gesture for display by at least outputting, for display, a respective character associated with each key from the plurality of keys that is displayed at a region of the presence-sensitive input device that corresponds to a location of the display device at which the single continuous gesture is detected.

12. The computing device of claim 9, wherein the at least one processor is further configured to:

determine, based at least in part on the first key, a word-level token comprising a single string of a plurality of predicted characters;

determine that the word-level token represents the first candidate word; and

responsive to determining that the word-level token represents the first candidate word, determine a phrase-level token based at least in part on the word-level token and the second key, wherein the phrase-level token comprises a plurality of character strings including the first candidate word and the second candidate word.

13. The computing device of claim 12, wherein the at least one processor is further configured to:

determine the candidate phrase based at least in part on the phrase-level token.

14. The computing device of claim 9, wherein at least one of:

the display device is configured to display the committed-text region positioned, within the graphical user interface, above the graphical keyboard;

or

the display device is configured to display the suggested-text region positioned, within the graphical user interface, above the graphical keyboard.

15. The computing device of claim 9, wherein the display device is configured to display the suggested-text region positioned, within the graphical user interface, between the committed-text region and the graphical keyboard.

16. The computing device of claim 9, wherein the computing device comprises a presence-sensitive display that includes the display device and the presence-sensitive input device.

17. A non-transitory computer-readable storage medium comprising instructions that, when executed, cause at least one processor of a computing device to:

output, for display, a graphical user interface including a committed-text region, a text-suggestion region, and a graphical keyboard comprising a plurality of keys;

detect, at regions of a presence-sensitive input device that correspond to locations of a display device at which at least two different keys from the plurality of keys are displayed, a gesture;

determine, by a computing device, based on the gesture, a candidate phrase comprising at least two candidate words, a first candidate word from the at least two candidate words comprising a first character associated with a first key from the at least two different keys and a second candidate word from the at least two candidate words comprising a second character associated with a second key from the at least two different keys;

output, for display, in the committed-text region of the graphical user interface, a respective character associated with each key from the plurality of keys that is selected by the single continuous gesture; and

output, for display, in the text-suggestion region of the graphical user interface, each word in the candidate phrase separated by a space character.

18. The non-transitory computer-readable storage medium of claim 17, wherein the candidate phrase comprises one or more characters that are not associated with any keys from the plurality of keys that are selected by the single continuous gesture.

19. The non-transitory computer-readable storage medium of claim 17, wherein at least one of:

the display device is configured to display the committed-text region positioned, within the graphical user interface, above the graphical keyboard;

or

the display device is configured to display the suggested-text region positioned, within the graphical user interface, above the graphical keyboard.

20. The non-transitory computer-readable storage medium of claim 17, wherein the display device is configured to display the suggested-text region positioned, within the graphical user interface, between the committed-text region and the graphical keyboard.