Gesture keyboard input of non-dictionary character strings

• US 10,095,405 B2
• Filed: 09/21/2016
• Issued: 10/09/2018
• Est. Priority Date: 02/05/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Kataoka, Satoshi, Kuroyanagi, Keisuke
• Primary Examiner(s): Yodichkas, Aneeta
• Application Number:
  US15/271,769
• Publication Number:
  US 20170010800A1
• Time in Patent Office: 748 Days
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation
• CPC Class Codes: G06F 40/242 Dictionaries
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs

Abstract

A computing device is described that outputs, for display, a graphical keyboard comprising a plurality of keys. The computing device receives, an indication of a gesture detected at a presence-sensitive input device. The computing device determines, based at least in part on the indication of the gesture and at least one characteristic of the gesture, one or more keys from the plurality of keys. The computing device determines a character string based on the one or more keys from the plurality of keys. In response to determining that the character string is not included in a lexicon and a spatial model probability associated with the one or more keys from the plurality of keys exceeds a probability threshold, the computing device outputs, for display, the character string.

Claims

1. A method comprising:

outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys;

receiving, by the computing device, an indication of a gesture detected at a region of a presence-sensitive input device that is associated with a location at which the plurality of keys are displayed;

determining, by the computing device, based at least in part on the indication of the gesture, a character string that is not included in a lexicon;

determining, by the computing device, based on the character string, a candidate word or phrase from the lexicon;

determining, by the computing device, whether a category of text input associated with the character string is a particular category of text input;

if the category of text input associated with the character string is the particular category of text input, outputting, by the computing device, for display, the character string; and

if the category of text input associated with the character string is not the particular category of text input, outputting, by the computing device, for display, the candidate word or phrase from the lexicon.

2. The method of claim 1, wherein the particular category of text input is one of a group comprising a portion of a name, a portion of an address, and a portion of an electronic mail address.

3. The method of claim 1, wherein the graphical keyboard is output for display as part of a graphical user interface, the method further comprising:

determining, by the computing device, that the character string is associated with a particular portion of the graphical user interface; and

determining, by the computing device, based on the particular portion of the graphical user interface, the category of text input associated with the character string.

4. The method of claim 1, further comprising:

determining, by the computing device, based at least in part on the indication of the gesture, a spatial model probability associated with one or more keys from the plurality of keys; and

adjusting, by the computing device, based on at least one characteristic of the gesture, the spatial model probability associated with the one or more keys from the plurality of keys, wherein;

the character string is further determined based on the adjusted spatial model probability associated with the one or more keys from the plurality of keys; and

the character string is output if the category of text input associated with the character string is not the particular category of text input and if the adjusted spatial model probability associated with the one or more keys from the plurality of keys exceeds a probability threshold.

5. The method of claim 4, wherein the candidate word or phrase from the lexicon is output if the category of text input associated with the character string is the particular category of text input and if the adjusted spatial model probability associated with the one or more keys from the plurality of keys does not exceed the probability threshold.

6. The method of claim 4, wherein the at least one characteristic of the gesture includes at least one of a speed of a portion of the gesture, a density of the portion of the gesture, or a curvature of the portion of the gesture.

7. The method of claim 4, wherein adjusting the spatial model probability associated with the one or more keys from the plurality of keys comprises:

if the at least one characteristic satisfies a threshold, increasing, by the computing device, the spatial model probability associated with the one or more keys; and

if the at least one characteristic does not satisfy the threshold, decreasing, by the computing device, the spatial model probability.

8. The method of claim 1, wherein the character string is output for display at a suggestion region of the graphical keyboard if the category of text input associated with the character string is the particular category of text input.

9. The method of claim 8, further comprising:

while outputting the character string for display at the suggestion region of the graphical keyboard, outputting, by the computing device, for display at the suggestion region of the graphical keyboard, one or more additional candidate words or phrases from the lexicon.

10. A computing device comprising:

at least one processor; and

a memory configured to store instructions that, when executed, cause the at least one processor to;

output, for display at a display device operably coupled to the computing device, a graphical keyboard comprising a plurality of keys;

receive, an indication of a gesture detected at a region of a presence-sensitive input device that is associated with a location of the display device at which the plurality of keys are displayed;

determine, based at least in part on the indication of the gesture, a character string that is not included in a lexicon;

determine, based on the character string, a candidate word or phrase from the lexicon;

determine whether a category of text input associated with the character string is a particular category of text input;

if the category of text input associated with the character string is the particular category of text input, output, for display at the display device, the character string; and

if the category of text input associated with the character string is not the particular category of text input, output, for display at the display device, the candidate word or phrase from the lexicon.

11. The computing device of claim 10, wherein the computing device comprises at least one of the display device or the presence-sensitive input device.

12. The computing device of claim 10, wherein the display device comprises the presence-sensitive input device.

13. The computing device of claim 10, wherein the display device comprises the presence-sensitive input device.

14. The computing device of claim 10, wherein the instructions, when executed, further cause the at least one processor to:

output the graphical keyboard for display as part of a graphical user interface;

determine that the character string is associated with a particular portion of the graphical user interface; and

determine, based on the particular portion of the graphical user interface, the category of text input associated with the character string.

15. The computing device of claim 10, wherein the instructions, when executed, further cause the at least one processor to:

determine, based at least in part on the indication of the gesture, a spatial model probability associated with one or more keys from the plurality of keys;

adjust, based on at least one characteristic of the gesture, the spatial model probability associated with the one or more keys from the plurality of keys;

determine the character string further based on the adjusted spatial model probability associated with the one or more keys from the plurality of keys; and

output the character string if the category of text input associated with the character string is not the particular category of text input and if the adjusted spatial model probability associated with the one or more keys from the plurality of keys exceeds a probability threshold.

16. A non-transitory computer-readable storage medium encoded with instructions that, when executed, cause at least one processor of a computing device to:

output, for display at a display device operably coupled to the computing device, a graphical keyboard comprising a plurality of keys;

receive, an indication of a gesture detected at a region of a presence-sensitive input device that is associated with a location of the display device at which the plurality of keys are displayed;

determine, based at least in part on the indication of the gesture, a character string that is not included in a lexicon;

determine, based on the character string, a candidate word or phrase from the lexicon;

determine whether a category of text input associated with the character string is a particular category of text input;

if the category of text input associated with the character string is the particular category of text input, output, for display at the display device, the character string; and

if the category of text input associated with the character string is not the particular category of text input, output, for display at the display device, the candidate word or phrase from the lexicon.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions, when executed, cause the at least one processor to output the character string for display at a suggestion region of the graphical keyboard if the category of text input associated with the character string is the particular category of text input.

18. The non-transitory computer-readable storage medium of claim 17, wherein the instructions, when executed, further cause the at least one processor to:

while outputting the character string for display at the suggestion region of the graphical keyboard, output, for display at the suggestion region of the graphical keyboard, one or more additional candidate words or phrases from the lexicon.

19. The non-transitory computer-readable storage medium of claim 16, wherein the instructions, when executed, further cause the at least one processor to:

output the graphical keyboard for display as part of a graphical user interface;

determine that the character string is associated with a particular portion of the graphical user interface; and

determine, based on the particular portion of the graphical user interface, the category of text input associated with the character string.

20. The non-transitory computer-readable storage medium of claim 16, wherein the instructions, when executed, further cause the at least one processor to:

determine, based at least in part on the indication of the gesture, a spatial model probability associated with one or more keys from the plurality of keys;

adjust, based on at least one characteristic of the gesture, the spatial model probability associated with the one or more keys from the plurality of keys;

determine the character string further based on the adjusted spatial model probability associated with the one or more keys from the plurality of keys; and

output the character string if the category of text input associated with the character string is not the particular category of text input and if the adjusted spatial model probability associated with the one or more keys from the plurality of keys exceeds a probability threshold.