Gesture keyboard with gesture cancellation

• US 9,569,107 B2
• Filed: 04/19/2013
• Issued: 02/14/2017
• Est. Priority Date: 10/16/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Zhai, Shumin, Partridge, Kurt Edward, Bi, Xiaojun, Ouyang, Yu
• Primary Examiner(s): CHOI, DAVID E
• Application Number:
  US13/866,680
• Publication Number:
  US 20140108993A1
• Time in Patent Office: 1,397 Days
• Field of Search: 715/773
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof

Abstract

In one example, a method includes outputting, for display at a presence-sensitive display, a graphical user interface comprising a graphical keyboard that includes a group of keys, wherein each key in the group of keys is associated with a respective, different region of the presence-sensitive display. The method further includes receiving an indication of a gesture to select a sequence of one or more keys in the group of keys of the graphical keyboard. The method further includes determining, based at least in part on the indication of the gesture, that the gesture includes at least one feature associated with a cancellation of the selected sequence of one or more keys. The method further includes, in response to determining that the gesture includes the at least one feature associated with the cancellation, omitting the selected sequence of one or more keys from entry to a text input field.

Claims

1. A method comprising:

outputting, by a computing device and for display at a presence-sensitive display, a graphical user interface comprising a text input field and a graphical keyboard that includes a group of keys;

receiving, by the computing device, an indication of an initial portion of a continuous gesture;

determining, by the computing device, based on an initial portion of the continuous gesture, a sequence of keys from the group of keys;

outputting, by the computing device, for display at the text input field of the graphical user interface, one or more characters associated with the sequence of keys determined based on the initial portion of the continuous gesture;

after receiving the indication of the initial portion of the continuous gesture, receiving, by the computing device, an indication of a subsequent portion of the continuous gesture;

responsive to determining that at least one feature of the subsequent portion of the continuous gesture indicates a user intended cancellation of the initial portion and the subsequent portion of the continuous gesture, determining, by the computing device, a probability that the subsequent portion of the continuous gesture in combination with the initial portion of the continuous gesture represents a selection letters to complete any potential word in a language model of the computing device, wherein the at least one feature comprises a zigzag pattern having first and second groups of vertices that are each associated with a respective area of the graphical user interface that is substantially the same size or smaller than one of the keys in the graphical keyboard;

after outputting the one or more characters at the text input field of the graphical user interface and in response to determining that the probability is below a threshold, omitting, by the computing device, from the text input field of the graphical user interface, all characters determined based on the continuous gesture including the one or more characters associated with the sequence of keys determined based on the initial portion of the continuous gesture.

2. The method of claim 1, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined location of the graphical user interface associated with the subsequent portion of the gesture.

3. The method of claim 2, wherein the determined location of the graphical user interface comprises the text input field.

4. The method of claim 2, wherein the determined location of the graphical user interface comprises a non-textual character key in the group of keys of the graphical keyboard.

5. The method of claim 4, wherein the non-textual character key comprises a space bar in the group of keys of the graphical keyboard.

6. The method of claim 1, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined shape.

7. The method of claim 1, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined path over time.

8. The method of claim 7, wherein the determined path over time comprises a path that extends back and forth more than once within a confined area of the graphical keyboard.

9. The method of claim 8, wherein the confined area is substantially the same width or narrower than a width of one of the keys in the graphical keyboard.

10. The method of claim 1, wherein determining that the probability is below the threshold comprises processing, by the computing device, a path of the continuous gesture based on one or more of:

the language model, a comparison with adjacent keys, and a model of gesture input motions.

11. The method of claim 1, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined path along the graphical user interface.

12. The method of claim 11, wherein the determined path extends from within the graphical keyboard to an edge of the graphical keyboard.

13. The method of claim 11, wherein the determined path extends from within the graphical keyboard to outside the graphical keyboard.

22. The method of claim 1, further comprising:

after receiving the indication of the subsequent portion of the continuous gesture, receiving, by the computing device, an indication of a third portion of the continuous gesture;

determining, by the computing device, based only on the third portion of the continuous gesture, a word in the language model;

after omitting the one or more characters from the text input field of the graphical user interface, outputting, by the computing device for display at the text input field of the graphical user interface, the word.

23. The method of claim 22, wherein the continuous gesture is a single gesture continuously being detected by the presence-sensitive display while receiving the indications of initial portion of the continuous gesture, the subsequent portion of the continuous gesture, and the third portion of the continuous gesture.

14. A computing device, comprising:

at least one processor; and

a memory configured to store instructions that when executed cause the at least one processor to;

output, for display at a presence-sensitive display, a graphical user interface comprising a text input field and a graphical keyboard that includes a group of keys;

receive an indication of an initial portion of a continuous gesture;

determine, based on the initial portion of the continuous gesture, a sequence of keys from the group of keys;

output, for display at the text input field of the graphical user interface, one or more characters associated with the sequence of keys determined based on the initial portion of the continuous gesture;

after receiving the indication of the initial portion of the continuous gesture, receive an indication of a subsequent portion of the continuous gesture;

responsive to determining that at least one feature of the subsequent portion of the continuous gesture indicates a user intended cancellation of the initial portion and the subsequent portion of the continuous gesture, determine a probability that the subsequent portion of the continuous gesture in combination with the initial portion of the continuous gesture represents a selection of letters to complete any potential word in a language model of the computing device,

wherein the at least one feature comprises a zigzag pattern having first and second groups of vertices that are each associated with a respective area of the graphical user interface that is substantially the same size or smaller than one of the keys in the graphical keyboard; and

after outputting the one or more characters at the text input field of the graphical user interface and in response to determining that the probability is below a threshold, omit, from the text input field of the graphical user interface, all characters determined based on the continuous gesture including the one or more characters associated with the sequence of keys determined based on the initial portion of the continuous gesture.

15. The computing device of claim 14, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined location of the graphical user interface.

16. The computing device of claim 14, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined shape.

17. The computing device of claim 14, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined path along the graphical user interface.

24. The computing device of claim 14, wherein the instructions, when executed, further cause the at least one processor to:

after receiving the indication of the subsequent portion of the continuous gesture, receive an indication of a third portion of the continuous gesture;

determine, based only on the third portion of the continuous gesture, a word in the language model;

after omitting the one or more characters from the text input field of the graphical user interface, output, for display at the text input field of the graphical user interface, the word.

25. The computing device of claim 24, wherein the continuous gesture is a single gesture continuously being detected by the presence-sensitive display while the at least one processor receives the indications of initial portion of the continuous gesture, the subsequent portion of the continuous gesture, and the third portion of the continuous gesture.

18. A non-transitory computer-readable storage medium encoded with instructions executable by at least one processor to:

output, for display at a presence-sensitive display, a graphical user interface comprising a text input field and a graphical keyboard that includes a group of keys;

receive an indication of an initial portion of a continuous gesture;

determine, based on the initial portion of the continuous gesture, a sequence of keys from the group of keys;

output, for display at the text input field, one or more characters associated with the sequence of keys determined based on the initial portion of the continuous gesture;

after receiving the indication of the initial portion of the continuous gesture, receive an indication of a subsequent portion of the continuous gesture;

responsive to determining that at least one feature of the subsequent portion of the continuous gesture indicates a user intended cancellation of the initial portion and the subsequent portion of the continuous gesture, determine a probability that the subsequent portion of the continuous gesture in combination with the initial portion of the continuous gesture represents a selection of letters to complete any potential word in a language model of the computing device, wherein the at least one feature comprises a zigzag pattern having first and second groups of vertices that are each associated with a respective area of the graphical user interface that is substantially the same size or smaller than one of the keys in the graphical keyboard; and

after outputting the one or more characters at the text input field of the graphical user interface and in response to determining that the probability is below a threshold, omit, from the text input field of the graphical user interface, all characters determined based on the continuous gesture including the one or more characters determined based on the initial portion of the continuous gesture.

19. The non-transitory computer-readable storage medium of claim 18, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined location of the graphical user interface.

20. The non-transitory computer-readable storage medium of claim 18, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined shape.

21. The non-transitory computer-readable storage medium of claim 18, wherein the at least one feature of the subsequent portion of the continuous gesture comprises a determined path along the graphical user interface.

26. The non-transitory computer-readable storage medium of claim 18, wherein the instructions, when executed, further cause the at least one processor to:

after receiving the indication of the subsequent portion of the continuous gesture, receive an indication of a third portion of the continuous gesture;

determine, based only on the third portion of the continuous gesture, a word in the language model;

after omitting the one or more characters from the text input field of the graphical user interface, output, for display at the text input field of the graphical user interface, the word.

27. The non-transitory computer-readable storage medium of claim 26, wherein the continuous gesture is a single gesture continuously being detected by the presence-sensitive display while the at least one processor receives the indications of initial portion of the continuous gesture, the subsequent portion of the continuous gesture, and the third portion of the continuous gesture.