Dynamically-positioned character string suggestions for gesture typing

• US 9,547,439 B2
• Filed: 11/10/2014
• Issued: 01/17/2017
• Est. Priority Date: 04/22/2013
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bi, Xiaojun, Zhai, Shumin, Cleron, Michael Andrew
• Primary Examiner(s): TITCOMB, WILLIAM D
• Application Number:
  US14/537,730
• Publication Number:
  US 20150074586A1
• Time in Patent Office: 799 Days
• Field of Search: 715/773
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs

Abstract

A computing device outputs, for display, a virtual keyboard comprising a plurality of virtual keys. Furthermore, the computing device receives an indication of a first movement of an input object along a spatial path. The computing device determines, based on locations of the virtual keys and locations along the spatial path, a plurality of character strings. In response to determining that the first movement has ceased for at least a threshold amount of time, the computing device outputs, for display, the plurality of character strings. While the character strings are displayed, the computing device receives an indication of a second movement of the input object. The computing device selects, in response to the indication of the second movement, and based at least in part on a direction of the second movement of the input object, a particular character string from the plurality of character strings.

Claims

1. A method comprising:

receiving, by a computing device, an indication of movement of an input object along a spatial path of a presence-sensitive input device operatively coupled to the computing device, the computing device being operatively coupled to a display device;

determining, by the computing device and based at least in part on one or more respective locations along the spatial path, a plurality of character strings;

detecting, after receiving the indication of movement of the input object along the spatial path, a suspension of movement of the input object for an amount of time that exceeds a threshold, wherein during the suspension of movement of the input object, the input object is at a particular location of the display device;

responsive to detecting the suspension of movement of the input object, outputting, by the computing device, the plurality of character strings for display at locations of the display device determined based on the particular location;

during a time period that the plurality of character strings is displayed, receiving, by the computing device, an indication of a resumption of movement of the input object following the suspension of movement of the input object;

responsive to receiving the indication of the resumption of movement, selecting by the computing device, based on a direction of movement of the input object after the resumption of movement, a particular character string from the plurality of character strings; and

responsive to receiving an indication of a termination of movement of the input object after the resumption of movement, outputting, by the computing device, for display in a text input area displayed by the display device, the selected character string.

2. The method of claim 1, wherein selecting the particular character string comprises:

selecting, by the computing device, based on the direction of movement of the input object after the resumption of movement being toward the particular character string, the particular character string from the plurality of character strings.

3. The method of claim 1, wherein:

outputting the plurality of character strings comprises outputting, by the computing device, for display, the plurality of character strings in a horizontally-oriented or vertically-oriented array.

4. The method of claim 1,

wherein outputting the plurality of character strings comprises outputting, by the computing device, for display, the plurality of character strings such that, for each respective character string of the plurality character strings, a distance between the respective character string and the particular location is substantially equal to a same value.

5. The method of claim 1, further comprising:

responsive to determining that the direction of movement of the input object after the resumption of the movement is not an applicable direction, removing, by the computing device, the plurality of character strings from display, wherein;

if the plurality of character strings is displayed in a horizontally-oriented array, the applicable direction is leftward or rightward,

if the plurality of character strings is displayed in a vertically-oriented array, the applicable direction is upward or downward, and

if the plurality of character strings are displayed such that, for each respective character string of the plurality character strings, a distance between the respective character string and the particular location is substantially equal to a same value, the applicable direction is toward one of the character strings.

6. The method of claim 1, wherein:

the plurality of character strings is a first plurality of character strings,

after the resumption of movement, movement of the input object is along an extension of the spatial path,

selecting the particular character string comprises;

responsive to determining that a distance traveled by the input object after the resumption of movement is less than a threshold distance, selecting, by the computing device, based at least in part on a direction of the input object along the extension of the spatial path, the particular character string from the plurality of character strings, and

the method further comprises;

responsive to determining that the distance traveled by the input object after the resumption of movement is greater than the threshold distance, determining, by the computing device, based at least in part on respective locations of the virtual keys and respective locations along the spatial path and one or more locations along the extension of the spatial path, a second plurality of character strings that is different than the first plurality of character strings; and

outputting, by the computing device, for display, the second plurality of character strings.

7. The method of claim 1, further comprising, responsive to selecting the particular character string, outputting, by the computing device, for display, the particular character string such that the particular character string is indicated as being currently selected.

8. The method of claim 1, wherein determining the plurality of character strings comprises:

determining, by the computing device and based at least in part on the one or more respective locations along the spatial path and respective locations of one or more virtual keys of a virtual keyboard, the plurality of character strings.

9. A computing device comprising one or more processors configured to:

responsive to receiving an indication of movement of an input object along a spatial path, determine, based at least in part on one or more respective locations along the spatial path, a plurality of character strings, wherein movement of the input object is detected at a presence-sensitive input device operatively coupled to the computing device, the computing device being operatively coupled to a display device;

detect, after receiving the indication of movement of the input object along the spatial path, a suspension of movement of the input object for at least an amount of time that exceeds a threshold, wherein during the suspension of movement of the input object, the input object is at a particular location of the display device;

responsive to detecting the suspension of movement of the input object, output the plurality of character strings for display at locations of the display device determined based on the particular location;

responsive to receiving an indication of a resumption of movement of the input object following the suspension of movement of the input object and during a time period that the plurality of character strings is displayed, selecting, by the computing device, based on a direction of movement of the input object after the resumption of movement, a particular character string from the plurality of character strings; and

responsive to receiving an indication of a termination of movement of the input object, output, for display in a text input area displayed by the display device, the selected character string.

10. The computing device of claim 9, wherein the one or more processors are configured to:

select, based on the direction of movement of the input object after the resumption of movement being toward the particular character string, the particular character string from the plurality of character strings.

11. The computing device of claim 9, wherein the one or more processors are configured to:

output, for display, the plurality of character strings in a horizontally-oriented or vertically-oriented array.

12. The computing device of claim 9, wherein the one or more processors are configured to:

output, for display, the plurality of character strings such that, for each respective character string of the plurality character strings, a distance between the respective character string and the particular location is substantially equal to a same value.

13. The computing device of claim 9, wherein:

the one or more processors are configured to remove the plurality of character strings from display responsive to determining that the direction of movement of the input object after the resumption of movement is not an applicable direction,

if the plurality of character strings is displayed in a horizontally-oriented array, the applicable direction is leftward or rightward,

if the plurality of character strings is displayed in a vertically-oriented array, the applicable direction is upward or downward, and

if the plurality of character strings are displayed such that, for each respective character string of the plurality character strings, a distance between the respective character string and the particular location is substantially equal to a same value, the applicable direction is toward one of the character strings.

14. The computing device of claim 9, wherein:

the plurality of character strings is a first plurality of character strings,

after the resumption of movement, movement of the input object is along an extension of the spatial path, and

the one or more processors are configured to;

responsive to determining that a distance traveled by the input object after the resumption of movement is less than a threshold distance, select, based at least in part on a direction of the input object along the extension of the spatial path, the particular character string from the plurality of character strings;

responsive to determining that the distance traveled by the input object after the resumption of movement is greater than the threshold distance, determine, based at least in part on respective locations of the virtual keys and respective locations along the spatial path and one or more locations along the extension of the spatial path, a second plurality of character strings that is different than the first plurality of character strings; and

output, for display, the second plurality of character strings.

15. The computing device of claim 9, wherein the one or more processors are configured to, responsive to selecting the particular character string, output, for display, the particular character string such that the particular character string is indicated as being currently selected.

16. The computing device of claim 9, wherein the one or more processors are configured to determine, based at least in part on the one or more respective locations along the spatial path and respective locations of one or more virtual keys of a virtual keyboard, the plurality of character strings.

17. A non-transitory computer-readable data storage medium having instructions stored thereon that, when executed, cause a computing device to:

responsive to receiving an indication of movement of an input object along a spatial path, determine, based at least in part on one or more respective locations along the spatial path and respective locations of one or more virtual keys of a virtual keyboard, a plurality of character strings, wherein movement of the input object is detected at a presence-sensitive input device operatively coupled to the computing device, the computing device being operatively coupled to a display device;

detect, after receiving the indication of movement of the input object along the spatial path, a suspension of movement of the input object for at least an amount of time that exceeds a threshold, wherein during the suspension of movement of the input object, the input object is at a particular location of the display device;

responsive to detecting the suspension of movement of the input object, output the plurality of character strings for display at locations of the display device determined based on the particular location;

responsive to receiving an indication of a resumption of movement of the input object following the suspension of movement of the input object and during a time period that the plurality of character strings is displayed, select, based on a direction of movement of the input object after the resumption of movement, a particular character string from the plurality of character strings; and

responsive to receiving an indication of a termination of the input object after the resumption of movement, output, for display in a text input area displayed by the display device, the selected character string.

18. The non-transitory computer-readable data storage medium of claim 17, wherein the instructions cause the computing device to:

select, based on the direction of movement of the input object after the resumption of movement being toward the particular character string, the particular character string from the plurality of character strings.

19. The non-transitory computer-readable data storage medium of claim 17, wherein:

the plurality of character strings is a first plurality of character strings,

after the resumption of movement, movement of the input object is along an extension of the spatial path, and

the instructions cause the computing device to;

responsive to determining that a distance traveled by the input object after the resumption of movement is less than a threshold distance, select, based at least in part on a direction of the input object along the extension of the spatial path, the particular character string from the plurality of character strings;

responsive to determining that the distance traveled by the input object after the resumption of movement is greater than the threshold distance, determine, based at least in part on respective locations of the virtual keys and respective locations along the spatial path and one or more locations along the extension of the spatial path, a second plurality of character strings that is different than the first plurality of character strings; and

output, for display, the second plurality of character strings.

20. The non-transitory computer-readable data storage medium of claim 17, wherein:

the instructions cause the computing device to remove, responsive to determining that the direction of movement of the input object after the resumption of movement is not an applicable direction, the plurality of character strings from display,

if the plurality of character strings is displayed in a horizontally-oriented array, the applicable direction is leftward or rightward,

if the plurality of character strings is displayed in a vertically-oriented array, the applicable direction is upward or downward, and

if the plurality of character strings are displayed such that, for each respective character string of the plurality character strings, a distance between the respective character string and the particular location is substantially equal to a same value, the applicable direction is toward one of the character strings.