GESTURE-BASED CURSOR CONTROL

• US 20140109016A1
• Filed: 01/07/2013
• Published: 04/17/2014
• Est. Priority Date: 10/16/2012
• Status: Abandoned Application

• Current Assignee: Google Inc. (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Ouyang, Yu, Zhai, Shumin
• Application Number:
  US13/735,869
• Publication Number:
  US 20140109016A1
• Time in Patent Office: Days
• US Class Current: 715/856
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

In general, this disclosure describes techniques for enabling gesture-based cursor control on gesture keyboards. For example, a computing device outputs a graphical keyboard and a text display region, including a cursor at a first cursor location. The computing device detects a gesture that originates at a location of the graphical keyboard and determines whether the location of the detected gesture originates within a cursor control region of the graphical keyboard. In response to determining that the location of the detected gesture is within the cursor control region, the computing device also outputs the cursor at a second cursor location that is different from the first cursor location, wherein the second cursor location is based at least in part on the gesture.

Claims

1. A method comprising:

outputting, by a computing device and for display, a graphical user interface that comprises;

a graphical keyboard comprising a plurality of keys, a cursor control region, and a non-cursor control region, wherein the cursor control region comprises an area of at least one key that is included in the plurality of keys and wherein the cursor control region does not overlap with the non-cursor control region, and

a text display region that includes a cursor at a first cursor location of the text display region;

receiving, by the computing device, an indication of a first gesture;

determining, by the computing device, whether the first gesture is a cursor control enlargement gesture;

determining, by the computing device, whether the first gesture originated within the cursor control region of the graphical keyboard;

responsive to determining that the first gesture is the cursor control enlargement gesture and determining that the first gesture originated within the cursor control region of the graphical keyboard, outputting, by the computing device and for display, a cursor control pad that overlays at least a portion of the graphical keyboard;

receiving, by the computing device, an indication of a second gesture, wherein the second gesture originates at a location within the cursor control pad, and wherein the second gesture comprises at least one or a combination of a vertical movement component and a horizontal movement component; and

responsive to receiving the second gesture, outputting, by the computing device and for display, the cursor at a second cursor location of the text display region that is different from the first cursor location, wherein the second cursor location is based at least in part on the at least one or the combination of the vertical movement component and the horizontal movement component.

3. The method of claim 1, further comprising receiving, by the computing device, an indication of a selection of a mode key, wherein outputting the cursor at the second cursor location of the text display region further comprises outputting, for display and responsive to receiving the indication of the selection of the mode key, text content located between the first cursor location and the second cursor location in a selected state.

5. The method of claim 1, wherein the second gesture comprises a diagonal movement including the combination of the vertical movement component and the horizontal movement component.

7. The method of claim 1,

wherein determining whether the first gesture is the cursor control enlargement gesture comprises:

receiving, by the computing device, an indication of two concurrent inputs;

receiving, by the computing device, an indication of input corresponding to motion of both of the two concurrent inputs at substantially the same time; and

determining, by the computing device, whether the motion of both of the two concurrent inputs is in a substantially vertical direction, and

wherein determining whether the first gesture originated within the cursor control region of the graphical keyboard comprises determining whether both of the two concurrent inputs originated within the cursor control region of the graphical keyboard.

8. The method of claim 1, wherein outputting the cursor control pad comprises outputting a graphical cursor control interface, the graphical cursor control interface comprising the cursor control pad and at least one cursor control button.

9. The method of claim 8, further comprising:

receiving, by the computing device, an indication of a selection of the at least one cursor control button,

wherein outputting the cursor at the second cursor location further comprises outputting, for display and responsive to receiving the indication of the selection of the at least one cursor control button, text content located between the first cursor location and the second cursor location in a selected state.

10. The method of claim 8, wherein the at least one cursor control button is selectable to copy, cut, or paste text content.

11. The method of claim 1, further comprising:

receiving, by the computing device, an indication of a third gesture;

determining, by the computing device, whether the third gesture is a cursor control reduction gesture; and

responsive to determining that the third gesture is a cursor control reduction gesture, removing from display, the cursor control pad.

12. The method of claim 11, wherein determining whether the third gesture is a cursor control reduction gesture comprises:

receiving, by the computing device, an indication of two concurrent inputs at the cursor control pad;

receiving, by the computing device, an indication of input corresponding to motion of both of the two concurrent inputs at substantially the same time; and

determining, by the computing device, whether the motion of both of the two concurrent inputs is in a substantially vertical direction.

13. The method of claim 11,

wherein outputting the cursor control pad comprises outputting a graphical cursor control interface, the graphical cursor control interface comprising the cursor control pad and a dismissal button,

wherein determining whether the third gesture is a cursor control reduction gesture comprises receiving, by the computing device, an indication of a selection of the dismissal button, and

wherein removing from display the cursor control pad comprises removing, from display, the graphical cursor control interface.

14. The method of claim 1,

wherein the first gesture comprises a plurality of gesture components,

wherein a first gesture component of the plurality of gesture components comprises a substantially horizontal motion, and

wherein determining whether the first gesture is a cursor control enlargement gesture comprises determining, by the computing device, whether a second gesture component of the plurality of gesture components comprises a substantially vertical motion, the second gesture component being subsequent to the first gesture component.

16. The method of claim 1, wherein the cursor control region comprises an area of a spacebar key included in the plurality of keys.

17. The method of claim 1, further comprising, responsive to receiving the second gesture, outputting, for display, a cursor indicator.

18. The method of claim 3, further comprising, responsive to receiving the indication of the selection of the mode key, outputting, for display, selection indicators that indicate a beginning boundary and an ending boundary of selected text content.

21. The method of claim 1, wherein the cursor control pad does not comprise a plurality of keys.

2. (canceled)

4. (canceled)

6. (canceled)

15. (canceled)

19. A non-transitory computer-readable storage medium encoded with instructions that, when executed, cause one or more processors of a computing device to perform operations comprising:

outputting, for display, a graphical user interface that comprises;

a graphical keyboard comprising a plurality of keys, a cursor control region, and a non-cursor control region, wherein the cursor control region comprises an area of at least one key that is included in the plurality of keys and wherein the cursor control region does not overlap with the non-cursor control region, and

a text display region that includes a cursor at a first cursor location of the text display region;

receiving an indication of a first gesture;

determining, by the computing device, whether the first gesture is a cursor control enlargement gesture;

determining, by the computing device, whether the first gesture originated within the cursor control region of the graphical keyboard;

responsive to determining that the first gesture is the cursor control enlargement gesture and determining that the first gesture originated within the cursor control region of the graphical keyboard, outputting, for display, a cursor control pad that overlays at least a portion of the graphical keyboard;

receiving an indication of a second gesture, wherein the second gesture originates at a location within the cursor control pad, and wherein the second gesture comprises at least one or a combination of a vertical movement component and a horizontal movement component; and

responsive to receiving the second gesture, outputting, for display, the cursor at a second cursor location of the text display region that is different from the first cursor location, wherein the second cursor location is based at least in part on the at least one or the combination of the vertical movement component and the horizontal movement component.

22. The non-transitory computer-readable storage medium of claim 19,

wherein the first gesture comprises a plurality of gesture components,

wherein a first gesture component of the plurality of gesture components comprises a substantially horizontal motion, and

wherein the instructions that cause the one or more processors of the computing device to determine whether the first gesture is a cursor control enlargement gesture comprise instructions that, when executed, cause the one or more processors of the computing device to perform operations comprising determining, by the computing device, whether a second gesture component of the plurality of gesture components comprises a substantially vertical motion, the second gesture component being subsequent to the first gesture component.

20. A computing device, comprising:

one or more processors; and

at least one module operable by the one or more processors to;

output, for display, a graphical user interface that comprises;

a graphical keyboard comprising a plurality of keys, a cursor control region, and a non-cursor control region, wherein the cursor control region comprises an area of at least one key that is included in the plurality of keys and wherein the cursor control region does not overlap with the non-cursor control region, and

a text display region that includes a cursor at a first cursor location of the text display region;

receive an indication of a first gesture;

determine whether the first gesture is a cursor control enlargement gesture;

determine whether the first gesture originated within the cursor control region of the graphical keyboard;

responsive to determining that the first gesture is the cursor control enlargement gesture and determining that the first gesture originated within the cursor control region of the graphical keyboard, output, for display, a cursor control pad that overlays at least a portion of the graphical keyboard;

receive an indication of a second gesture, wherein the second gesture originates at a location within the cursor control pad, and wherein the second gesture comprises at least one or a combination of a vertical movement component and a horizontal movement component; and

responsive to receiving the second gesture, output, for display, the cursor at a second cursor location of the text display region that is different from the first cursor location, wherein the second cursor location is based at least in part on the at least one or the combination of the vertical movement component and the horizontal movement component.

23. The device of claim 20,

wherein outputting the cursor control pad comprises outputting a graphical cursor control interface, the graphical cursor control interface comprising the cursor control pad and at least one cursor control button,

wherein the at least one module is further operable by the one or more processors to receive an indication of a selection of the at least one cursor control button, and

wherein outputting the cursor at the second cursor location further comprises outputting, for display and responsive to receiving the indication of the selection of the at least one cursor control button, text content located between the first cursor location and the second cursor location in a selected state.