Gesture-based text selection

• US 9,804,777 B1
• Filed: 07/16/2013
• Issued: 10/31/2017
• Est. Priority Date: 10/23/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Ouyang, Yu, Zhai, Shumin
• Primary Examiner(s): Ho, Ruay
• Application Number:
  US13/943,745
• Time in Patent Office: 1,568 Days
• Field of Search: 715200-277, 715700-867, 700701-866, 709201-229, 705 50- 79, 345 30-111, 345168, 345173, 345175, 345473, 345171, 34082572, 382305, 348 65
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

An example method includes outputting a plurality of characters, receiving an input indicative of a slide gesture across one or more regions associated with a group of characters included in the plurality of characters, determining, based on an origination point and/or a speed of movement, whether the slide gesture represents a character string level selection or a character level selection, responsive to determining that the slide gesture represents the character string level selection, outputting a graphical selection of at least one character string included in the group of characters, such that the at least one character string is visually differentiated from any of the plurality of characters not included in the group of characters, and responsive to determining that the slide gesture represents the character level selection, outputting, in single character increments, a graphical selection of at least one character included in the group of characters.

Claims

1. A method comprising:

outputting, by a computing device that includes one or more processors, for display, a plurality of characters;

receiving, by the computing device, an input indicative of a slide gesture across one or more regions of a presence-sensitive input device, the one or more regions being associated with a group of characters included in the plurality of characters;

determining, by the computing device and based at least in part on one or more of an origination point and a speed of movement associated with the slide gesture, whether the slide gesture represents a character string-level selection or a character-level selection from the group of characters, wherein the character string-level selection comprises a multi-character selection of a character string from the group of characters;

responsive to determining that the slide gesture represents the character string-level selection from the group of characters and determining that the input indicative of the slide gesture covers only a portion of at least one character string included in the group of characters, outputting, by the computing device and for display, a graphical selection of the at least one character string, such that the at least one character string is visually differentiated from any of the plurality of characters not included in the group of characters, wherein the at least one character string comprises two or more consecutive characters included in the group of characters, and wherein the at least one character string does not comprise any space characters; and

responsive to determining that the slide gesture represents the character-level selection from the group of characters, outputting, by the computing device, for display and in single character increments, a graphical selection of at least one character included in the group of characters, such that the at least one character is visually differentiated from any of the plurality of characters not included in the group of characters; and

outputting, for display and in a preview area of a user interface (UI), one or more occluded characters of the plurality of characters,

wherein the plurality of characters is displayed at a display area of the UI,

wherein the computing device detects a user contact at a region of the presence-sensitive input device that is associated with the one or more occluded characters, and

wherein the preview area of the UI is different from the display area of the UI.

2. The method of claim 1, wherein the at least one character string is demarcated from remaining characters of the plurality of characters by one or more space characters.

3. The method of claim 1, wherein outputting the one or more occluded characters in the preview area of the UI further comprises:

outputting, for display in the preview area of the UI, at least one full line of characters of the plurality of characters.

4. The method of claim 1, further comprising:

detecting, by the computing device and based at least in part on at least one of

     1) a change in a direction of movement associated with the slide gesture and

     2) a change in the speed of movement associated with the slide gesture, a change between the character string-level selection and the character-level selection.

5. The method of claim 1, further comprising:

outputting, for display in a user interface (UI), at least two selection handles, such that at least a first selection handle is positioned before the at least one character string or before the at least one character within the UI, and a second selection handle is positioned after the at least one character string or after the at least one character within the UI.

6. The method of claim 5, further comprising:

receiving an indication of a contact input, the contact input corresponding to an initial position of the second selection handle;

receiving an indication of a movement beginning at the initial position of the second selection handle;

modifying the UI to display the second selection handle at an updated position, the updated position being different from the initial position of the second selection handle; and

selecting at least one additional character of the plurality of characters,

wherein the at least one additional character is different from the at least one character string and different from the at least one character, and

wherein the at least one additional character is visually differentiated from any of the plurality of characters not included in the group of characters.

7. The method of claim 5, further comprising:

receiving an indication of a contact input, the contact input corresponding to an initial position of the second selection handle;

receiving an indication of a movement beginning at the initial position of the second selection handle;

modifying the UI to display the second selection handle at an updated position, the updated position being different from the initial position of the second selection handle; and

deselecting at least a first character of the at least one character string or the at least one character, such that the at least one deselected character is no longer visually differentiated from the plurality of characters not included in the group of characters.

8. The method of claim 1, wherein determining whether the slide gesture represents the character string-level selection or the character-level selection is further based on whether one or more previously selected characters of the plurality of characters are associated with the character string-level selection or the character-level selection.

9. The method of claim 1, further comprising:

identifying, by the computing device, an active program that provides the computing device with the plurality of characters;

determining, by the computing device, whether the active program is classified as a variable text-selection program, the variable text-selection program providing at least one user interface (UI) element that enables the character string-level selection and the character-level selection; and

responsive to determining that the identified active program is classified as a variable text-selection program, configuring the computing device to operate in a variable text-selection mode, the variable text-selection mode enabling the character string-level selection and the character-level selection through the at least one UI element.

10. The method of claim 1, further comprising:

determining, by the computing device, whether the plurality of characters is received at a text-editor portion of a user interface (UI) provided by a program executing at the computing device;

determining, by the computing device, whether the active program is classified as a variable text-selection program, the variable text-selection program providing at least one user interface (UI) element that enables the character string-level selection and the character-level selection; and

responsive to determining that the identified active program is classified as a variable text-selection program, configuring the computing device to operate in a variable text-selection mode that allows the character string-level selection and the character-level selection.

11. A device comprising:

a memory; and

one or more programmable processors configured to;

output, for display, a plurality of characters;

receive an input indicative of a slide gesture across one or more regions of a presence-sensitive input device that are associated with a group of characters included in the plurality of characters;

determine, based at least in part on one or more of an origination point and a speed of movement associated with the slide gesture, whether the slide gesture represents a character string-level selection or a character-level selection from the group of characters, wherein the character string-level selection comprises a multi-character selection of a character string from the group of characters;

responsive to determining that the slide gesture represents the character string-level selection from the group of characters and determining that the input indicative of the slide gesture covers only a portion of at least one character string included in the group of characters, output for display, a graphical selection of the at least one character string, such that the at least one character string is visually differentiated from any of the plurality of characters not included in the group of characters, wherein the character string comprises two or more consecutive characters included in the group of characters, and wherein the at least one character string does not comprise any space characters; and

responsive to determining that the slide gesture represents the character-level selection from the group of characters, output for display and in single character increments, a graphical selection of at least one character included in the group of characters, such that the at least one character is visually differentiated from any of the plurality of characters not included in the group of characters; and

output, for display and in a preview area of a user interface (UT), one or more occluded characters of the plurality of characters,

wherein the plurality of characters is displayed at a display area of the UI,

wherein the computing device detects a user contact at a region of the presence-sensitive input device that is associated with the one or more occluded characters, and

wherein the preview area of the UI is different from the display area of the UI.

12. The device of claim 11, wherein the at least one character string is demarcated from remaining characters of the plurality of characters by one or more space characters.

13. The device of claim 11, wherein, to output the one or more occluded characters in the preview area of the UI at least in part by, the one or more programmable processors are configured to:

output, for display in the preview area of the UI, at least one full line of characters of the plurality of characters.

14. The device of claim 11, wherein the one or more programmable processors are further configured to:

detect, based at least in part on at least one of

     1) a change in a direction of movement associated with the slide gesture and

     2) a change in the speed of movement associated with the slide gesture, a change between the character string-level selection and the character-level selection.

15. The device of claim 11, wherein the one or more programmable processors are further configured to:

output, for display in a user interface (UI), at least two selection handles, such that at least a first selection handle is positioned before the at least one character string or before the at least one character within the UI, and a second selection handle is positioned after the at least one character string or after the at least one selected character within the UI.

16. The device of claim 11, wherein the one or more programmable processors are further configured to:

identify an active program that provides the computing device with the plurality of characters;

determine whether the active program is classified as a variable text-selection program, the variable text-selection program providing at least one user interface (UI) element that enables the character string-level selection and the character-level selection; and

responsive to determining that the identified active program is classified as a variable text-selection program, configure the computing device to operate in a variable text-selection mode, the variable text-selection mode enabling the character string-level selection and the character-level selection through the at least one UI element.

17. The device of claim 11, wherein the one or more programmable processors are further configured to:

determine whether the plurality of characters is received at a text-editor portion of a user interface (UI) provided by a program executing at the computing device;

determine whether the identified active program is classified as a variable text-selection program, the variable text-selection program providing at least one user interface (UI) element that enables the character string-level selection and the character-level selection; and

responsive to determining that the active program is classified as a variable text-selection program, configure the computing device to operate in a variable text-selection mode that allows the character string-level selection and the character-level selection.

18. A computer-readable storage device encoded with instructions that, when executed, cause one or more programmable processors of a computing device to perform operations comprising:

outputting, for display, a plurality of characters;

receiving an input indicative of a slide gesture across one or more regions of a presence-sensitive input device that are associated with a group of characters included in the plurality of characters;

determining, based at least in part on one or more of an origination point and a speed of movement associated with the slide gesture, whether the slide gesture represents a character string-level selection or a character-level selection from the group of characters, wherein the character string-level selection comprises a multi-character selection of a character string from the group of characters without incrementally selecting any individual characters included in the character string;

responsive to determining that the slide gesture represents the character string-level selection from the group of characters and determining that the input indicative of the slide gesture covers only a portion of at least one character string included in the group of characters, outputting for display, a graphical selection of the at least one character string, the at least one character string being demarcated from remaining characters of the plurality of characters by one or more space characters, such that the at least one character string is visually differentiated from the remaining characters of the plurality of characters by one or more space characters that are not included in the group of characters, wherein the selected character string comprises two or more consecutive characters included in the group of characters, and wherein the character string does not comprise any space characters; and

responsive to determining that the slide gesture represents the character-level selection from the group of characters, outputting for display and in single character increments, a graphical selection of at least one character included in the group of characters, such that the at least one character is visually differentiated from any of the plurality of characters not included in the group of characters; and

outputting, for display and in a preview area of a user interface (UI), one or more occluded characters of the plurality of characters,

wherein the plurality of characters is displayed at a display area of the UI,

wherein the computing device detects a user contact at a region of the presence-sensitive input device that is associated with the one or more occluded characters, and

wherein the preview area of the UI is different from the display area of the UI.