Gesture-based selection

• US 8,745,542 B2
• Filed: 09/30/2011
• Issued: 06/03/2014
• Est. Priority Date: 01/04/2011
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Queru, Jean Baptiste Maurice
• Primary Examiner(s): HO, RUAY L
• Application Number:
  US13/249,318
• Publication Number:
  US 20120174043A1
• Time in Patent Office: 977 Days
• Field of Search: 715200-277, 715700-867, 700701-866, 709201-229, 705 50- 79, 345 30-111, 345/173, 707200-206, 707/722, 704/270
• US Class Current: 715/863
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/566 Mobile devices displaying vehicle information
• CPC Class Codes: B60K 2360/573 Mobile devices controlling vehicle functions
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for gesture-based selection. In one aspect, a method includes displaying, on a user interface, information referencing a first set of data items and at least one control that references multiple values. A first gesture input by a user using the control is identified, and a first value is selected based on the first gesture. A second gesture input by the user using the control is identified, and a second value is selected based on the second gesture. A second set of data items is selected based on the first and second values, and information referencing the second set of data items is displayed.

Claims

1. A method performed by data processing apparatus, the method comprising:

providing, for display, information identifying data items of a set of data items;

receiving data indicating receipt of a single continuous gesture input that traces an uninterrupted path comprising;

a first segment, followed by a second segment that is perpendicular to the first segment within a predetermined tolerance, followed by a third segment that is perpendicular to the second segment within the predetermined tolerance;

selecting a first alphanumeric character based on the first segment of the uninterrupted path;

adding the first alphanumeric character to a set of confirmed values to generate an updated set of confirmed values based on detecting the second segment that is perpendicular to the first segment within the predetermined tolerance;

selecting a second alphanumeric character based on the third segment that is perpendicular to the second segment within the predetermined tolerance;

selecting a subset of data items from the set of data items based on the updated set of confirmed values and the second alphanumeric character; and

providing, for display, information identifying data items of the subset of data items.

2. The method of claim 1, wherein the updated set of confirmed values and the second alphanumeric character are included in a query.

3. The method of claim 1, wherein a control in a user interface indicates a value that changes among multiple alphanumeric characters during movement that traces the first segment of the continuous gesture input;

and

wherein selecting the first alphanumeric character comprises selecting the alphanumeric character indicated by the control during a portion of the single continuous gesture input that traces the second segment of the uninterrupted path.

4. The method of claim 1, further comprising:

in response to receiving the data indicating receipt of the single continuous gesture input, providing, for display, information identifying different subsets of data items from the set of data items, each of the different subsets corresponding to a different location along the first segment of the uninterrupted path.

5. The method of claim 1, wherein each of the data items of the set of data items is associated with a corresponding identifier,

wherein selecting the subset of data items based on the updated set of confirmed values and the second alphanumeric character comprises selecting, from the set of data items, data items for which the corresponding identifier includes the first alphanumeric character followed by the second alphanumeric character.

6. The method of claim 1, wherein adding the first alphanumeric character to the set of confirmed values comprises appending the first alphanumeric character to a search query string.

7. The method of claim 1, further comprising providing, for display, the updated set of confirmed values.

8. The method of claim 1, further comprising:

selecting a second subset of data items from the set of data items based on the first alphanumeric character; and

before receiving data indicating receipt of the third segment of the continuous gesture input, providing, for display, information identifying the data items of the second subset of data items.

9. The method of claim 1, wherein the second segment of the uninterrupted path indicates movement along an axis in a first direction followed by movement along the axis in a direction that is opposite the first direction.

10. The method of claim 1, wherein the predetermined tolerance designates segments as perpendicular to each other when the segments define an angle between 45 degrees and 135 degrees.

11. A system comprising:

one or more processors; and

a non-transitory computer-readable medium coupled to the one or more processors having instructions stored thereon which, when executed by the one or more processors, cause the system to perform operations comprising;

providing, for display, information identifying data items of a set of data items;

receiving data indicating receipt of a single continuous gesture input that traces an uninterrupted path comprising;

a first segment, followed by a second segment that is perpendicular to the first segment within a predetermined tolerance, followed by a third segment that is perpendicular to the second segment within the predetermined tolerance;

selecting a first alphanumeric character based on the first segment of the uninterrupted path;

adding the first alphanumeric character to a set of confirmed values to generate an updated set of confirmed values based on detecting the second segment that is perpendicular to the first segment within the predetermined tolerance;

selecting a second alphanumeric character based on the third segment that is perpendicular to the second segment within the predetermined tolerance;

selecting a subset of data items from the set of data items based on the updated set of confirmed values and the second alphanumeric character; and

providing, for display, information identifying data items of the subset of data items.

12. The system of claim 11, wherein a control in a user interface indicates a value that changes among multiple alphanumeric characters during movement that traces the first segment of the continuous gesture input;

and

wherein selecting the first alphanumeric character comprises selecting the alphanumeric character indicated by the control during a portion of the single continuous gesture input that traces the second segment of the uninterrupted path.

13. The system of claim 11, wherein the operations further comprise:

in response to receiving the data indicating receipt of the single continuous gesture input, providing, for display, information identifying different subsets of data items from the set of data items, each of the different subsets corresponding to a different location along the first segment of the uninterrupted path.

14. The system of claim 11, wherein each of the data items of the set of data items is associated with a corresponding identifier,

wherein selecting the subset of data items based on the updated set of confirmed values and the second alphanumeric character comprises selecting, from the set of data items, data items for which the corresponding identifier includes the first alphanumeric character followed by the second alphanumeric character.

15. The system of claim 11, wherein adding the first alphanumeric character to the set of confirmed values comprises appending the first alphanumeric character to a search query string.

16. The system of claim 11, wherein the operations further comprise providing, for display, the updated set of confirmed values.

17. The system of claim 11, wherein the second segment of the uninterrupted path indicates movement along an axis in a first direction followed by movement along the axis in a direction that is opposite the first direction.

18. A non-transitory computer storage medium storing a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

providing, for display, information identifying data items of a set of data items;

receiving data indicating receipt of a single continuous gesture input that traces an uninterrupted path comprising;

a first segment, followed by a second segment that is perpendicular to the first segment within a predetermined tolerance, followed by a third segment that is perpendicular to the second segment within the predetermined tolerance;

selecting a first alphanumeric character based on the first segment of the uninterrupted path;

adding the first alphanumeric character to a set of confirmed values to generate an updated set of confirmed values based on detecting the second segment that is perpendicular to the first segment within the predetermined tolerance;

selecting a second alphanumeric character based on the third segment that is perpendicular to the second segment within the predetermined tolerance;

selecting a subset of data items from the set of data items based on the updated set of confirmed values and the second alphanumeric character; and

providing, for display, information identifying data items of the subset of data items.

19. The non-transitory computer storage medium of claim 18, wherein a control in a user interface indicates a value that changes among multiple alphanumeric characters during movement that traces the first segment of the continuous gesture input;

and

wherein selecting the first alphanumeric character comprises selecting the alphanumeric character indicated by the control during a portion of the single continuous gesture input that traces the second segment of the uninterrupted path.

20. The non-transitory computer storage medium of claim 18, wherein the operations further comprise:

in response to receiving the data indicating receipt of the single continuous gesture input, providing, for display, information identifying different subsets of data items from the set of data items, each of the different subsets corresponding to a different location along the first segment of the uninterrupted path.

21. The non-transitory computer storage medium of claim 18, wherein each of the data items of the set of data items is associated with a corresponding identifier,

wherein selecting the subset of data items based on the updated set of confirmed values and the second alphanumeric character comprises selecting, from the set of data items, data items for which the corresponding identifier includes the first alphanumeric character followed by the second alphanumeric character.

22. The non-transitory computer storage medium of claim 18, wherein adding the first alphanumeric character to the set of confirmed values comprises appending the first alphanumeric character to a search query string.

23. The non-transitory computer storage medium of claim 18, wherein the operations further comprise providing, for display, the updated set of confirmed values.