GESTURE-BASED SELECTION

• US 20120174043A1
• Filed: 09/30/2011
• Published: 07/05/2012
• Est. Priority Date: 01/04/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Queru, Jean Baptiste Maurice
• Granted Patent: US 8,745,542 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/566 Mobile devices displaying vehicle information
• CPC Class Codes: B60K 2360/573 Mobile devices controlling vehicle functions
• CPC Class Codes: B60K 2370/566 Mobile devices displaying vehicle information
• CPC Class Codes: B60K 2370/573 Mobile devices controlling vehicle functions
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for gesture-based selection. In one aspect, a method includes displaying, on a user interface, information referencing a first set of data items and at least one control that references multiple values. A first gesture input by a user using the control is identified, and a first value is selected based on the first gesture. A second gesture input by the user using the control is identified, and a second value is selected based on the second gesture. A second set of data items is selected based on the first and second values, and information referencing the second set of data items is displayed.

Claims

1. A computer-implemented method comprising:

displaying, on a proximity-sensitive display, a user interface that includes information referencing a first set of data items, and at least one control that references multiple values;

receiving a first selection gesture input by a user using the at least one control, the first selection gesture comprising movement on the proximity-sensitive display along a first axis;

selecting a first value from the multiple values based on the first selection gesture;

receiving a confirmatory gesture after receiving the first selection gesture, the confirmatory gesture comprising movement on the proximity-sensitive display along a second axis that is substantially perpendicular to the first axis;

adding the first value to a set of confirmed values in response to receiving the confirmatory gesture;

receiving, after receiving the confirmatory gesture, a second selection gesture input by the user using the at least one control;

selecting a second value from the multiple values based on the second gesture;

selecting a second set of data items based on the set of confirmed values and the second value; and

displaying, at the proximity-sensitive display, information referencing the second set of data items.

3. The computer-implemented method of claim 1, wherein the at least one control is a single control, and the first selection gesture, the confirmatory gesture, and the second selection gesture are input using the single control.

4. The computer-implemented method of claim 1, wherein the at least one control comprises a first control and a second control,

the user inputs the first selection gesture using the first control, and

the user inputs the second selection gesture using the second control.

8. The computer-implemented method of claim 1, wherein the information referencing a first set of data items is sorted, and wherein the first value and the second value are included in a query.

9. The computer-implemented method of claim 8, wherein the first value is a character and the second value is a character.

10. The computer-implemented method of claim 8, wherein the first value represents time expressed according to a first unit of time and the second value represents time expressed according to a second, different unit of time.

11. The computer-implemented method of claim 1, wherein selecting the first value comprises selecting a value displayed on the at least one control when the first selection gesture ends.

21. The computer-implemented method of claim 1, wherein, after receiving the confirmatory gesture, user input comprising movement along the first axis on the proximity-sensitive display does not alter the first value.

22. The computer-implemented method of claim 1, wherein the second selection gesture input by the user comprises movement on the proximity-sensitive display in a direction substantially parallel to the first axis.

23. The computer-implemented method of claim 1, wherein the first selection gesture and the confirmatory gesture collectively trace a single continuous path on the proximity-sensitive display.

24. The computer-implemented method of claim 1, wherein, collectively, the first selection gesture and the confirmatory gesture do not trace a single continuous path on the proximity-sensitive display.

25. The method of claim 1, further comprising, while the first selection gesture is being received, changing a value displayed at a region of the proximity-sensitive display at which the at least one control is displayed.

26. The computer-implemented method of claim 1, further comprising, while receiving the first selection gesture:

displaying different values referenced by the at least one control, and

displaying information referencing different data items, the information referencing the different data items being selected based on the different values displayed on the at least one control.

27. The computer-implemented method of claim 1, wherein each data item in the second set of data items is associated with a respective identifier that includes a prefix that matches the first value and the second value.

28. The computer-implemented method of claim 1, further comprising determining that the confirmatory gesture comprises movement substantially perpendicular to the first axis,

wherein adding the first value to the set of confirmed values occurs in response to determining that the confirmatory gesture comprises movement substantially perpendicular to the first axis.

29. The computer-implemented method of claim 1, wherein:

the first value is a character, and

adding the first value to the set of confirmed values comprises appending the selected character to a search query string.

30. The computer-implemented method of claim 1, further comprising displaying, in the user interface, the set of confirmed values.

31. The computer-implemented method of claim 1, further comprising:

selecting a third set of data items based on the first value; and

displaying information referencing the third set of data items before receiving the second selection gesture.

2. (canceled)

5-7. -7. (canceled)

12. (canceled)

13. A system comprising:

one or more processors; and

a computer-readable medium coupled to the one or more processors having instructions stored thereon which, when executed by the one or more processors, cause the system to perform operations comprising;

displaying, on a proximity-sensitive display, a user interface that includes information referencing a first set of data items, and at least one control that references multiple values;

receiving a first selection gesture input by a user using the at least one control, the first selection gesture comprising movement on the proximity-sensitive display along a first axis;

selecting a first value from the multiple values based on the first selection gesture;

receiving a confirmatory gesture after receiving the first selection gesture, the confirmatory gesture comprising movement on the proximity-sensitive display along a second axis that is substantially perpendicular to the first axis;

adding the first value to a set of confirmed values in response to receiving the confirmatory gesture;

receiving, after receiving the confirmatory gesture, a second selection gesture input by the user using the at least one control;

selecting a second value from the multiple values based on the second gesture;

selecting a second set of data items based on the set of confirmed values and the second value; and

displaying, at the proximity-sensitive display, information referencing the second set of data items.

15. The system of claim 13, wherein the at least one control is a single control, and the first selection gesture, the confirmatory gesture, and the second selection gesture are input using the single control.

16. The system of claim 13, wherein the at least one control comprises a first control and a second control,

the user inputs the first selection gesture using the first control, and

the user inputs the second selection gesture using the second control.

14. (canceled)

17. A computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

displaying, on a proximity-sensitive display, a user interface that includes information referencing a first set of data items, and at least one control that references multiple values;

receiving a first selection gesture input by a user using the at least one control, the first selection gesture comprising movement on the proximity-sensitive display along a first axis;

selecting a first value from the multiple values based on the first selection gesture;

receiving a confirmatory gesture after receiving the first selection gesture, the confirmatory gesture comprising movement on the proximity-sensitive display along a second axis that is substantially perpendicular to the first axis;

adding the first value to a set of confirmed values in response to receiving the confirmatory gesture;

receiving, after receiving the confirmatory gesture, a second selection gesture input by the user using the at least one control;

selecting a second value from the multiple values based on the second gesture;

selecting a second set of data items based on the set of confirmed values and the second value; and

displaying, at the proximity-sensitive display, information referencing the second set of data items.

19. The computer storage medium of claim 17, wherein the at least one control is a single control, and the first selection gesture, the confirmatory gesture, and the second selection gesture are input using the single control.

20. The computer storage medium of claim 17, wherein the at least one control comprises a first control and a second control,

the user inputs the first selection gesture using the first control, and

the user inputs the second selection gesture using the second control.

18. (canceled)