Dynamic icons for gesture discoverability

• US 9,710,128 B2
• Filed: 03/17/2015
• Issued: 07/18/2017
• Est. Priority Date: 03/17/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kauffmann, Alejandro Jose
• Primary Examiner(s): Kujundzic, Dino
• Application Number:
  US14/660,270
• Publication Number:
  US 20160274735A1
• Time in Patent Office: 854 Days
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/453 Help systems

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing gesture discoverability with a mobile computing device. In one aspect, a method include actions of obtaining gesture definition data for a particular gesture. The gesture definition data specifies a predefined onset position associated with commencement of the particular gesture, a predefined motion associated with completion of the particular gesture, a particular action that is triggered upon the completion of the particular gesture, and a visual indicator for visually indicating a progress toward the completion of the particular gesture as the predefined motion is performed. Additional actions include determining that an orientation of a mobile computing device matches the onset position of the particular gesture, providing the visual indicator, determining a motion, determining whether the motion matches the predefined motion, and determining whether to update the visual indicator.

Claims

1. A computer-implemented method comprising:

obtaining gesture definition data for a particular gesture, wherein the gesture definition data specifies a predefined onset position associated with commencement of the particular gesture, a predefined motion associated with completion of the particular gesture, a particular action that is triggered upon the completion of the particular gesture, and a visual indicator for visually indicating a progress toward the completion of the particular gesture as the predefined motion is performed, wherein the visual indicator includes a representation of one or more physical objects whose motion, in free space, is associated with the same predefined motion;

before an orientation of a mobile computing device is determined to match the onset position of the particular gesture, providing, on a graphical user interface of the mobile computing device, the visual indicator in an inactive state that indicates that the orientation of the mobile computing device does not yet match the onset position of the particular gesture;

after providing, on the graphical user interface of the mobile computing device, the visual indicator in the inactive state that indicates that the orientation of the mobile computing device does not vet match the onset position of the particular gesture, determining that the orientation of a mobile computing device matches the onset position of the particular gesture;

in response to determining that the orientation of the mobile computing device matches the predefined onset position of the gesture, providing, on the graphical user interface of the mobile computing device, the visual indicator in the active state that indicates that the orientation of the mobile computing device matches the onset position of the particular gesture;

determining a motion of the mobile computing device;

determining whether the motion of the mobile computing device matches the predefined motion; and

in response to determining whether the motion of the mobile computing device matches the predefined motion, determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture.

2. The method of claim 1, wherein determining whether the motion of the mobile computing device matches the predefined motion comprises:

determining that the motion of the mobile computing device completes the particular gesture; and

in response to determining that the motion of the mobile computing device completes the particular gesture, triggering the particular action.

3. The method of claim 1, wherein determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture comprises:

determining to update the visual indicator to indicate an increase in the progress toward completion of the particular gesture based on a determination that the motion of the mobile computing device matches the predefined motion.

4. The method of claim 1, wherein determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture comprises:

determining to update the visual indicator to indicate the inactive state that indicates that the orientation of the mobile computing device does not match the particular gesture based on a determination that the motion of the mobile computing device does not match the predefined motion.

5. The method of claim 1, wherein the particular gesture comprises holding the mobile computing device upright and turning the mobile computing device counterclockwise until the mobile computing device is upside down, and the visual indicator comprises a representation of a bottle being poured.

6. A system comprising:

one or more computers; and

one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

obtaining gesture definition data for a particular gesture, wherein the gesture definition data specifies a predefined onset position associated with commencement of the particular gesture, a predefined motion associated with completion of the particular gesture, a particular action that is triggered upon the completion of the particular gesture, and a visual indicator for visually indicating a progress toward the completion of the particular gesture as the predefined motion is performed, wherein the visual indicator includes a representation of one or more physical objects whose motion, in free space, is associated with the same predefined motion;

before an orientation of a mobile computing device is determined to match the onset position of the particular gesture, providing, on a graphical user interface of the mobile computing device, the visual indicator in an inactive state that indicates that the orientation of the mobile computing device does not yet match the onset position of the particular gesture;

after providing, on the graphical user interface of the mobile computing device, the visual indicator in the inactive state that indicates that the orientation of the mobile computing device does not yet match the onset position of the particular gesture, determining that the orientation of a mobile computing device matches the onset position of the particular gesture;

in response to determining that the orientation of the mobile computing device matches the predefined onset position of the gesture, providing, on the graphical user interface of the mobile computing device, the visual indicator in the active state that indicates that the orientation of the mobile computing device matches the onset position of the particular gesture;

determining a motion of the mobile computing device;

determining whether the motion of the mobile computing device matches the predefined motion; and

in response to determining whether the motion of the mobile computing device matches the predefined motion, determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture.

7. The system of claim 6, wherein determining whether the motion of the mobile computing device matches the predefined motion comprises:

determining that the motion of the mobile computing device completes the particular gesture; and

in response to determining that the motion of the mobile computing device completes the particular gesture, triggering the particular action.

8. The system of claim 6, wherein determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture comprises:

determining to update the visual indicator to indicate an increase in the progress toward completion of the particular gesture based on a determination that the motion of the mobile computing device matches the predefined motion.

9. The system of claim 6, wherein determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture comprises:

determining to update the visual indicator to indicate the inactive state that indicates that the orientation of the mobile computing device does not match the particular gesture based on a determination that the motion of the mobile computing device does not match the predefined motion.

10. The system of claim 6, wherein the particular gesture comprises holding the mobile computing device upright and turning the mobile computing device counterclockwise until the mobile computing device is upside down, and the visual indicator comprises a representation of a bottle being poured.

11. A non-transitory computer-readable medium storing instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

obtaining gesture definition data for a particular gesture, wherein the gesture definition data specifies a predefined onset position associated with commencement of the particular gesture, a predefined motion associated with completion of the particular gesture, a particular action that is triggered upon the completion of the particular gesture, and a visual indicator for visually indicating a progress toward the completion of the particular gesture as the predefined motion is performed, wherein the visual indicator includes a representation of one or more physical objects whose motion, in free space, is associated with the same predefined motion;

before an orientation of a mobile computing device is determined to match the onset position of the particular gesture, providing, on a graphical user interface of the mobile computing device, the visual indicator in an inactive state that indicates that the orientation of the mobile computing device does not yet match the onset position of the particular gesture;

after providing, on the graphical user interface of the mobile computing device, the visual indicator in the inactive state that indicates that the orientation of the mobile computing device does not yet match the onset position of the particular gesture, determining that the orientation of a mobile computing device matches the onset position of the particular gesture;

in response to determining that the orientation of the mobile computing device matches the predefined onset position of the gesture, providing, on the graphical user interface of the mobile computing device, the visual indicator in the active state that indicates that the orientation of the mobile computing device matches the onset position of the particular gesture;

determining a motion of the mobile computing device;

determining whether the motion of the mobile computing device matches the predefined motion; and

in response to determining whether the motion of the mobile computing device matches the predefined motion, determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture.

12. The medium of claim 11, wherein determining whether the motion of the mobile computing device matches the predefined motion comprises:

determining that the motion of the mobile computing device completes the particular gesture; and

in response to determining that the motion of the mobile computing device completes the particular gesture, triggering the particular action.

13. The medium of claim 11, wherein determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture comprises:

determining to update the visual indicator to indicate an increase in the progress toward completion of the particular gesture based on a determination that the motion of the mobile computing device matches the predefined motion.

14. The medium of claim 11, wherein determining whether to update the visual indicator to indicate the progress toward completion of the particular gesture comprises:

determining to update the visual indicator to indicate an inactive the inactive state that indicates that the orientation of the mobile computing device does not match the particular gesture based on a determination that the motion of the mobile computing device does not match the predefined motion.