DETECTING AND INTERPRETING REAL-WORLD AND SECURITY GESTURES ON TOUCH AND HOVER SENSITIVE DEVICES

• US 20160034177A1
• Filed: 10/12/2015
• Published: 02/04/2016
• Est. Priority Date: 01/06/2007
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: WESTERMAN, Wayne Carl, HAGGERTY, Myra Mary
• Application Number:
  US14/881,031
• Publication Number:
  US 20160034177A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

“Real-world” gestures such as hand or finger movements/orientations that are generally recognized to mean certain things (e.g., an “OK” hand signal generally indicates an affirmative response) can be interpreted by a touch or hover sensitive device to more efficiently and accurately effect intended operations. These gestures can include, but are not limited to, “OK gestures,” “grasp everything gestures,” “stamp of approval gestures,” “circle select gestures,” “X to delete gestures,” “knock to inquire gestures,” “hitchhiker directional gestures,” and “shape gestures.” In addition, gestures can be used to provide identification and allow or deny access to applications, files, and the like.

Claims

1. A method comprising:

at an electronic device with a display and a sensor panel;

detecting one or more images at the sensor panel;

determining that the one or more images are arranged in a pattern corresponding to a predetermined hand edge gesture; and

in response to the determination, aligning a user interface element displayed on the display in accordance with an axis defined by the pattern corresponding to the predetermined hand edge gesture.

2. The method of claim 1, wherein determining that the one or more images are arranged in the pattern corresponding to the predetermined hand edge gesture comprises:

identifying a pinky feature in the one or more images; and

identifying a palm edge feature in the one or more images.

3. The method of claim 1, wherein the axis comprises an elongated axis of the hand edge gesture.

4. The method of claim 1, wherein aligning the user interface element displayed on the display in accordance with the axis defined by the one or more images comprises aligning the user interface element with the axis.

5. The method of claim 1, wherein the one or more images comprise one or more touch images.

6. A method comprising:

at an electronic device with a display and a sensor panel;

detecting one or more images at the sensor panel;

determining that;

the one or more images are arranged in a pattern corresponding to a predetermined hand edge gesture having a first orientation along a first axis on the sensor panel, and

the one or more images move along a second axis, different from the first axis, while maintaining the first orientation; and

in response to the determination, performing an action in accordance with the movement of the one or more images along the second axis.

7. The method of claim 6, wherein determining that the one or more images are arranged in the pattern corresponding to the predetermined hand edge gesture comprises:

identifying a pinky feature in the one or more images; and

identifying a palm edge feature in the one or more images.

8. The method of claim 6, wherein:

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises a movement from the left portion to the right portion on the sensor panel, and

the action comprises an erase operation.

9. The method of claim 6, further comprising:

displaying a first workspace on the display,

wherein;

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises

a movement from the left portion to the right portion on the sensor panel, and

the action comprises switching from displaying the first workspace on the display to displaying a second workspace on the display, different from the first workspace.

10. The method of claim 6, wherein:

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises a movement from the left portion to the right portion on the sensor panel, and

the action comprises performing a redo operation in accordance with the movement of the one or more images.

11. The method of claim 6, wherein:

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises a movement from the left portion to the right portion on the sensor panel, and

the action comprises moving forward on a timeline in accordance with the movement of the one or more images.

12. The method of claim 6, further comprising:

displaying a first workspace on the display,

wherein;

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises

a movement from the right portion to the left portion on the sensor panel, and

the action comprises switching from displaying the first workspace on the display to displaying a second workspace on the display, different from the first workspace.

13. The method of claim 6, wherein:

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises a movement from the right portion to the left portion on the sensor panel, and

the action comprises performing an undo operation in accordance with the movement of the one or more images.

14. The method of claim 6, wherein:

the sensor panel has;

a left portion corresponding to a left portion of the display, and

a right portion corresponding to a right portion of the display,

the movement of the one or more images along the second axis comprises a movement from the right portion to the left portion on the sensor panel, and

the action comprises moving backward on a timeline in accordance with the movement of the one or more images.

15. The method of claim 6, further comprising:

displaying a first workspace on the display,

wherein;

the sensor panel has;

a top portion corresponding to a top portion of the display, and

a bottom portion corresponding to a bottom portion of the display,

the movement of the one or more images along the second axis comprises

a movement from the top portion to the bottom portion on the sensor panel, and

the action comprises switching from displaying the first workspace on the display to displaying a second workspace on the display, different from the first workspace.

16. The method of claim 6, wherein:

the sensor panel has;

a top portion corresponding to a top portion of the display, and

a bottom portion corresponding to a bottom portion of the display,

the movement of the one or more images along the second axis comprises a movement from the top portion to the bottom portion on the sensor panel, and

the action comprises hiding a user interface element on the display.

17. The method of claim 6, wherein:

the sensor panel has;

a top portion corresponding to a top portion of the display, and

a bottom portion corresponding to a bottom portion of the display,

the movement of the one or more images along the second axis comprises a movement from the bottom portion to the top portion on the sensor panel, and

the action comprises maximizing a user interface element on the display.

18. The method of claim 6, wherein the one or more images comprise one or more touch images.

19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and a sensor panel, cause the electronic device to:

detect one or more images at the sensor panel;

determine that the one or more images are arranged in a pattern corresponding to a predetermined hand edge gesture; and

in response to the determination, align a user interface element displayed on the display in accordance with an axis defined by the pattern corresponding to the predetermined hand edge gesture.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and a sensor panel, cause the electronic device to:

detect one or more images at the sensor panel;

determine that;

the one or more images are arranged in a pattern corresponding to a predetermined hand edge gesture having a first orientation along a first axis on the sensor panel, and

the one or more images move along a second axis, different from the first axis, while maintaining the first orientation; and

in response to the determination, perform an action in accordance with the movement of the one or more images along the second axis.

21. An electronic device, comprising:

one or more processors;

memory;

a display;

a sensor panel; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

detecting one or more images at the sensor panel;

determining that the one or more images are arranged in a pattern corresponding to a predetermined hand edge gesture; and

in response to the determination, aligning a user interface element displayed on the display in accordance with an axis defined by the pattern corresponding to the predetermined hand edge gesture.

22. An electronic device, comprising:

one or more processors;

memory;

a display;

a sensor panel; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

detecting one or more images at the sensor panel;

determining that;

the one or more images are arranged in a pattern corresponding to a predetermined hand edge gesture having a first orientation along a first axis on the sensor panel, and

the one or more images move along a second axis, different from the first axis, while maintaining the first orientation; and

in response to the determination, performing an action in accordance with the movement of the one or more images along the second axis.