HAND POSE INTERACTION

• US 20130031517A1
• Filed: 07/27/2012
• Published: 01/31/2013
• Est. Priority Date: 07/28/2011
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Freeman, Dustin, Madhvanath, Sriganesh, Shekhawat, Ankit, Vennelakanti, Ramadevi
• Granted Patent: US 8,869,073 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Provided is a method of hand pose interaction. The method recognizes a user input related to selection of an object displayed on a computing device and displays a graphical user interface (GUI) corresponding to the object. The graphical user interface comprises at least one representation of a hand pose, wherein each representation of a hand pose corresponds to a unique function associated with the object. Upon recognition of a user hand pose corresponding to a hand pose representation in the graphical user interface, the function associated with the hand pose representation is executed.

Claims

1. A computer implemented method of hand pose interaction, comprising:

recognizing a user input related to selection of an object displayed on a computing device;

displaying a graphical user interface (GUI) corresponding to the object, the graphical user interface comprising at least one representation of a hand pose, wherein each representation of a hand pose corresponds to a unique function associated with the object; and

upon recognition of a user hand pose corresponding to a hand pose representation in the graphical user interface, executing the function associated with the hand pose representation.

2. A method according to claim 1, wherein the user input is provided by a gesture and/or a voice command.

3. A method according to claim 1, wherein the graphical user interface (GUI) corresponding to the object is displayed on a secondary computing device.

4. A method according to claim 3, wherein the recognition of a user input related to selection of an object occurs on the secondary computing device.

5. A method according to claim 1, wherein the at least one representation of a hand pose comprises at least one of an image, animation and a drawing.

6. A method according to claim 1, wherein the graphical user interface (GUI) corresponding to the object is displayed adjacent to the object.

7. A method according to claim 1, wherein the unique function corresponding to a representation of a hand pose is pre-configured.

8. A method according to claim 1, wherein the unique function corresponding to a representation of a hand pose is configurable at the option of a user.

9. A method according to claim 1, wherein the at least one representation of a hand pose is a single hand pose representation or a two-hand pose representation.

10. A computer implemented method of hand pose interaction, comprising:

displaying a graphical user interface (GUI) corresponding to an object, the graphical user interface comprising a representation of a hand pose, wherein the hand pose representation corresponds to a function associated with the object;

recognizing a user hand pose corresponding to the hand pose representation in the graphical user interface; and

upon recognition, allowing the user to control the object.

11. A system comprising:

an input device that recognizes a user input related to selection of an object displayed on a computing device;

a display device that displays a graphical user interface (GUI) corresponding to the object, the graphical user interface comprising at least one representation of a hand pose, wherein each representation of a hand pose corresponds to a unique function associated with the object; and

a processor which, upon recognition of a user hand pose corresponding to a hand pose representation in the graphical user interface, instructs an application to execute the function associated with the hand pose representation.

12. The system of claim 11, further comprising a camera for the recognition of a user hand pose corresponding to a hand pose representation in the graphical user interface

13. The system of claim 11, wherein the graphical user interface (GUI) corresponding to the object is displayed on a secondary computing device.

14. The system of claim 13, wherein the recognition of a user input related to selection of an object occurs on the secondary computing device.

15. The system of claim 11, wherein the secondary computing device is at least one of a mobile device, a tablet personal computer, a personal computer and a personal digital assistant.