GESTURE MAPPING FOR DISPLAY DEVICE

• US 20120274550A1
• Filed: 03/24/2010
• Published: 11/01/2012
• Est. Priority Date: 03/24/2010
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Campbell, Robert, Suggs, Bradley, McCarthy, John
• Application Number:
  US13/386,121
• Publication Number:
  US 20120274550A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Embodiments of the present invention disclose a gesture mapping method for a computer system including a display and a database coupled to a processor. According to one embodiment, the method includes storing a plurality of two-dimensional gestures for operating the computer system, and detecting the presence of an object within a field of view of at least two three-dimensional optical sensors. Positional information is associated with movement of the object, and this information is mapped to one of the plurality of gestures stored in the database. Furthermore, the processor is configured to determine a control operation for the mapped gesture based on the positional information and a location of the object with respect to the display.

Claims

1. A method for interacting with a computer system including a display device and a database coupled to a processor, the method comprising:

storing, in the database, a plurality of two-dimensional gestures for operating the computer system;

detecting, via at least two three-dimensional optical sensors coupled to the processor, the presence of an object within a field of view of the sensors;

associating, via the processor, positional information with movement of the object within the field of view of the sensors;

mapping, via the processor, the positional information of the object with one of the plurality of gestures stored in the database;

determining, via the processor, a control operation based on the mapped gesture and a location of the object with respect to the display.

2. The method of claim 1, wherein at least one sensor is configured to obtain positional information of the object from a first perspective and at least one sensor is configured to obtain positional information of the object from a second perspective.

3. The method of claim 2, wherein the positional information includes the height, width, depth, and orientation of the object.

4. The method of claim 2, wherein associating positional information with movement of the object comprises:

analyzing a starting position of the object; and

continually updating the positional data associated with the object until an ending position of the object is determined.

5. The method of claim 1, wherein the object is a hand of a user and the plurality of gestures stored in the database are a set of different hand movements.

6. The method of claim 1, wherein the control operation is an executable instruction by the processor that performs a specific function on the computer system.

7. The method of claim 6, wherein when the object is within the field of view of and in front of the display device, movement of the object from a first position to a second position causes scrollable data shown on display device to scroll in a direction from the first position to the second position.

8. The method of claim 7, wherein movement of the object within close proximity to a physical button of the computer system, causes a control operation associated with the physical button to be executed by the processor.

9. A system comprising:

a display coupled to a processor;

a database coupled to the processor and configured to store a set of two-dimensional gestures for operating the system;

at least two three-dimensional optical sensors configured to detect movement of an object within a field of view of either optical sensor;

wherein upon detection of an object within the field of view of at least one sensor, the processor is configured to;

map movement of the object with at least one gesture in the set of gestures stored in the database, and

determine an executable control operation based on the mapped gesture and a location of the object with respect to the display.

10. The system of claim 9, wherein at least one sensor is configured to obtain positional information of the object from a first perspective and at least one sensor is configured to obtain positional information of the object from a second perspective.

11. The system of claim 10, wherein the positional information includes the height, width, depth, and orientation of the object.

12. The system of claim 10, wherein the processor is further configured to:

analyze a starting position of the object; and

continually update the positional data associated with the object until an ending position of the object is determined.

13. The system of claim 12, wherein the object is a hand of a user and the plurality of gestures stored in the database are a set of different hand movements.

14. A computer readable storage medium having stored executable instructions, that when executed by a processor, causes the processor to:

store a plurality of two-dimensional gestures in a database;

detect the presence of a user'"'"'s hand within a field of view of at least two three-dimensional optical sensors;

associate positional information with movement of the hand within the field of view of the sensors;

map the positional information of the hand with one of the plurality of hand gestures stored in the database;

determine a control operation for the hand gesture based on the positional information and a location of the hand with respect to the display.

15. The computer readable storage medium of claim 14, wherein the executable instructions further cause the processor to:

analyze a starting position of the hand; and

continually update the positional data associated with the hand until an ending position of the hand is determined.