GESTURE BASED COMMANDS

• US 20140253427A1
• Filed: 03/06/2013
• Published: 09/11/2014
• Est. Priority Date: 03/06/2013
• Status: Abandoned Application

• Current Assignee: Snaptrack Incorporated (Qualcomm, Inc.)
• Original Assignee: Qualcomm MEMS Technologies Incorporated (Qualcomm, Inc.)
• Inventors: GRUHLKE, Russell W., Maitan, Jacek
• Application Number:
  US13/786,625
• Publication Number:
  US 20140253427A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

Techniques described herein enable a computing device to detect a user hand gesture in near field using less expensive hardware by capturing enough information in coarse resolution. Furthermore, techniques described herein detect an object, such as a hand by characterizing the object without fully reconstructing the object. In one embodiment, embodiments of the invention performed by the computing device detect the number of unfurled fingers passing through the detectable region of the field of view of the detection surface of a computing device and the direction of the movement of the user'"'"'s hand. The computing device may determine a user command in response to detecting the user gesture and provide feedback to the user.

Claims

1. A method for determining a user hand gesture, comprising:

determining if a hand is within a detectable region of a field of view of a detection surface coupled to a computing device;

detecting a sequence of one or more hand features associated with the hand;

detecting a direction of movement of the hand; and

determining the user hand gesture based on the detected sequence of one or more hand features and the direction of the movement of the hand.

2. The method of claim 1, wherein the determining of the user hand gesture begins when the hand enters the detectable region of the field of view and the determining of the user hand gesture completes when the hand exits the detectable region of the field of view.

3. The method of claim 1, wherein the detectable region of the field of view is a near field mode.

4. The method of claim 3, wherein the near field mode comprises a region starting from the detection surface coupled to the computing device and extending outward to between one half of diagonal length of the detection surface to a full diagonal length of the detection surface.

5. The method of claim 1, wherein detecting the sequence of one or more hand features further comprises accumulating information associated with the one or more hand features as the hand moves across the field of view of the detection surface.

6. The method of claim 5, wherein the one or more hand features are fingers or finger tips and accumulating the information associated with the one or more hand features comprises counting a total number of unfurled fingers or finger tips.

7. The method of claim 1, wherein detecting the direction of the movement of the hand is one of left to right, right to left, top to bottom, bottom to top, away from the detection surface and towards the detection surface.

8. The method of claim 1, wherein detecting the direction of the movement of the hand further comprises:

using an electro-optic technology to measure and interpret intensity of light that is bended by a transparent panel using one or more light detectors to measure the intensity of light incident on the detection surface, wherein the transparent panel is part of the detection surface.

9. The method of claim 1, wherein detecting the sequence of one or more hand features further comprises:

using an electro-optic technology to measure and interpret intensity of light that is bended by a transparent panel using one or more light detectors to measure the intensity of light incident on the detection surface, wherein the transparent panel is part of the detection surface.

10. The method of claim 1, wherein the one or more hand features are detected using one of capacitive sensors and ultrasound proximity sensors.

11. The method of claim 1, wherein detecting the sequence of one or more hand features is based on detecting characteristics of the hand from shadows casting from the hand on to the detection surface.

12. The method of claim 1, wherein detecting the sequence of one or more hand features is based on detecting characteristics of the hand by emitting light from the computing device and away from the detection surface and detecting reflected back light from the hand onto the detection surface.

13. The method of claim 1, further comprising determining a user command using the determined user hand gesture.

14. The method of claim 13, further comprising providing visual and/or auditory feedback to a user in response to determining the user command.

15. A computing device for detecting a user hand gesture, comprising:

a plurality of sensors configured to receive light signals;

a processor configured to;

determine if a hand is within a detectable region of a field of view of a detection surface coupled to the computing device;

detect a sequence of one or more hand features associated with the hand;

detect a direction of movement of the hand; and

determine the user hand gesture based on the detected sequence of one or more hand features and the direction of the movement of the hand.

16. The computing device of claim 15, wherein the determination of the user hand gesture, by the processor, begins when the hand enters the detectable region of the field of view and the determining of the user hand gesture completes when the hand exits the detectable region of the field of view.

17. The computing device of claim 15, wherein the detectable region of the field of view is a near field mode.

18. The computing device of claim 17, wherein the near field mode comprises a region starting from the detection surface coupled to the computing device and extending outward to between one half of diagonal length of the detection surface to a full diagonal length of the detection surface.

19. The computing device of claim 15, wherein detecting the sequence of one or more hand features, by the processor, further comprises accumulating information associated with the one or more hand features as the hand moves across the field of view of the detection surface.

20. The computing device of claim 19, wherein the one or more hand features are fingers or finger tips and accumulating the information associated with the one or more hand features comprises counting a total number of unfurled fingers or finger tips.

21. The computing device of claim 15, wherein detecting the direction of the movement of the hand, by the processor, is one of left to right, right to left, top to bottom, bottom to top, away from the detection surface and towards the detection surface.

22. The computing device of claim 15, wherein detecting the direction of the movement of the hand, by the processor, further comprises:

using an electro-optic technology to measure and interpret intensity of light that is bended by a transparent panel using one or more light detectors to measure the intensity of light incident on the detection surface, wherein the transparent panel is part of the detection surface.

23. The computing device of claim 15, wherein detecting the sequence of one or more hand features, by the processor, further comprises:

using an electro-optic technology to measure and interpret intensity of light that is bended by a transparent panel using one or more light detectors to measure the intensity of light incident on the detection surface, wherein the transparent panel is part of the detection surface.

24. The computing device of claim 15, wherein the one or more hand features are detected, by the processor, using one of capacitive sensors and ultrasound proximity sensors.

25. The computing device of claim 15, wherein detecting the sequence of one or more hand features, by the processor, is based on detecting characteristics of the hand from shadows casting from the hand on to the detection surface.

26. The computing device of claim 15, wherein detecting the sequence of one or more hand features is based on detecting characteristics of the hand by emitting light from the computing device and away from the detection surface and detecting reflected back light from the hand onto the detection surface.

27. The computing device of claim 15, wherein the processor is further configured to determine a user command using the determined user hand gesture.

28. The computing device of claim 27, wherein the processor is further configured to provide visual and/or auditory feedback to a user in response to determining the user command.

29. A non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium comprises instructions executable by a processor, the instructions comprising instructions to:

determine if a hand is within a detectable region of a field of view of a detection surface coupled to a computing device;

detect a sequence of one or more hand features associated with the hand;

detect a direction of movement of the hand; and

determine a user hand gesture based on the detected sequence of one or more hand features and the direction of the movement of the hand.

30. The non-transitory computer readable storage medium of claim 29, wherein detecting the sequence of one or more hand features further comprises accumulating information associated with the one or more hand features as the hand moves across the field of view of the detection surface.

31. The non-transitory computer readable storage medium of claim 30, wherein the one or more hand features are fingers or finger tips and accumulating the information associated with the one or more hand features comprises counting a total number of unfurled fingers or finger tips.

32. The non-transitory computer readable storage medium of claim 29, wherein detecting the sequence of one or more hand features further comprises:

using an electro-optic technology to measure and interpret intensity of light that is bended by a transparent panel using one or more light detectors to measure the intensity of light incident on the detection surface, wherein the transparent panel is part of the detection surface.

33. An apparatus, comprising:

means for determining if a hand is within a detectable region of a field of view of a detection surface coupled to a computing device;

means for detecting a sequence of one or more hand features associated with the hand;

means for detecting a direction of movement of the hand; and

means for determining the user hand gesture based on the detected sequence of one or more hand features and the direction of the movement of the hand.

34. The apparatus of claim 33, wherein detecting the sequence of one or more hand features further comprises means for accumulating information associated with the one or more hand features as the hand moves across the field of view of the detection surface.

35. The apparatus of claim 33, wherein detecting the sequence of one or more hand features further comprises:

using an electro-optic technology to measure and interpret intensity of light that is bended by a transparent panel using one or more light detectors to measure the intensity of light incident on the detection surface, wherein the transparent panel is part of the detection surface.