Methods and Apparatus For Gesture Recognition Mode Control

• US 20110221666A1
• Filed: 11/24/2010
• Published: 09/15/2011
• Est. Priority Date: 11/24/2009
• Status: Abandoned Application

• Current Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Not Yet Assigned
• Inventors: Xu, Stephen Sheng, Smith, Trent, Newton, John David, Port, Brendon
• Application Number:
  US12/953,591
• Publication Number:
  US 20110221666A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Computing devices can comprise a processor and an imaging device. The processor can be configured to support both a mode where gestures are recognized and one or more other modes during which the computing device operates but does not recognize some or all available gestures. The processor can determine whether a gesture recognition mode is activated, use image data from the imaging device to identify a pattern of movement of an object in the space, and execute a command corresponding to the identified pattern of movement if the gesture recognition mode is activated. The processor can also be configured to enter or exit the gesture recognition mode based on various input events.

Claims

1. A computer-implemented method, comprising:

receiving input indicating that a gesture recognition mode of a computing device is to be activated, the computing device configured to operate in at least a gesture recognition mode and a second mode during which gestures are not recognized;

in response to the received input, activating the gesture recognition mode, and while the gesture recognition mode is activated;

obtaining image data representing a space,

identifying a pattern of movement of an object in the space based on the image data,

determining a command to be carried out by the computing device and corresponding to the pattern of movement, and

carrying out the command.

2. The method of claim 1, wherein receiving input indicating that the gesture recognition mode is to be activated comprises:

obtaining image data representing the space, and

analyzing the image data to determine whether the object is in the space for a threshold period of time, wherein the gesture recognition mode is to be activated if the object remains in view for the threshold period of time.

3. The method of claim 2, wherein analyzing the image data comprises determining whether a finger is in the space for the threshold period of time.

4. The method of claim 1, wherein receiving input indicating that the gesture recognition mode is to be activated comprises:

sensing actuation of a button or switch.

5. The method of claim 1, wherein receiving input indicating that the gesture recognition mode is to be activated comprises receiving input indicating that a key or combination of keys of a keyboard has been pressed.

6. The method of claim 1, wherein receiving input indicating that the gesture recognition mode is to be activated comprises receiving an event from a software application indicating that the gesture recognition mode is to be activated.

7. The method of claim 1, wherein identifying the pattern of movement of the object in the space comprises identifying a deactivation pattern, the command is a command to exit the gesture recognition mode, and wherein carrying out the command is exiting the gesture recognition mode.

8. The method of claim 1,

wherein identifying the pattern of movement of the object comprises identifying a first pattern of movement followed by a second pattern of movement, and

wherein determining the command to be carried out comprises selecting one of a plurality of commands corresponding to the first pattern of movement and determining a parameter value based on the second pattern of movement.

9. The method of claim 1, wherein the pattern of movement corresponds to a line in the space and the command comprises a scroll command.

10. The method of claim 1, wherein the pattern of movement corresponds to a line in the space pointed toward a display device and the command comprises a zoom command.

11. The method of claim 1, wherein the pattern of movement comprises a path in space corresponding to an alphanumeric character.

12. The method of claim 11, wherein the pattern of movement corresponds to a “

Z”

character and the command comprises a zoom command.

13. The method of claim 11, wherein the pattern of movement corresponds to a “

R”

character and the command comprises a resize command.

14. The method of claim 11, wherein the pattern of movement corresponds to a “

X”

character and the command comprises a delete command.

15. The method of claim 1, wherein the pattern of movement comprises a shooting gesture recognized by a pointing gesture followed by extension of a thumb from a user'"'"'s hand, followed by bringing the thumb back into contact with the hand.

16. The method of claim 1, wherein the pattern of movement comprises a single-click gesture recognized by an incurvation of a user'"'"'s finger.

17. The method of claim 16, wherein the single-click gesture is recognized by an incurvation of one finger while a different finger remains extended.

18. The method of claim 1, wherein the pattern of movement comprises a separation of a plurality of a user'"'"'s fingers.

19. The method of claim 1, wherein the pattern of movement comprises movement of a finger in a diagonal path through the imaged space and the command comprises a resize command.

20. The method of claim 1, wherein the pattern of movement comprises a closed hand followed by opening of the hand.

21. The method of claim 20, wherein the hand is opened with a number of fingers and the command is based on the number of fingers.

22. The method of claim 1, wherein the pattern of movement comprises a plurality of fingers arranged as if gripping a knob.

23. The method of claim 1, wherein the pattern of movement comprises movement of a hand through the imaged space and the command comprises a panning command.

24. The method of claim 1, wherein the pattern of movement comprises closing of a hand followed by rotation of the closed hand.

25. A device, comprising:

a processor; and

an imaging device,

wherein the processor is configured by program code embodied in a computer-readable medium and comprising;

program code that configures the processor to determine whether a gesture recognition mode is activated;

program code that configures the processor to use image data from the imaging device to identify a pattern of movement of an object in the space; and

program code that configures the processor to execute a command corresponding to the identified pattern of movement if the gesture recognition mode is activated.

26. The device of claim 25, wherein the program instructions further comprise:

program code that configures the processor to analyze data from the imaging device to determine whether an object is in the space for a threshold period of time and, if the object is in the space for the threshold period of time, store data indicating that the gesture recognition mode is activated.

27. The device of claim 25, wherein the program code that configures the processor to analyze data from the imaging device configures the processor to analyze the data to determine whether a finger is in the space for a threshold period of time.

28. The device of claim 25, wherein identifying the pattern of movement of the object in the space comprises identifying a deactivation pattern and executing the command comprises storing data that the gesture recognition mode is no longer activated.

29. The device of claim 25, wherein program code that configures the processor to use image data from the imaging device to identify a pattern of movement of an object in the space configures the processor identify a path in space corresponding to an alphanumeric character.

30. A computer program product comprising a computer-readable medium embodying program code, the program code comprising:

program code for receiving input indicating that a gesture recognition mode of a computing device is to be activated;

program code for, in response to the received input, activating the gesture recognition mode; and

program code for, while the gesture recognition mode is activated;

obtaining image data representing a space,

identifying a pattern of movement of an object in the space based on the image data,

determining a command to be carried out by the computing device and corresponding to the command, and

carrying out the command.

31. The computer program product of claim 30, wherein receiving input indicating that the gesture recognition mode is to be activated comprises:

obtaining image data representing the space, and

analyzing the image data to determine whether the object is in the space for a threshold period of time, wherein the gesture recognition mode is to be activated if the object remains in view for the threshold period of time.

32. The computer program product of claim 30, wherein identifying the pattern of movement of the object in the space comprises identifying a deactivation pattern, wherein the command is a command to exit the gesture recognition mode, and wherein carrying out the command is exiting the gesture recognition mode.

33. The computer program product of claim 30,

wherein identifying the pattern of movement of the object comprises identifying a first pattern of movement followed by a second pattern of movement, and

wherein determining the command to be carried out comprises selecting one of a plurality of commands corresponding to the first pattern of movement and determining a parameter value based on the second pattern of movement.