IDENTIFICATION OF A GESTURE

• US 20160195935A1
• Filed: 03/16/2016
• Published: 07/07/2016
• Est. Priority Date: 08/03/2012
• Status: Active Grant

• Current Assignee: Crunchfish Gesture Interaction AB
• Original Assignee: Crunchfish AB
• Inventors: CRONHOLM, Paul
• Granted Patent: US 9,690,388 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A computing device for identifying a gesture performed by a tracked object in an image stream, said computing device comprising a memory and a controller, wherein said controller is configured to: determine a movement vector for the tracked object, compare the movement vector against a reference library of gestures, and thereby identify a gesture matching the movement vector, wherein said movement vector comprises at least one partial movement having a direction being identified by a relative angle and wherein said comparison is based on said relative angle.

Claims

1. A computing device for identifying a gesture performed by a tracked object in an image stream, said computing device comprising a memory and a controller, wherein said controller is configured to:

determine a movement vector for the tracked object;

compare the movement vectors against a reference library of gestures, and thereby identify a gesture matching the movement vector,

wherein said movement vector comprises at least one partial movement having a direction being identified by a relative angle (α

) and wherein said comparison is based on said relative angle (α

),

wherein said controller is further configured to traverse a state diagram, wherein a transition corresponds to an element of said movement vector and at least one state corresponds to an action;

whereby the controller executes a transition from a state to another according to elements of the movement vector until a gesture is identified by reaching the corresponding state, and

wherein said controller is further configured to preemptively execute an action corresponding to an assumed gesture as said gesture is being detected, wherein the controller is configured to assume that the gesture being detected is an assumed gesture if the state of the state diagram currently being visited is on a transition path to said gesture to be detected.

2. The computing device of claim 1, wherein said state diagram comprises at least one stable state, wherein a stable state is a state corresponding to an action or an initial state and

wherein said controller is further configured to return to a previous stable state when a no other transition exists in the state diagram for the elements in the movement vector.

3. The computing device of claim 2, wherein said controller is further configured to if no further partial movement is detected within a timeout threshold (T1).

4. The computing device of claim 1, wherein said controller is further configured to present or effect a result of the actions corresponding to the assumed gesture as the state for the gesture to he detected is reached.

5. The computing device of claim 1, wherein said state transition diagram comprises at least one stable state on a path to another stable state for enabling a first gesture to be defined by a sub-sequence of movements for a second gesture.

6. The computing device of claim 1, wherein said controller is further configured to identify a gesture for a plurality of objects by traversing a plurality of state diagrams each being associated with each of the plurality of objects, wherein said controller is further configured to identity a gesture for said plurality of objects is being tracked by traversing the associated state diagram, wherein a transition in an associated state diagram corresponds to an element of a movement vector for the associated object to be tracked.

7. The computing device of claim 1, wherein said controller is further configured to identify a gesture for a plurality of objects by traversing a state diagram wherein each transition corresponds to a movement of the plurality of objects.

8. The computing device of claim 1, wherein said controller is further configured to determine that an angle (α

) matches a library angle (β

) if the angle (α

) being compared is within an error tolerance (φ

) of said library angle (β

).

9. The computing device of claim 8, wherein said controller is further configured to:

determine a distance of a movement (dist);

determine if the distance of the movement is above a first distance threshold value (V1); and

if so, compare the angle (α

) of the movement with the library angle (β

).

10. The computing device of claim 1, wherein said movement vector comprises at least one further dimension taken from a group consisting of:

depth, rotation, degrees of turning, distance of movement and speed of movement.

11. The computing device of claim 9, wherein said controller is configured to differentiate between a fast and a slow movement.

12. The computing device of claim 10, wherein said controller is configured to differentiate between a short and a long movement.

13. The computing device of claim 1, wherein said controller is configured to determine a distance based on a size of the object to be tracked, a distance to the object to be tracked, size of a display and the field of view of a camera.

14. A method for use in a computing device for identifying a gesture performed by a tracked object (H, H′

, O1, O2) in an image stream, said method comprising;

determining a movement vector for the tracked object (H, H′

, O1, O2);

comparing the movement vector against a reference library of gestures, and thereby identifying a gesture snatching the movement vector,

wherein said movement vector comprises at least one partial movement having a direction being identified by a relative angle (α

) and wherein said comparison is based on said relative angle (α

), and

wherein said method further comprises traversing a stare diagram, wherein a transition corresponds to an element of said movement vector and at least one state corresponds to an action;

whereby a transition from a state to another is executed according to elements of the movement vector until a gesture is identified by reaching the corresponding state, and

wherein said method further comprises preemptively executing an action corresponding to an assumed gesture as said gesture is being detected, wherein the gesture being detected is assumed to be an assumed gesture if the state of the state diagram currently being visited is on a transition path to said gesture to be detected.

15. A computer readable storage medium encoded with instructions that, when loaded and executed on a processor, causes the method according to claim 14 to be performed.