IDENTIFICATION OF A GESTURE

• US 20150220776A1
• Filed: 07/08/2013
• Published: 08/06/2015
• Est. Priority Date: 08/03/2012
• Status: Active Grant

• Current Assignee: Crunchfish Gesture Interaction AB
• Original Assignee: Crunchfish AB
• Inventors: Cronholm, Paul
• Granted Patent: US 9,361,512 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A computing device for identifying a gesture performed by a tracked object in an image stream, said computing device comprising a memory and a controller, wherein said controller is configured to: determine a movement vector for the tracked object, compare the movement vector against a reference library of gestures, and thereby identify a gesture matching the movement vector, wherein said movement vector comprises at least one partial movement having a direction being identified by a relative angle and wherein said comparison is based on said relative angle.

Claims

1-19. -19. (canceled)

20. A computing device for identifying a gesture performed by a tracked object in an image stream, said computing device comprising a memory and a controller, wherein said controller is configured to:

determine a movement vector for the tracked object;

compare the movement vector against a reference library of gestures; and

thereby identify a gesture matching the movement vector,

wherein said movement vector comprises at least one partial movement having a direction being identified by an angle and wherein said comparison is based on said angle, wherein

said controller is further configured to correct for a misalignment of said computing device by determining said angle as a relative angle between a direction of a first partial movement and a direction of a second partial movement.

21. The computing device of claim 20, wherein said controller is further configured to determine a base direction for adapting said relative angle or for adapting a library angle to be compared with.

22. The computing device of claim 21, wherein said controller is further configured to determine said base direction by comparing a structure of the tracked object with a model structure.

23. The computing device of claim 20, wherein said controller is further configured to traverse a state diagram, such as a Turing machine, wherein a transition corresponds to an element of said movement vector and at least one state corresponds to an action;

whereby the controller executes a transition from a state to another according to elements of the movement vector until a gesture is identified by reaching the corresponding state.

24. The computing device of claim 23, wherein said state diagram comprises at least one stable state, wherein a stable state is a state corresponding to an action or an initial state and

wherein said controller is further configured to return to a previous stable state when a no other transition exists in the state diagram for the elements in the movement vector.

25. The computing device of claim 24, wherein said controller is further configured to return to an initial state of said state diagram if no further partial movement is detected within a timeout threshold.

26. The computing device of claim 23, wherein said controller is further configured to preemptively execute an action corresponding to an assumed gesture as said gesture is being detected, wherein the controller is configured to assume that the gesture being detected is an assumed gesture if the state of the state diagram currently being visited is on a transition path to said gesture to be detected.

27. The computing device of claim 26, wherein said controller is further configured to present or effect a result of the actions corresponding to the assumed gesture as the state for the gesture to be detected is reached.

28. The computing device of claim 23, wherein said state transition diagram comprises at least one stable state on a path to another stable state for enabling a first gesture to be defined by a sub sequence of movements for a second gesture.

29. The computing device of claim 23, wherein said controller is further configured to identify a gesture for a plurality of objects by traversing a plurality of state diagrams each being associated with each of the plurality of objects, wherein said controller is further configured to identify a gesture for said plurality of objects being tracked by traversing the associated state diagram, wherein a transition in an associated state diagram corresponds to an element of a movement vector for the associated object to be tracked.

30. The computing device of claim 23, wherein said controller is further configured to identify a gesture for a plurality of objects by traversing a state diagram wherein each transition corresponds to a movement of the plurality of objects.

31. The computing device of claim 20, wherein said controller is further configured to determine that an angle matches a library angle to be compared with if the angle being compared is within an error tolerance of said library angle.

32. The computing device of claim 20, wherein said controller is further configured to:

determine a distance of a movement;

determine if the distance of the movement is above a first distance threshold value; and

if so,

compare the angle of the movement with the library angle.

33. The computing device of claim 20, wherein said movement vector comprises at least one further dimension taken from a group consisting of:

depth, rotation, degrees of turning, distance of movement and speed of movement.

34. The computing device of claim 32, wherein said controller is configured to differentiate between a fast and a slow movement.

35. The computing device of claim 32, wherein said controller is configured to differentiate between a short and a long movement.

36. The computing device of claim 20, wherein said controller is configured to determine a distance based on a size of the object to be tracked, a distance to the object to be tracked, size of a display and the field of view of a camera.

37. A method for use in a computing device for identifying a gesture performed by a tracked object in an image stream, said method comprising:

determining a movement vector for the tracked object;

comparing the movement vector against a reference library of gestures; and

thereby identifying a gesture matching the movement vector,

wherein said movement vector comprises at least one partial movement having a direction being identified by an angle and wherein said comparison is based on said angle, wherein

said method further comprises correcting for a misalignment of said computing device by determining said angle as a relative angle between a direction of a first partial movement and a direction of a second partial movement.

38. A computer readable storage medium encoded with instructions that, when loaded and executed on a processor, causes the method according to claim 37 to be performed.