METHOD AND APPARATUS FOR PROCESSING GESTURE INPUT

• US 20160187990A1
• Filed: 05/21/2015
• Published: 06/30/2016
• Est. Priority Date: 12/26/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: LEE, Kyoobin, PARK, Keun Joo, RYU, Eric Hyunsurk
• Granted Patent: US 9,857,878 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A method and apparatus for processing a gesture input are provided. The method includes determining a type of an elliptical arc corresponding to a gesture input; determining a rotation direction corresponding to the gesture input; and processing the gesture input based on the type of the elliptical arc and the rotation direction.

Claims

1. A method of processing a gesture input, the method comprising:

determining a type of an elliptical arc corresponding to a gesture input;

determining a rotation direction corresponding to the gesture input; and

processing the gesture input based on the type of the elliptical arc and the rotation direction.

2. The method of claim 1, wherein the gesture input is a portion of an iterative elliptical motion input.

3. The method of claim 1, wherein the gesture input corresponds to one of an intention delivery portion and a return portion of a circular motion input.

4. The method of claim 1, wherein the type of the elliptical arc comprises:

a direction of a long axis of an ellipse corresponding to the gesture input; and

a relative position of the elliptical arc based on the long axis.

5. The method of claim 1, further comprising:

receiving event signals output by pixels of an event based vision sensor that detects a change in light due to the gesture input,

wherein at least one of the type of the elliptical arc and the rotation direction is determined based on the event signals.

6. The method of claim 5, further comprising:

determining an optical flow based on distance differences and time differences between elements of an event map that correspond to the event signals and peripheral elements of the elements,

wherein at least one of the type of the elliptical arc and the rotation direction is determined based on the optical flow.

7. The method of claim 1, further comprising:

receiving images output by a frame based vision sensor that captures the gesture input for each frame; and

comparing the images to generate difference information between the images,

wherein at least one of the type of the elliptical arc and the rotation direction is determined based on the difference information.

8. The method of claim 1, wherein the determining the type of the elliptical arc comprises:

matching the gesture input to one of ellipses; and

matching the gesture input to one of elliptical arcs of the matched one of the ellipses.

9. The method of claim 8, wherein the elliptical arcs are mutually separate based on a long axis of the matched one of the ellipses.

10. The method of claim 1, wherein the determining the type of the elliptical arc comprises:

determining an eccentricity of an ellipse corresponding to the gesture input; and

determining an angle indicating a position corresponding to the gesture input in a periphery of the ellipse.

11. The method of claim 1, wherein the determining the rotation direction comprises:

determining whether the gesture input is one of a clockwise direction and a counterclockwise direction.

12. The method of claim 1, further comprising:

determining at least one of a change in motion vectors over time and a change in position information over time corresponding to the gesture input,

wherein at least one of the type of the elliptical arc and the rotation direction is determined based on one of the change in the motion vectors over time and the change in the position information over time.

13. The method of claim 1, wherein the processing comprises:

determining an input direction corresponding to the gesture input based on the type of the elliptical arc and the rotation direction; and

performing an action corresponding to the input direction.

14. The method of claim 1, wherein the processing comprises:

determining whether the gesture input corresponds to one of an intention delivery portion and a return portion of a circular motion input based on the type of the elliptical arc and the rotation direction;

performing an action corresponding to the circular motion input in response to the gesture input being determined to correspond to the intention delivery portion; and

suspending the action in response to the gesture input being determined to correspond to the return portion.

15. The method of claim 1, wherein the processing comprises:

determining whether to perform an action corresponding to the gesture input based on a first angle indicating a position corresponding to a previous gesture input and a second angle indicating a position corresponding to the gesture input in a periphery of an ellipse corresponding to the previous gesture input and the gesture input.

16. The method of claim 1, wherein the processing comprises:

controlling a phase of an action corresponding to the gesture input based on an angle indicating a position corresponding to the gesture input in a periphery of an ellipse corresponding to the gesture input.

17. The method of claim 1, further comprising:

determining whether the gesture input corresponds to an ellipse; and

discarding the gesture input in response to the gesture input being determined not to correspond to the ellipse.

18. The method of claim 1, wherein the gesture input is input on a virtual plane in parallel with a vision sensor that detects the gesture input.

19. The method of claim 1, wherein the processing comprises:

processing the gesture input further based on at least one of a size of an ellipse corresponding to the gesture input, a velocity of the gesture input, and a depth of the gesture input.

20. A non-transitory computer-readable storage medium storing a program comprising instructions to cause a computer to implement the method of claim 1.

21. An apparatus for processing a gesture input, the apparatus comprising:

a sensor configured to detect a gesture input;

a determiner configured to determine a figure corresponding to the gesture input, and a part corresponding to the gesture input among parts of the figure, based on figures having a rotation direction and a trajectory; and

a decider configured to determine whether to perform an action corresponding to the figure based on the part corresponding to the gesture input.

22. The apparatus of claim 21, wherein the figure corresponds to a swipe action in a direction of a main axis of the figure.

23. The apparatus of claim 21, wherein the sensor comprises:

an event based vision sensor configured to detect a change in light due to the gesture input; and

a frame based vision sensor configured to capture the gesture input for each frame.

24. The apparatus of claim 21, wherein the determiner is configured to:

determine a rotation direction corresponding to the gesture input; and

determine the figure having the rotation direction among the figures having the rotation direction.

25. The apparatus of claim 21, wherein the decider is configured to:

determine to perform the action in response to the part corresponding to an operation of performing the action; and

determine not to perform the action in response to the part corresponding to a return operation to iteratively perform the action.

26. An apparatus for processing a gesture input, the apparatus comprising:

a first decider configured to determine a portion of a circular motion input corresponding to the gesture input;

a second decider configured to determine a rotation direction corresponding to the gesture input; and

a processor configured to process the gesture input based on the portion of the circular motion input and the rotation direction.

27. The apparatus of claim 26, wherein the processor is configured to:

perform an action corresponding to the portion of the circular motion input and the rotational direction, in response to the portion of the circular motion input being an intention delivery portion; and

suspend the action in response to the portion of the circular motion input being a return portion.

28. The apparatus of claim 27, wherein the circular motion input has one of a triangular shape of which a base side is longest and a semi-elliptical shape of which a long axis is the base side, and

the processor is configured to determine a first portion of the circular motion input corresponding to the base side as the intention delivery portion.

29. The apparatus of claim 27, wherein the processor is configured to:

determine a first portion of the circular motion input relatively close to a sensor as the intention delivery portion.

30. The apparatus of claim 26, wherein the processor is further configured:

determine a change in an x-axial motion vector, a y-axial motion vector, and a z-axial motion vector over time corresponding to the gesture input,

wherein at least one of the type of the elliptical arc and the rotation direction is determined based on the change in the x-axial motion vector, the y-axial motion vector, and the z-axial motion vector over time.