Method and apparatus for processing gesture input based on elliptical arc and rotation direction that corresponds to gesture input

• US 9,857,878 B2
• Filed: 05/21/2015
• Issued: 01/02/2018
• Est. Priority Date: 12/26/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Lee, Kyoobin, Park, Keun Joo, Ryu, Eric Hyunsurk
• Primary Examiner(s): Snyder, Adam J
• Application Number:
  US14/718,259
• Publication Number:
  US 20160187990A1
• Time in Patent Office: 957 Days
• Field of Search: 345175, 178 1809
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A method and apparatus for processing a gesture input are provided. The method includes determining a type of an elliptical arc corresponding to a gesture input; determining a rotation direction corresponding to the gesture input; and processing the gesture input based on the type of the elliptical arc and the rotation direction.

Claims

1. A method of processing a current gesture input, the method comprising:

determining whether a direction of a long axis of an ellipse corresponding to the current gesture input is horizontal or vertical;

determining whether an elliptical arc position of an elliptical arc corresponding to the current gesture input is in a first position or a second position that is separated from the long axis;

determining whether a rotation direction corresponding to the current gesture input is clockwise or counterclockwise;

performing an action corresponding to the current gesture input in response to the determining that the direction of the long axis is vertical and the elliptical arc is in the first position; and

suspending the action in response to the determining that the direction of the long axis is vertical and the elliptical arc is in the second position,

wherein the action comprises a first action and a second action different from the first action, the first action being performed in response to the determining that the rotation direction is clockwise, and the second action being performed in response to the determining that the rotation direction is counterclockwise.

2. The method of claim 1, wherein the current gesture input is a portion of an iterative elliptical motion input.

3. The method of claim 1, wherein the current gesture input is corresponding to one of an intention delivery portion and a return portion of a circular motion input.

4. The method of claim 1, further comprising:

receiving a plurality of event signals from pixels of an event based vision sensor that detects a change in light due to the current gesture input,

wherein any one or any combination of the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction is determined based on the plurality of event signals.

5. The method of claim 4, further comprising:

determining an optical flow, based on distance differences and time differences between first elements of an event map that correspond to the plurality of event signals and peripheral elements of the first elements,

wherein any one or any combination of the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction is determined based on the optical flow.

6. The method of claim 1, further comprising:

receiving a plurality of images from a frame based vision sensor that captures the current gesture input for each frame; and

comparing the plurality of images to generate difference information between the plurality of images,

wherein any one or any combination of the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction is determined based on the difference information.

7. The method of claim 1, further comprising:

matching the current gesture input to the ellipse among ellipses; and

matching the current gesture input to the elliptical arc among arcs of the ellipse.

8. The method of claim 7, wherein the arcs are mutually separate based on the long axis of the ellipse.

9. The method of claim 1, further comprising:

determining an eccentricity of the ellipse; and

determining an angle indicating a current gesture input position corresponding to the current gesture input in a periphery of the ellipse.

10. The method of claim 1, further comprising:

determining either one or both of a first change in motion vectors over time and a second change in position information over time that correspond to the current gesture input,

wherein any one or any combination of the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction is determined based on either one or both of the first change in the motion vectors over time and the second change in the position information over time.

11. The method of claim 1, further comprising:

determining an input direction corresponding to the current gesture input, based on the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction,

wherein the action corresponding to the input direction is performed.

12. The method of claim 1, further comprising:

determining whether the current gesture input is corresponding to one of an intention delivery portion and a return portion of a circular motion input, based on the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction,

wherein the performing comprises performing the action corresponding to the circular motion input in response to the determining that the current gesture input is corresponding to the intention delivery portion, and

the suspending comprises suspending the action in response to the determining that the current gesture input is corresponding to the return portion.

13. The method of claim 1, further comprising:

determining whether to perform the action, based on a first angle indicating a previous gesture input position corresponding to a previous gesture input and a second angle indicating a current gesture input position corresponding to the current gesture input in a periphery of the ellipse corresponding to the previous gesture input and the current gesture input.

14. The method of claim 1, further comprising:

controlling a phase of the action, based on an angle indicating a current gesture input position corresponding to the current gesture input in a periphery of the ellipse.

15. The method of claim 1, further comprising:

determining whether the current gesture input is corresponding to the ellipse; and

discarding the current gesture input in response to the determining that the current gesture input does not correspond to the ellipse.

16. The method of claim 1, wherein the current gesture input is input on a virtual plane in parallel with a vision sensor that detects the current gesture input.

17. The method of claim 1, further comprising:

processing the current gesture input, based on any one or any combination of a size of the ellipse, a velocity of the current gesture input, and a depth of the current gesture input.

18. A non-transitory computer-readable storage medium storing a program comprising instructions to cause a computer to implement the method of claim 1.

19. An apparatus for processing a current gesture input, the apparatus comprising:

a sensor configured to detect the current gesture input;

a processor configured to;

determine whether a direction of a long axis of an ellipse corresponding to the current gesture input is horizontal or vertical;

determine whether an elliptical arc position of an elliptical arc corresponding to the current gesture input is in a first position or a second position that is separated from the long axis; and

determine whether a rotation direction corresponding to the current gesture input is clockwise or counterclockwise; and

a decider configured to decide to;

perform an action corresponding to the current gesture input in response to the direction of the long axis being determined to be vertical and the elliptical arc being determined to be in the first position; and

suspend the action in response to the direction of the long axis being determined to be vertical and the elliptical arc being determined to be in the second position,

wherein the action comprises a first action and a second action different from the first action, the first action being performed in response to the rotation direction being determined to be clockwise, and the second action being performed in response to the rotation direction being determined to be counterclockwise.

20. The apparatus of claim 19, wherein the current gesture input comprises a swipe action in the direction of the long axis.

21. The apparatus of claim 19, wherein the sensor comprises:

an event based vision sensor configured to detect a change in light due to the current gesture input; and

a frame based vision sensor configured to capture the current gesture input for each frame.

22. An apparatus for processing a current gesture input, the apparatus comprising:

a sensor configured to detect the current gesture input;

a processor configured to;

determine whether a direction of a long axis of an ellipse corresponding to the current gesture input is horizontal or vertical;

determine whether an elliptical arc position of an elliptical arc corresponding to the current gesture input is above, below, left of, or right of the long axis; and

determine whether a rotation direction corresponding to the current gesture input is clockwise or counterclockwise; and

a decider configured to decide to;

perform a first action in response to the direction of the long axis being determined to be vertical, the elliptical arc position of the elliptical arc being determined to be left of the long axis, and the rotation direction being determined to be clockwise;

suspend the first action in response to the direction of the long axis being determined to be vertical, the elliptical arc position of the elliptical arc being determined to be right of the long axis, and the rotation direction being determined to be clockwise;

perform a second action in response to the direction of the long axis being determined to be vertical, the elliptical arc position of the elliptical arc being determined to be left of the long axis, and the rotation direction being determined to be counterclockwise; and

suspend the second action in response to the direction of the long axis being determined to be vertical, the elliptical arc position of the elliptical arc being determined to be right of the long axis, and the rotation direction being determined to be counterclockwise.

23. The apparatus of claim 22, wherein the processor is further configured:

determine a change in an x-axial motion vector, a y-axial motion vector, and a z-axial motion vector over time that correspond to the current gesture input,

wherein any one or any combination of the direction of the long axis, the elliptical arc position of the elliptical arc, and the rotation direction is determined based on the change in the x-axial motion vector, the y-axial motion vector, and the z-axial motion vector over time.