DYNAMIC USER INTERACTIONS FOR DISPLAY CONTROL AND IDENTIFYING DOMINANT GESTURES

• US 20140201674A1
• Filed: 01/15/2014
• Published: 07/17/2014
• Est. Priority Date: 01/15/2013
• Status: Active Grant

• Current Assignee: Lmi Liquidating Co., LLC
• Original Assignee: Leap Motion Incorporated (Ultraleap Limited)
• Inventors: HOLZ, David
• Granted Patent: US 9,696,867 B2
• Time in Patent Office: Days
• US Class Current: 715/782
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

The technology disclosed relates to distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space. In particular, it relates to calculating spatial trajectories of different gestures and determining a dominant gesture based on magnitudes of the spatial trajectories. The technology disclosed also relates to uniformly responding to gestural inputs from a user irrespective of a position of the user. In particular, it relates to automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface by automatically proportioning on-screen responsiveness to scaled movement distances of gestures in the physical space, user spacing with the 3D sensory space, or virtual object density in the gestural interface. The technology disclosed further relates to detecting if a user has intended to interact with a virtual object based on measuring a degree of completion of gestures and creating interface elements in the 3D space.

Claims

1. A method of distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space, the method including:

distinguishing wrist and finger flexing from an overall trajectory of an arm gesture while the arm is in motion, including;

detecting positions of the arm and attached wrist and fingers in a three dimensional (3D) sensory space using an electronic sensor;

calculating from a series of the detected positions a spatial trajectory of a waving gesture executed by the arm;

calculating from the detected positions spatial trajectories of the flexing gestures of the wrist and/or fingers; and

determining whether the waving gesture or the flexing gestures dominate based on magnitudes of the respective spatial trajectories; and

triggering a response to the dominant gesture without triggering a response to the non-dominant gesture.

2. The method of claim 1, wherein the magnitude of the spatial trajectory of the waving gesture is determined at least in part by a distance traversed in performance of the waving gesture.

3. The method of claim 1, wherein the magnitudes of the spatial trajectories of the flexing gestures are determined at least in part by a scale of curling of the fingers.

4. A method of distinguishing between two simultaneous gestures originating from a single object in a three-dimensional (3D) sensory space, the method including:

distinguishing finger and wrist flexing from an overall trajectory of an arm gesture while the arm is in motion, including;

detecting positions of the arm and attached wrist and fingers in a three dimensional (3D) sensor space using an electronic sensor;

calculating from a series of the detected positions a spatial trajectory of a waving gesture executed by the arm, wherein magnitude of the spatial trajectory is determined at least in part by a distance traversed in performance of the waving gesture;

calculating spatial trajectories of the flexing gestures of the wrist and/or fingers, wherein magnitudes of the spatial trajectories is determined at least in part by a scale of curling of the fingers and degrees of freedom between the fingers; and

evaluating magnitudes of respective spatial trajectories and determining a dominant gesture based on magnitudes of the spatial trajectories; and

triggering a response to the overall trajectory dependent on the dominant gesture.

5. A method of creating interface elements in a three-dimensional (3D) sensory space, the method including:

detecting a circular sweep of a finger in a three-dimensional (3D) sensory space using an electronic sensor;

constructing an on-screen button in a gestural interface responsive to the circular sweep;

detecting a subsequent lateral sweep of the finger in the 3D sensory space; and

registering a pressing of the on-screen button responsive to the subsequent lateral sweep and performing at least one associated function.

6. The method of claim 5, wherein the associated function is selected based on a context of the gestural interface.

7. The method of claim 5, wherein the associated function is selected based on a location of the on-screen button on the gestural interface.

8. The method of claim 5, further including interpreting the lateral sweep as a left mouse click if at least a threshold percentage of its motion is in a direction the finger is pointing.

9. The method of claim 5, further including interpreting the lateral sweep as a right mouse click if at least a threshold percentage of its motion is in a direction opposite to which the finger is pointing.