DYNAMIC USER INTERACTIONS FOR DISPLAY CONTROL AND SCALING RESPONSIVENESS OF DISPLAY OBJECTS

• US 20140201690A1
• Filed: 01/15/2014
• Published: 07/17/2014
• Est. Priority Date: 01/15/2013
• Status: Active Grant

• Current Assignee: Lmi Liquidating Co., LLC
• Original Assignee: Leap Motion Incorporated (Ultraleap Limited)
• Inventors: HOLZ, David
• Granted Patent: US 9,632,658 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

The technology disclosed relates to distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space. In particular, it relates to calculating spatial trajectories of different gestures and determining a dominant gesture based on magnitudes of the spatial trajectories. The technology disclosed also relates to uniformly responding to gestural inputs from a user irrespective of a position of the user. In particular, it relates to automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface by automatically proportioning on-screen responsiveness to scaled movement distances of gestures in the physical space, user spacing with the 3D sensory space, or virtual object density in the gestural interface. The technology disclosed further relates to detecting if a user has intended to interact with a virtual object based on measuring a degree of completion of gestures and creating interface elements in the 3D space.

Claims

1. A method of uniformly responding to gestural inputs from a user irrespective of a position of the user in a three-dimensional (3D) sensory space, the method including:

automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface, including;

calculating a control object'"'"'s distance from a camera electronically coupled to the gestural interface;

scaling an apparent angle traversed by movement in the camera'"'"'s field of view to a scaled movement distance based on the control object'"'"'s distance from the camera; and

automatically proportioning responses to the scaled movement distance of gestures in the physical space rather than the apparent angle traversed.

2. The method of claim 1, further including decreasing on-screen responsiveness of the gestural interface when the apparent angle traversed is below a threshold value.

3. The method of claim 1, further including amplifying on-screen responsiveness of the gestural interface when the apparent angle traversed is above a threshold value.

4. A method of adjusting responsiveness of virtual objects of a gestural interface in a three-dimensional (3D) sensory space, the method including:

automatically adjusting a responsiveness scale between gestures in a physical space and resulting responses of virtual objects in a gestural interface, including;

calculating a virtual object density of the gestural interface based on a numerosity of the virtual objects; and

automatically proportioning on-screen responsiveness of the virtual objects to the gestures responsive to the virtual object density in the gestural interface.

5. The method of claim 4, further including automatically specifying a low on-screen responsiveness of virtual objects in response to a particular gesture when the content density is above a threshold value.

6. The method of claim 4, further including automatically specifying a high on-screen responsiveness of virtual objects in response to the particular gesture when the content density is below a threshold value.

7. A method of uniformly responding to gestural inputs from multiple users within a three-dimensional (3D) sensory space, the method including:

automatically adapting a responsiveness scale between gestures in a physical space from multiple users and resulting responses in a shared gestural interface by;

calculating a user spacing within a three-dimensional (3D) sensory space based on a spacing of users detected in the 3D sensory space; and

automatically proportioning on-screen responsiveness of the shared gestural interface responsive to the user spacing when interpreting movement distances of the gestures in the physical space.