User-defined virtual interaction space and manipulation of virtual cameras with vectors

• US 10,579,155 B2
• Filed: 05/06/2019
• Issued: 03/03/2020
• Est. Priority Date: 12/16/2013
• Status: Active Grant

• Current Assignee: Ultrahaptics Ip Two Limited (Ultraleap Holdings Ltd.)
• Original Assignee: Ultrahaptics Ip Two Limited (Ultraleap Holdings Ltd.)
• Inventors: Cohen, Isaac, Sills, Maxwell, Durdik, Paul
• Primary Examiner(s): Reed, Stephen T.
• Application Number:
  US16/404,641
• Publication Number:
  US 20190265803A1
• Time in Patent Office: 302 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

The technology disclosed relates to creating user-defined interaction spaces and modalities in a three dimensional (3D) sensor space in response to control gestures. It also relates to controlling virtual cameras in the 3D sensor space using control gestures and manipulating controls of the virtual cameras through the control gestures. In particular, it relates to defining one or more spatial attributes of the interaction spaces and modalities in response to one or more gesture parameters of the control gesture. It also particularly relates to defining one or more visual parameters of a virtual camera in response to one or more gesture parameters of the control gesture.

Claims

1. A method of manipulating virtual objects in a three-dimensional (3D) sensor space, the method including:

creating a virtual vector field in response to a control gesture that makes swirling motions in a 3D sensor space, wherein the virtual vector field is a vortex;

creating a plurality of virtual objects in response to subsequent control gestures that make circular sweeps in the 3D sensor space and define object vectors on respective virtual objects;

compounding interactions of the vector field with the object vectors based on their respective magnitudes; and

adjusting an effect of the vortex on the virtual objects in proportion to the interactions of the vector field and the object vectors to cause the object vectors of the respective virtual objects thereby bringing one or more of the virtual objects closer to a center of the vortex or pushing one or more of the virtual objects away from the center of the vortex.

2. The method of claim 1, further comprising:

determining from the control gestures the area of the vortex.

3. The method of claim 1, further comprising:

determining from the plurality of virtual objects a set of virtual objects within the vortex based upon the size of the vortex; and

moving members of the set of virtual objects in unison responsive to the control gesture.

4. The method of claim 1, further comprising determining from a compounding of the size of the vortex and curling of fingers of a hand an appropriate velocity of motion for the virtual objects.

5. The method of claim 1, further comprising determining from a compounding of the size of the vortex and degrees of freedom between fingers of curled fingers of a hand an appropriate velocity of motion for the virtual objects.

6. The method of claim 1, further comprising increasing strength of the virtual vector field responsive to continued circling of a control gesture.

7. The method of claim 1, further comprising determining a repulsive vortex in which virtual objects move further apart from one another.

8. A non-transitory computer-readable recording medium having a program recorded thereon for manipulating virtual objects in a three-dimensional (3D) sensor space, the program, when executed on a processor, implementing a method comprising:

creating a virtual vector field in response to a control gesture that makes swirling motions in a 3D sensor space, wherein the virtual vector field is a vortex;

creating a plurality of virtual objects in response to subsequent control gestures that make circular sweeps in the 3D sensor space and define object vectors on respective virtual objects;

compounding interactions of the vector field with the object vectors based on their respective magnitudes; and

adjusting an effect of the vortex on the virtual objects in proportion to the interactions of the vector field and the object vectors to cause the object vectors of the respective virtual objects thereby bringing one or more of the virtual objects closer to a center of the vortex or pushing one or more of the virtual objects away from the center of the vortex.

9. The non-transitory computer-readable recording medium of claim 8, further comprising:

determining from the control gestures the area of the vortex.

10. The non-transitory computer-readable recording medium of claim 8, further comprising:

determining from the plurality of virtual objects a set of virtual objects within the vortex based upon the size of the vortex; and

moving members of the set of virtual objects in unison responsive to the control gesture.

11. The non-transitory computer-readable recording medium of claim 8, wherein the method further includes determining from a compounding of the size of the vortex and curling of fingers of a hand an appropriate velocity of motion for the virtual objects.

12. The non-transitory computer-readable recording medium of claim 8, wherein the method further includes determining from a compounding of the size of the vortex and degrees of freedom between fingers of curled fingers of a hand an appropriate velocity of motion for the virtual objects.

13. The non-transitory computer-readable recording medium of claim 8, further comprising increasing strength of the virtual vector field responsive to continued circling of a control gesture.

14. The non-transitory computer-readable recording medium of claim 8, wherein the method further includes determining a repulsive vortex in which virtual objects move further apart from one another.

15. A smart phone having an interface that manipulates virtual objects in a three-dimensional (3D) sensor space, the smart phone comprising:

a hardware controller storing instructions that, when executed, implement actions including;

creating a virtual vector field in response to a control gesture, as viewed by a camera having a particular vantage point, that makes swirling motions in a 3D sensor space, wherein the virtual vector field is a vortex;

creating a plurality of virtual objects in response to subsequent control gestures that make circular sweeps in the 3D sensor space and define object vectors on respective virtual objects;

compounding interactions of the vector field with the object vectors based on their respective magnitudes; and

adjusting an effect of the vortex on the virtual objects in proportion to the interactions of the vector field and the object vectors to cause the object vectors of the respective virtual objects thereby bringing one or more of the virtual objects closer to a center of the vortex or pushing one or more of the virtual objects away from the center of the vortex.

16. The smart phone of claim 15, wherein the actions further include:

determining from the control gestures the area of the vortex.

17. The smart phone of claim 15, wherein the actions further include:

determining from the plurality of virtual objects a set of virtual objects within the vortex based upon the size of the vortex; and

moving members of the set of virtual objects in unison responsive to the control gesture.

18. The smart phone of claim 15, wherein the actions further include determining from a compounding of the size of the vortex and curling of fingers of a hand an appropriate velocity of motion for the virtual objects.

19. The smart phone of claim 15, wherein the actions further include determining from a compounding of the size of the vortex and degrees of freedom between fingers of curled fingers of a hand an appropriate velocity of motion for the virtual objects.

20. The smart phone of claim 15, wherein the actions further includes determining a repulsive vortex in which virtual objects move further apart from one another.