Three dimensional surface drawing controlled by hand motion

• US 7,212,197 B1
• Filed: 02/01/2000
• Issued: 05/01/2007
• Est. Priority Date: 02/01/1999
• Status: Expired due to Fees

• Current Assignee: California Institute of Technology
• Original Assignee: California Institute of Technology
• Inventors: Schroeder, Peter, Schkolne, Steven
• Primary Examiner(s): Nguyen; Phu K.
• Application Number:
  US09/496,137
• Time in Patent Office: 2,646 Days
• Field of Search: 345/419, 345/427, 345/428, 345/619
• US Class Current: 345/419
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

Surface drawing is described as a medium which provides direct control over the creation of a wide range of intricate shapes. Surfaces are created by moving a hand, instrumented with a special glove, through space in a semi-immersive 3D display and interaction environment. Intricate forms can be created using intuitive motions. The design space can be freely explored during the modeling process without the need to plan the construction of the final shape. In particular it supports unconstrained erasing and buildup of new geometry. An incremental Cookie Cutter algorithm, a construction method for triangulated meshes is described which allows the user to freely grow, join, and erase surfaces based on hand motions.

Claims

1. A method of producing a shape, comprising:

using a virtual reality environment in which positions of a user'"'"'s hand are tracked;

forming a three-dimensional modeled surface by adding shapes defined by hand movements at each of a plurality of intervals; and

wherein an inside surface of the hand is used to form the modeled surface, by tracking movement of a tangent to the hand, to define a tangent plane of a surface being created.

2. A method as in claim 1 wherein said using comprises tracking hand movement is tracked via a tracker and glove.

3. A method of producing a shape, comprising:

using a virtual reality environment in which positions of a user'"'"'s hand are tracked;

forming a three-dimensional modeled surface by adding shapes defined by hand movements at each of a plurality of intervals, wherein an added shape comprises a surface region formed from sampled positions of a hand movement in the virtual reality environment during at least one of said intervals; and

using an incremental technique to take an existing mesh of samples and changing it to add a new sample.

4. A method as in claim 3 further comprising defining a first hand position which defines a starting position and a second hand position which defines a stopping of drawing.

5. A method as in claim 3 further comprising defining a hand position which forms an eraser tool.

6. A method of producing a shape, comprising:

using a virtual reality environment in which positions of a user'"'"'s hand are tracked;

forming a three-dimensional modeled surface by adding shapes defined by hand movements at each of a plurality of intervals;

using an incremental technique to take an existing mesh of samples and changing it to add a new sample; and

wherein said technique comprises finding a neighborhood of samples, identifying a surface region, removing identified parts, and creating new parts to replace the identified parts, where the new parts take a new sample into account.

7. A method as in claim 6 wherein said technique utilizes a projective plane to determine how the new parts should be formed.

8. A method of producing a shape, comprising:

using a virtual reality environment in which positions of a user'"'"'s hand are tracked;

forming a three-dimensional modeled surface by adding shapes defined by hand movements at each of a plurality of intervals;

wherein the surface is selected as a normal to the surface of the hand.

9. A method of producing a shape, comprising:

using a virtual reality environment in which positions of a user'"'"'s hand are tracked;

forming a three-dimensional modeled surface by adding shapes defined by hand movements at each of a plurality of intervals, wherein an added shape comprises a surface region formed from sampled positions of a hand movement in the virtual reality environment during at least one of said intervals; and

modifying the drawing using one of a plurality of props.

10. A method as in claim 9 wherein said props are tongs which can be squeezed and moved to rotate the shape.

11. A method as in claim 9 wherein said prop is a spherical ball.

12. A method as in claim 9 wherein said prop is a sponge which alters a look of the shape.

13. A method as in claim 12 wherein said altering is by smoothing.

14. A method of producing a shape, comprising:

tracking a position of a user'"'"'s hand;

forming a three-dimensional modeled surface based on said position of said user'"'"'s hand at different times;

wherein said forming comprises using the hand to create 3d-strokes of shape; and

wherein said samples are added by deprojecting a shape, removing parts, adding new parts, and reprojecting said shape.

15. A method of producing a shape, comprising:

tracking a position of a user'"'"'s hand; and

forming a three-dimensional modeled surface by finding hand positions at different times, storing those positions, and forming the surface using said positions to define points on the actual surface that is formed;

wherein a first hand posture comprises a start to track posture; and

,

using the finger to draw a narrower stroke.

16. A method as in claim 15, wherein said forming comprises using the hand to create 3d-strokes of shape.

17. A method as in claim 15, wherein said using comprises using the bend of the hand to define the curvature of 3d-strokes.

18. A method as in claim 15, further comprising

sensing at least 7 of the hand'"'"'s degrees of freedom for the purposes of shape creation, said degrees of freedom including the hand'"'"'s position and orientation in space, along with degrees of freedom that are affected by the hand'"'"'s posture.

19. A method as in claim 15,

wherein said forming comprises using the hand to create 3d-strokes of shape, each 3d-stroke of shape comprising a plurality of points created in 3d-space by motion of the hand, the plurality of points defining the 3d-stroke of shape;

and

further comprising merging samples from one hand position to an existing shape.

20. A method as in claim 15 further comprising using hand postures to switch between different modes of operation.

21. A method as in claim 15, wherein a second hand posture comprises a stop track posture.

22. A method as in claim 15, further comprising displaying different tools at the hand'"'"'s position based on different postures.