Systems and methods for interfacing with a virtual object in a haptic virtual environment

• US 8,576,222 B2
• Filed: 01/03/2011
• Issued: 11/05/2013
• Est. Priority Date: 07/17/1998
• Status: Expired due to Term

• Current Assignee: 3D Systems, Inc. (3D Systems Corporation)
• Original Assignee: 3D Systems, Inc. (3D Systems Corporation)
• Inventors: Handley, Joshua E., Midura, Marc, Payne, Bradley A., Aviles, Walter A., Massie, Thomas Harold, Shannon, Walter C. III
• Primary Examiner(s): HAJNIK, DANIEL F
• Application Number:
  US12/983,553
• Publication Number:
  US 20110202856A1
• Time in Patent Office: 1,037 Days
• Field of Search: None
• US Class Current: 345/419
• CPC Class Codes: B33Y 50/00 Data acquisition or data processing for additive manufacturing
• CPC Class Codes: B33Y 80/00 Products made by additive manufacturing
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/21 Collision detection, intersection
• CPC Class Codes: G06T 2210/28 Force feedback
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

A user of a modeling application modifies an initial virtual object using a sketch drawn on one or more construction planes. Typically, construction planes are connected by an axis that intersects the virtual object. The user can draw a sketch on each construction plane, and the modeling application interpolates a shape along the axis between the sketches to determine what material in the virtual object is to be removed from it. In this manner, material may be removed to create a recess or hole in the virtual object or otherwise to slice away material from the object. A user can use two or more axes and construction planes to produce complex shapes from the initial virtual object. A user can also select a portion of a virtual object and mirror the selected portion. Modifications that the user makes in the selected portion are made correspondingly in the mirrored portion.

Claims

1. A method for interfacing with a virtual object in a haptic virtual environment, the method comprising:

generating, by a processor of a computing device, the virtual object comprising a first plurality of discrete points in the haptic virtual environment, wherein the virtual object comprises a virtual surface, wherein voxel density values associated with the first plurality of discrete points define a shape of the virtual object, and wherein each discrete point of the first plurality of distinct points having a density value greater than a density threshold is determined to be inside the virtual object;

identifying a first location of a user in real space;

determining, by the processor, a virtual tool comprising a second plurality of discrete points for use by the user in the haptic virtual environment;

responsive to identifying the first location of the user in real space, determining, by the processor, a first haptic interface location in the haptic virtual environment;

receiving information regarding a movement of the user to a second location in real space;

responsive to the movement, determining, by the processor, a second haptic interface location in the haptic virtual environment;

determining, by the processor, a proposed movement of the virtual tool towards the virtual surface of the virtual object responsive to the second haptic interface location;

responsive to the proposed movement of the virtual tool, determining, by the processor, penetration of one or more discrete points of the second plurality of discrete points of the virtual tool into the virtual surface of the virtual object;

calculating, by the processor, a force feedback as a function of the second haptic interface location, wherein

the force feedback corresponds to a resistance of the proposed movement of the virtual tool into the virtual object, and

the force feedback is calculated based in part upon a determination that at least one of the one or more discrete points of the second plurality of discrete points of the virtual tool has encountered a discrete point of the first plurality of discrete points of the virtual object having a voxel density value greater than the density threshold; and

causing, by the processor, a haptic interface device to provide the force feedback to the user.

2. The method of claim 1, further comprising:

responsive to the proposed movement, determining, by the processor, an updated position of the virtual tool within the virtual environment, wherein

determining the updated position comprises determining the updated position based in part upon the force feedback, wherein

the force feedback allows the user to move the virtual tool along the virtual surface in a manner that minimizes a spring distance between the virtual tool and the second haptic interface location.

3. The method of claim 1, wherein calculating the force feedback comprises determining a surface direction vector.

4. The method of claim 1, further comprising:

responsive to the proposed movement, determining, by the processor, an updated position of the virtual tool within the virtual environment, wherein

determining the updated position comprises moving the virtual tool as close as possible to the second haptic interface location, without crossing the virtual surface.

5. The method of claim 1, further comprising:

determining a tool origin of the virtual tool in the haptic virtual environment, wherein

the virtual tool is blocked from penetrating the virtual surface of the virtual object, and

calculating the force feedback comprises calculating the force feedback based at least in part on a connection between the tool origin and the haptic interface location.

6. The method of claim 5, wherein the connection comprises a virtual spring.

7. The method of claim 5, wherein the connection comprises a virtual dash-pot.

8. The method of claim 5, wherein the tool origin corresponds to a first point on the virtual tool, wherein the one or more discrete points of the second plurality of discrete points comprise the first point.

17. The method of claim 1, wherein the second haptic interface location penetrates the virtual surface of the virtual object.

19. The method of claim 1, wherein the volume of the virtual object is defined by a gradient of voxel density values that range from a minimum density value to a maximum density value.

20. The method of claim 1, further comprising:

calculating the voxel density values for a plurality of points of the virtual tool;

identifying a preset number of points of the virtual tool with the highest voxel density values upon calculating voxel density values for the plurality of points, wherein the preset number of points is less than all points of the virtual tool; and

detecting collision between the virtual tool and the virtual object by evaluating the identified preset number of points with respect to the first plurality of discrete points associated with the virtual object.

9. A system for interfacing with a virtual object in a haptic virtual environment, the system comprising:

a haptic interface device, wherein the haptic interface device is configured to sense a current location of a user in real space; and

a modeling application for modeling

the virtual object comprising a first plurality of discrete points, wherein the virtual object comprises a virtual surface, wherein voxel density values associated with the first plurality of discrete points define a shape of the virtual object, and wherein each discrete point of the first plurality of distinct points having a density value greater than a density threshold is determined to be inside the virtual object, and

a virtual tool comprising a second plurality of discrete points for use by the user in the haptic virtual environment,

wherein the modeling application is configured, when executed by a processor of a computing device, to;

determine a haptic interface location in the haptic virtual environment corresponding to the current location of the user in real space,

receive, from the haptic interface device, information identifying a movement to an updated current location of the user in real space,

determine, based upon the information, a second haptic interface location in the haptic virtual environment,

responsive to the second haptic interface location, determine a proposed movement of the virtual tool towards the virtual surface of the virtual object,

responsive to the proposed movement of the virtual tool, determine penetration of one or more discrete points of the second plurality of discrete points of the virtual tool into the virtual surface of the virtual object,

calculate a force feedback as a function of the second haptic interface location, wherein

the force feedback corresponds to a resistance of the movement of the virtual tool into the virtual object, and

the force feedback is calculated based in part upon a determination that at least one of the one or more discrete points of the second plurality of discrete points of the virtual tool has encountered a discrete point of the first plurality of discrete points of the virtual object having a voxel density value greater than the density threshold, and

cause the haptic interface device to provide the force feedback to the user.

10. The system of claim 9, wherein the modeling application is configured to:

responsive to the proposed movement, determine an updated position of the virtual tool within the virtual environment, wherein

determining the updated position comprises determining the updated position based in part upon the force feedback, wherein

the force feedback allows the user to move the virtual tool along the virtual surface in a manner that minimizes a spring distance between the virtual tool and the second haptic interface location.

11. The system of claim 9, wherein calculating the force feedback comprises determining a surface direction vector.

12. The system of claim 9, wherein the modeling application is configured to, responsive to the proposed movement:

determine an updated position of the virtual tool within the virtual environment, wherein

determining the updated position comprises moving the virtual tool as close as possible to the haptic interface location, without crossing the virtual surface.

13. The system of claim 12, wherein:

the modeling application is configured to determine a tool origin of the virtual tool in the haptic virtual environment, wherein,

the modeling application is configured to avoid penetration of the virtual tool into the virtual surface of the virtual object, and

calculating the force feedback comprises calculating the force feedback based at least in part on a connection between the tool origin and the second haptic interface location.

14. The system of claim 13, wherein the connection comprises a virtual spring.

15. The system of claim 13, wherein the connection comprises a virtual dash-pot.

16. The system of claim 13, wherein the tool origin corresponds to a first point on the virtual tool, wherein the one or more discrete points of the second plurality of discrete points comprise the first point.

18. The system of claim 9, wherein the second haptic interface location penetrates the virtual surface of the virtual object.