Virtual reality system for creation of design models and generation of numerically controlled machining trajectories

• US 20020133264A1
• Filed: 01/26/2001
• Published: 09/19/2002
• Est. Priority Date: 01/26/2001
• Status: Abandoned Application

• Current Assignee: New Jersey Institute of Technology
• Original Assignee: New Jersey Institute of Technology
• Inventors: Maiteh, Bilal Y., Blackmore, Denis L., Leu, Ming C.
• Application Number:
  US09/770,929
• Publication Number:
  US 20020133264A1
• Time in Patent Office: Days
• US Class Current: 700/182
• CPC Class Codes: G05B 19/4097 characterised by using design data to control NC machines, e.g. CAD/CAM G05B19/4093 takes precedence
• CPC Class Codes: G05B 2219/35149 Generate model with haptic interface, virtual sculpting
• CPC Class Codes: G05B 2219/40122 Manipulate virtual object, for trajectory planning of real object, haptic display
• CPC Class Codes: G05B 2219/40131 Virtual reality control, programming of manipulator
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

A system for using a virtual reality environment to create a design model and generate numerically controlled (NC) machining trajectories for use in fabrication of the model. The model is created in a virtual environment by carving a workpiece with one or more tools, each of which may have the geometry of a hand tool (e.g. a knife) or a machining tool (e.g. milling cutter). The selection and manipulation of virtual objects is performed in virtual space. Swept volumes of the virtual objects are generated using a solid modeling system according to the shape of the virtual objects and their trajectories, and Boolean operations are performed on the swept volumes and the initial virtual stock (workpiece) to create the design model. If the virtual object has the geometry of a computer numerical control (CNC) machining tool, the real NC machining trajectories for making the design object can be generated from the virtual object'"'"'s movements, during the design model creation with the virtual reality environment. In order for the virtual object to simulate the real machining tool, constraints are applied on the movements of the user to represent the physical effects and limitations of the real machining process. The trajectories of the machining tool in the virtual reality environment are post-processed by computer software, which converts the user movement (position and orientation) of the virtual tool to NC trajectories after taking the user movement and the machine parameters and conditions into consideration.

Claims

1. A system that uses a virtual reality environment to create a design model and generate numerically controlled (NC) machining trajectories for use in fabrication of the model, said system comprising:

display means for displaying in real time the three-dimensional images of a virtual environment with virtual machines, tools, workpieces and objects;

manipulation means for navigating through the virtual environment, sizing the virtual objects, and changing the positions and orientations of the virtual objects;

tracking means for measuring the position and orientation of a user'"'"'s hand;

sensing means for detecting touch or measuring force;

application means for applying a sense of touch or feedback force to the user;

communication means for allowing remote natural communication between multi-users participating in the design creation process; and

computation means for creating said design models and generating said NC machining trajectories by obtaining inputs from said tracking means and said sensing means and generating outputs to said display means, said manipulation means, and said application means;

wherein

said system operates in its entirety in real time, and design parameters and machining parameters defined by the operation of said system are output for at least one of direct application to a manufacturing protocol and review by a designer.

2. The system of claim 1, wherein the devices of virtual reality are used to create a design model by carving a workpiece with one or more virtual tools, to simulate the natural physical environment in which freeform models are created by designers, and wherein each of the virtual tools has the geometry of one of a hand tool, a machining tool, and a design tool.

3. The system according to claim 2, wherein the hand tool comprises a knife and the machining tool comprises a milling cutter.

4. The system of claim 1, wherein the design model is created by Boolean subtraction of the virtual tool swept volumes from an initial virtual stock comprised of the workpiece and the virtual tool swept volumes are computed from the geometry and trajectories of the virtual tool using a solid modeling system.

5. The system of claim 1, wherein the actual NC machining trajectories for fabricating the design model from the real workpiece are obtained by applying constraints on the user movements, which represent the physical limitations of the real machining tool and machining process, and by post-processing which includes smoothing the trajectories of the virtual tools that have the geometry of real machining cutters.

6. The system of claim 1 wherein, said manufacturing protocol comprises NC milling machinery.

7. A process for using a virtual reality environment to create a design model and to generate numerically controlled (NC) machining trajectories for use in fabrication of the design model, said process comprising the steps of:

(a) displaying a three-dimensional virtual environment in real time by a computer system;

(b) selecting a virtual workpiece created by a geometry modeler for placement in the virtual environment;

(c) selecting a virtual machine tool for use on the virtual workpiece;

(d) gripping the virtual tool by use of a haptic device;

(e) manipulating the virtual tool in the virtual environment to create a design model while the computer system records positions and orientations of the virtual tool and displays the condition of the virtual workpiece;

(f) simulating geometric changes of the virtual workpiece corresponding to the manipulation of the virtual tool;

(g) providing geometric information from the geometry modeler and material data of the virtual tool and the virtual workpiece as inputs to a physical simulation program;

(h) computing by the physical simulation program at least one physical attribute of the virtual tool selected from the group consisting of heat, cutting force, tool wear, tool vibration and breakage based on the inputs provided in step (g);

(i) transmitting the physical attribute data computed in step (h) to a user;

(j) generating an NC program from machine parameters, geometry of the virtual tool and position and orientation data of the virtual tool; and

(k) providing the NC Program and geometric models of the virtual workpiece and virtual tool from the geometry modeler as inputs for fabrication of the real design model.

8. The method according to claim 7, wherein the displaying recited in step (a) is provided by a head mounted device.

9. The method according to claim 7, wherein the displaying recited in step (a) is provided by a multi-wall display.

10. The method according to claim 8, wherein the displaying recited in step (a) is provided by shutter glasses and a monitor.

11. The method according to claim 7, wherein the physical simulation program in step (h) further includes providing feedback to a user effects and constraints corresponding to errors and limitations in an actual machining process.

12. The method according to claim 11, wherein said feedback provided is graphical.

13. The method according to claim 11, wherein said feedback provided is physical via a haptic device.

14. The method according to claim 11, wherein said feedback provided is audible by providing sounds indicative of errors and limitations in the machinery process.

15. The method according to claim 11, wherein said feedback provided comprises freezing the virtual reality environment with all information saved when the user ignored the effects and constraints for a predetermined amount of time.

16. The method according to claim 7, wherein said computer system generates a swept volume in a solid modeling system of the virtual tool from known dimensions and from measured trajectories based on the position and orientation data recorded in step (e).

17. The method according to claim 16, further comprising converting a solid model obtained from the solid modeling system to a model having discrete space in a three-dimensional array.

18. The method according to claim 17, wherein, the converting is performed by a ray casting system.

19. A process for recording the manipulation of virtual workpiece by a virtual machine tool in a virtual reality (VR) environment to create a design model, comprising the steps of:

(a) initializing a three-dimensional solid workpiece from an input system;

(b) gripping selected virtual objects which simulate real tools;

(c) constraining movement of the virtual objects by applying a force through a haptic interface to the virtual object which is gripped in step (b);

(d) sweeping the virtual objects in the virtual environment continuously within an area of constrained movement recited in step (c);

(e) modeling an in-process virtual workpiece geometry as a solid model by subtracting a swept volume of the virtual object from the virtual workpiece;

(f) recording a position and orientation data of the virtual object during the sweeping recited in step (d) by using VR hardware devices; and

(g) outputting full-scale manufacturing parameters as a design model for use as inputs to automated manufacturing operations for an actual manufacture of the model.