Haptic computer modeling system

• US 5,802,353 A
• Filed: 06/12/1996
• Issued: 09/01/1998
• Est. Priority Date: 06/12/1996
• Status: Expired due to Term

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Avila, Ricardo Scott, Sobierajski, Lisa Marie
• Primary Examiner(s): Teska, Kevin J.
• Assistant Examiner(s): MOHAMED, AYNI Y
• Application Number:
  US08/662,544
• Time in Patent Office: 811 Days
• Field of Search: 364/578, 395/500
• US Class Current: 703/13
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2210/28 Force feedback
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

A computer modeling and visualization system employs both 3D visual modeling and force feedback through a haptic device consistent with the visual display of the computer model. Force, or haptic, interaction is employed for exploring computer models. Point contact force equations were created for quickly computing forces directly from a model data which are provided to the haptic device, causing it to apply that force to an operator. The force equations employed are consistent with isosurface and volume rendering, providing a strong correspondence between visual and haptic rendering. The method not only offers the ability to see and feel the volumetric model but allows interactive modification and display of the model.

Claims

1. A haptic computer modeling system comprising:

a) a movable haptic input/output ("I/O") device capable of providing force feedback to an operator;

b) tracking device coupled to the haptic I/O device for tracking the position of at least one point on the haptic I/O device;

c) a model memory for storing information defining structure and properties of a computer model;

d) a force computation device coupled to the tracking device model memory and haptic I/O device capable of reading the location of the haptic I/O device and the computer model and for computing a feedback force based upon the location of the haptic I/O device relative to portions of the computer model and causing the haptic I/O device to provide the feedback force to the operator; and

e) a control panel for providing an operator/selected mode; and

f) a model modification device coupled to the control panel, the model memory and the tracking device for modifying parameters of the computer model at the location of the I/O device according to the mode received from the control panel.

2. The haptic computer modeling system of claim 1 wherein the force computation device receives density information d indicating penetration distance model memory at the current location of the I/O device and determines a retarding force f_r dependent upon the velocity of the haptic I/O device and a viscosity of the material at the current location within the model, and a stiffness force f_s dependent upon the characteristics of the model material as a function of density d.

3. A method of performing computer modeling on a volumetric model having a plurality of density values d, comprising the steps of:

a) providing a 3D visual image of a portion of the volume model;

b) reading current location of a functional point on an operator-manipulated haptic input/output device;

c) converting location of haptic device to corresponding location density d within the volume model;

d) determining a stiffness force f_s (d) and a viscous force, f_r (d) from the density value d; and

e) providing forces f_s (d) and f_r (d) to an operator through the haptic device creating the illusion of physically interacting with a material having specific and defined material characteristics.

4. The method of claim 3 further comprising the steps of:

a) selecting modification mode through a control panel;

b) altering parameters of the volume model near the location of haptic device to change the shape, color, or texture of the volumetric model;

c) altering the forces to the haptic device to simulate changes incurred by the model; and

d) updating the 3D visual image to correspond to the altered model.

5. A method for interacting with a 3D computer model having a plurality of properties each identified at a location comprising steps of:

a) rendering the computer model from an initial viewpoint;

b) monitoring the position of a functional point of a haptic device capable of providing force feedback to an operator;

c) modifying the properties of the computer model based upon an operator-specified modification mode;

d) computing a force from the position of the functional point relative to the computer model;

e) applying the computed force to the operator through the haptic device; and

f) rendering at least a portion of the modified computer model to the operator.

6. The method of method for interacting with a 3D computer model of claim 5 wherein the step of modifying the properties of the computer model comprising the steps of:

a) receiving a modification mode from the operator defining which model properties to modify, and how they are to be modified; and

b) modifying the model properties at a predetermined region around the monitored functional point.

7. The method of interacting with a 3D computer model of claim 5 wherein the step of rendering at least a portion of the modified computer model comprising steps of:

a) determining image pixels affected by model modification;

b) indicating the affected pixels; and

c) updating the indicated pixels with the modified model.

8. The method of interacting with a 3D computer model of claim 5 wherein the step of computing a force comprises the steps of:

a) computing a velocity of the functional point relative to the model;

b) determining a resistive force f_r from the velocity;

c) determining a stiffness force f_s from the density values; and

d) determining a resultant force to be used as the computed force in step 6e from the resistive force f_r, and the stiffness force f_s.

9. The method of interacting with a 3D computer model of claim 8 further comprising the step of:

a) measuring a velocity of a model object;

b) determining an inertial force from a relative velocity between the functional point and the model object when they interact;

c) adding the inertial force to the resultant force as the computed force in step 6e when they interact.

10. A method for creating a 3D computer model having a plurality of properties each identified at a location comprising steps of:

a) monitoring the position of a functional point of a haptic device capable of providing force feedback to an operator;

b) defining properties at the functional point of the haptic device to construct structures of the model;

c) computing a force consistent with material type and haptic I/O device velocity, from the position and velocity of the functional point relative to structures of the computer model;

d) applying the computed force to the operator through the haptic device; and

e) rendering at least a portion of the constructed computer model to the operator.