Development of stereoscopic-haptic virtual environments

• US 7,098,888 B2
• Filed: 04/28/2001
• Issued: 08/29/2006
• Est. Priority Date: 04/28/2000
• Status: Expired due to Fees

• Current Assignee: Texas Tech University System
• Original Assignee: Texas Tech University System
• Inventors: Temkin, Bharti, Watson, Kirk, Acosta, Eric
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): Nguyen, Kevin M.
• Application Number:
  US09/844,881
• Publication Number:
  US 20020084996A1
• Time in Patent Office: 1,949 Days
• Field of Search: 345 6- 9, 345/204, 345/156, 318/568.11, 318/561, 463/45, 463/262, 348/51, 348/45, 348/56, 348/77, 600/407, 600/130, 600/417, 600/429
• US Class Current: 345/156
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

The present invention provides a virtual-haptic environment that can be used to advantage to simulate and teach surgical procedures. Computer haptics simulates human sense of touch is provides with visual stereoscopy that simulates our natural depth perception and feeling of touch. Integration of these two senses enhances sense of realism. Thus by coupling force-feedback (or haptic) devices with a stereoscopic display, results in the illusion of being “inside” a virtual world, by being able to “see” and “touch and feel” 3D virtual environment. The computer based (on a PC using NT operating system) present invention provides an inexpensive, easy-to-use technique for generating a stereoscopic-haptic environment that provides a realistic virtual touch and see environment and dynamically adding haptic characteristics.

Claims

1. Method of creating a stereoscopic haptic virtual environment, comprising the steps of:

providing a computer controlling a display device and operatively coupled to a haptic device;

generating via programming executing on the computer a stereoscopic graphics for display on the display device by repeatedly performing the steps of;

rendering a first video image of a scene on stencil at a first position simulating the position of a left eye of a user;

rendering a second video image of the scene off stencil at a second position simulating the position of a right eye of the user;

interlacing the first video image and the second video image;

shuttering views of the display device while displaying the interlaced first and second video images in order to present in quick succession the first image to the left eye of the user and the second video image to the right eye of the user, each of said video images presented to the associated eye while the view of the other eye is shuttered;

generating haptic scene components including a component representing the haptic device;

time-synchronizing the stereoscopic graphics and haptic scene components;

presenting the synchronized stereoscopic graphics and haptic scene components to a user on the display device; and

providing a force response to the user when collisions among the stereoscopic graphics and the haptic device scene component are resolved.

2. The method of claim 1, wherein the generating step further comprises the steps of:

providing a visual cue via the display that a collision has been resolve between the haptic device and a virtual object.

3. The method of claim 2, wherein:

the visual cue is a displayed object model; and

the force provided is calculated to duplicate the force that an actual object modeled in virtual space would provide when touched with the haptic device.

4. The method of claim 1, wherein:

the presented synchronized stereoscopic graphics and haptic scene components are coordinated and consistent with each other; and

the synchronization step allows independent user customization of stereoscopic graphics and haptic scene components parameters.