Apparatus and methods for haptic rendering using a haptic camera view

• US 9,030,411 B2
• Filed: 05/13/2014
• Issued: 05/12/2015
• Est. Priority Date: 06/29/2004
• Status: Active Grant

• Current Assignee: 3D Systems, Inc. (3D Systems Corporation)
• Original Assignee: 3D Systems, Inc. (3D Systems Corporation)
• Inventors: Itkowitz, Brandon D., Shih, Loren C., Midura, Marc Douglass, Handley, Joshua E., Goodwin, William Alexander
• Primary Examiner(s): CERULLO, LILIANA P
• Application Number:
  US14/276,845
• Publication Number:
  US 20140333625A1
• Time in Patent Office: 364 Days
• Field of Search: 345/156, 345/419, 345/422, 345/581, 345632-634
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/012 Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/80 Shading
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/28 Force feedback
• CPC Class Codes: G06T 2215/06 Curved planar reformation of 3D line structures

Abstract

The invention provides systems and methods for using a “haptic camera” within a virtual environment and for using graphical data from the haptic camera to produce touch feedback. The haptic camera obtains graphical data pertaining to virtual objects within the vicinity and along the trajectory of a user-controlled haptic interface device. The graphical data from the camera is interpreted haptically, thereby allowing touch feedback corresponding to the virtual environment to be provided to the user.

Claims

1. A system for haptically rendering a virtual object in a virtual environment, the system comprising:

a graphics thread of a graphics hardware pipeline that generates two-dimensional (2D) screen view rendering data for display of a 2D screen view of a three-dimensional (3D) object in a virtual environment, wherein the 2D screen view rendering data comprises data from a buffer of the graphics hardware pipeline;

a collision thread that determines if a user-directed virtual proxy collides with at least one geometric feature within the virtual environment using the 2D screen view rendering data; and

a servo thread that generates force to be applied to a user in real space through a haptic interface device according to input from the collision thread, wherein the servo thread is in communication with the haptic interface device.

2. The system of claim 1, wherein the graphics thread refreshes the visual display at a rate within a range from about 5 Hz to about 150 Hz.

3. The system of claim 1, wherein the graphics thread refreshes the visual display at a rate within a range from about 30 Hz to about 60 Hz.

4. The system of claim 1, wherein the collision thread performs a collision detection computation at a rate within a range from about 30 Hz to about 200 Hz.

5. The system of claim 1, wherein the collision thread performs a collision detection computation at a rate within a range from about 80 Hz to about 120 Hz.

6. The system of claim 1, wherein the servo thread refreshes the force to be applied through the haptic interface device at a rate within a range from about 1000 Hz to about 10,000 Hz.

7. The system of claim 1, wherein the servo thread comprises at least one of a force shader and a proxy shader.

8. The system of claim 1, wherein the buffer of the graphics hardware pipeline is selected from the group consisting of a depth buffer, a feedback buffer, a color buffer, a stencil buffer, and an accumulation buffer.

9. The system of claim 1, wherein the 2D screen view rendering data comprises data organized in a two dimensional grid of known dimensions.

10. The system of claim 1, wherein the 2D screen view rendering data comprises scalar data.

11. The system of claim 1, wherein the graphics hardware pipeline generating the 2D screen view rendering data comprises a hardware accelerated module.

12. The system of claim 1, wherein the 2D screen view rendering data comprises rasterization processing data.

13. The system of claim 1, wherein the 2D screen view rendering data comprises occlusion processing data.

14. The system of claim 1, wherein the graphics hardware pipeline generating the 2D screen view rendering data comprises a module selected from the group consisting of a modeling transformation module, a rejection module, an illumination module, and a rasterization module.