Multi-plane horizontal perspective hands-on simulator

• US 20050264558A1
• Filed: 05/31/2005
• Published: 12/01/2005
• Est. Priority Date: 06/01/2004
• Status: Abandoned Application

• Current Assignee: Infinite Io, Inc.
• Original Assignee: Infinite Io, Inc.
• Inventors: Vesely, Michael A., Clemens, Nancy L.
• Application Number:
  US11/141,651
• Publication Number:
  US 20050264558A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G02B 30/40 giving the observer of a single two-dimensional [2D] image a perception of depth
• CPC Class Codes: G02B 30/50 the image being built up from image elements distributed over a 3D volume, e.g. voxels
• CPC Class Codes: G02B 30/56 by projecting aerial or floating images
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/304 For headphones

Abstract

The present invention discloses a multi-plane hands-on simulator system comprising at least two display surfaces, one of which displaying a three dimensional horizontal perspective images. Further, the display surfaces can have a curvilinear blending display section to merge the various images. The multi-plane hands-on simulator can comprise various camera eyepoints, one for the horizontal perspective images, and optionally one for the curvilinear blending display surface. The multi-plane display surface can further adjust the various images to accommodate the position of the viewer. The multi-plane hands-on simulator system can project horizontal perspective images into the open space and a peripheral device that allow the end user to manipulate the images with hands or hand-held tools.

Claims

1. A 3-D horizontal perspective simulator system comprising

a first horizontal perspective display using horizontal perspective to display a 3-D image onto an open space;

a second display showing information related to the 3-D image; and

a peripheral device to manipulate the display image by touching the 3-D image.

2. A simulator system as in claim 1 wherein the second display displays 2D images or central perspective images.

3. A simulator system as in claim 1 further comprising a third curvilinear display blending the first and the second displays.

4. A simulator system as in claim 1 further comprising a processing unit taking the input from the peripheral device and providing output to the first horizontal perspective display.

5. A simulator system as in claim 1 further comprising a processing unit taking the input from the second display and providing output to the first horizontal perspective display.

6. A simulator system as in claim 1 further comprising a means to track the physical peripheral device to the 3-D image.

7. A simulator system as in claim 1 further comprising a means to calibrate the physical peripheral device to the 3-D image.

8. A 3-D horizontal perspective simulator system comprising

a processing unit;

a first horizontal perspective display using horizontal perspective to display a 3-D image onto an open space;

a second display showing information related to the 3-D image;

a peripheral device to manipulate the display image by touching the 3-D image; and

a peripheral device tracking unit for mapping the peripheral device to the 3-D image.

9. A simulator system as in claim 8 further comprising a third curvilinear display blending the first and the second displays.

10. A simulator system as in claim 8 further comprising a processing unit taking the input from the second display and providing output to the first horizontal perspective display.

11. A simulator system as in claim 8 wherein the first horizontal perspective display further display a portion of the 3-D image onto an inner-access volume, whereby the image portion in the inner-access volume cannot be touched by the peripheral device.

12. A simulator system as in claim 8 wherein the first horizontal perspective display further comprises automatic or manual eyepoint tracking to synchronize the camera eyepoint of the horizontal perspective display with an user'"'"'s eyepoint.

13. A simulator system as in claim 8 wherein the first horizontal perspective display further comprises a means to zoom, rotation or movement of the 3-D image.

14. A simulator system as in claim 8 wherein the peripheral device is a tool, a handheld tool, a space glove or a pointing device.

15. A simulator system as in claim 8 wherein the peripheral device comprises a tip wherein the manipulation corresponds to the tip of the peripheral device.

16. A simulator system as in claim 8 wherein the manipulation comprises the action of modifying the display image or the action of generating a different image.

17. A simulator system as in claim 8 wherein the peripheral device mapping comprises inputting the position of the peripheral device to the processing unit.

18. A simulator system as in claim 8 wherein the peripheral device tracking unit comprises a triangulation or infrared tracking system.

19. A simulator system as in claim 8 further comprising a means to calibrate the coordinate of the display image to the peripheral device.

20. A multi-view 3-D horizontal perspective simulator system comprising

a processing unit;

a first stereoscopic horizontal perspective display using horizontal perspective to display a stereoscopic 3-D image onto an open space;

a second display showing information related to the 3-D image;

a peripheral device to manipulate the display image by touching the 3-D image; and

a peripheral device tracking unit for mapping the peripheral device to the 3-D image.