Multi-plane horizontal perspective hands-on simulator

• US 20050264559A1
• Filed: 05/31/2005
• Published: 12/01/2005
• Est. Priority Date: 06/01/2004
• Status: Abandoned Application

• Current Assignee: Infinite Io, Inc.
• Original Assignee: Infinite Io, Inc.
• Inventors: Vesely, Michael A., Clemens, Nancy L.
• Application Number:
  US11/141,652
• Publication Number:
  US 20050264559A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G02B 30/40 giving the observer of a single two-dimensional [2D] image a perception of depth
• CPC Class Codes: G02B 30/50 the image being built up from image elements distributed over a 3D volume, e.g. voxels
• CPC Class Codes: G02B 30/56 by projecting aerial or floating images
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/304 For headphones

Abstract

The present invention discloses a multi-plane hands-on simulator system comprising at least two display surfaces, one of which displaying a three dimensional horizontal perspective images. Further, the display surfaces can have a curvilinear blending display section to merge the various images. The multi-plane hands-on simulator can comprise various camera eyepoints, one for the horizontal perspective images, and optionally one for the curvilinear blending display surface. The multi-plane display surface can further adjust the various images to accommodate the position of the viewer. The multi-plane hands-on simulator system can project horizontal perspective images into the open space and a peripheral device that allow the end user to manipulate the images with hands or hand-held tools.

Claims

1. A method for 3-D horizontal perspective simulation by horizontal perspective projection, the horizontal perspective projection comprising displaying horizontal perspective images according to a predetermined projection eyepoint, the method comprising the steps of:

displaying a 3-D image onto an open space of a first display surface using horizontal perspective;

display a second image onto a second display; and

manipulating the display image on the first display surface by touching the 3-D image with a peripheral device.

2. A method as in claim 1 further comprising the step of taking an input from the second display and providing output to the first horizontal perspective display.

3. A method as in claim 1 further comprising a step of tracking the physical peripheral device to the 3-D image.

4. A method as in claim 3 wherein tracking the peripheral device comprises tracking a tip of the peripheral device.

5. A method as in claim 3 wherein the peripheral device tracking comprises inputting the position of the peripheral device to the processing unit.

6. A method as in claim 3 wherein the peripheral device tracking comprises a step of triangulation or infrared tracking.

7. A method as in claim 1 further comprising a step of calibrating the physical peripheral device to the 3-D image.

8. A method as in claim 7 wherein the calibration step comprises a manual inputting a reference coordinate.

9. A method as in claim 7 wherein the calibration step comprises an automatic inputting a reference coordinate through a calibration procedure.

10. A method as in claim 1 further comprising a step of display a third image onto a third curvilinear display, the curvilinear display blending the first display and the second display.

11. A method as in as in claim 1 wherein the horizontal perspective display is a stereoscopic horizontal perspective display using horizontal perspective to display a stereoscopic 3-D image.

12. A method as in as in claim 1 wherein the horizontal perspective display further display a portion of the 3-D image onto an inner-access volume, whereby the image portion in the inner-access volume cannot be touched by the peripheral device.

13. A method as in as in claim 1 further comprising a step of automatic or manual eyepoint tracking for the horizontal perspective display.

14. A method as in as in claim 1 further comprising a step of zooming, rotating or moving the 3-D image.

15. A method as in as in claim 1 wherein manipulating the display image by the peripheral device comprises tracking a tip of the peripheral device.

16. A method as in as in claim 15 wherein the manipulation comprises the action of modifying the display image or the action of generating a different image.

17. A 3-D simulation method using a 3-D horizontal perspective simulator system, the 3-D horizontal perspective simulator system comprising

a processing unit;

a first horizontal perspective display using horizontal perspective to display a 3-D image onto an open space;

a second display showing information related to the 3-D image;

a peripheral device to manipulate the display image by touching the 3-D image; and

a peripheral device tracking unit for mapping the peripheral device to the 3-D image;

the method comprising

calibrating the peripheral device;

displaying a first 3-D image onto an open space of the first display surface using horizontal perspective;

displaying a second image onto the second display;

tracking the peripheral device; and

manipulating the display image by touching the 3-D image with the peripheral device.

18. A method as in claim 17 further comprising a step of display a third image onto a third curvilinear display, the curvilinear display blending the first display and the second display.

19. A 3-D simulation method using a multi-view 3-D horizontal perspective simulator system, the multi-view 3-D horizontal perspective simulator system comprising

a processing unit;

a first stereoscopic horizontal perspective display using horizontal perspective to display a stereoscopic 3-D image onto an open space; and

a second display showing information related to the 3-D image;

a peripheral device to manipulate the display image by touching the 3-D image; and

a peripheral device tracking unit for mapping the peripheral device to the 3-D image;

the method comprising

displaying a first stereoscopic 3-D image onto an open space of the first display surface using horizontal perspective;

displaying a second image onto the second display;

tracking the peripheral device; and

manipulating the display image by touching the 3-D image with a peripheral device.

20. A method as in claim 19 further comprising a step of display a third image onto a third curvilinear display, the curvilinear display blending the first display and the second display.