Binaural horizontal perspective display

• US 20050264857A1
• Filed: 05/31/2005
• Published: 12/01/2005
• Est. Priority Date: 06/01/2004
• Status: Abandoned Application

• Current Assignee: Infinite Io, Inc.
• Original Assignee: Infinite Io, Inc.
• Inventors: Vesely, Michael A., Clemens, Nancy L.
• Application Number:
  US11/141,606
• Publication Number:
  US 20050264857A1
• Time in Patent Office: Days
• US Class Current: 359/13
• CPC Class Codes: G02B 30/40 giving the observer of a single two-dimensional [2D] image a perception of depth
• CPC Class Codes: G02B 30/50 the image being built up from image elements distributed over a 3D volume, e.g. voxels
• CPC Class Codes: G02B 30/56 by projecting aerial or floating images
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/304 For headphones

Abstract

The present invention display system discloses a three dimension display system comprising a three dimensional horizontal perspective display and a 3-D audio system such as binaural simulation to lend realism to the three dimensional display. The three dimensional display system can futher comprise a second display, together with a curvilinear blending display section to merge the various images. The multi-plane display surface can accommodate the viewer by adjusting the various images and 3-D sound according to the viewer'"'"'s eyepoint and earpoint locations.

Claims

1. A method of three dimensional image display by horizontal perspective projection and 3-D audio system projection, the horizontal perspective projection comprising a display of horizontal perspective images according to a predetermined projection eyepoint, and the 3-D audio system projection comprising providing 3-D sound according to a predertermined projection earpoint, the method comprising the steps of:

detecting an eyepoint location of a viewer;

displaying a horizontal perspective image using the detected eyepoint location as the projection eyepoint; and

projecting a 3-D sound to the viewer using the eyepoint location as the projection earpoint.

2. A method as in claim 2 wherein the 3-D sound comprises two sound channels and a HRTF (head related transfer function) filter.

3. A method as in claim 2 wherein the 3-D sound comprises a 3-D loudspeaker audio system or a 3-D headphone audio system.

4. A method of three dimensional image display by horizontal perspective projection and 3-D audio system projection, the horizontal perspective projection comprising a display of horizontal perspective images according to a predetermined projection eyepoint, and the 3-D audio system projection comprising providing 3-D sound according to a predertermined projection earpoint, the method comprising the steps of:

continuously scanning to detect an eyepoint location of a viewer;

calculating a new horizontal perspective image using the detected eyepoint location as the projection eyepoint;

displaying the new image;

calculating a new 3-D sound using the detected eyepoint location as the projection earpoint; and

displaying the new 3-D sound.

5. A method as in claim 4 wherein the 3-D sound comprises two sound channels and a HRTF (head related transfer function) filter.

6. A method as in claim 4 wherein the 3-D sound comprises a 3-D loudspeaker audio system or a 3-D headphone audio system.

7. A method as in claim 4 wherein the horizontal perspective image is stereoscopic images.

8. A method as in claim 4 wherein the horizontal perspective image is calculated from a flat two dimensional picture.

9. A method as in claim 4 wherein the horizontal perspective image is calculated from a three dimensional model.

10. A method as in claim 4 wherein detecting a viewer eyepoint location is by manually inputting the location through a manual input device.

11. A method as in claim 10 wherein the manual input device is a computer peripheral or a wireless computer peripheral.

12. A method as in claim 10 wherein the manual input device is selected from a group consisted of a keyboard, a stylus, a keypad, a computer mouse, a computer trackball, a tablet, a pointing device.

13. A method as in claim 4 wherein the detection of a viewer eyepoint location is through an automatic input device whereby the automatic input device automatically extracts the eyepoint location from the viewer.

14. A method as in claim 13 wherein the automatic input device is selected from a group consisted of radio-frequency tracking device, infrared tracking device, camera tracking device.

15. A method as in claim 4 further comprising the step of manipulating the image.

16. A method as in claim 4 wherein the manipulation of the image comprises the modification of the displayed image or the generation of a new image.

17. A method as in claim 4 wherein the modification of the displayed image comprises the movement, zooming or rotation of the image.

18. A method of image display by horizontal perspective projection and 3-D audio system projection, the horizontal perspective projection comprising a display of horizontal perspective images according to a predetermined projection eyepoint, and the 3-D audio system projection comprising providing 3-D sound according to a predertermined projection earpoint, the method comprising the steps of:

displaying a first image onto a first display;

continuously scanning to detect an eyepoint location of a viewer;

calculating a second horizontal perspective image using the detected eyepoint location as the projection eyepoint;

displaying the second image onto a second horizontal perspective display; and

projecting a 3-D sound to the viewer using the eyepoint location as the projection earpoint.

19. A method as in claim 18 further comprising a step of display a third image onto a third curvilinear display, the curvilinear display blending the first display and the second display.

20. A method as in claim 18 further comprising a step of calculating the third image using the eyepoint location as the projection eyepoint before displaying.