Binaural horizontal perspective display

• US 20050281411A1
• Filed: 05/31/2005
• Published: 12/22/2005
• Est. Priority Date: 06/01/2004
• Status: Abandoned Application

• Current Assignee: Infinite Io, Inc.
• Original Assignee: Infinite Io, Inc.
• Inventors: Vesely, Michael A., Clemens, Nancy L.
• Application Number:
  US11/141,640
• Publication Number:
  US 20050281411A1
• Time in Patent Office: Days
• US Class Current: 381/61
• CPC Class Codes: G02B 30/40 giving the observer of a single two-dimensional [2D] image a perception of depth
• CPC Class Codes: G02B 30/50 the image being built up from image elements distributed over a 3D volume, e.g. voxels
• CPC Class Codes: G02B 30/56 by projecting aerial or floating images
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/356 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04R 2499/15 Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/304 For headphones

Abstract

The present invention display system discloses a three dimension display system comprising a three dimensional horizontal perspective display and a 3-D audio system such as binaural simulation to lend realism to the three dimensional display. The three dimensional display system can futher comprise a second display, together with a curvilinear blending display section to merge the various images. The multi-plane display surface can accommodate the viewer by adjusting the various images and 3-D sound according to the viewer'"'"'s eyepoint and earpoint locations.

Claims

1. A horizontal perspective display system comprising

a first real time display to display horizontal perspective images according to a predetermined projection eyepoint;

and

a 3-D audio simulation system providing 3-D sound to a predetermined projection earpoint, the 3-D sound corresponded to the horizontal perspective images.

2. A horizontal perspective display system comprising

a first real time display to display horizontal perspective images according to a predetermined projection eyepoint;

an eyepoint input device for accepting an input eyepoint location wherein the displayed images can be adjusted using the input eyepoint as the projection eyepoint; and

a 3-D audio simulation system providing 3-D sound to a predetermined projection earpoint, the 3-D sound corresponded to the horizontal perspective images.

3. A display system as in claim 2 wherein the eyepoint input device further functions as an earpoint input device for accepting an input earpoint location wherein the 3-D sound can be adjusted using the input earpoint as the projection earpoint

4. A display system as in claim 2 wherein the 3-D audio simulation system comprises two sound channels and a HRTF (head related transfer function) filter.

5. A display system as in claim 2 wherein the 3-D audio simulation system comprises a 3-D loudspeaker audio system or a 3-D headphone audio system.

6. A display system as in claim 2 further comprising a computer system for receiving the input eyepoint location from the eyepoint input device, calculating the horizontal perspective projection images according to the input eyepoint location, and outputting the images to the display wherein the displayed images is real time adjusted using the input eyepoint as the projection eyepoint.

7. A display system as in claim 3 further comprising a computer system for receiving the input eyepoint location from the eyepoint input device,

calculating the horizontal perspective projection images according to the input eyepoint location, and outputting the images to the display wherein the displayed images is real time adjusted using the input eyepoint as the projection eyepoint;

and

calculating the 3-D sound according to the input eyepoint location, and outputting the 3-D sound wherein the 3-D sound is real time adjusted using the input eyepoint as the projection earpoint.

8. A display system as in claim 2 wherein the eyepoint input device is a manual input device whereby the eyepoint input location is manually entered.

9. A display system as in claim 3 wherein the eyepoint input device is a manual input device whereby the eyepoint and earpoint input locations are manually entered.

10. A display system as in claim 8 or 9 wherein the manual input device is a computer peripheral or a wireless computer peripheral.

11. A display system as in claim 8 or 9 wherein the manual input device is selected from a group consisted of a keyboard, a stylus, a keypad, a computer mouse, a computer trackball, a tablet, a pointing device.

12. A display system as in claim 2 wherein the eyepoint input device is an automatic input device whereby the automatic input device automatically extracts the eyepoint location from the viewer.

13. A display system as in claim 3 wherein the eyepoint input device is an automatic input device whereby the automatic input device automatically extracts the eyepoint and earpoint locations from the viewer.

14. A display system as in claim 12 or 13 wherein the automatic input device is selected from a group consisted of radio-frequency tracking device, infrared tracking device, camera tracking device.

15. A display system as in claim 2 further comprising

an image input device for accepting an image command;

wherein the computer system further accepts an image command from the image input device, calculating a horizontal perspective projection image according to the image command using the input eyepoint location as the projection eyepoint before outputting the image to the display.

16. A display system as in claim 15 wherein the image command includes image magnification, image movement, image rotation command and command to display another predetermined image.

17. A display system as in claim 2 further comprising

a second display positioned at an angle to the first display.

18. A display system as in claim 17 further comprising a third curvilinear display blending the first and the second displays.

19. A horizontal perspective display system comprising

a first real time display to display horizontal perspective images according to a predetermined projection eyepoint;

a 3-D audio simulation system providing 3-D sound to a predetermined projection earpoint, the 3-D sound corresponded to the horizontal perspective images; and

an earpoint input device for accepting an input earpoint location wherein the 3-D sound can be adjusted using the input earpoint as the projection earpoint.

20. A display system as in claim 19 wherein the earpoint input device further functions as an eyepoint input device for accepting an input eyepoint location wherein the display images can be adjusted using the input eyepoint as the projection eyepoint.