Three dimensional display method, system and apparatus

• US 7,385,600 B2
• Filed: 07/15/2004
• Issued: 06/10/2008
• Est. Priority Date: 07/16/2003
• Status: Expired due to Fees

• Current Assignee: 1614367 Ontario Incorporated
• Original Assignee: 1614367 Ontario Incorporated
• Inventors: Marion, Dale Scott
• Primary Examiner(s): Nguyen; Phu K.
• Application Number:
  US10/564,764
• Publication Number:
  US 20060146047A1
• Time in Patent Office: 1,426 Days
• Field of Search: 345/419, 345/633, 353/10, 353/28, 359/478
• US Class Current: 345/419
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388

Abstract

A system, method and apparatus for providing a two dimensional image that will be perceived by the human visual perception system as a three dimensional image is disclosed. The system and apparatus preferably employ a transparent rear projection screen onto which an image of the at least one object to be displayed is projected. The at least one object moves at perceptual speed and preferably has highlights, comprising specular highlights, ambient lighting, shadows and reflections, consistent with its display location so that the human visual perception system perceives the displayed image as a three dimensional one. The method preferably comprises surveying the display site to identify important light sources and objects and to gather a reflection map which are both used to create the final displayed image.

Claims

1. A method of creating a final image which, when displayed at a target location, is perceived by viewers as being three dimensional, comprising the steps of:

(i) selecting a target location for the display at a display site and surveying the display site to identify and characterize light sources and objects which would result in visual highlights on a object displayed at the target location, the identified and characterized lights and objects employed in a computer animation system to light a model of the at least one object to be displayed;

(ii) capturing video of at least one object to be displayed in the final image under a recreation of the characterized light sources and objects surveyed at the target location, the at least one object moving in the video at a necessary perceptual speed by one of translating generally along a plane extending through the eyes of expected viewers, rotating generally about an axis perpendicular to said plane, or a combination thereof and obtaining the captured video by rendering a video image of the at least one object in said computer animation system;

(iii) displaying the final image at the site onto a transparent screen positioned such that the final image appears at the target location in front of a background and such that the movement of the at least one object at the perceptual speed occurs.

2. The method of claim 1 wherein for rotation of the at least one object, the perceptual speed is in the range of from about 0.8% to about 10% of the size of the at least one object.

3. The method of claim 2 wherein for rotation of the at least one object, the perceptual speed is in the range of from about 1% to about 8% of the size of the at least one object.

4. The method of claim 3 wherein for rotation of the at least one object, the perceptual speed is in the range of from about 3% to about 5% of the size of the at least one object.

5. The method of claim 1 wherein for translation of the at least one object, the perceptual speed is in the range of from about 3% to about 12% of the size of the at least one object.

6. The method of claim 5 wherein for translation of the at least one object, the perceptual speed is in the range of from about 4% to about 6% of the size of the at least one object.

7. The method of claim 1 further comprising the step of capturing a wide angle photograph of the display site about the target location and applying the captured wide angle photograph as a reflection map to the captured video of the at least one object to create the final image.

8. The method of claim 7 wherein a panoramic photograph is captured.

9. The method of claim 7 wherein the wide angle photograph is obtained iteratively to update reflections on the final image as the surrounding environment changes about the target location.

10. The method of claim 1 wherein a mocking stage is constructed to recreate the light sources and objects identified and characterized, the object is placed on said mocking stage in front of a chromakey backdrop and the video of the object is captured and the background removed by a chromakey process to obtain the captured video.

11. The method of claim 1, further comprising the step of capturing a wide angle photograph of the display site about the target location and applying the captured wide angle photograph as a reflection map during the rendering process.

12. The method of claim 1 wherein the necessary perceptual speed of the at least one object is such that movement of a point on the object along the plane of the expected viewers eyes occurs at a rate of about at least three percent of the size of the object, measured through that plane, per second relative to the background.

13. The method of claim 12 wherein the necessary perceptual speed of the at least one object is about at least five percent of the size of the object, measured through that plane, per second relative to the background.

14. The method of claim 1 wherein the necessary perceptual speed of the at least one object is rotational movement of the object about an axis not exceeding 40 degrees from an axis orthogonal to the plane of the expected viewers eyes.

15. The method of claim 1 wherein the necessary perceptual speed of the at least one object is translation movement across the display along the plane of the expected viewers eyes.

16. The method of claim 1 wherein the necessary perceptual speed of the at least one object is a combination of translational movement and rotational movement.

17. The method of claim 1 wherein the background is a moving background image behind the screen and the necessary perceptual speed is the relative speed difference between the movement of the at least one object and the speed of the moving background image.

18. A system for displaying on a two dimensional display at a target location a final image of at least one object, the final image being perceived by viewers as a three dimensional image, comprising:

survey data to identify and characterize light sources and objects which would result in visual highlights on a object displayed at the target location;

a computer animation system to light a model of the at least one object to be displayed employing the identified and characterized lights and objects;

a transparent screen onto which the final image is displayed allowing a background behind said screen to also be viewed where not obscured by said final image;

a projector to display the final image onto the screen; and

a video source providing a final image to the projector, the video source of the at least one object to be displayed captured under a recreation of the characterized light sources and objects surveyed at the target location, and the captured video is obtained by rendering a video image of the at least one object in said computer animation system and the final image having at least one object moving at perceptual speed upon said screen.

19. The system of claim 18 wherein the final image includes visual highlights on said at least one image corresponding to the surrounding environment at the target location.

20. The system of claim 19 further comprising a wide angle camera to intermittently capture a wide angle image of the surrounding environment from the target location and the video source employing the captured image as a reflection map to modify the visual highlights of the displayed final image.

21. The system of claim 18 further comprising at least four projectors and wherein the screen rotates such that a different one of each projectors displays a different final image on the screen at different times.

22. A method of having the human visual perception system perceive an observed image of at least one object on a two dimensional display at a target location as a three dimensional image, comprising the steps of:

(i) moving the at least one object in the image such that a point on the at least one object along a plane of the expected viewers eyes occurs at a perceptual speed;

(ii) applying visual highlights to the at least one object in the image by employing a computer animation system using a recreation of characterized light sources and objects surveyed at the target location, the visual highlights including specular highlight and shadows appropriate for the object at the target location and obtained by surveying a display site to identify and characterize light sources and objects which would result in visual highlights on a object displayed at the target location; and

(iii) obtaining a wide angle image of the surroundings of the target location and applying this wide angle image as a reflection map to the final image of the at least one object and rendering a video image of the at least one object in said computer animation system.