Three-dimensional image projection employing retro-reflective screens

• US 6,843,564 B2
• Filed: 01/06/2003
• Issued: 01/18/2005
• Est. Priority Date: 01/04/2002
• Status: Active Grant

• Current Assignee: James Virrilli
• Original Assignee: Neurok LLC
• Inventors: Lukyanitsa, Andrew A., Putilin, Andrey N.
• Primary Examiner(s): MAHONEY, CHRISTOPHER E
• Application Number:
  US10/336,842
• Publication Number:
  US 20030156260A1
• Time in Patent Office: 743 Days
• Field of Search: 353/7, 353/10, 349/15, 359/462, 348/42, 348/47, 348/51
• US Class Current: 353/7
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/32 using arrays of controllable light sources; using moving apertures or moving light sources
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/368 for two or more viewers
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/38 for tracking vertical translational head movements
• CPC Class Codes: H04N 13/393 the volume being generated by a moving, e.g. vibrating or rotating, surface
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

Disclosed herein are three-dimensional projection systems and related methods employing two electronically controlled projectors and a retro-reflective screen. The retro-reflective screen produces a known non-linear light reflection pattern when images are projected thereon. Image computational means are used to calculating flat image information for each projector based upon inputted stereopair images and information regarding the projectors and screen. In preferred embodiments of the present invention, the projection system uses an image computational device that employs a neural network feedback calculation to calculate the appropriate flat image information and appropriate images to be projected on the screen by the projectors at any given time. More than two projectors can be employed to produce multiple aspect views, to support multiple viewers, and the like. In another embodiment, the projection system includes a digital camera that provides feedback data to the image computational device.

Claims

1. A method for producing a perceived three dimensional image of an object, said method comprising:

obtaining a retro-reflective screen, said screen having a known non-linear light reflection pattern;

aligning at least two image projectors in a geometry so as to be able to project images onto said screen;

simultaneously calculating separate two-dimensional images, one each or projecting by a different one of said projectors, said calculated images being determined from stereopair image information regarding the object and from said pattern and said geometry;

each said calculated image simultaneously containing at least some image information intended for the left eye and at least some image information intended for the right eye; and

projecting said calculated images from said projectors onto said screen such that they reflect off said screen in a superimposed manner that produces a three-dimensional image of said object to a viewer at a known location.

2. The method according to claim 1, wherein said pattern comprises a Gaussian distribution.

3. The method according to claim 1, wherein said pattern has relatively wide-angle vertical scattering and relatively low-angle horizontal scattering.

4. The method according to claim 1, wherein said projectors include tramsmissive liquid crystal display panels for displaying said calculated images.

5. The method according to claim 1, wherein said calculate images are iteratively calculated to reduce error in said three-dimensional image of said object.

6. The method according to claim 5, wherein said iterative calculations of said calculated images is performed by a computational device employing a neural network.

7. The method according to claim 1, wherein said calculate images are obtained by the steps of:

estimating the light wave components being created by individual pixels of a display in each projector when displaying each said calculated image;

calculating a resulting three dimensional image of an object from the expected interaction of said estimated light wave components and said known pattern;

comparing the resulting three dimensional image with a desired three dimensional image to obtain a degree of error; and

adjusting said flat image until said error reaches a predetermined threshold.

8. The method according to claim 7, wherein said steps for calculating said amplitude information is performed using a neural network.

9. The method according to claim 1, further comprising sensing the location of said viewer.

10. The method according to claim 1, wherein said step of simultaneously calculating separate two-dimensional images for projecting by each projector comprising solving a system of non-linear equations.

11. The method according to claim 1 further comprising the steps of:

projecting a test image each from of the projectors;

capturing and comparing said projected test images; and

modifying the projection of the calculated images as needed match the projection from the projectors.

12. A system for producing a perceived three-dimensional image of an object, said system comprising:

a retro-reflective screen, said screen having a known non-linear light reflection pattern;

at least two projectors capable of projecting two dimensional images o to said screen, said projectors being aligned in a geometry relative to said screen, and said projectors each containing electronically switchable displays for producing two-dimensional images;

an imaging computational device containing a processor, said device being adapted to control pixels of said displays, and said device being adapted to generate a seperate flat image for each display, said flat images being calculated by said device using said pattern and said geometry and electronic stereopair images of the object;

each said flat image simultaneously containing at least some image information intended for the left eye and at least some image information intended for the right eye.

13. The system according to claim 12, wherein said display is a transmissive liquid crystal display panel.

14. The system according to claim 12, each projector comprising at least three transmissive displays and at least three light sources, each said transmissive display and each said light source being adapted to produce one of three color components of said flat images, said color components of said flat image being combinable to produce a full color three dimensional image of said object.

15. The system according to claim 12, wherein said flat images are iteratively calculated in said computational device to reduce error in said three dimensional image of said object.

16. The system according to claim 15, wherein said computational device employs a neural network to reduce error in said three dimensional image of said object.

17. The system according to claim 12, wherein said computational device calculates said flat images by operating according to the steps of:

estimating the light wave components being created by individual pix is of said display when displaying said flat image;

calculating a resulting three dimensional image of an object from the expected interaction of said estimated light wave components and said pattern of said screen;

comparing the resulting three dimensional image with a desired three dimensional image to obtain a degree of error; and

adjusting said flat image until said error reaches a predetermined threshold.

18. The system according to claim 17, wherein said steps for calculating said amplitude information is performed using a neural network.

19. The system according to claim 12, wherein said display control system further comprises means for sensing a spatial orientation of a viewer of said three dimensional image, and wherein said computational device is adapted to adjust said generated flat images such that said viewer can perceive said three dimensional image of the object.

20. The system according to claim 12, wherein said computational device simultaneously calculates said flat images for projecting by each projector by solving a system of non-linear equations.

21. The system according to claim 12, further comprising at east four projectors whereby said system can display two separate perceived three-dimensional views of said object to two different viewers.

22. The system according to claim 12, wherein said pattern comprises a Gaussian distribution.

23. The system according to claim 12, wherein said pattern comprises relatively wide-angle vertical scattering and relatively low-angle horizontal scattering.

24. The system according to claim 12 further comprising a camera electronically connected to said imaging computational device, wherein said imaging computational device receives an image captured by said camera and uses said captured image to modify the generation of said separate flat images.

25. A system for producing a perceived three-dimensional image of an object, said system comprising:

a retro-reflective screen, said screen having a known non-linear light reflection pattern and comprising a film having a first surface embossed with high spatial frequency micro-prisms and a second surface embossed with low spatial frequency micro-prisms;

at least two projectors capable of projecting two dimensional images onto said screen, said projectors being aligned in a geometry relative to said screen, and said projectors each containing electronically switchable displays for producing two-dimensional images;

an imaging computational device containing a processor, said device being adapted to control pixels of said displays, and said device being adapted to generate a seperate flat image for each display, said flat images being calculated by said device using said pattern and said geometry and electronic stereopair images of the object.

26. The system according to claim 25, wherein said flat images are iteratively calculated in said computational device to reduce error in said three dimensional image of said object.

27. The system according to claim 26, wherein said computational device employs a neural network to reduce error in said three dimensional image of said object.

28. The system according to claim 25, wherein said computational device calculates said flat images by operating according to the steps of:

estimating the light wave components being created by individual pixel of said display when displaying said flat image;

calculating a resulting three dimensional image of an object from the expected interaction of said estimated light wave components and said pattern of said screen;

comparing the resulting three dimensional image with a desired three dimensional image to obtain a degree of error; and

adjusting said flat image until said error reaches a predetermined threshold.

29. The system according to claim 28, wherein said steps for calculating said amplitude information is performed using a neural network.

30. The system according to claim 25, wherein said display control system further comprises means for sensing a spatial orientation of a viewer of said three dimensional image, and wherein said computational device is adapted to adjust said generate flat images such that said viewer can perceive said three dimensional image of the object.

31. The system according to claim 25, wherein said pattern comprises relatively wide-angle vertical scattering and relatively low-angle horizontal scattering.

32. A system for producing a percieved three-dimensional image of an object, said system comprising:

a retro-reflective screen, said screen having a known non-linear light reflection pattern and comprising a micro-prism retro-reflector film and a one-dimensional micro-prism array scattering film;

at least two projectors capable of projecting two dimensional images onto said screen, said projectors being aligned in a geometry relative to said screen, and said projectors each containing electronically switchable displays for producing two-dimensional ages;

an imaging computational device containing a processor, said device being adapted to control pixels of said displays, and said device being adapted to generate a seperate flat image for each display, said flat images being calculated by said device using said pattern and said geometry and electronic stereopair images of the object.

33. The system according to claim 32, wherein said flat images are iteratively calculated in said computational device to reduce error in said three dimensional image of said object.

34. The system according to claim 33, wherein said computational device employs a neural network to reduce error in said three dimensional image of said object.

35. The system according to claim 32, wherein said computational device calculates said flat images by operating according to the steps of:

estimating the light wave components being created by individual pixels of said display when displaying said flat image;

calculating a resulting three dimensional image of an object from the expected interaction of said estimated light wave components and said pattern of said screen;

comparing the resulting three dimensional image with a desired three dimensional image to obtain a degree of error; and

adjusting said flat image until said error reaches a predetermined threshold.

36. The system according to claim 35, wherein said steps for calculating said amplitude information is performed using a neural network.

37. The system according to claim 32, wherein said display control system further comprises means for sensing a spatial orientation of a viewer of said three dimensional image, and wherein said computational device is adapted to adjust said generated flat images such that said viewer can perceive said three dimensional image of the object.

38. The system according to claim 32, wherein said pattern comprises relatively wide-angle vertical scattering and relatively low-angle horizontal scattering.