Method And Apparatus For Displaying 3D Images

• US 20120127320A1
• Filed: 04/08/2010
• Published: 05/24/2012
• Est. Priority Date: 07/31/2009
• Status: Active Grant

• Current Assignee: Tibor Balogh
• Original Assignee: Tibor Balogh
• Inventors: Balogh, Tibor
• Granted Patent: US 9,383,587 B2
• Time in Patent Office: Days
• US Class Current: 348/180
• CPC Class Codes: G02B 30/27 involving lenticular arrays
• CPC Class Codes: G02B 5/0257 creating an anisotropic diffusion characteristic, i.e. distributing output differently in two perpendicular axes
• CPC Class Codes: G02B 5/0278 used in transmission
• CPC Class Codes: G02B 5/0284 used in reflection
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388

Abstract

A method and an apparatus for displaying 3D images are disclosed. 2D images are projected from multiple points to a surface with narrow diffusion characteristics, thus it is possible to get a 3D light field with arbitrary angular dependence. According to the invention, the projectors (10) do not target particular screen (12) points. The projectors (10) are directed to the screen (12) with no special positioning, however from the bunch of light beams present, pertaining to the large number of pixels in the projected images, it is possible to select and define a pixel-wise precise 3D light-field through a calibration process. A novel calibration method and device are also described for calibrating 3D display systems, the device being equipped with proper image sensor(s) and a control system.

Claims

1. A method for displaying 3D images comprising the steps of

projecting 2D images by means of multiple projectors (10) onto a diffuser screen (12), the 2D images generating together a 3D light-field (13), wherein 2D views of the 3D light-field (13) are composed of sections of multiple projector (10) images,

wherein the diffuser screen (12) comprises a uniform optical structure, and has a diffusion angle (σ

) being equal to or larger than the largest angle (σ

) between optical centers (11) of neighboring projectors (10) as seen from any screen point, the diffuser screen (12) thereby performing a limited diffusion—

without changing the main direction of light beams projected onto the screen (12)—

to eliminate inhomogeneities resulting from gaps between neighboring projectors (10) and to enable smooth transitions between the 3D images in the 3D light-field (13) when a viewer'"'"'s position in the 3D light-field (13) changes.

2. The method according to claim 1, characterized by applying multiple projectors (10) which are arranged horizontally, and applying a diffuser screen (12) with an asymmetric diffusion character, wherein the diffusion angle (σ

) is the horizontal diffusion angle of the diffuser screen, and the vertical diffusion angle (σ

_v) of the screen (12) is larger than its horizontal diffusion angle.

3. An apparatus for displaying 3D images, the apparatus comprising a diffuser screen (12) and multiple projectors (10) projecting 2D images onto the diffuser screen (12), the 2D images generating together a 3D light-field (13), wherein

the 3D images correspond to respective viewer'"'"'s positions in the 3D light-field (13),

views of the 3D light-field (13) are contributed by multiple projectors (10), and the viewers see sections of multiple projector (10) images within the 3D image on the different screen (12) areas, and

the diffuser screen (12) comprises a uniform optical structure and has a diffusion angle (σ

) being equal to or larger than the largest angle (α

) between optical centers (11) of neighboring projectors (10) as seen from any screen point, the diffuser screen (12) thereby performing a limited diffusion to eliminate inhomogeneities resulting from gaps between neighboring projectors (10) and enabling smooth transitions between the 3D images in the 3D light-field (13) when a viewer'"'"'s position in the 3D light-field (13) changes.

4. The apparatus according to claim 3, characterized in that the multiple projectors (10) are arranged horizontally, and the diffuser screen (12) has an asymmetric diffusion character, wherein the diffusion angle (σ

) is the horizontal diffusion angle of the diffuser screen, and the vertical diffusion angle (σ

_v) of the screen (12) is larger than its horizontal diffusion angle.

5. The apparatus according to claim 3, characterized in that the projectors (10) are video projectors, data projectors, video projector optical engines, RPTV optical engines, LED projectors, laser projectors, micro-, nano-, or pico-projectors, projectors based on scanner components, or projectors based on microdisplays like DMD, LCOS, OLED or LCD.

6. The apparatus according to claim 3, characterized in that the projectors (10) are based on diffractive imaging, containing micro displays enabling lens-less holographic projection to the screen.

7. The apparatus according to claim 3, characterized in that the diffuser screen (12) is a holographic screen, a microlens screen, a volumetric diffusion screen, a lenticular screen, a retroreflective screen, a refractive or diffractive diffuser sheet, Fresnel lens or any combination thereof, or a surface created by a laminar flow of a substance.

8. The apparatus claim 3, characterized in that the screen (12) comprises more than one diffusive layers aligned slightly rotated relative to each other.

9. The apparatus according to claim 3, characterized in that the screen (12) has a controllable diffusion by comprising an active diffuse layer, like a switchable LC film

10. The apparatus according to claim 3, characterized in that the screen (12) is transparent with partly diffusing character transmitting a part of the incident light without diffusion.

11. The apparatus according to claim 3, characterized in that the screen (12) further comprises

layers directing the projected light beams optimally towards the viewers typical height, like direction turning films, cylindrical Fresnel lenses, or

layers blocking light incident from other directions than from the projectors (10), typically lenticular arrays with black matrix.

12. The apparatus according to claim 3, characterized by being a portable 3D device—

preferably a 3D mobile phone, a 3D DVD player, a 3D game set, a 3D GPS set or the like—

comprising multiple projection modules, preferably compact size pico projectors (10), wherein the diffuser screen (12) is moveable into an optimum projection position for displaying 3D images, a control system and batteries allowing autonomous operation.

13. The apparatus according to claim 3, characterized by being a 3D cinema apparatus, wherein the projectors (10) and the diffuser screen (12) are arranged in a front projection configuration, wherein the diffuser screen (12) is of a 1D retroreflective or mirror-like reflective surface and the projectors are preferably arranged in an off-axis position above the viewers area.

14. The apparatus according to claim 13, characterized in that the 3D light-field (13) projected by the projectors (10) is split into multiple narrower angle zones, projecting 3D content periodically repeated for fixed view positions.

15. The apparatus according to claim 3, characterized by comprising a control system autonomously calculating intermediate images from the images inputted to the apparatus, where the number of input images is less than the number of projectors (10), or the input 3D information does not contain all the information necessary to drive all the projectors (10).

16. The apparatus according to claim 15, characterized in that the control system comprises an input device, such as a camera, IR sensor or other tracking device for assisting in optimization for the viewers position, to create highly realistic 3D images rendering environmental illumination on the 3D objects, performing texture mapping, shading or enabling interactions with the displayed 3D objects.

17. A method for calibrating an apparatus according to claim 3, comprising the steps of

detecting the images projected by the multiple projectors (10) with at least one image detector (20), evaluating the detected images and generating calibration data for the projectors based on the evaluation, and modifying the input data of the projectors on the basis of the respective calibration data.

18. The method according to claim 17, characterized in that the detecting, evaluating, calibration data generating and input data modifying steps are performed periodically.

19. The method according to claim 17, characterized by successively projecting a 2D test image pattern with each of the projectors (10) onto a wide angle diffuser screen (12w) replacing or covering the screen (12), the test image pattern extending on the entire display area of the wide angle diffuser screen (12w), wherein all of the projected test image patterns are detected during the detecting step by means of a single image detector (20) arranged on the same side of the diffuser screen (12) as the projectors (10).

20. The method according to claim 19, characterized in that

in the evaluation step at least one of the following is evaluated:

the test image patterns are appearing coincidentally on the diffuser screen (12), the test image patterns have that same brightness/contrast, the test image patterns have that same color, and

in the calibration data generating step the calibration data is generated for compensating optical imperfections, distortions, geometrical or color misalignments, and/or brightness/contrast differences between the projectors (10).

21. The method according to claim 17, characterized in that the detecting, evaluating, calibration data generating and input data modifying steps are performed continuously or quasi-continuously during the normal operation of the apparatus.

22. The method according to claim 17, characterized in that the projected images are detected by means of multiple image detectors arranged on the same side of the diffuser screen (12) as the projectors (10) for front-projection arrangements, or on the side of the diffuser screen (12) opposite than the projectors (10) for rear-projection arrangements.

23. A calibration device for calibrating an apparatus according to claim 3, comprising

at least one image detector (20) for detecting images projected by the projectors (10) onto the diffuser screen (12),

evaluating means for evaluating the detected images,

calibration data generating means for generating calibration data for the projectors (10) based on the evaluation, and

modifying means for modifying the input data of the projectors (10) on the basis of the respective calibration data.

24. The calibration device according to claim 23, characterized by comprising a single image detector (20) arranged on the same side of the diffuser screen (12) as the projectors (10), the image detector (20) being capable of detecting 2D test image patterns successively projected with each of the projectors (10) onto the diffuser screen (12).

25. The calibration device according to claim 23, characterized by comprising multiple image detectors arranged on the same side of the diffuser screen (12) as the projectors (10) for front-projection arrangements, or on the opposite side of the diffuser screen (12) than the projectors (10) for rear-projection arrangements, the image detectors being capable of detecting the images simultaneously projected by the projectors (10) onto the diffuser screen (12).

26. The calibration device according to claim 23, characterized in that the evaluating means is capable for establishing a difference between the detected image and a theoretical error-free image.

27. The calibration device according to claim 23, characterized in that the evaluating means, the calibration data generating means and the modifying means are implemented as computer program modules running in a control system of the apparatus.