Method and Apparatus for Reconstructing a Three-Dimensional Scene in a Holographic Display

• US 20100149611A1
• Filed: 05/09/2008
• Published: 06/17/2010
• Est. Priority Date: 05/16/2007
• Status: Abandoned Application

• Current Assignee: SeeReal Technologies S.A.
• Original Assignee: SeeReal Technologies S.A.
• Inventors: Leister, Norbert
• Application Number:
  US12/600,372
• Publication Number:
  US 20100149611A1
• Time in Patent Office: Days
• US Class Current: 359/32
• CPC Class Codes: G03H 1/0808 Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 1/32 Systems for obtaining speckle elimination
• CPC Class Codes: G03H 2001/2297 using frame sequential, e.g. for reducing speckle noise
• CPC Class Codes: G03H 2210/452 into points
• CPC Class Codes: G03H 2222/34 Multiple light sources
• CPC Class Codes: G03H 2225/31 Amplitude only
• CPC Class Codes: G03H 2225/32 Phase only
• CPC Class Codes: G03H 2225/33 Complex modulation
• CPC Class Codes: G03H 2226/05 Means for tracking the observer
• CPC Class Codes: G03H 2240/41 Binary
• CPC Class Codes: G03H 2240/42 Discrete level

Abstract

A method is disclosed for reconstructing a three-dimensional scene in a holographic display. A 3D scene that is to be reconstructed is decomposed into object points, and one respective object point is encoded as a sub-hologram in the light modulator. Processor means and reconstruction means are provided for calculating and encoding as well as for reconstructing the 3D scene in order to overcome known drawbacks encountered when encoding a hologram and holographically reconstructing the 3D scene in holographic display devices. Processor elements are provided for generating a movable two-dimensional grid in the light modulating means, forming groups of object points from grid-related object points, and sequentially encoding the holograms of said groups of object points, by means of which intrinsically coherent partial constructions of the groups of object points are generated in a rapid sequence, said partial constructions being incoherent relative to one another.

Claims

1. Method for reconstructing a three-dimensional scene in a holographic display,

where the three-dimensional scene (3D scene) is divided into individual object points, where each object point is encoded as a sub-hologram on a spatial light modulator means, which is illuminated with sufficiently coherent light by light sources of an illumination system,

where the 3D scene is reconstructed within a reconstruction space, which stretches between a visibility region and a screen, from reconstructed wave fronts of the object points, where the reconstruction is visible for at least one observer eye in a position which is situated in the visibility region,

and where a processor comprises processor elements for computing and encoding the 3D scene, wherein

A first processor element

Generates on the light modulator means a displaceable, two-dimensional grid with regularly arranged grid cells for encoding the sub-holograms,

Selects object points depending on the set positions of the grid cells and aggregates them to form object point groups, and

Simultaneously computes the sub-holograms of the object points of a generated object point group and simultaneously encodes them as a common hologram of the object point group in a separate grid cell on the light modulator means, where the common holograms of all object point groups are encoded sequentially, and

A second processor element controls the illumination system in synchronism with the displacement of the grid on the light modulator means such that intrinsically coherent but mutually incoherent partial reconstructions of the object point groups are generated from the multitude of sequentially encoded holograms at a fast pace and superposed sequentially in the visibility region.

2. Method according to claim 1, wherein the first processor element defines in the reconstruction space a depth range, which is confined by two planes, which comprises all object points which contribute to the reconstruction of the 3D scene, and which defines the surface area of their sub-holograms on the light modulator means.

3. Method according to claim 2, wherein the maximum surface area of a single sub-hologram is defined by the axial distance of one of the two planes of the given depth range from the plane of the visibility region or where the depth range is limited to a maximal axial distance in front of and, optionally, behind the light modulator means.

6. Method according to claim 2, wherein the first processor element forms an object point group by selecting object points from the defined depth range depending on their spatial position to a grid cell of the generated grid, and by combining them in an object point group.

7. Method according to claim 6, wherein only those object points which lie in a certain position of the generated grid, centrally in relation to a grid cell, form an object point group.

8. Method according to claim 6, wherein the first processor element is controlled by software means to displace the grid by at least one pixel in a pixelated light modulator means in order to compute and encode the common hologram of a further object point group.

9. Method according to claim 8, wherein the first processor element displaces the grid horizontally in order to encode a one-dimensional hologram, and both horizontally and vertically in order to encode a two-dimensional hologram.

10. Method according to claim 9, wherein the sub-holograms of an object point group are simultaneously encoded in the horizontal and vertical direction on the light modulator means in the case of two-dimensional encoding and where the grid is displaced in the horizontal and/or vertical direction by maximal one grid cell each, where all different positions of object points in the depth range are covered.

12. Method according to claim 1, wherein the size of a sub-hologram (S) is computed according to the equation

npx,y=|z/(D−

z)|*Dλ

/px,y2 

 

(1),

where z is the axial distance between an object point and the light modulator means or a screen, D is the distance of the visibility region from the light modulator means or a screen, λ

is the wavelength of the light of a light source used in the illumination system, and p_x,y is the width (p_x) or height (p_y) of a macro pixel.

13. Method according to claim 1, wherein a position finder detects the current eye position of an observer eye and a position controller controls the direction of propagation of the modulated wave fronts of the sub-holograms such that they are directed at the current eye position.

14. Method according to claim 1, wherein a sub-hologram is encoded in one dimension or in two dimensions in adjacent pixels of a grid cell of the light modulator means.

15. Method according to claim 12, wherein the light modulator means, on which the sub-hologram is encoded, serves as a screen, where the light modulator means is preferably a transmissive light modulator or where the screen is an optical element onto which a hologram encoded on the light modulator means, or a wave front of the 3D scene encoded on the light modulator means, is projected.

17. Method according to claim 15, wherein the light modulator means is optionally a transmissive or a reflective light modulator.

18. Method according to claim 1, wherein a temporally averaged visible luminous intensity of object points is controlled by reconstructing the object points for variable periods of time.

19. Method according to claim 18, wherein additionally the luminous intensity of at least one light source of the illumination system, which illuminates the entire light modulator means or only individual grid cells thereof, is temporally varied.

20. Device for reconstructing a three-dimensional scene

with an illumination system comprising at least one light source which emits sufficiently coherent light, for illuminating at least one spatial light modulator means,

with reconstruction means for reconstructing the three-dimensional scene (3D scene) which is divided into individual object points, within a reconstruction space which is stretched between the light modulator means and a visibility region, where the reconstruction is visible from an eye position in the visibility region, and

with a processor with processor elements for computing and encoding sub-holograms of the object points of the 3D scene,

for implementing the method according to claim 1, wherein

A first processor element is provided for generating a displaceable, two-dimensional grid with regularly arranged grid cells on the light modulator means, for defining a depth range in the reconstruction space, for generating object point groups from the object points of the 3D scene, for computing a multitude of sub-holograms of the object points of a generated object point group, and for simultaneously encoding the sub-holograms as a common hologram of the respective object point group in a separate grid cell each, where the common holograms of all object point groups are encoded sequentially, and

A second processor element is provided for controlling the illumination system in synchronism with the displacement of the grid on the light modulator means such that intrinsically coherent but mutually incoherent partial reconstructions of the object point groups are generated from the multitude of sequentially encoded holograms at a fast pace and superposed sequentially in the visibility region.

21. Device according to claim 20, which is preferably a holographic display in the form of a direct-view display or a projection display.

22. Device according to claim 21, wherein the light modulator means directly serves as a screen, or where the device comprises a screen onto which images of the information of the 3D scene which is holographically encoded on the light modulator means are projected.

23. Device according to claim 20, wherein a grid cell comprises a region of multiple horizontally and vertically adjacent pixels, or where the surface area of a grid cell corresponds with the surface area of the largest possible sub-hologram.

24. Device according to claim 21, wherein the light modulator means is a phase-modulating light modulator, which is capable of controlling at least three phase levels.

26. Device according to claim 24, wherein a sub-hologram is represented on the phase-modulating light modulator as a lens function in a grid cell, and where the luminous intensity of a reconstructed object point can be controlled by representing that lens function in the sub-hologram for a variable period of time.

27. Device according to claim 24, wherein a linear phase function is represented in the boundary areas of a grid cell on the phase-modulating light modulator, said phase function deflecting the light to a position outside the visibility region.

28. Device according to claim 26, wherein for the period of time during which no lens function is represented a linear phase function is represented in the grid cell, said phase function deflecting the light to a position outside the visibility region.

29. Device according to claim 21, wherein the light modulator means is a binary phase-modulating light modulator or comprises a combination of a phase-modulating light modulator and an amplitude-modulating light modulator.

31. Device according to claim 29, wherein the amplitude-modulating light modulator is a binary modulator, and where the temporally averaged visible luminous intensity of a reconstructed object point will be controlled in that the amplitude-modulating light modulator is switched to a transmissive mode in the region of a sub-hologram for a variable period of time.

32. Device according to claim 31, wherein a frame, which limits the extent of a sub-hologram, and which exhibits a minimum transmittance, is written to a grid cell of the amplitude-modulating light modulator, more precisely between that sub-hologram and the edge of the grid cell.

33. Device according to claim 29, wherein the phase-modulating light modulator is of a binary type or is capable of controlling at least three phase levels.

34. Device according to claim 20, wherein one or multiple light sources are provided in an illumination system for illuminating at least one grid cell of the light modulator means, where the luminous intensity of said light source is controllable in order to control the temporally averaged luminous intensity of the reconstruction of individual object points.

35. Device according to claim 20, wherein a partial reconstruction of the three-dimensional scene is generated from an encoded object point group.

36. Device according to claim 20, wherein the grid is controlled by software means to be displaced by at least one pixel of the light modulator means but by maximal one grid cell, in order to encode a different hologram, which comprises different sub-holograms, where the grid is displaced both horizontally and vertically for a two-dimensional encoding.

37. Holographic display for reconstructing a three-dimensional scene with an illumination system for illuminating with sufficiently coherent light a spatial light modulator means, which modulates the light with holographic information of the encoded three-dimensional scene (3D scene), and with a projection system which projects the light to an eye position in a visibility region, from where the reconstruction of the 3D scene is visible in a frustrum-shaped reconstruction space, which stretches between the light modulator means and the visibility region, for at least one observer eye, whose position is detected by a position finder, which is combined controlled by software means with a processor for computing and encoding holograms of the 3D scene, where the display uses a selection process for encoding the 3D scene which is divided into object points, as set forth in claim 1, and wherein

A first processor element, which is controlled together with the light modulator means, is provided for generating on the light modulator means a displaceable two-dimensional grid with regularly arranged two-dimensional grid cells, in which common holograms of the 3D scene are encoded, which comprise sub-holograms which are computed according to the selection process and which are simultaneously encoded in the horizontal and/or vertical direction, and which represent partial reconstructions of the 3D scene, where one sub-hologram is always encoded in one grid cell, and

A second processor element is provided, which controls the illumination system in synchronism with the displacement of the grid on the light modulator means, for sequentially generating other partial reconstructions of the 3D scene which are resulting from a displacement of the grid, which are intrinsically coherent, but mutually incoherent, and whose wave fronts, which are modulated with holographic information, are sequentially superposed in the visibility region, and which can be seen from the eye position as a single, temporally averaged reconstruction.

38. Method according to claim 3, wherein the first processor element defines the surface area of a grid cell of the grid such that it corresponds with the largest sub-hologram.

4-5. -5. (canceled)

11. (canceled)

16. (canceled)

25. (canceled)

30. (canceled)