Auto stereoscopic 3D telepresence using integral holography

• US 8,334,889 B2
• Filed: 11/26/2010
• Issued: 12/18/2012
• Est. Priority Date: 03/18/2010
• Status: Active Grant

• Current Assignee: Tipd, LLC, Arizona Board of Regents (University of Arizona)
• Original Assignee: Tipd, LLC, Arizona Board of Regents (University of Arizona)
• Inventors: Blanche, Pierre-Alexandre Jean, Bablumyan, Arkady, Peyghambarian, Nasser N.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US12/954,758
• Publication Number:
  US 20110228040A1
• Time in Patent Office: 753 Days
• Field of Search: 348 1401- 1416, 348/40, 345/419, 345/205, 359/11, 359/32, 359/9, 359/35, 359/242, 359/244
• US Class Current: 348/14.07
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2645 Multiplexing processes, e.g. aperture, shift, or wavefront multiplexing
• CPC Class Codes: G03H 1/268 Holographic stereogram
• CPC Class Codes: G03H 2001/0088 for video-holography, i.e. integrating hologram acquisition, transmission and display
• CPC Class Codes: G03H 2001/0264 Organic recording material
• CPC Class Codes: G03H 2001/048 Parallel printer, i.e. a fringe pattern is reproduced
• CPC Class Codes: G03H 2001/0497 Dot matrix holograms
• CPC Class Codes: G03H 2001/2292 Using scanning means
• CPC Class Codes: G03H 2001/2297 using frame sequential, e.g. for reducing speckle noise
• CPC Class Codes: G03H 2210/22 2D SLM object wherein the object beam is formed of the light modulated by the SLM
• CPC Class Codes: G03H 2222/33 Pulsed light beam
• CPC Class Codes: G03H 2260/36 Dynamic material where the lifetime of the recorded pattern is quasi instantaneous, the holobject is simultaneously reconstructed
• CPC Class Codes: G03H 2260/54 Photorefractive reactivity wherein light induces photo-generation, redistribution and trapping of charges then a modification of refractive index, e.g. photorefractive polymer

Abstract

A holographic direct-view display system uses holographic integral imaging techniques that is an auto stereoscopic way to reproduce parallax and occlusion. The display is not resolution limited and is scalable to display life size images if desired. The system can be used to transmit 3D depictions of a scene at video and sub-video rates as well as other information, such as images of documents or computer generated images. The images may be captured, transmitted and displayed in real-time (or near real-time) for telepresence or stored for time-shifted display. The system combines integral holography, a pulsed laser to record the hologram at high speed and a dynamic refreshable holographic material such as a photorefractive polymer as a recording media. The system uses techniques to write, read and erase the updateable hologram that allow the holographic material, hence direct-view display to remain stationary throughout each of the processes for continuous presentation of the hologram to the audience. The system may write, read and erase at the same time and continuously to increase throughput. This system may also use additional novel techniques to improve brightness, efficiently implement a full-parallax display and to implement a full-color display in a transmission geometry.

Claims

1. An auto stereoscopic integral holographic display, comprising:

a dynamic refreshable holographic recording material held in a stationary mount to present a stationary direct-view display to an audience;

a memory;

hogel data stored in said memory, said hogel data encoded using integral imaging from multiple views of a scene, said hogel data representing a temporal sequence of multiple holograms for presentation to the audience at a refresh rate;

a pulsed laser that produces a coherent pulsed beam at a repetition rate to support presentation of the holograms at the refresh rate;

a beam splitter that splits the coherent pulsed beam into an object beam and a reference beam;

a spatial light modulator (SLM), said hogel data loaded into said SLM as an image to spatially modulate the amplitude of the object beam with the hogel data, said hogel data loaded into said SLM at a load rate to support presentation of the holograms at the refresh rate;

a beam steering mechanism that steers the modulated object beam and the reference beam relative to the stationary holographic recording material to interfere at the material and write successive hogels at different locations on the material to record the holograms at the refresh rate;

a reading source that directs a reading beam onto the holographic recording material, said reading beam diffracted by the hologram to produce a diffracted beam that presents the auto stereoscopic integral hologram to the audience, said hologram being refreshed at said refresh rate; and

control electronics that synchronize the pulsed laser, beam steering mechanism and SLM.

2. A telepresence system, comprising the auto stereoscopic integral holographic display of claim 1, and further comprising:

an image capture system including multiple video cameras that capture multiple images of a scene according to different positions;

a computer that processes the images and calculates the hogel data for integral imagery at the refresh rate of the display; and

a network that transmits the hogel data to a remote location where the display is located to present the auto stereoscopic integral holograms of the scene at the refresh rate to the audience in real or near real-time.

3. The display of claim 1, wherein the holographic recording material comprises a photorefractive polymer.

4. The display of claim 3, wherein the photorefractive polymer has a form factor of at least 12 inches by 12 inches.

5. The display of claim 1, wherein the hogel data comprises either single-color of three-color hogel data.

6. The display of claim 1, wherein the pulsed laser repetition rate is sub-microsecond.

7. The display of claim 1, wherein the pulsed laser records each hogel of the hologram with a single pulse.

8. The display of claim 1, wherein the SLM comprises a liquid crystal modulator.

9. The display of claim 1, wherein the SLM comprises a micro-mirror array.

10. The display of claim 1, wherein the beam steering mechanism comprises one or more translation stages that either translate or tilt optics to steer the object and reference beams.

11. The display of claim 1, wherein the refresh rate of the sequence of holograms is at least 0.1 Hz, 0.5 Hz, 1 Hz, 30 Hz or 60 Hz.

12. The display of claim 1, wherein the holographic recording material comprises multiple tiles of holographic recording material arranged in an array to create a display size greater than any one tile.

13. The display of claim 12, wherein the array of tiles are addressed by a single pulse laser and recording system.

14. The display of claim 12, wherein each tile in the array is addressed by its own pulse laser and recording system.

15. The display of claim 12, wherein the form factor of the array is at least that of the captured scene.

16. The display of claim 1, wherein the reading source directs the reading beam onto the holographic recording material to continuously present the hologram to the audience while the modulated object beam and reference beam write successive hogels to record the holograms.

17. The display of claim 16, wherein a shaped erase beam erases hogel date for the previous hologram while the modulated object beam and reference beam write successive hogels to record the current hologram.

18. The display of claim 17, wherein the shaped erase beam is the object beam, said object beam simultaneously erasing the hogel data for the previous hologram and writing the hogel data for the current hologram.

19. The display of claim 18, wherein the power of the pulse laser is high enough to erase the hogel data without leaving a ghost image and low enough to record the hogel data without causing a permanent set.

20. The display of claim 17, wherein the shaped erase beam is the object beam in which every other pulse constitutes an erase pulse, said beams steered so that the erase pulse erases the hogel data for the previous hologram at a location and then a pulse encoded with hogel data records the hogel for the location.

21. The display of claim 17, wherein the shaped erase beam is a pulsed beam that is temporally interlaced with the write pulse beam to erase the hogel data just prior to the write pulse beam writing the hogel data.

22. The display of claim 17, wherein the shaped erase beam is steered to erase the next hogel just prior to arrival of the write beams.

23. The display of claim 1, wherein the holograms are recording using horizontal-parallax only (HPO) or full-parallax.

24. The display of claim 1, wherein the display is configured for a transmission geometry, further comprising:

a mask/mirror positioned between the pulsed laser and the holographic recording material, said mask mirror comprising an aperture that defines the extent of a hogel and a mirror surface facing the recording material; and

a translation stage that moves the mask/mirror to synchronize the position of the aperture with the location of the steered object and reference and beams,

said read source positioned on the opposite side of the recording material to direct the reading beam through the material where it reflects off the mirrored surface and is transmitted back through the hologram in the material where it is diffracted to produce the diffracted beam.

25. The display of claim 24, further comprising a filter positioned between the recording material and the audience to absorb the object and reference beams that may pass through the material.

26. The display of claim 1, wherein the display is configured for a transmission geometry, further comprising:

a holographic optical element positioned between the holographic recording material and the incident modulated object and reference beams, said HOE configured to allow the object beam to pass there through and to diffract the reference beam at an acute angle to reduce the angle between the grating vector and the external electric field to increase the diffraction efficiency of the material.

27. The display of claim 1, wherein the display is configured for a transmission geometry and full-parallax recording of the hologram, further comprising:

a lens array that focuses the object beam on the recording material at multiple positions, said object beam spatially structured so that each position corresponds to the correct hogel data;

a diffractive element that splits the reference beam into multiple reference beams that are directed to the lens array that collimates the multiple reference beams,

wherein the multiple object and multiple reference beams interfere at the multiple positions on the material to write multiple hogels simultaneously.

28. The display of claim 27, wherein the object beam is spatially structured by loading hogel data for the multiple hogels into the SLM structured to match the lens array.

29. The display of claim 1, wherein the display is configured for a transmission geometry and three-color recording of the hologram from a single pulsed laser writing source, further comprising:

an optical system to separate the pulsed beam into reference and object beams having first and second orthogonal polarization components (horizontal and vertical or circular left and right polarizations);

an optical system to split the object beams into first, second and third object beams, said first and second object beams having said first polarization component and said third object beam having said second polarization component, said first and second object beams positioned to have an angle of incidence so that the grating vector of a hologram formed by cross-talk is perpendicular to the external electric field in the material so that the diffraction efficiency is near zero;

wherein angles of incidence for all three object beams satisfy the Bragg equation so that when each hologram is read with a different color it displays a full color hologram in the direction of the audience.

30. The display of claim 29, wherein to achieve this condition the first object beam is set at a symmetrical angle from the second object beam considering the external electric field vector direction.

31. A telepresence system, comprising:

an image capture system including multiple video cameras that capture multiple images of a scene according to different positions;

a computer that processes the images and calculates the hogel data using integral imagery at a refresh rate of the holographic display;

a network that transmits the hogel data to a remote location; and

an auto stereoscopic integral holographic display at the remote location to present the auto stereoscopic integral holograms of the scene at the refresh rate to the audience in real or near real-time from initial capture, comprising;

a dynamic refreshable holographic recording material held in a stationary mount to present a stationary direct-view display to an audience;

a memory;

hogel data stored in said memory, said hogel data encoded using integral imaging from multiple views of a scene, said hogel data representing a temporal sequence of multiple holograms for presentation to the audience at a refresh rate;

a pulsed laser that produces a coherent pulsed beat at a repetition rate to support presentation of the holograms at the refresh rate;

a beam splitter that splits the coherent pulsed beam into an objecting beam and a reference beam;

a spatial light modulator (SLM), said hogel data loaded into said SLM as image to spatially modulate the amplitude of the object beam with the hogel data, said hogel data loaded into said SLM at a load rate to support presentation of the holograms at the refresh rate;

a beam steering mechanism that steers the modulated object beam and the reference beam relative to the stationary holographic recording material to interfere at the material and write successive hogels at different locations on the material to record the holograms at the refresh rate;

a reading source that directs a reading beam onto the holographic recording material, said reading beam diffracted by the hologram to produce a diffracted beam that presents the auto stereoscopic integral hologram to the audience, said hologram being refreshed at said refresh rate; and

control electronics that synchronize the pulsed laser, beam steering mechanism and SLM.

32. An auto stereoscopic integral holographic display, comprising:

a dynamic refreshable holographic recording material comprising a photorefractive (PR) polymer held in a stationary mount to present a stationary direct-view display to an audience;

a memory;

hogel data stored in said memory, said hogel data encoded using integral imaging from multiple views of a scene, said hogel data representing a temporal sequence of multiple holograms for presentation to the audience at a refresh rate of at least 0.1 Hz, 0.5 Hz, 1 Hz, 30 Hz or 60 Hz;

a pulsed laser that produces a coherent pulsed beat at a sub-nanosecond repetition rate to support presentation of the holograms at the refresh rate;

a beam splitter that splits the coherent pulsed beam into an objecting beam and a reference beam;

a spatial light modulator (SLM), said hogel data loaded into said SLM as image to spatially modulate the amplitude of the object beam with the hogel data, said hogel data loaded into said SLM at a load rate to support presentation of the holograms at the refresh rate;

a beam steering mechanism that steers the modulated object beam and the reference beam relative to the stationary holographic recording material to interfere at the material and write successive hogels at different locations on the material to record the holograms at the refresh rate;

a reading source that directs a reading beam onto the holographic recording material, said reading beam diffracted by the hologram to produce a diffracted beam that presents the auto stereoscopic integral hologram continuously to the audience while said object and reference beams continue to record hogels to refresh the hologram at said refresh rate;

an erase source that directs a focused erase beam onto the material that erases hogel date for the previous hologram while the modulated object beam and reference beam record successive hogels to record the current hologram and

control electronics that synchronize the pulsed laser, beam steering mechanism and SLM.

33. The display of claim 32, wherein the focused erase beam is the object beam, said object beam simultaneously erasing the hogel data for the previous hologram and writing the hogel data for the current hologram.

34. The display of claim 32, wherein the display is configured for a transmission geometry, further comprising:

a mask/mirror positioned between the pulsed laser and the holographic recording material, said mask mirror comprising an aperture that defines the extent of a hogel and a mirror surface facing the recording material; and

a translation stage that moves the mask/mirror to synchronize the position of the aperture with the location of the steered object and reference and beams,

said read source positioned on the opposite side of the recording material to direct the reading beam through the material where it reflects off the mirrored surface and is transmitted back through the hologram in the material where it is diffracted to produce the diffracted beam.