Enhanced environment visualization using holographic stereograms

• US 20050052714A1
• Filed: 07/26/2004
• Published: 03/10/2005
• Est. Priority Date: 07/24/2003
• Status: Active Grant

• Current Assignee: FoVI 3D, Inc.
• Original Assignee: Zebra Imaging, Inc.
• Inventors: Newswanger, Craig, Klug, Michael A., Holzbach, Mark E.
• Granted Patent: US 7,190,496 B2
• Time in Patent Office: Days
• US Class Current: 359/3
• CPC Class Codes: G03H 1/22 Processes or apparatus for obtaining an optical image from holograms G03H1/26 - G03H1/34 take precedence
• CPC Class Codes: G03H 1/2249 Holobject properties
• CPC Class Codes: G03H 1/268 Holographic stereogram
• CPC Class Codes: G03H 2001/0016 Covert holograms or holobjects requiring additional knowledge to be perceived, e.g. holobject reconstructed only under IR illumination microholograms G03H2230/10
• CPC Class Codes: G03H 2001/0022 Deciphering being performed with numerical or optical key, e.g. with the optical scrambler used during recording optical element in object beam G03H1/041
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2001/2236 Details of the viewing window
• CPC Class Codes: G03H 2001/2284 Superimposing the holobject with other visual information
• CPC Class Codes: G03H 2210/30 3D object
• CPC Class Codes: G03H 2210/441 Numerical processing applied to the object data other than numerical propagation synthesizing propagation G03H1/0808

Abstract

Hologram production techniques can combine source data representing realistic information describing an environment with source data providing representational information describing a feature of the environment and/or some object interacting with the environment. The combined data is used to produce holograms, and particularly holographic stereograms including features that enhance the visualization of the environment depicted in hologram. A haptic interface can be used in conjunction with such holograms to further aid use of the hologram, and to provide an interface to secondary information provided by a computer and related to the images depicted in the hologram.

Claims

1. A method comprising:

combining first image data with second image data, wherein the first image data comprises realistic information describing an environment, and wherein the second image data comprises representational information describing at least one of a feature of the environment and an item interacting with the environment;

rendering data for a plurality of hogels using combined first and second image data; and

forming a plurality of hogels in a holographic recording material, wherein the plurality of hogels are formed using the data for the plurality of hogels.

2. The method of claim 1 further comprising:

providing data for at least one of the plurality of hogels to a spatial light modulator;

intensity modulating an object beam from a laser with the spatial light modulator; and

exposing a portion of the holographic recording material to an interference pattern formed by a reference beam from the laser and the object beam from the laser.

3. The method of claim 1 further comprising:

calculating a fringe pattern corresponding to data for at least one of the plurality of hogels.

4. The method of claim 1 wherein the realistic information describing an environment is derived from at least one of:

a plurality of measurements of the environment, and design information describing the environment.

5. The method of claim 4 wherein the plurality of measurements of the environment include at least one of:

RADAR data, LIDAR data, SONAR data, photographic data, video data, x-ray data, sonogram data, CT scan data, PET scan data, MRI imaging data, electrical impedance tomography (EIT) data, and laser scanning data.

6. The method of claim 1 wherein the realistic information describing an environment includes at least one of:

terrain information, hydrological information, map information, building information, campus information, facilities information, vehicle information, and biological specimen information.

7. The method of claim 1 wherein the representational information describing at least one of a feature of the environment and an item interacting with the environment includes at least one of:

an icon, a symbol, a color, a shape, a texture map, a path, a shadow, and a volume.

8. The method of claim 1 wherein the combining first image data with second image data further comprises:

combining the first image data with the second image data and with third image data, wherein the third image data comprises information to be selectively viewable by at least one of a user and a machine.

9. The method of claim 8 wherein the forming a plurality of hogels in a holographic recording material further comprises:

forming at least one of the plurality of hogels in the holographic recording material so that at least a portion of the third image data is viewable from a narrowly defined viewing location.

10. The method of claim 1 further comprising:

providing a haptic interface in a volume coincident with an image volume of an image produced by the plurality of hogels in the holographic recording material;

comparing a location of a portion of the haptic interface with a corresponding location in a haptic model of the image produced by the plurality of hogels in the holographic recording material; and

imparting a force to the haptic interface in response to the comparing.

11. The method of claim 10 further comprising:

periodically sensing the location of the portion of the haptic interface within the volume; and

correlating each sensed location with a portion of the image produced by the plurality of hogels in the holographic recording material.

12. The method of claim 10 further comprising:

providing a computer interface for displaying a graphical representation of the haptic model; and

selectively displaying, via the computer interface, information related to a scene depicted in an image produced by the plurality of hogels.

13. The method of claim 12 wherein the selectively displaying is controlled, at least in part, by user manipulation of the haptic interface.

14. The method of claim 12 wherein the information related to a scene depicted in an image produced by the plurality of hogels includes at least one of:

point of interest information, distance between points information, a view of the haptic model corresponding to the a location of a portion of the haptic interface, flight path information, a webpage, and a cursor corresponding to the a location of a portion of the haptic interface.

15. The method of claim 10 further comprising:

generating the haptic model using at least one of the first image data and the second image data.

16. The method of claim 1 further comprising:

forming a second plurality of hogels in a second holographic recording material, wherein the plurality of hogels are formed using data for a second plurality of hogels; and

locating the holographic recording material with respect to the second holographic recording material so that a first image volume of an image produced by the plurality of hogels in the holographic recording material overlaps a second image volume of a second image produced by the second plurality of hogels in the second holographic recording material.

17. The method of claim 16 wherein each of the holographic recording material and the second holographic recording material includes a respective registration mark.

18. An apparatus comprising:

a light source that produces a coherent beam;

a beam splitter that splits the coherent beam into an object beam and a reference beam;

an object beam optical system for directing the object beam to interfere with the reference beam at a holographic recording material, wherein the object beam optical system includes a spatial light modulator for intensity modulating the object beam;

a computer coupled to the spatial light modulator and programmed to control delivery of a rendered image to the spatial light modulator, wherein the rendered image includes first image data and second image data, the first image data comprises realistic information describing an environment, and the second image data comprises representational information describing at least one of a feature of the environment and an item interacting with the environment; and

a reference beam optical system for directing the reference beam to interfere with the object beam at the holographic recording material.

19. The apparatus of claim 18 wherein at least one of the computer coupled to the spatial light modulator and a second computer is programmed to rendering data for a plurality of hogels using combined first and second image data.

20. The apparatus of claim 18 wherein the realistic information describing an environment is derived from at least one of:

a plurality of measurements of the environment, and design information describing the environment.

21. The apparatus of claim 20 wherein the plurality of measurements of the environment include at least one of:

RADAR data, LIDAR data, SONAR data, photographic data, video data, x-ray data, sonogram data, CT scan data, PET scan data, MRI imaging data, electrical impedance tomography (EIT) data, and laser scanning data.

22. The apparatus of claim 18 wherein the realistic information describing an environment includes at least one of:

terrain information, hydrological information, map information, building information, campus information, facilities information, vehicle information, and biological specimen information.

23. The apparatus of claim 18 wherein the representational information describing at least one of a feature of the environment and an item interacting with the environment includes at least one of:

an icon, a symbol, a color, a shape, a texture map, a path, a shadow, and a volume.

24. The apparatus of claim 18 wherein the rendered image includes third image data selectively viewable by at least one of a user and a machine.

25. The apparatus of claim 18 further comprising:

a haptic interface located in a volume coincident with an image volume of an image produced by an interference pattern recorded in the holographic recording material; and

a second computer coupled to the haptic interface and programmed to describe a haptic model of the image produced by the interference pattern recorded in the holographic recording material.

26. The apparatus of claim 25 further comprising:

a computer interface coupled to the second computer for displaying a graphical representation of the haptic model, wherein the second computer is further configured to display via the computer interface information related to a scene depicted in the image produced by the interference pattern recorded in the holographic recording material.

27. The apparatus of claim 26 wherein the display of information is controlled, at least in part, by user manipulation of the haptic interface.

28. The apparatus of claim 26 wherein the information related to a scene depicted in the image produced by the interference pattern recorded in the holographic recording material includes at least one of:

point of interest information, distance between points information, a view of the haptic model corresponding to the a location of a portion of the haptic interface, flight path information, a webpage, and a cursor corresponding to the a location of a portion of the haptic interface.

29. The apparatus of claim 25 wherein the second computer is further configured to generate the haptic model using at least one of the first image data and the second image data.