Holography-based device, system and method for coded aperture imaging

• US 8,243,353 B1
• Filed: 04/06/2009
• Issued: 08/14/2012
• Est. Priority Date: 04/07/2008
• Status: Active Grant

• Current Assignee: Applied Science Innovations, Inc.
• Original Assignee: Applied Science Innovations, Inc.
• Inventors: Gutin, Mikhail, Wang, Xu-Ming
• Primary Examiner(s): Doak, Jennifer L.
• Application Number:
  US12/418,654
• Time in Patent Office: 1,226 Days
• Field of Search: 359/9, 359 10- 11, 359 15- 16
• US Class Current: 359/21
• CPC Class Codes: G02B 2207/129 Coded aperture imaging
• CPC Class Codes: G03H 1/2286 Particular reconstruction light G03H1/24 takes precedence; Beam properties
• CPC Class Codes: G03H 2001/0066 for wavefront matching wherein the hologram is arranged to convert a predetermined wavefront into a comprehensive wave, e.g. associative memory

Abstract

A system and related method for coded aperture sensing, comprising: passing at least one scene wavefront from a target scene through at least one original coded aperture mask onto a focal plane array, producing a diffracted projection of the target scene; and processing the diffracted projection into a representation of the target scene by correlating a function of the diffracted projection with a function of a known array pattern of the at least one original coded aperture mask and by using at least one reconstructing wavefront for holographic reconstructing.

Claims

1. A method for coded aperture sensing, comprising:

passing at least one scene wavefront from a target scene through at least one original binary coded aperture mask comprising transparent and opaque portions thereof, onto a focal plane array, producing a diffracted projection of the target scene; and

processing said diffracted projection into a representation of the target scene by correlating a function of said diffracted projection with a function of a known array pattern of said at least one original binary coded aperture mask and by using at least one reconstructing wavefront for holographic reconstructing.

2. The method of claim 1, said function of said known array pattern of said at least one original binary coded aperture mask comprising a complement of said at least one original binary coded aperture mask.

3. The method of claim 1, wherein:

said correlating occurs before said holographic reconstructing;

said correlating produces a hologram of the target scene;

said holographic reconstructing comprises Fresnel illuminating said hologram into a holographic reconstruction of the target scene.

4. The method of claim 3, further comprising focusing said holographic reconstruction onto an image plane, producing an image of the target scene.

5. The method of claim 1, further comprising:

passing at least one scene wavefront from a target scene through a complement of said at least one original binary coded aperture mask, producing a complementary diffracted projection of the target scene;

wherein;

said function of said diffracted projection comprises a difference between said diffracted projection, and said complementary diffracted projection.

6. The method of claim 1, wherein:

said correlating occurs before said holographic reconstructing;

said correlating produces a hologram of the target scene; and

said holographic reconstructing comprises illuminating said hologram into a holographic reconstruction of said target scene;

further comprising;

propagating said holographic reconstruction onto an image plane and calculating intensity at points of said image plane, producing an image of the target scene.

7. The method of claim 1, said function of said diffracted projection comprising a portion of said diffracted projection.

8. The method of claim 1, said function of said known array pattern of said at least one original binary coded aperture mask comprising a morphed pattern of said at least one original coded aperture mask.

9. The method of claim 1, wherein:

said holographic reconstructing occurs before said correlating;

said holographic reconstructing comprises illuminating said diffracted projection of the target scene as a hologram of said diffracted projection to produce a pattern image; and

said correlating comprises correlating said pattern image of said hologram with said function of said known array pattern of said at least one original binary coded aperture mask, producing an image of the target scene.

10. The method of claim 1, further comprising:

said function of said diffracted projection comprising said diffracted projection;

said function of said known array pattern of said at least one original binary coded aperture mask comprising a prerecorded impulse response comprising a complex field produced by passing a wavefront through said at least one original binary coded aperture mask onto said focal plane array; and

correlating said diffracted projection with said impulse response to produce an image of the target scene.

11. The method of claim 1, wherein:

said correlating occurs before said holographic reconstructing;

said correlating produces a hologram of the target scene; and

said holographic reconstructing comprises illuminating said hologram using an array of light sources arranged in a pattern complementary to said at least one original binary coded aperture mask, to produce a holographic reconstruction of the target scene;

further comprising;

focusing said holographic reconstruction onto an image plane, produces an image of the target scene.

12. The method of claim 3, said correlating comprising correlating using deconvolution.

13. The method of claim 6, said correlating comprising correlating using deconvolution.

14. The method of claim 9, said correlating comprising correlating using deconvolution.

15. The method of claim 10, said correlating comprising correlating using deconvolution.

16. The method of claim 2, further comprising:

a polarizing coded aperture mask comprising both original mask polarizers with a first polarization orientation and complementary mask polarizers with a second polarization orientation;

wherein;

diffracted projections produced by said original mask polarizers and diffracted projections produced by said complementary mask polarizers are respectively separated into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

17. The method of claim 2, further comprising:

a diffraction grating coded aperture mask comprising both original mask grating rulings and complementary mask grating;

wherein;

diffracted projections produced by said original mask grating rulings and diffracted projections produced by said complementary mask grating rulings are respectively separated into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

18. The method of claim 2, further comprising:

a refractive coded aperture mask comprising both original mask refractive elements and complementary mask refractive elements;

wherein;

diffracted projections produced by said original mask refractive elements and diffracted projections produced by said complementary mask refractive elements are respectively separated into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

19. The method of claim 2, further comprising:

a mixed transparent and reflective coded aperture mask comprising both transparent and reflective elements;

wherein;

diffracted projections produced by said transparent elements and diffracted projections produced by said reflective elements are separated into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

20. The method of claim 2, further comprising:

a dynamic coded aperture mask for forming in sequence, both said at least one original binary coded aperture mask and said complement of said at least one original binary coded aperture mask;

wherein;

diffracted projections produced by said at least one original binary coded aperture mask and diffracted projections produced by said complement of said at least one original binary coded aperture mask are respectively separated into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

21. The method of claim 1, said using at least one reconstructing wavefront for holographic reconstructing comprising increasing spatial resolution by narrowing a spectral range with a filter selected from the filter group consisting of:

bandpass filters and notch filters.

22. The method of claim 1, said using at least one reconstructing wavefront for holographic reconstructing comprising:

using a plurality of reconstructing wavefronts of different wavelengths to focus different spectral components of the holographic reconstruction; and

combining said different spectral components of said holographic reconstruction, producing a hyperspectral image of the target scene.

23. The method of claim 1, said using at least one reconstructing wavefront for holographic reconstructing comprising applying a change detection algorithm to said representation of the target scene.

24. The method of claim 23, wherein said representation of the target scene is denoted by h(x,y), said change detection algorithm comprising:

producing a shifted image of said representation of the target scene denoted by h′

(x, y), such that;

h′

(x,y)=h(x−

a,y−

b)+g(x,y),

where g(x,y) denotes a difference between said representation of the target scene and said shifted image of said representation of the target scene;

detecting said difference g(x,y), using a first Fourier filter

25. The method of claim 1, wherein said at least one original binary coded aperture mask and said focal plane array are substantially parallel to one another.

26. The method of claim 1, wherein said at least one original binary coded aperture mask and said focal plane array are substantially not parallel to one another.

27. The method of claim 1, further comprising at least one optical element for concentrating said at least one scene wavefront onto said focal plane array to reduce wavefront loss.

28. The method of claim 1, wherein said at least one original binary coded aperture mask is substantially planar.

29. The method of claim 1, wherein said at least one original binary coded aperture mask is substantially non-planar.

30. The method of claim 29, wherein a shape of said at least one original binary coded aperture mask is conformal.

31. The method of claim 2, further comprising:

a polarimetric coded aperture mask comprising all four of;

opaque elements;

transparent elements polarized in a first polarization orientation;

transparent elements polarized in a second polarization orientation; and

unpolarized transparent elements transparent to said first polarization orientation and said second polarization orientation;

wherein said transparent elements and said opaque elements are arranged in statistically independent patterns; and

processing said diffracted projection into a representation of the target scene in said first and second polarization orientations by correlating a function of said diffracted projection with a function of the pattern of said transparent elements, respectively, in said first and second polarization orientations, and for each polarization orientation, by using at least one reconstructing wavefront for holographic reconstructing.

32. The method of claim 1, further comprising compensating for known aberrations introduced by system optics used between the target scene and said original binary coded aperture mask, by subtracting said known aberrations from the holographic reconstruction, to produce an aberration-compensated holographic reconstruction.

33. The method of claim 1, further comprising compensating for known aberrations introduced by system optics used between the target scene and said original binary coded aperture mask, by:

remapping a digital pattern of said original binary coded aperture mask, as a function of said known aberrations; and

using the remapped digital pattern for said holographic reconstructing, to produce an aberration-compensated holographic reconstruction.

34. The method of claim 1, further comprising compensating for unknown aberrations introduced by system optics used between the target scene and said original binary coded aperture mask, by a calibration procedure comprising:

passing at least one calibration wavefront through said system optics in combination with said at least one original binary coded aperture mask onto the focal plane array, producing an aberrated diffracted projection of a source of said calibration wavefront;

deducing a measured system optics aberration from said aberrated diffracted projection; and

subtracting said measured system optics aberration during processing of said diffracted projection of the target scene, to produce an aberration-compensated holographic reconstruction.

35. The method of claim 1, further comprising compensating for unknown atmospheric aberrations introduced between the target scene and said original binary coded aperture mask, by computationally maximizing a sharpness function during processing of said diffracted projection of the target scene, to produce an aberration-compensated holographic reconstruction.

36. The method of claim 1, further comprising compensating for unknown atmospheric aberrations introduced between the target scene and said original binary coded aperture mask, by:

subdividing at least one wavefront of the holographic reconstruction, into a plurality of coherent sub-wavefronts, each smaller than Fried'"'"'s parameter;

computationally refocusing each sub-wavefront to produce corresponding object images;

correlating said object images to calculate shifts and tilts of the corresponding sub-wavefronts, caused by the atmospheric turbulence;

removing the calculated shifts and tilts to produce a corresponding plurality of corrected sub-wavefronts; and

coherently combining said corrected sub-wavefronts, to produce an aberration-compensated holographic reconstruction.

37. A system for coded aperture sensing, comprising requisite optical elements, computerized storage and computerized processing for:

passing at least one scene wavefront from a target scene through at least one original binary coded aperture mask comprising transparent and opaque portions thereof, onto a focal plane array, producing a diffracted projection of the target scene; and

processing said diffracted projection into a representation of the target scene by correlating a function of said diffracted projection with a function of a known array pattern of said at least one original binary coded aperture mask and by using at least one reconstructing wavefront for holographic reconstructing.

38. The system of claim 37, said function of said known array pattern of said at least one original binary coded aperture mask comprising a complement of said at least one original binary coded aperture mask.

39. The system of claim 37, wherein:

said correlating occurs before said holographic reconstructing;

said correlating produces a hologram of the target scene;

said holographic reconstructing comprises Fresnel illuminating said hologram into a holographic reconstruction of the target scene.

40. The system of claim 39, further comprising said requisite optical elements, computerized storage and computerized processing for focusing said holographic reconstruction onto an image plane, producing an image of the target scene.

41. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for:

passing at least one scene wavefront from a target scene through a complement of said at least one original binary coded aperture mask, producing a complementary diffracted projection of the target scene;

wherein;

said function of said diffracted projection comprises a difference between said diffracted projection, and said complementary diffracted projection.

42. The system of claim 37, wherein:

said correlating occurs before said holographic reconstructing;

said correlating produces a hologram of the target scene; and

said holographic reconstructing comprises illuminating said hologram into a holographic reconstruction of said target scene;

further comprising said requisite optical elements, computerized storage and computerized processing for;

propagating said holographic reconstruction onto an image plane and calculating intensity at points of said image plane, producing an image of the target scene.

43. The system of claim 37, said function of said diffracted projection comprising a portion of said diffracted projection.

44. The system of claim 37, said function of said known array pattern of said at least one original binary coded aperture mask comprising a morphed pattern of said at least one original binary coded aperture mask.

45. The system of claim 37, wherein:

said holographic reconstructing occurs before said correlating;

said holographic reconstructing comprises illuminating said diffracted projection of the target scene as a hologram of said diffracted projection to produce a pattern image; and

said correlating comprises correlating said pattern image of said hologram with said function of said known array pattern of said at least one original binary coded aperture mask, producing an image of the target scene.

46. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for:

said function of said diffracted projection comprising said diffracted projection;

said function of said known array pattern of said at least one original binary coded aperture mask comprising a prerecorded impulse response comprising a complex field produced by passing a wavefront through said at least one original binary coded aperture mask onto said focal plane array; and

correlating said diffracted projection with said impulse response to produce an image of the target scene.

47. The system of claim 37, wherein:

said correlating occurs before said holographic reconstructing;

said correlating produces a hologram of the target scene; and

said holographic reconstructing comprises illuminating said hologram using an array of light sources arranged in a pattern complementary to said at least one original binary coded aperture mask, producing a holographic reconstruction of the target scene;

further comprising said requisite optical elements, computerized storage and computerized processing for;

focusing said holographic reconstruction onto an image plane, to produce an image of the target scene.

48. The system of claim 39, further comprising said requisite optical elements, computerized storage and computerized processing for said correlating comprising correlating using deconvolution.

49. The system of claim 42, further comprising said requisite optical elements, computerized storage and computerized processing for said correlating comprising correlating using deconvolution.

50. The system of claim 45, further comprising said requisite optical elements, computerized storage and computerized processing for said correlating comprising correlating using deconvolution.

51. The system of claim 46, further comprising said requisite optical elements, computerized storage and computerized processing for said correlating comprising correlating using deconvolution.

52. The system of claim 38, further comprising:

a polarizing coded aperture mask comprising both original mask polarizers with a first polarization orientation and complementary mask polarizers with a second polarization orientation; and

;

said requisite optical elements, computerized storage and computerized processing for respectively separating diffracted projections produced by said original mask polarizers and diffracted projections produced by said complementary mask polarizers into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

53. The system of claim 38, further comprising:

a diffraction grating coded aperture mask comprising both original mask grating rulings and complementary mask grating; and

said requisite optical elements, computerized storage and computerized processing for respectively separating diffracted projections produced by said original mask grating rulings and diffracted projections produced by said complementary mask grating rulings into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

54. The system of claim 38, further comprising:

a refractive coded aperture mask comprising both original mask refractive elements and complementary mask refractive elements; and

said requisite optical elements, computerized storage and computerized processing for respectively separating diffracted projections produced by said original mask refractive elements and diffracted projections produced by said complementary mask refractive elements into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

55. The system of claim 38, further comprising:

a mixed transparent and reflective coded aperture mask comprising both transparent and reflective elements; and

said requisite optical elements, computerized storage and computerized processing for separating diffracted projections produced by said transparent elements and diffracted projections produced by said reflective elements into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

56. The system of claim 38, further comprising:

a dynamic coded aperture mask for forming in sequence, both said at least one original binary coded aperture mask and said complement of said at least one original binary coded aperture mask; and

said requisite optical elements, computerized storage and computerized processing for respectively separating diffracted projections produced by said at least one original binary coded aperture mask and diffracted projections produced by said complement of said at least one original binary coded aperture mask into said diffracted projection of the target scene and a complementary diffracted projection of the target scene.

57. The system of claim 37, said using at least one reconstructing wavefront for holographic reconstructing comprising increasing spatial resolution by narrowing a spectral range with a filter selected from the filter group consisting of:

bandpass filters and notch filters.

58. The system of claim 37, said using at least one reconstructing wavefront for holographic reconstructing comprising:

using a plurality of reconstructing wavefronts of different wavelengths to focus different spectral components of the holographic reconstruction; and

combining said different spectral components of said holographic reconstruction, producing a hyperspectral image of the target scene.

59. The system of claim 37, said using at least one reconstructing wavefront for holographic reconstructing comprising applying a change detection algorithm to said representation of the target scene.

60. The system of claim 59, wherein said representation of the target scene is denoted by h(x,y), said change detection algorithm comprising:

producing a shifted image of said representation of the target scene denoted by h′

(x, y), such that;

h′

(x,y)=h(x−

a,y−

b)+g(x,y),

where g(x,y) denotes a difference between said representation of the target scene and said shifted image of said representation of the target scene;

detecting said difference g(x,y), using a first Fourier filter

61. The system of claim 37, wherein said at least one original binary coded aperture mask and said focal plane array are substantially parallel to one another.

62. The system of claim 37, wherein said at least one original binary coded aperture mask and said focal plane array are substantially not parallel to one another.

63. The system of claim 37, further comprising at least one optical element for concentrating said at least one scene wavefront onto said focal plane array to reduce wavefront loss.

64. The system of claim 37, wherein said at least one original binary coded aperture mask is substantially planar.

65. The system of claim 37, wherein said at least one original binary coded aperture mask is substantially non-planar.

66. The system of claim 65, wherein a shape of said at least one original binary coded aperture mask is conformal.

67. The system of claim 38, further comprising:

a polarimetric coded aperture mask comprising all four of;

opaque elements;

transparent elements polarized in a first polarization orientation;

transparent elements polarized in a second polarization orientation; and

unpolarized transparent elements transparent to said first polarization orientation and said second polarization orientation;

wherein said transparent elements and said opaque elements are arranged in statistically independent patterns; and

said requisite optical elements, computerized storage and computerized processing for processing said diffracted projection into a representation of the target scene in said first and second polarization orientations by correlating a function of said diffracted projection with a function of the pattern of said transparent elements, respectively, in said first and second polarization orientations, and for each polarization orientation, by using at least one reconstructing wavefront for holographic reconstructing.

68. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for compensating for known aberrations introduced by at least one of said optical elements, used between the target scene and said original binary coded aperture mask, by subtracting said known aberrations from the holographic reconstruction, to produce an aberration-compensated holographic reconstruction.

69. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for compensating for known aberrations introduced by at least one of said optical elements, used between the target scene and said original binary coded aperture mask, by:

remapping a digital pattern of said original binary coded aperture mask, as a function of said known aberrations; and

using the remapped digital pattern for said holographic reconstructing, to produce an aberration-compensated holographic reconstruction.

70. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for compensating for unknown aberrations introduced by at least one of said optical elements, used between the target scene and said original binary coded aperture mask, by a calibration procedure comprising:

passing at least one calibration wavefront through said at least one of said optical elements in combination with said at least one original binary coded aperture mask, onto the focal plane array, producing an aberrated diffracted projection of a source of said calibration wavefront;

deducing a measured aberration due to said at least one of said optical elements, from said aberrated diffracted projection; and

subtracting said measured aberration due to said at least one of said optical elements, during processing of said diffracted projection of the target scene, to produce an aberration-compensated holographic reconstruction.

71. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for compensating for unknown atmospheric aberrations introduced between the target scene and said original binary coded aperture mask, by computationally maximizing a sharpness function during processing of said diffracted projection of the target scene, to produce an aberration-compensated holographic reconstruction.

72. The system of claim 37, further comprising said requisite optical elements, computerized storage and computerized processing for compensating for unknown atmospheric aberrations introduced between the target scene and said original binary coded aperture mask, by:

subdividing at least one wavefront of the holographic reconstruction, into a plurality of coherent sub-wavefronts, each smaller than Fried'"'"'s parameter;

computationally refocusing each sub-wavefront to produce corresponding object images;

correlating said object images to calculate shifts and tilts of the corresponding sub-wavefronts, caused by the atmospheric turbulence;

removing the calculated shifts and tilts to produce a corresponding plurality of corrected sub-wavefronts; and

coherently combining said corrected sub-wavefronts, to produce an aberration-compensated holographic reconstruction.