Joint transform image correlation using a nonlinear spatial light modulator at the fourier plane

• US 4,832,447 A
• Filed: 12/04/1987
• Issued: 05/23/1989
• Est. Priority Date: 12/04/1987
• Status: Expired due to Term

• Current Assignee: Connecticut Research Foundation University of
• Original Assignee: The Board of Trustees of Michigan State University (Michigan State University)
• Inventors: Javidi, Bahram
• Primary Examiner(s): ARNOLD, BRUCE
• Application Number:
  US07/128,803
• Time in Patent Office: 536 Days
• Field of Search: 350/162.13, 350/162.14, 364/822
• US Class Current: 359/561
• CPC Class Codes: G01N 21/95623 using a spatial filtering method per se G02B
• CPC Class Codes: G06E 3/00 Devices not provided for in group G06E1/00, e.g. for processing analogue or hybrid data
• CPC Class Codes: G06V 10/92 using spatial domain filters, e.g. joint transform correlators

Abstract

The present invention is a nonlinear joint transform image correlator which employs a spatial modulator operating in a binary mode at the Fourier plane. The reference and input images are illuminated by a coherent light at the object plane of a Fourier transform lens system. A image detection device, such as a charge coupled device, is disposed at the Fourier plane of this Fourier transform lens system. A thresholding network detects the median intensity level of the imaging cells of the charge coupled device at the Fourier plane and binarizes the Fourier transform interference intensity. The correlation output is formed by an inverse Fourier transform of this binarized Fourier transform interference intensity. In the preferred embodiment this is achieved via a second Fourier transform lens system. This binary data is then applied to spatial light modulator device operating in a binary mode located at the object plane of a second Fourier transform lens system. This binary mode spatial light modulator device is illuminated by coherent light producing the correlation output at the Fourier plane of the second Fourier transform lens system. The inverse Fourier transform may also be formed via a computer. In an alternative embodiment, the Fourier transform interference intensity is thresholded into one of three ranges. An inverse Fourier transform of this trinary Fourier transform interference intensity produces the correlation output.

Claims

1. A nonlinear joint transform image correlator comprising:

a joint image production means for producing a collimated joint image of a reference image and an input image;

a first Fourier transform lens device disposed to receive said collimated joint image at an object plane thereof and to produce the interference between the Fourier transforms of said reference image and said input image at a Fourier plane thereof;

an image detector means located at said Fourier plane of said first Fourier transform lens device, said image detector means including a plurality of detection cells disposed in a planar array at said Fourier plane, each of said detection cells generating an indication of the light intensity of said interference of said Fourier transforms of said reference image and said input image at said detection cell;

a threshold device connected to each detection cell of said image detector means for determining if the light intensity detected by each detection cell is greater than a threshold value, thereby generating a thresholded indication of the light intensity of said interference of said Fourier transforms of said reference image and said input image at said detection cell; and

inverse Fourier transform means connected to said thresholding means for producing the inverse Fourier transform of said thresholded indication of the light intensity of said interference of said reference image and said input image, said inverse Fourier transform being the correlation between said reference image and said input image.

2. The nonlinear joint transform image correlator claimed in claim 1, wherein said joint image production means includes:

a reference image spatial light modulator having a plurality of light modulation cells disposed in a planar array within said object plane of said first Fourier transform lens device, said light modulation cells having transparency states corresponding to said reference image;

an input image spatial light modulator having a plurality of light modulation cells disposed in a planar array within said object plane of said first Fourier transform lens device adjacent to said planar array of said reference image spatial light modulator, said light modulation cells having transparency states corresponding to said input image; and

an input source of collimated light disposed to illuminate said reference and image spatial light modulators, whereby said first Fourier transform lens device receives light from said image source as modified by said reference image spatial light modulator and said input image spatial light modulator.

3. The nonlinear joint transform image correlator claimed in claim 1, wherein said joint image production means includes:

an image spatial light modulator having a plurality of light modulation cells disposed in a planar array within said object plane of said first Fourier transform lens device, said image spatial light modulator including a reference image portion having light modulation cells having transparency states corresponding to said reference image and an input image portion adjacent to said reference image potion having light modulation cells having transparency states corresponding to said input image; and

an input source of collimated light disposed to illuminate said reference and image spatial light modulators, whereby said first Fourier transform lens device receives light from said image source as modified by said image spatial light modulator.

4. The nonlinear joint transform image correlator claimed in claim 1, wherein said image detector means consists of a charge coupled device.

5. The nonlinear joint transform image correlator claimed in claim 1, wherein:

said threshold device further includes;

a threshold setting means for setting said threshold value based upon a statistical measure of the central tendency of the said indication of the light intensity at said detection cells.

6. The nonlinear joint transform image correlator claimed in claim 5, wherein:

said threshold setting means includes means for quantizing said indication of light intensity of said detection cells, means for forming a histogram of said quantized indications of light intensity and means for determining the median of said histogram, and means for setting said threshold value to said median.

7. The nonlinear joint transform image correlator claimed in claim 1, wherein:

said inverse Fourier transform means includes

a Fourier plane spatial light modulator connected to said threshold device having a plurality of light modulation cells disposed in a planar array, each light modulation cell corresponding to a predetermined one of said detection cells, each light modulator cell operating in a binary mode having a first transparency state if the light intensity detected by said corresponding detection cell is greater than said threshold value and having a second transparency state if the light intensity detected by said corresponding detection cell is not greater than said threshold value,

an output source of collimated light disposed to illuminate said Fourier plane spatial light modulator, and

a second Fourier transform lens device disposed to receive said collimated light from said Fourier plane spatial light modulator at an object plane thereof, the correlation output of said nonlinear joint transform image correlator appearing at a Fourier plane thereof.

8. The nonlinear joint transform image correlator claimed in claim 7, wherein:

said Fourier plane spatial light modulator consists of a magneto-optic device.

9. The nonlinear joint transform image correlator claimed in claim 7, wherein:

said Fourier plane spatial light modulator consists of a gray scale liquid crystal device operated in saturation.

10. The nonlinear joint transform image correlator claimed in claim 7, further comprising:

a second image detector means located at said Fourier plane of said second Fourier transform lens device, said second image detector means including a plurality of detection cells disposed in a planar array at said Fourier plane, each of said detection cells generating an indication of the light intensity of the correlation signal a said detection cell.

11. The nonlinear joint transform image correlator claimed in claim 1, wherein:

said inverse Fourier transform means includes a computer circuit connected to said thresholding network for forming the inverse Fourier transform of said thresholded indication of the light intensity of said interference of said reference image and said output image.

12. The nonlinear joint transform image correlator claimed in claim 11, wherein:

said inverse Fourier transform means further includes a visual display device connected to said computer circuit for producing a visual display of said inverse Fourier transform of said thresholded indication of the light intensity of said interference of said reference image and said input image formed by said computer circuit.

13. A nonlinear joint transform image correlator comprising:

a joint image production means for producing a collimated joint image of a reference image and an input image;

a first Fourier transform lens device disposed to receive said collimated joint image at an object plane thereof and to produce the interference between the Fourier transforms of said reference image and said input image at a Fourier plane thereof;

an optically addressed spatial light modulator operating in the binary mode including a plurality of nonlinear light modulator cells of high contrast disposed at said Fourier plane of said first Fourier transform lens device, each light modulator cell having a first transparency state if the light intensity thereon is greater than a predetermined threshold value and having a second transparency state of the light intensity thereon is not greater than said predetermined threshold value, thereby transmitting light therethrough based upon the relation of the light intensity of said interference between the Fourier transforms of said reference image and said input image to said predetermined threshold value for each light modulator cell;

an

a second Fourier transform lens device disposed to receive light transmitted from said optically addressed spatial light modulator at an object plane thereof, the correlation output of said nonlinear joint transform image correlator appearing at a Fourier plane thereof.

14. A nonlinear joint transform image correlator comprising:

a joint image production means for producing a collimated joint image of a reference image and an input image;

a first Fourier transform lens device disposed to receive said collimated joint image at an object plane thereof and to produce the interference between the Fourier transforms of said reference image and said input image at a Fourier plane thereof;

an image detector means located at said Fourier plane of said first Fourier transform lens device, said image detector means including a plurality of detection cells disposed in a planar array at said Fourier plane, each of said detection cells generating an indication of the light intensity of said interference of said Fourier transforms of said reference image and said input image at said detection cell;

a threshold device connected to each detection cell of said image detector means for determining if the light intensity detected by each detection cell is within one of three intensity ranges, thereby generating a thresholded indication of the light intensity of said interference of said Fourier transforms of said reference image and said input image at said detection cell; and

inverse Fourier transform means connected to said thresholding means for producing the inverse Fourier transform of said thresholded indication of the light intensity of said interference of said reference image and said input image, said inverse Fourier transform being the correlation between said reference image and said input image.

15. A method of forming a nonlinear joint transform image correlation, comprising the steps of:

producing a collimated joint image of a reference image and an input image;

forming the Fourier transform of said collimated joint image using a first Fourier transform lens device disposed to receive said collimated joint image at an object plane thereof and to produce the interference between the Fourier transforms of said reference image and said input image at a Fourier plane thereof;

detecting the Fourier transform interference intensity at said Fourier plane of said first Fourier transform lens device, including detection of the Fourier transform interference light intensity at a plurality of detection cells disposed in a planar array at said Fourier plane;

determining if the detected light intensity of each cell is greater than a threshold value, thereby generating a thresholded indication of the light intensity of said interference of said Fourier transforms of said reference image and said input image at said detection cell; and

forming the inverse Fourier transform of said thresholded indication of the light intensity of said interference of said reference image and said input image, said inverse Fourier transform being the correlation between said reference image and said input image.

16. The method of forming a nonlinear joint transform image correlation as claimed in claim 15, wherein:

said step of forming the inverse Fourier transform includes

producing a beam of collimated coherent light,

spatial light modulating said collimated coherent light via a plurality of light modulation cells, each light modulation cell operating in a binary mode having a first transparency state if the detected light intensity of a corresponding detection cell is greater than said threshold value and having a second transparency state if the detected light intensity of said corresponding detection cell is not greater than said threshold value,

forming the inverse Fourier transform of said spatial light modulated collimated coherent light using a second Fourier transform lens device disposed to receive said spatial light modulated collimated coherent light at an object plane thereof and to produce the correlation results at a Fourier plane thereof, and

reading the correlation output at said Fourier plane of said second Fourier transform lens system.

17. A method of forming a nonlinear joint transform image correlation, comprising the steps of:

producing a collimated joint image of a reference image and an input image;

forming the Fourier transform of said collimated joint image using a first Fourier transform lens device disposed to receive said collimated joint image at an object plane thereof and to produce the interference between the Fourier transforms of said reference image and said input image at a Fourier plane thereof;

detecting the Fourier transform interference intensity a said Fourier plane of said first Fourier transform lens device, including detection of the Fourier transform interference light intensity at a plurality of detection cells disposed in a planar array at said Fourier plane;

determining if the detected light intensity of each cell is within one of three intensity ranges, thereby generating a thresholded indication of the light intensity of said interference of said Fourier transforms of said reference image and said input image at said detection cell; and

forming the inverse Fourier transform of said thresholded indication of the light intensity of said interference of said reference image and said input image, said inverse Fourier transform being the correlation between said reference image and said input image.