Optical correlator

• US 6,804,412 B1
• Filed: 08/14/2000
• Issued: 10/12/2004
• Est. Priority Date: 12/12/1997
• Status: Expired due to Fees

• Current Assignee: Cambridge Correlators Limited
• Original Assignee: Cambridge Correlators Limited
• Inventors: Wilkinson, Timothy David
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Kassa, Yosef
• Application Number:
  US09/581,466
• Time in Patent Office: 1,520 Days
• Field of Search: 382/209, 382/216, 382/217, 382/218, 382/219, 382/278, 382/284, 382/291, 382/293, 382/295, 382/294, 382/115, 382/116, 382/124, 250/205, 250/559.04, 250/559.05, 358/537, 358/539, 358/540, 340/5.52, 340/5.53, 340/5.1
• US Class Current: 382/278
• CPC Class Codes: G06E 3/00 Devices not provided for in group G06E1/00, e.g. for processing analogue or hybrid data
• CPC Class Codes: G06E 3/005 using electro-optical or opto-electronic means

Abstract

A method is described of optically performing a joint transform correlation starting from images displayed side-by-side on a spatial light modulator illuminated by a collimated light source. The image is focused by a lens onto a camera, the image is recorded by a frame grabber, and processed by a computer. By using a two pass process, the result is a measure of the correlation of the images. The images may be preprocessed in a phase-encoded chequerboard pattern and binarised by thresholding based on the average value of neighbouring pixels.

Claims

1. A method of optical correlation between an input image and a reference image, including the steps of:

Optically performing a joint transform correlation between an input image and a reference image;

displaying the two images side by side as a binary phase image;

modulating the resulting binary phase image with a phase-encoded checkerboard pattern;

displaying the modulated image on a spatial light modulator;

illuminating by a constant light source the spatial light modulator; and

performing a joint transform correlation on the displayed image, the correlation including binarising an intermediate image by thresholding each pixel using values of its surrounding pixels.

2. A method according to claim 1 in which the joint transform correlation is performed by:

obtaining the joint power spectrum (JPS) corresponding to the Fourier transform of the input and reference images, and then

obtaining a correlation image containing information about the correlation between input and reference images by taking the Fourier transform of the JPS.

3. A method according to claim 1, wherein the step of performing a joint transform correlation comprises:

shining collimated light onto the spatial light modulator;

forming an intermediate image of the modulated image on the spatial light modulator through a lens;

recording and processing the intermediate image;

displaying the result on a spatial light modulator;

shining collimated light onto the latter spatial light modulator; and

recording a resulting correlation image of the spatial light modulator through a lens.

4. A method according to claim 1, further comprising the steps of:

forming the intermediate image of the displayed modulated image and recording it with a camera;

processing the intermediate image;

displaying the processed intermediate image on the same spatial light modulator; and

recording the correlation image with the camera to give an indication of the correlation between the input and reference images.

5. A method according to claim 4, further including a step of binarising the intermediate image by thresholding each pixel on the basis of the average value of the surrounding pixels.

6. A method of optical correlation for obtaining a correlation image corresponding to the correlation between an input and a reference image by displaying the input and reference images on a spatial light modulator, and performing a joint transform correlation, including the steps of:

shining collimated light onto the spatial light modulator;

forming an intermediate image of the spatial light modulator through a lens;

recording the intermediate image electronically as a plurality of pixels;

binarising the intermediate image by thresholding each pixel using a value of the surrounding pixels;

displaying the binarised intermediate image on a spatial light modulator; and

shining collimated light onto the spatial light modulator, to obtain the correlation image being the image through a lens of the intermediate image on the latter spatial light modulator.

7. A method according to claim 6, in which the step of binarising the intermediate image is performed by thresholding each pixel on the basis of the mean value of each of the eight surrounding pixels.

8. A joint transform correlator comprising:

an electrically addressed spatial light modulator (SLM) for modulating collimated input light by an input image and a reference image;

a lens;

a camera for capturing modulated light after it has passed through the lens and for producing a signal corresponding thereto; and

a control means for recording the captured image from the modulator and for addressing the spatial light modulator;

wherein the correlator is adapted to operate in a two-pass process to produce a correlation image from the input image and the reference image;

characterized in that the control means is adapted to phase-encode the input image and the reference image using a checkerboard pattern before displaying them on the spatial light modulator.

9. A joint transform correlator according to claim 8, wherein the spatial light modulator is a ferroelectric liquid crystal modulator.

10. A correlator according to claim 9, wherein the ferroelectric liquid-crystal modulator is a binarising liquid crystal modulator with a plurality of pixels each of which can switch between two states outputting light in antiphase with respect to each other.

11. A correlator according to claim 8, wherein the control means is adapted to take the recorded image, to process it and to display the processed image on the spatial light modulator in a second pass, and in turn to output the correlation image.

12. A correlator according to claim 11, wherein the control means is further adapted to binarise the intermediate image by thresholding each pixel on the basis of the mean value of the eight surrounding pixels.

13. A correlator according to claim 8, wherein the camera is a non-linear CMOS detector array.

14. A correlator according to claim 8, wherein the camera is arranged at the focal point of the lens, so that the image recorded by the camera corresponds to the Fourier transform of the image displayed by the spatial light modulator.

15. A method of inspection of products passing a video camera, comprising the steps of:

recording images of the individual products passing the video camera;

displaying pairs of recorded images as input and reference images on a correlator according to claim 8; and

outputting the correlation between the pair of the recorded images as a measure of disturbances in the products.

16. A joint transform correlator comprising:

an electrically addressed spatial light modulator (SLM) for modulating collimated input light by an input image and a reference image;

a lens;

a camera for capturing modulated light after it has passed through the lens and for producing a signal corresponding thereto; and

a control means for recording the captured image from the modulator and for addressing the spatial light modulator;

wherein the correlator is adapted to operate in a two-pass process to produce a correlation image from the input image and the reference image;

characterised in that the control means is further adapted to binarise the intermediate image by thresholding each pixel on the basis of the mean value of the eight surrounding pixels.

17. A joint transform correlator comprising:

an electrically addressed, binarising, ferroelectric liquid crystal modulator with a plurality of pixels each of which can switch between two states outputting light in antiphase with respect to each other for modulating collimated input light by an input image and a reference image;

a lens;

a camera for capturing modulated light after it has passed through the lens and for producing a signal corresponding thereto; and

a control means for recording the captured image from the modulator and for addressing the ferroelectric liquid-crystal spatial light modulator;

wherein the correlator is adapted to operate in a two-pass process to produce a correlation image from the input image and the reference image;

characterized in that the control means is adapted to phase-encode the input image and the reference image using a checkerboard pattern before displaying them on the spatial light modulator.

18. A joint transform correlator comprising:

an electrically addressed spatial light modulator (SLM) for modulating collimated input light by an input image and a reference image;

a lens;

a camera for capturing modulated light after it has passed through the lens and for producing a signal corresponding thereto; and

a control means for recording the captured image from the modulator and for addressing the ferroelectric liquid-crystal spatial light modulator, the control means being adapted to take the recorded image, to process it and to display the processed image on the spatial light modulator in a second pass, and in turn to output the correlation image;

wherein the correlator is adapted to operate in a two-pass process to produce a correlation image from the input image and the reference image;

characterized in that the control means is adapted to phase-encode the input image and the reference image using a checkerboard pattern before displaying them on the spatial light modulator.