Optical pattern recognition apparatus

• US 5,309,523 A
• Filed: 08/18/1992
• Issued: 05/03/1994
• Est. Priority Date: 06/16/1989
• Status: Expired due to Term

• Current Assignee: Seiko Instruments Incorporated (Seiko Group)
• Original Assignee: Seiko Instruments Incorporated (Seiko Group)
• Inventors: Mitsuoka, Yasuyuki, Iwaki, Tadao
• Primary Examiner(s): Razavi, Michael T.
• Assistant Examiner(s): CHANG, JON CARLTON
• Application Number:
  US07/931,893
• Time in Patent Office: 623 Days
• Field of Search: 382/42, 382/43, 382/31, 382/32, 364/822, 359/561
• US Class Current: 382/210
• CPC Class Codes: G06E 3/005 using electro-optical or opto-electronic means
• CPC Class Codes: G06V 10/92 using spatial domain filters, e.g. joint transform correlators

Abstract

In a joint transform correlator utilizing a spatial optic modulator, depending on the light intensity of each correlation peak obtained from optical correlation processing between at least one reference image and at least one input image, the light intensity passing through each reference image corresponding to each correlation peak is substantially adjusted so as to constitute a feedback system. By such construction, when processing a relatively large number of input or reference images, the correlator can avoid failure of recognition due to the reduction of light intensity of the correlation peaks and can avoid erroneous recognition to enable fast pattern recognition.

Claims

1. An optical pattern recognition apparatus for applying optical correlation processing using coherent light to a two-dimensional image so as to automatically recognize and measure a particular pattern, comprising:

means for converting at least three images comprised of at least one reference image and at least one input image into a joint coherent image;

means for Fourier transforming the joint coherent image to produce a joint Fourier transform image of each said reference image and each said input image;

means including a spatial light modulator of the light addressed type for converting the joint Fourier transform image into an intensity distribution image and recording the same on the spatial light modulator;

means for reading the image recorded in the spatial light modulator of the light addressed type by using coherent light;

means for Fourier transforming the read image into a correlation image;

means for converting the correlation image into correlation signals;

means for processing the correlation, signals to determine a correlation coefficient between each said reference image and each said input image; and

means including another spatial light modulator adjacent to a plane of each said reference image for changing the intensity of the coherent light passing through the plane of each said reference image before the joint coherent image is Fourier transformed again by the means for Fourier transforming the joint coherent image, the intensity of the coherent light being changed according to the determined correlation coefficient between each said reference image and each said input image to thereby effect correction of the correlation coefficient through feedback.

2. An optical pattern recognition apparatus for applying optical correlation processing using coherent light to a two-dimensional image so as to automatically recognize and measure a particular pattern, comprising:

means for converting at least three images comprised of at least one reference image and at least one input image into a joint coherent image;

means for Fourier transforming the joint coherent image to produce a joint Fourier transform image of each said reference image and each said input image;

means for converting the joint Fourier transform image into an intensity distribution signal;

means including a spatial light modulator of the electrically addressed type receptive of the intensity distribution signal for recording an intensity distribution image corresponding to the intensity distribution signal;

means for reading the image recorded in the spatial light modulator of the electrically addressed type by using coherent light;

means for Fourier transforming the read image into a correlation image;

means for converting the correlation image into correlation signals;

means for processing the correlation signals to determine a correlation coefficient between each said reference image and each said input image; and

means including another spatial light modulator adjacent to a plane of each said reference image for changing an intensity of the coherent light passing through the plane of each said reference image before the joint coherent image is Fourier transformed again by the means for Fourier transforming the joint coherent image, the intensity of the coherent light being changed according to the determined correlation coefficient between each said reference image and each said input image to thereby effect correction of the correlation coefficient through feedback.

3. An optical pattern recognition apparatus for applying optical correlation processing using coherent light to a two-dimensional image so as to automatically recognize and measure a particular pattern, comprising:

means for converting at least three images comprised of at least one reference image and at least one input image into a joint coherent image;

means for Fourier transforming the joint coherent image to produce a joint Fourier transform image of each said reference image and each said input image;

means including a binary spatial light modulator for converting the joint Fourier transform image into a binarized intensity distribution image and for recording the binarized intensity distribution image on the binary spatial light modulator;

means for reading the binarized intensity distribution image on the spatial light modulator by using coherent light;

means for further Fourier transforming the read binarized intensity distribution image into a correlation image;

means for converting the correlation image into correlation signals;

means for processing the correlation signals to determine a correlation coefficient between at least one said reference image and at least one said input image; and

means including another spatial light modulator adjacent to a plane of each said reference image for changing an intensity of the coherent light passing through the plane of each said reference image before the joint coherent image is Fourier transformed again by the means for Fourier transforming the joint coherent image, the intensity of the coherent light being changed according to the determined correlation coefficient between each said reference image and each said input image to thereby effect correction of the correlation coefficient through feedback.

4. An optical pattern recognition apparatus according to claim 3;

wherein the means for converting the joint Fourier transform image into the binarized intensity distribution image and for recording the binarized intensity distribution image on the binary spatial light modulator includes an image sensor for detecting the joint Fourier transform image to convert the same into a corresponding electrical signal, means for binarizing the electrical signal, and a spatial light modulator to the electrically addressed type for recording the binarized intensity distribution image according to the electrical signal.

5. An optical pattern recognition apparatus according to claim 3;

wherein the means for converting the joint Fourier transform image into the binarized intensity distribution image and for recording the binarized intensity distribution image on the binary spatial light modulator includes a binary spatial light modulator of the light addressed type containing a ferroelectric liquid crystal having bistable memory characteristic between optical reflectivity and an applied voltage for receiving the joint Fourier transform image and for directly binarizing the same to record the binarized results.

14. An optical pattern recognition apparatus according to claim 3;

wherein the other spatial light modulator adjacent to a plane of the reference images includes means for changing the intensity of the coherent light passing through the plane of the reference images in nonlinear relation to the determined correlation coefficient to thereby effect correction of the correlation coefficient through feedback.

6. An optical pattern recognition apparatus for applying optical correlation processing using coherent light to two-dimensional image so as to automatically recognize and measure a particular pattern, comprising:

means for converting at least three images comprised of at least one reference image and at least one input image into a joint coherent image;

means for Fourier transforming the joint coherent image to produce a joint Fourier transform image of each said reference image and each said input image;

means including a spatial light modulator for converting the joint Fourier transform image into an intensity distribution image and recording the same on the spatial light modulator;

means for reading the intensity distribution image recorded on the spatial light modulator by using coherent light;

means for Fourier transforming the read intensity distribution image into a correlation image;

means for converting the correlation image into correlation signals;

means for processing the correlation signals to determine a correlation coefficient between each said reference image and each said input image; and

means including a masking device adjacent to a plane of each said reference image for changing the intensity of the coherent light passing through the plane of each said reference image before the joint coherent image is Fourier transformed again by the means for Fourier transforming the joint coherent image, the intensity of the coherent light being changed according to one of (1) a segment ratio of each said reference image and each said input image, and (2) an incident light intensity component through each said reference image, so as to normalize a Fourier transform intensity for each said reference image.

7. An optical pattern recognition apparats according to claim 6;

wherein the masking device comprises an electrically addressed spatial light modulator disposed before or after the reference image plane.

8. An optical pattern recognition apparatus according to claim 7;

wherein the masking device includes means for controlling light intensity of a coherent beam passing through each section of the reference image plane according to the determined correlation coefficient to thereby effect correction of the correlation coefficient through feedback.

9. An optical pattern recognition apparatus according to claim 6;

wherein the means for converting the joint Fourier transform image into the intensity distribution image and for recording the same on the spatial light modulator includes means for converting the joint Fourier transform image into a binarized intensity distribution image and for displaying the binarized intensity distribution image on a binary spatial light modulator.

10. An optical pattern recognition apparatus according to claim 7;

wherein the means for converting the joint Fourier transform image into the intensity distribution image and for recording the same on the spatial light modulator includes means for converting the joint Fourier transform image into a binarized intensity distribution image and for displaying the binarized intensity distribution image on a binary spatial light modulator.

11. An optical pattern recognition apparatus according to claim 8;

wherein the means for converting the joint Fourier transform image into the intensity distribution image and for recording the same on the spatial light modulator includes means for converting the joint Fourier transform image into a binarized intensity distribution image and for displaying the binarized intensity distribution image on a binary spatial light modulator.

12. An optical pattern recognition apparatus according to claim 9;

wherein the means for converting the joint Fourier transform image into the binarized intensity distribution image and for recording the same includes a binary spatial light modulator of the light addressed type having ferroelectric liquid crystal which exhibits bistable memory characteristic of optical reflectivity in response to an applied voltage.

15. An optical pattern recognition apparatus according to claim 8;

wherein the masking device adjacent to a plane of the reference images includes means for changing an intensity of the coherent light passing through the plane of the reference images in a nonlinear relation to the determined correlation coefficient to thereby effect correction of the correlation coefficient through feedback.

17. An optical pattern recognition apparatus according to claim 15;

wherein the nonlinear relation can be represented by one of a saturation function, a step function having at least one stage, and the combination thereof.

13. An optical pattern recognition apparatus for applying optical correlation processing using coherent light to a two-dimensional image so as to automatically recognize and measure a particular pattern, comprising:

means for converting at least three images comprised of at least one reference image and at least one input image into a joint coherent image;

means for Fourier transforming the joint coherent image to produce a joint Fourier transform image of each said reference image and each said input image;

means including a spatial light modulator for converting the joint Fourier transform image into an intensity distribution image and for recording the intensity distribution image on the spatial light modulator;

means for reading the intensity distribution image recorded on the spatial light modulator by using coherent light;

means for Fourier transforming the read intensity distribution image into a correlation image;

means for converting the correlation image into correlation signals;

means for processing the correlation signals to determine a correlation coefficient between each said reference image and each said input image; and

means including a masking spatial light modulator adjacent to a plane of each said reference image for changing an intensity of the coherent light passing through the plane of each said reference image before the joint coherent image is Fourier transformed again by the means for Fourier transforming the joint coherent image, the intensity of the coherent light being changed in a nonlinear relation to the determined correlation coefficient between each said reference image and each said input image to thereby effect correction of the correlation coefficient through feedback.

16. An optical pattern recognition apparatus according to claim 13;

wherein the nonlinear relation can be represented by one of a saturation function, a step function having at least one stage, and the combination thereof.

18. An apparatus for optical pattern recognition by iterative processing, comprising:

first converting means for converting at least three images comprised of at least one reference image and at least one input image into a joint image;

first transforming means for Fourier transforming the joint image into a Fourier transform image;

recording means for perceiving and recording the Fourier transform image as an intensity distribution image;

reading means for reading the intensity distribution image from the recording means and Fourier transforming the read image into a correlation image;

computing means receptive of the correlation image for determining a correlation coefficient for each said reference image correlated with each said input image and producing a correlation signal in response thereto;

feed-back means operable with each iteration for changing the light intensity of each said reference image before the joint image is Fourier transformed again by the first transforming means, the light intensity being changed in response to the correlation signal so as to correspondingly alter the perception of each said reference image by said recording means to thereby effect optical pattern recognition to each said input image by repetitively reducing with each iteration the perception of each said reference image that does not have the highest corresponding correlation coefficient.

19. An apparatus for optical pattern recognition according to claim 18;

wherein said recording means includes binarizing means for recording the Fourier transform image as a binary intensity distribution image.

20. An apparatus for optical pattern recognition according to claim 18;

wherein said recording means includes a first spatial light modulator of the light addressed type having ferroelectric liquid crystal for recording the Fourier transform image as a binary intensity distribution image.

21. An apparatus for optical pattern recognition according to claim 20;

wherein said feed-back means includes a second spatial light modulator receptive of the correlation signal for changing the light intensity of each reference image.

26. An apparatus for optical pattern recognition according to claim 18;

wherein the first converting means includes means for converting a plurality of reference images each having a light intensity and a size, and said at least one input image, into a joint image.

27. An apparatus for optical pattern recognition according to claim 18;

wherein the recording means includes means for recording the Fourier transform image as an analog intensity distribution image.

22. An apparatus for optical pattern recognition according to claim 22;

wherein said computing means includes normalizing means for determining a normalized value for each respective said correlation coefficient based on the size of each said reference image, and said computing means produces the correlation signal in response to the normalized value and the correlation coefficient corresponding to each said reference image.

23. An apparatus for optical pattern recognition according to claim 22;

wherein said computing means includes transfer function computing means to determine the correlation signal based on a saturation transfer function.

24. An apparatus for optical pattern recognition according to claim 22;

wherein said computing means includes transfer function computing means to determine the correlation signal based on a step transfer function.

25. An apparatus for optical pattern recognition according to claim 22;

wherein said computing means includes transfer function computing means to determine the correlation signal based on a combination of a step transfer function and a saturation transfer function.