Inspection method and apparatus for the inspection of either random or repeating patterns
First Claim
1. In an inspection system for detecting defects in a device having either random, repeating or mixed patterns thereon, said inspection system includes first and second fields of view each positioned along a different optic axis, the first field of view creates a first spatial domain pixel map of a portion of a first device on a first substrate;
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
said second spatial domain pixel map is developed from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a pattern on a second substrate;
a method for detecting defects in said first device in said first field of view comprising the steps of;
(a) transforming said first and second spatial domain pixel maps from said first and second fields of view using a two dimensional Fourier like transform to convert said first and second spatial domain pixel maps from the spatial domain to first and second frequency domain pixel maps, respectively;
(b) identifying those frequencies in both dimensions having amplitude maxima in the frequency domain of said first and second frequency domain pixel maps with any repeating pattern of each of said first and second frequency domain pixel maps from said first and second fields of view occurring at those frequencies in the frequency domain;
(c) entering zero values for the amplitudes at the frequencies identified in step (b) in both dimensions to remove any repeating pattern of each of said first and second frequency domain pixel maps said first and second fields of view creating first and second amplitude modified frequency domain pixel maps;
(d) conjugating one of said first and second frequency domain pixel maps of said first and second fields of view from step (a);
(e) multiplying the conjugated one of said first and second frequency domain pixel maps from step (d) with the other one of said first and second frequency domain pixel maps of step (a) that was not conjugated in step (d);
(f) inverse transforming the multiplication result of step (e) using the inverse of the two dimensional Fourier like transformation of step (a) to create the correlation surface of the patterns of said first and second spatial domain pixel maps of said first and second fields of view, said correlation surface is a function of the spatial offset between said patterns;
(g) identifying the peaks of the correlation surface of step (f) along both the x and y axis, the location of those peaks representing the offset, Δ
x and Δ
y, between said first and second spatial domain pixel maps of first and second fields of view;
(h) trigonometrically altering one of said first and second modified frequency domain pixel maps from step (c) using the Δ
x and Δ
y axis offset values of step (g); and
(i) inverse transforming the trigonometrically alerted one of said first and second modified frequency domain pixel maps from step (h) and the non-trigonometericaly altered one of said first and second modified frequency domain pixel maps from step (c) using the inverse of the two dimensional Fourier like transformation of step (a) to obtain first and second modified and aligned spatial domain pixel maps of said first and second fields of view with repeating patterns removed.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention is a hybrid technique for finding defects on digitized device images using a combination of spatial domain and frequency domain techniques. The two dimensional spectra of two images are found using Fourier like transforms. Any strong harmonics in the spectra are removed, using the same spectral filter on both spectra. The images are then aligned, transformed back to the spatial domain, and subtracted. The resulting spectrally-filtered difference image is thresholded and analyzed for defects. Use of the hybrid technique of the present invention to process digitized images results in the highest-performance and most flexible defect detection system. It is the best performer on both array and random devices, and it can cope with problems such as shading variations and the dark-bright problem that no other technique can address. The hybrid technique of the present invention also uses frequency domain techniques to align the images with fewer errors than spatial domain techniques of similar or lesser complexity. Further, the relative offsets of the pairs of images are determined by frequency domain techniques--and this method may be the most accurate and the least expensive.
206 Citations
30 Claims
-
1. In an inspection system for detecting defects in a device having either random, repeating or mixed patterns thereon, said inspection system includes first and second fields of view each positioned along a different optic axis, the first field of view creates a first spatial domain pixel map of a portion of a first device on a first substrate;
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
said second spatial domain pixel map is developed from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a pattern on a second substrate;
a method for detecting defects in said first device in said first field of view comprising the steps of;(a) transforming said first and second spatial domain pixel maps from said first and second fields of view using a two dimensional Fourier like transform to convert said first and second spatial domain pixel maps from the spatial domain to first and second frequency domain pixel maps, respectively; (b) identifying those frequencies in both dimensions having amplitude maxima in the frequency domain of said first and second frequency domain pixel maps with any repeating pattern of each of said first and second frequency domain pixel maps from said first and second fields of view occurring at those frequencies in the frequency domain; (c) entering zero values for the amplitudes at the frequencies identified in step (b) in both dimensions to remove any repeating pattern of each of said first and second frequency domain pixel maps said first and second fields of view creating first and second amplitude modified frequency domain pixel maps; (d) conjugating one of said first and second frequency domain pixel maps of said first and second fields of view from step (a); (e) multiplying the conjugated one of said first and second frequency domain pixel maps from step (d) with the other one of said first and second frequency domain pixel maps of step (a) that was not conjugated in step (d); (f) inverse transforming the multiplication result of step (e) using the inverse of the two dimensional Fourier like transformation of step (a) to create the correlation surface of the patterns of said first and second spatial domain pixel maps of said first and second fields of view, said correlation surface is a function of the spatial offset between said patterns; (g) identifying the peaks of the correlation surface of step (f) along both the x and y axis, the location of those peaks representing the offset, Δ
x and Δ
y, between said first and second spatial domain pixel maps of first and second fields of view;(h) trigonometrically altering one of said first and second modified frequency domain pixel maps from step (c) using the Δ
x and Δ
y axis offset values of step (g); and(i) inverse transforming the trigonometrically alerted one of said first and second modified frequency domain pixel maps from step (h) and the non-trigonometericaly altered one of said first and second modified frequency domain pixel maps from step (c) using the inverse of the two dimensional Fourier like transformation of step (a) to obtain first and second modified and aligned spatial domain pixel maps of said first and second fields of view with repeating patterns removed. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
-
9. An inspection system to detect defects in a device having either random, repeating or mixed patterns thereon comprising:
-
a processor to control the operation of said inspection system; first and second optic systems to provide first and second fields of view each under control of said processor and each defines a different optic axis, the first field of view of said first optic system creates a first spatial domain pixel map of a portion of a first device on a first substrate, and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a second substrate pattern; a transform system coupled to said first and second optic systems under control of said processor to individually identify and remove repeating patterns from each of said first and second spatial domain pixel maps, said transform system includes; a two dimensional Fourier like transformer coupled to said first and second optic systems to receive said first and second spatial domain pixel maps to individually transform them into first and second frequency domain pixel maps, respectively; a harmonic trimmer coupled to said Fourier like transformer to receive said first and second frequency domain pixel maps and to individually determine the frequencies present in said first and second frequency domain pixel maps in both dimensions having amplitude maxima in the frequency domain and individually zeroing out the values at the frequencies at which the maxima values are detected to create first and second modified frequency domain pixel maps, respectively; and a first two dimensional inverse Fourier like transformer coupled to said harmonic trimmer to receive said first and second modified frequency domain pixel maps to individually transform said first and second modified frequency domain pixel maps using the inverse of a two dimensional Fourier like transform used by said Fourier like transformer to obtain first and second modified spatial domain pixel maps without the repeating patterns of said first and second spatial domain pixel maps; a conjugator coupled to said Fourier like transformer to receive one of said first and second frequency domain pixel maps and under control of said processor to conjugate the received one of said first and second frequency domain pixel maps; a multiplier coupled to said conjugator and said Fourier like transformer to receive the other one of said first and second frequency domain pixel maps than that received by said conjugator, under control of said processor, to multiply said conjugated one of first and second frequency domain pixel maps from said conjugator with the other of said first and second frequency domain pixel maps received from said Fourier like transformer to create a multiplied frequency domain pixel map; a second inverse Fourier like transformer couple to said multiplier to receive said multiplied frequency domain pixel map to inverse transform said multiplied frequency domain pixel map using the inverse of the Fourier like transform used by said Fourier like transformer to create a correlation surface of the patterns of said first and second spatial domain pixel maps, said correlation surface being a function of the spatial offset between said first and second spatial domain pixel maps; a peak detector coupled to said second inverse Fourier like transformer to receive said correlation surface to identify the peaks of said correlation surface along both the x and y axis with the location of those peaks representing the offset, Δ
x and Δ
y, between said first and second spatial domain pixel maps; anda shifting filter coupled to said peak detector to receive said offset, Δ
X and Δ
y, and said harmonic trimmer to receive one of said first and second modified frequency domain pixel map to trigonometrically alter the two dimensional sinusoids of the received one of said first and second modified frequency domain pixel maps using the Δ
x and Δ
y axis offset values identified by said peak detector to align the received one of said first and second modified frequency domain pixel maps with the other of said first and second modified frequency domain pixel maps.
-
-
10. In an inspection system for detecting defects in a device having either random, repeating or mixed patterns thereon, said inspection system includes first and second fields of view each positioned along a different optic axis, the first field of view creates a first spatial domain pixel map of a portion of a first device on a first substrate;
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
said second spatial domain pixel map is developed from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a pattern on a second substrate;
a method for detecting defects in said first device in said first field of view comprising the steps of;(a) transforming said first and second spatial domain pixel maps from said first and second fields of view using a two dimensional Fourier like transform to convert said first and second spatial domain pixel maps from the spatial domain to first and second frequency domain pixel maps, respectively; (b) identifying those frequencies in both dimensions having amplitude maxima in the frequency domain of said first and second frequency domain pixel maps with any repeating pattern of each of said first and second frequency domain pixel maps from said first and second fields of view occurring at those frequencies in the frequency domain; (c) entering zero values for the amplitudes at the frequencies identified in step (b) in both dimensions to remove any repeating pattern of each of said first and second frequency domain pixel maps said first and second fields of view creating first and second amplitude modified frequency domain pixel maps; (d) inverse transforming said first and second amplitude modified frequency domain pixel maps from step (c) using the inverse of the two dimensional Fourier like transformation of step (a) to obtain first and second modified spatial domain pixel maps that are substantially equivalent to said first and second spatial domain pixel maps of said first and second fields of view with any repeating patterns removed; (e) subtracting one of said first and second modified spatial domain pixel maps of step (d) from the other of said first and second modified spatial domain pixel maps of step (d) to form a difference spatial domain pixel map that only substantially contains any combined noise and defects of said first and second spatial domain pixel maps; (f) filtering, individually, each of said first and second modified spatial domain pixel maps of step (d) and said difference spatial domain map of step (e) using a threshold amplitude that is above the noise level and below the defect level of each of said first and second modified spatial domain pixel map and said difference spatial domain pixel map to remove defect shadows introduced by the inverse transformation step (d) where each defect shadow is an integral multiple of each defect with the shadows further being of the opposite color from a real defect and of a lessor amplitude, said filtering producing a first and a second further modified spatial domain pixel map each including any random pattern and defects for the corresponding one of said first and second spatial domain pixel maps, and a modified difference spatial domain pixel map including only defects for each of said first and second spatial domain pixel maps; and (g) comparing said first further modified spatial domain pixel map, said second further modified spatial domain pixel map and said modified difference spatial domain pixel map, each from step (f), to determine the defects present in said first spatial pixel map in said first field of view. - View Dependent Claims (11, 12, 13, 14, 15, 16)
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
-
17. In an inspection system for detecting defects in a device having either random, repeating or mixed patterns thereon, said inspection system includes first and second fields of view each positioned along a different optic axis, the first field of view creates a first spatial domain pixel map of a portion of a first device on a first substrate;
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
said second spatial domain pixel map is developed from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a pattern on a second substrate;
a method for detecting defects in said first device in said first field of view comprising the steps of;(a) transforming said first and second spatial domain pixel maps from said first and second fields of view using a two dimensional Fourier like transform to convert said first and second spatial domain pixel maps from the spatial domain to first and second frequency domain pixel maps, respectively; (b) identifying those frequencies in both dimensions having amplitude maxima in the frequency domain of said first and second frequency domain pixel maps with any repeating pattern of each of said first and second frequency domain pixel maps from said first and second fields of view occurring at those frequencies in the frequency domain; (c) entering zero values for the amplitudes at the frequencies identified in step (b) in both dimensions to remove any repeating pattern of each of said first and second frequency domain pixel maps said first and second fields of view creating first and second amplitude modified frequency domain pixel maps; (d) subtracting one of said first and second amplitude modified frequency domain pixel maps of step (c) from the other of said first and second amplitude modified frequency domain pixel maps of step (c) to form a difference frequency domain pixel map that contains only the combined noise and defects of said first and second frequency domain pixel maps; (e) individually inverse transforming said first and second amplitude modified frequency domain pixel maps from step (c) using the inverse of the two dimensional Fourier like transformation of step (a) to obtain first and second modified spatial domain pixel maps of said first and second fields of view with any repeating patterns of said first and second spatial domain pixel maps removed; (f) inverse transforming said difference frequency domain pixel map from step (d) using the inverse of the two dimensional Fourier like transformation of step (a) to obtain a difference spatial domain pixel map that contains only the combined noise and defects of said first and second spatial domain pixel maps; (g) filtering, individually, each of said first and second modified spatial domain pixel maps of step (e) and said difference spatial domain map of step (f) using a threshold amplitude that is above the noise level and below the defect level of each of said first and second modified spatial domain pixel maps and said difference spatial domain map to remove defect shadows introduced by the inverse transformation steps (e) and (f) where each defect shadow is an integral multiple of each defect with the shadows further being of the opposite color from the real defect and of a lessor amplitude, said filtering producing a first and a second further modified spatial domain pixel map each including any random pattern and defects for the corresponding one of said first and second spatial domain pixel maps, and a modified difference spatial domain pixel map including only defects for each of said first and second spatial domain pixel maps; and (h) comparing said first further modified spatial domain pixel map, said second further modified spatial domain pixel map and said modified difference spatial domain pixel map, each from step (g), to determine the defects present in said first spatial domain pixel map in said first field of view. - View Dependent Claims (18, 19, 20, 21, 22, 23)
- and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked;
-
24. An inspection system to detect defects in a device having either random, repeating or mixed patterns thereon comprising:
-
a processor to control the operation of said inspection system; first and second optic systems to provide first and second fields of view each under control of said processor and each defines a different optic axis, the first field of view of said first optic system creates a first spatial domain pixel map of a portion of a first device on a first substrate, and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a second substrate pattern; a transform system coupled to said first and second optic systems under control of said processor to identify and remove repeating patterns from each of said first and second spatial domain pixel maps, said transform system includes; a two dimensional Fourier like transformer coupled to said first and second optic systems to receive said first and second spatial domain pixel maps to individually transform them into first and second frequency domain pixel maps, respectively; a harmonic trimmer coupled to said Fourier like transformer to receive said first and second frequency domain pixel maps and to individually determine the frequencies present in said first and second frequency domain pixel maps in both dimensions having amplitude maxima in the frequency domain and individually zeroing out the values at the frequencies at which the maxima values are detected to create first and second modified frequency domain pixel maps, respectively; and a first two dimensional inverse Fourier like transformer coupled to said harmonic trimmer to receive said first and second modified frequency domain pixel maps to individually transform said first and second modified frequency domain pixel maps using the inverse of a two dimensional Fourier like transform used by said Fourier like transformer to obtain first and second modified spatial domain pixel maps without the repeating patterns of said first and second spatial domain pixel maps; a subtractor coupled to said first inverse Fourier like transformer to receive said first and second modified spatial domain pixel maps under control of said processor to subtract one of said first and second modified spatial domain pixel maps from the other of said first and second modified spatial domain pixel maps to form a difference spatial domain pixel map that only substantially contains the combined noise and defects of both of said first and second modified spatial domain pixel maps; first, second and third threshold filters, said first and second threshold filters individually connected to said first inverse Fourier like transformer to received said first and second modified spatial domain pixel maps, respectively, and said third threshold filter coupled to said subtractor to receive said difference spatial domain pixel map, said first second and third threshold filters to each individually filter said first modified spatial domain pixel map, said second modified spatial domain pixel map and said difference spatial domain pixel map using a threshold amplitude that is selected to be above the noise level and below the defect level, to remove defect shadows introduced by said first and second inverse Fourier like transformers where each defect shadow is an integral multiple of each defect with the shadows further being of the opposite color from the real defect and of a lessor amplitude, to individually create first and second further modified spatial domain pixel maps and a modified difference spatial domain pixel map, respectively, said first and second further modified spatial domain pixel maps each includes the random and defects for each of said first and second spatial domain pixel maps, respectively, and said modified difference spatial domain pixel map contains only defects for each of said first and second spatial dominant pixel maps; and defect analyzer coupled to said first, second and third threshold filters to receive said first and second further modified spatial domain pixel maps and said modified difference spatial domain pixel map from which to compare said first further modified spatial domain pixel map, said second further modified spatial domain pixel map and said modified difference spatial domain pixel map to determine the defects present in said first spatial domain pixel map. - View Dependent Claims (25, 26, 27)
-
-
28. An inspection system to detect defects in a device having either random, repeating or mixed patterns thereon comprising:
-
a processor to control the operation of said inspection system; first and second optic systems to provide first and second fields of view each under control of said processor and each defines a different optic axis, the first field of view of said first optic system creates a first spatial domain pixel map of a portion of a first device on a first substrate, and said second field of view provides a second spatial domain pixel map against which said first spatial domain pixel map is to be checked from one of a pre-stored pixel map of a desired pattern, a scaled drawing of a desired pattern, a repeating pattern within said first device in said first field of view, a pattern within a second device on said first substrate as in said first field of view, and a second substrate pattern; a transform system coupled to said first and second optic systems under control of said processor to identify and remove repeating patterns from each of said first and second spatial domain pixel maps, said transform system includes; a two dimensional Fourier like transformer coupled to said first and second optic systems to receive said first and second spatial domain pixel maps to individually transform them into first and second frequency domain pixel maps, respectively; a harmonic trimmer coupled to said Fourier like transformer to receive said first and second frequency domain pixel maps and to individually determine the frequencies present in said first and second frequency domain pixel maps in both dimensions having amplitude maxima in the frequency domain and individually zeroing out the values at the frequencies at which the maxima values are detected to create first and second modified frequency domain pixel maps, respectively; and a first two dimensional inverse Fourier like transformer coupled to said harmonic trimmer to receive said first and second modified frequency domain pixel maps to individually transform said first and second modified frequency domain pixel maps using the inverse of a two dimensional Fourier like transform used by said Fourier like transformer to obtain first and second modified spatial domain pixel maps without the repeating patterns of said first and second spatial domain pixel maps; a subtractor coupled to said harmonic trimmer to receive said first and second modified frequency domain pixel maps under control of said processor to subtract one of said first and second modified frequency domain pixel maps from the other of said first and second modified frequency domain pixel maps to form a difference frequency domain pixel map that only substantially contains the combined noise and defects of both of said first and second modified frequency domain pixel maps; and a second two dimensional inverse Fourier like transformer, using the inverse of a two dimensional Fourier like transform used by said Fourier like transformer, coupled to said subtractor to receive said difference frequency domain pixel map under control of said processor to transform said difference frequency domain pixel map to the spatial domain as a difference spatial domain pixel map; first, second and third threshold filters, said first and second threshold filters individually connected to said first inverse Fourier like transformer to received said first and second modified spatial domain pixel maps, respectively, and said third threshold filter coupled to said second inverse Fourier like transformer to receive said difference spatial domain pixel map, said first second and third threshold filters to each individually filter said first modified spatial domain pixel map, said second modified spatial domain pixel map and said difference spatial domain pixel map using a threshold amplitude that is selected to be above the noise level and below the defect level, to remove defect shadows introduced by said first and second inverse Fourier like transformers where each defect shadow is an integral multiple of each defect with the shadows further being of the opposite color from the real defect and of a lessor amplitude, to individually create first and second further modified spatial domian pixel maps and a modified difference spatial domain pixel map, respectively, said first and second further modified spatial domain pixel maps each includes the random and defects for each of said first and second spatial domain pixel maps, respectively, and said modified difference spatial domain pixel map contains only defects for each of said first and second spatial domain pixel maps; and defect analyzer coupled to said first, second and third threshold filters to receive said first and second further modified spatial domain pixel maps and modified difference spatial domain pixel map to compare said first further modified spatial domain pixel map, said second further modified spatial domain pixel map and said modified difference spatial domain pixel map to determine the defects present in said first spatial domain pixel map. - View Dependent Claims (29, 30)
-
Specification