System and method for automatic optical inspection

• US 5,483,603 A
• Filed: 10/17/1994
• Issued: 01/09/1996
• Est. Priority Date: 10/22/1992
• Status: Expired due to Term

• Current Assignee: Advanced Interconnection Technology, LLC
• Original Assignee: Advanced Interconnection Technology, LLC
• Inventors: Creavin, Damien W. P., Luke, Edward P., Reetz, Robert R.
• Primary Examiner(s): Mancuso, Joseph
• Application Number:
  US08/324,454
• Time in Patent Office: 449 Days
• Field of Search: 382/8, 382/30, 382/34, 382/17, 382/87, 382/141, 382/145, 382/147, 382/162, 382/165, 382/209, 382/217, 382/218, 348/87, 348/42, 348/126, 348/179
• US Class Current: 382/147
• CPC Class Codes: G01R 31/308 using non-ionising electromagnetic radiation, e.g. optical radiation investigating or analysing materials by the use of optical means G01N21/00; image analysis G06T7/00
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30141 Printed circuit board [PCB]
• CPC Class Codes: G06T 7/0004 Industrial image inspection

Abstract

An optical inspection system for inspecting faults on circuit boards like printed circuit boards and wire scribed circuit boards is disclosed. A video camera for receiving desired images of hole sites on a wire circuit board is provided. The camera converts each image to electrical video signals. A frame grabber converts electrical video signals to a plurality of pixels and stores information representing color element values contained in each of the pixels. A panel feature detector receives the color element values of the pixel that has to be analyzed and provides a wire indication when the color element value of the pixel corresponds to the wire feature. A fault detector circuit receives the wire indication from the panel feature detector corresponding to predetermined pixels associated with the hole site for determining faults on the circuit board.

Claims

1. An optical inspection system for detecting faults at potential hole sites of a wire scribed circuit board having a plurality of wires scribed on a substrate, comprising:

a video camera for receiving images of desired hole sites on said wire scribed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing color element values indicative of the chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a wire indication when said color element values of said pixel correspond to a wire feature;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with a hole site to be analyzed; and

an open detector circuit receiving said wire indication from said panel feature detector corresponding to said predetermined pixels associated with said hole site, said open detector determining whether an open circuit could occur when said hole site is drilled;

wherein said pixel retrieve controller further comprises an open scan table associated with a hole site having a plurality of corresponding scan lines said open scan table for each said scan line storing boundary values for an open circuit region, where said boundary values are used to derive said command signals.

2. The system according to claim 1 further comprising:

a keepout detector circuit receiving said wire indication from said panel feature detector corresponding to said predetermined pixels associated with said hole site, said keepout detector circuit determining whether no wire is crossing said hole site.

3. The system according to claim 2 wherein said pixel retrieve controller further comprises:

a keepout scan table associated with a hole site having a plurality of corresponding scan lines said keepout scan table for each said scan line storing;

the number of pixels from said vertical diameter crossing through said hole site to the circle formed by a keepout reticle.

4. The system according to claim 2 wherein said predetermined pixels correspond to a keepout reticle superimposed on said hole site and said keepout detector further comprises:

a wire pixel counter; and

a comparator for determining whether the number of wire pixels detected in said keepout reticle are less than a predetermined threshold.

5. The system according to claim 1 wherein said image storage memory comprises a frame grabber providing data on a scan line basis to a pixel row buffer, said pixel row buffer retaining information of all pixels contained in a scan line and providing said information to paid panel feature detector on a pixel by pixel basis.

6. The system according to claim 1 wherein said boundary values include the number of pixels from said vertical diameter crossing through said hole site to a circle formed by said open circuit region.

7. The system according to claim 1 wherein said predetermined pixels correspond to said open circuit region superimposed on said hole site and said open detector circuit further comprises:

a wire pixel counter; and

a comparator for determining whether the number of wire pixels detected in said open circuit region is above a predetermined threshold.

8. The system according to claim 1 wherein said panel feature detector further comprises:

a wire look up table representing a three dimensional RGB space, said wire look up table addressed by a number corresponding to the magnitude of said color element values of a pixel provided by said image storage memory, wherein said wire indication is provided when said magnitudes of said color element values correspond to a wire feature.

9. The system according to claim 1 wherein said panel feature detector further comprises:

an RGB to hue extractor receiving the RGB values corresponding to each pixel being analyzed and providing a hue component corresponding to said pixel being analyzed; and

a threshold adjuster having a first and a second hue parameter defining a range of hue values such that said pixel being analyzed is attributed to a wire pixel when the value of said hue component corresponding to said pixel being analyzed is within said range of hue values.

10. The system according to claim 1 wherein said panel feature detector further comprises:

a neural network having an input layer containing three nodes with linear transfer functions for distributing incoming RGB data corresponding to a pixel to be analyzed to the rest of said neural network;

a plurality of hidden layers containing a plurality of nodes, each node having connections to predetermined nodes in following layers;

an output node providing said wire indication indicating whether said pixel to be analyzed is a wire pixel or a substrate pixel.

11. The system according to claim 10 wherein said neural network is a two hidden layer fully connected feed forward network.

12. An optical inspection system for detecting faults at potential hole sites of a wire scribed circuit board having a plurality of wires scribed on a substrate, comprising:

a video camera for receiving images of desired hole sites on said wire scribed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing color element values indicative of a chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a wire indication when said color element values of said pixel correspond to a wire feature;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with a hole site to be analyzed; and

a short detector circuit receiving said wire indication from said panel feature detector corresponding to said predetermined pixels associated with said hole site, said short detector circuit determining whether a short circuit could occur when said hole site is drilled;

wherein said pixel retrieve controller further comprises a short scan table associated with a hole site having a plurality of corresponding scan lines said short scan table for each said scan line storing boundary values for a short circuit region, where said boundary values are used to derive said command signals.

13. The system according to claim 12 wherein said stored boundary values include the number of pixels from a vertical diameter crossing through said hole site to the outer and inner circles formed by said short circuit region.

14. The system according to claim 12 wherein said panel feature detector further comprises:

a wire look up table representing a three dimensional RGB space, said wire look up table addressed by a number corresponding to the magnitude of said color element values of a pixel provided by said image storage memory, wherein said wire indication is provided when said magnitudes of said color element values correspond to a wire feature.

15. An optical inspection system for detecting faults at potential hole sites of a wire scribed circuit board having a plurality of wires scribed on a substrate, comprising:

a video camera for receiving images of desired hole sites on said wire scribed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing color element values indicative of a chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a wire indication when said color element values of said pixel correspond to a wire feature;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with a hole site to be analyzed; and

a short detector circuit receiving said wire indication from said panel feature detector corresponding to said predetermined pixels associated with said hole site, said short detector circuit determining whether a short circuit could occur when said hole site is drilled;

wherein said predetermined pixels correspond to an annular short circuit region superimposed on said hole site and said short detector circuit further comprises;

a bin histogram having a plurality of bins dividing said annular short circuit region into equal parts, each bin having a corresponding bin number, said bin histogram storing the number of detected wire pixels associated with each bin number;

a digital filter for processing data stored in said bin histogram for identifying the peak occurrences of said detected wire pixels; and

an analyzer for determining whether the ratio of the number of wire pixels detected in the highest two peak occurrences over the total number of pixels in said bin histogram is above a predetermined threshold.

16. An optical inspection system for detecting faults at hole sites of a wire scribed circuit board having a plurality of wires scribed on a substrate, comprising:

a video camera for receiving images of desired hole sites on said wire scribed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing color element values indicative of the chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a wire indication when said color element values of said pixel correspond to a wire feature;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with a hole site to be analyzed;

a fault detector circuit receiving said wire indication from said panel feature detector corresponding to said predetermined pixels associated with said hole site, said fault detector determining whether a fault is present at said hole site; and

a registration analyzer that aligns said wire scribed circuit board with respect to a desired location comprising;

a row profile buffer receiving said wire pixel indication from said panel feature detector;

a column profile buffer receiving said wire pixel indication from said panel feature detector;

a cluster identifier for recognizing significant wire pixel peak occurrences in said row and column profile buffers;

a cluster analyzer for determining the x-y coordinates of the center of said wire pixel peak occurrences corresponding to data in said row profile buffer and said column profile buffer; and

a compensator for comparing the desired location of said center and actual location of said center determined by said cluster analyzer and computing a transformation matrix so that errors arising from an improper alignment of said wire scribed circuit board can be compensated.

17. An optical inspection system for detecting faults at hole sites of a wire scribed circuit board having a plurality of wires scribed on a substrate, comprising:

a video camera for receiving images of desired hole sites on said wire scribed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing color element values indicative of the chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a wire indication when said color element values of said pixel correspond to a wire feature;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with a hole site to be analyzed;

a fault detector circuit receiving said wire indication from said panel feature detector corresponding to said predetermined pixels associated with said hole site, said fault detector determining whether a fault is present at said hole site; and

wherein said panel feature detector further comprises;

a wire look up table representing a three dimensional RGB space said wire look up table addressed by a number corresponding to the magnitude of color element values of a pixel provided by said image storage memory, where the data corresponding to said address is set to "1" when said color element values of said pixel correspond to a wire pixel, where the data has been stored during a previous training mode;

a substrate look up table representing a three dimensional RGB space addressed by a number corresponding to the magnitude of color element values of a pixel provided by said image storage memory, where the data corresponding to said address is set to "1" when said color element values of said pixel correspond to a substrate pixel, where the data has been stored during a previous training mode; and

an inhibitor for setting an addressed bit in said wire look up table back to zero whenever the same color element values of a pixel have set an addressed bit in both wire and substrate lookup tables to "1".

18. The system according to claim 17 further comprising a dilator locating set bits in said wire and substrate look up table with a value "one" and setting immediate neighbors of said set bits in all three dimensions of said RGB space corresponding to said wire and substrate look up tables with a value "1".

19. An optical inspection system for differentiating wires from substrate in a wire scribed circuit board having a plurality of wires scribed on said substrate, comprising:

a video camera for receiving desired images on said wire scribed circuit board, said video camera converting each image to electrical video signals;

conversion means for converting said electrical video signals into a plurality of scan lines having a plurality of pixels;

a memory means for storing information representing RGB color element values contained in each of said pixels of said image;

means for sampling regions on said wire scribed circuit board during a training mode;

a wire look up table for representing points in RGB space corresponding to wire features and a substrate look up table for representing points in RGB space corresponding to substrate features, where the contents of said wire look up table are determined from samples of wire regions obtained by said sampling means, and the contents of said substrate look up table are determined from samples of substrate regions obtained by said sampling means.

20. The system according to claim 19, wherein each of said tables have a plurality of bytes and said wire look up table and said substrate look up table are addressed by a combination of binary values representing each component of said RGB color element values, wherein the least three significant bits of said address point to a bit location in one of said bytes and the remaining most significant bits of said address point to a byte location.

21. The system according to claim 20 wherein all RGB values that belong to wire features will address a "one" bit in said wire look up table and all RGB values that belong to a substrate feature will address a "one" bit in said substrate look up table.

22. The system according to claim 21 wherein an addressed bit in said wire look up table is set back to "zero" whenever the same RGB values corresponding to a pixel have set an addressed bit in said substrate look up table to "one".

23. A method for detecting faults at hole sites of a plurality of wire scribed circuit boards each having a plurality of wires scribed on a substrate, comprising the steps of:

receiving desired images from each wire scribed circuit board;

converting each one of said desired images to a plurality of pixels;

deriving color element values indicative of chromaticity corresponding to each pixel of said desired images;

displaying said desired images from said wire scribed circuit board;

providing a training mode for a sample wire scribed circuit board by,

sampling wire regions of said circuit board for retrieving color element values associated with wire;

sampling substrate regions of said circuit board for retrieving color element values associated with substrate;

tinting, to a first color, all pixels in said displayed image having color element values corresponding to said retrieved color element values associated with wire; and

tinting, to a second color, all pixels in said displayed image having color element values corresponding to said retrieved color element values associated with substrate.

24. The method according to claim 23 further comprising the steps of:

providing an inspection mode for each one of said plurality of wire scribed circuit boards by,

retrieving color element values corresponding to predetermined pixels associated with a hole site to be analyzed and providing a wire indication when said color element values correspond to said retrieved color element values associated with wire;

analyzing said wire indication corresponding to said predetermined pixels to determine whether a fault could occur when said hole site is drilled.

25. The method according to claim 23 further comprising the steps of:

setting appropriate locations in a wire look up table addressed by color element values associated with wire to a "1" denoting wire indication;

setting appropriate locations in a substrate look up table addressed by color element values associated with substrate to a "1" denoting substrate indication; and

inhibiting an addressed bit in said wire look up table back to zero whenever the same color element values of a pixel have set an addressed bit in both wire and substrate look up tables to "1".

26. A method for detecting faults at hole sites of a plurality of wire scribed circuit boards each having a plurality of wires scribed on a substrate, comprising the steps of:

receiving desired images from each wire scribed circuit board;

converting each one of said desired images to a plurality of pixels;

deriving hue values corresponding to each pixel of said desired images;

displaying said desired images from said wire scribed circuit board;

providing a training mode for a sample wire scribed circuit board by,

setting two hue thresholds so that all pixels in said displayed image having hue values in a range between said two hue thresholds are associated with wire pixels and all other pixels are associated with substrate pixels.

27. An optical inspection system for detecting faults at desired inspection sites of a printed circuit board having a plurality of conductor traces disposed on a substrate, comprising:

a video camera for receiving images of said desired inspection sites on said printed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing information representing color element values indicative of the chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a conductor trace indication when said color element values of said pixel correspond to a conductor trace;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with said desired inspection site to be analyzed;

a fault detector circuit receiving said conductor trace indication from said panel feature detector corresponding to said predetermined pixels associated with said desired inspection site, said fault detector determining whether a fault is present at said desired inspection site; and

wherein said panel feature detector is provided with a training mode where conductor trace regions are sampled for establishing color element values associated with conductor trace and substrate regions are sampled for establishing color element values associated with substrate.

28. The system according to claim 27 wherein said fault detector determines the gap between two conductor traces and compares said gap with a predetermined threshold value.

29. The system according to claim 28 wherein said fault detector further determines the width of a conductor trace to be inspected and compares said width with a predetermined threshold value.

30. The system according to claim 29 wherein said image storage memory comprises a frame grabber providing data on a scan line basis to a pixel row buffer, said pixel row buffer retaining information of all pixels contained in a scan line and providing said information to said panel feature detector on a pixel by pixel basis.

31. The system according to claim 27 further comprising a registration analyzer comprising:

a row profile buffer receiving said conductor trace pixel indication from said panel feature detector;

a column profile buffer receiving said conductor trace pixel indication from said panel feature detector;

a cluster identifier for recognizing significant conductor trace pixel peak occurrences in said row and column profile buffers;

a cluster analyzer for determining the x-y coordinates of the center of said conductor trace pixel peak occurrences corresponding to data in said row profile buffer and said column profile buffer; and

a compensator for comparing the desired location of said center and actual location of said center determined by said cluster analyzer and computing a transformation matrix so that misalignment errors or said printed circuit board can be compensated.

32. The system according to claim 27 wherein said panel feature detector further comprises:

a conductor trace look up table representing a three dimensional RGB space said conductor trace look up table addressed by a number corresponding to the magnitude of color element values of a pixel provided by said image storage memory, the data corresponding to said address set to "1" when during said training mode said color element values of said pixel correspond to a conductor trace pixel;

a substrate look up table representing a three dimensional RGB space addressed by a number corresponding to the magnitudes of color element values of a pixel provided by said image storage memory, the data corresponding to said address set to "1" during said training mode when said color element values of said pixel correspond to a substrate pixel; and

an inhibitor for setting an addressed bit in said wire look up table back to zero whenever the same color element values of a pixel have set an addressed bit in both wire and substrate lookup tables to "1".

33. The system according to claim 27 further comprising a dilator locating set bits in said conductor trace and substrate look up table with a value "one" and setting immediate neighbors of said set bits in all three dimensions of said RGB space corresponding to said conductor and substrate look up tables with a value "1".

35. The system according to claim 27 wherein said panel feature detector further comprises:

a neural network having an input layer containing three nodes with linear transfer functions for distributing incoming RGB data corresponding to a pixel to be analyzed to the rest of said neural network;

a plurality of hidden layers containing a plurality of nodes, each node having connections to predetermined nodes in following layers;

an output node indicating whether said pixel to be analyzed is a conductor trace pixel or a substrate pixel.

36. The system according to claim 35 wherein said neural network is a two hidden layer fully connected feed forward network.

34. An optical inspection system for detecting faults at desired inspection sites of a printed circuit board having a plurality of conductor traces disposed on a substrate, comprising:

a video camera for receiving images of said desired inspection sites on said printed circuit board, said video camera converting each image to electrical video signals;

an image storage memory for storing information representing color element values indicative of the chromaticity of a plurality of pixels derived from said electrical video signals;

a panel feature detector receiving said color element values of a pixel to be analyzed from said image storage memory, providing a conductor trace indication when said color element values of said pixel correspond to a conductor trace;

a pixel retrieve controller providing command signals to said image storage memory to transmit to said panel feature detector color element values corresponding to predetermined pixels associated with said desired inspection site to be analyzed;

a fault detector circuit receiving said conductor trace indication from said panel feature detector corresponding to said predetermined pixels associated with said desired inspection site, said fault detector determining whether a fault is present at said desired inspection site; and

wherein said panel feature detector further comprises;

an RGB to hue extractor receiving the RGB values corresponding to each pixel being analyzed and providing a hue component corresponding to said pixel being analyzed; and

a threshold adjuster having a first and a second hue parameter defining a range of hue values such that said pixel being analyzed is attributed to a trace pixel when the value of said hue component corresponding to said pixel being analyzed is within said range of hue values.

37. A method for detecting shorts at potential hole sites of a wire scribed circuit board having a plurality of wires scribed on a substrate, comprising the steps of:

receiving desired images from said wire scribed circuit board;

converting said desired images to a plurality of pixels;

retrieving from said plurality of pixels those pixels located within boundaries of an annular short circuit reticle superimposed on a hole site;

analyzing said retrieved pixels so as to provide wire indications indicating whether said pixels correspond to wires scribed on said substrate;

dividing said annular short circuit reticle into equal parts each said equal part encompassing a plurality of said retrieved pixels and associated with a bin;

assigning to each bin a bin value indicative of the number of said wire indications occurring within said bin'"'"'s associated equal part; and

processing said bin values to identify clusters for determining whether a short circuit could occur when said hole site is drilled.

38. The method according to claim 37 wherein said converting step includes associating color element values to said plurality of pixels and said analyzing step retrieves said color elements values so as to provide wire indications when said color element values correspond to wires scribed on said substrate.

39. The method according to claim 37 wherein said step of retrieving pixels further includes the step of deriving boundary parameters for said annular short circuit reticle from a short scan table associated with a hole site.

40. The method according to claim 37, wherein said step of determining a short circuit further comprises the steps of:

providing a histogram of said bin values;

processing said histogram for identifying the peak occurrences of said wire indications; and

determining whether the ratio of the number of wire indications detected in the highest two peak occurrences to the total number of wire indications in said histogram exceeds a predetermined threshold.