Product gauge methods and apparatus for use in the optical determination of the acceptability of products

• US 5,353,356 A
• Filed: 06/29/1992
• Issued: 10/04/1994
• Est. Priority Date: 02/09/1989
• Status: Expired due to Term

• Current Assignee: Philip Morris USA Incorporated (Altria Group, Inc.)
• Original Assignee: Philip Morris USA Incorporated (Altria Group, Inc.)
• Inventors: Maher, Robert J., Waugh, Richard M.
• Primary Examiner(s): Couso, Jose L.
• Application Number:
  US07/905,898
• Time in Patent Office: 827 Days
• Field of Search: 382/1, 382/6, 382/8, 382/48, 382/30, 382/34, 358/101, 358/106, 358/107, 356/71, 364/527, 312/234
• US Class Current: 382/143
• CPC Class Codes: B07C 5/10 measured by light-responsive means sorting according to colour B07C5/342
• CPC Class Codes: B07C 5/34 Sorting according to other particular properties material testing per se G01N; quality control G07C3/14
• CPC Class Codes: B07C 5/3422 using video scanning devices, e.g. TV-cameras
• CPC Class Codes: G01N 21/8851 Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002
• CPC Class Codes: G05B 19/41875 characterised by quality surveillance of production
• CPC Class Codes: G05B 2219/32177 Computer assisted quality surveyance, caq
• CPC Class Codes: G05B 2219/37208 Vision, visual inspection of workpiece
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G06V 2201/06 Recognition of objects for industrial automation
• CPC Class Codes: G07C 3/14 Quality control systems
• CPC Class Codes: Y02P 90/02 Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

A product gauge is disclosed for use in the optical inspection of products. The product gauge can be produced from the image of a model of the product. The product gauge can also be electronically constructed on a video screen by a computer line-drawing program. The product gauge aids in the alignment and the processing of information by the optical inspecting means including aiding an operator in determining whether a product is acceptable. The product gauge can be used to quickly and accurately tailor a generalized product inspection apparatus to specific products and thus ease the change from inspecting one product to another product.

Claims

1. A method of determining the acceptability of a product, comprising the steps of:

superimposing a product gauge image over an image of the product;

identifying an acceptable image by comparing the product gauge image with the image of the product;

generating a filter from a first set of acceptable images of said product;

comparing said filter with a member of a second set of images of said product to produce a processed value, said second set including at least some acceptable images;

repeating said comparing step to produce a distribution of processed values;

generating from said distribution of processed values a first range (A) of processed values, said first range comprising processed values associated with acceptable images of said product;

generating from said distribution of processed values a second range (B) of processed values, said second range comprising processed values associated with unacceptable images of said product;

comparing said filter with a further image of said product so as to produce a further processed value;

generating an indication of acceptability or unacceptability of said further image by comparing said further processed value to said first and second ranges;

if said further processed value is outside both said first and second ranges, selecting said further image only if said further image is acceptable; and

adaptively training said filter with said selected further image to produce a modified filter such that comparing said modified filter with said selected further image produces a modified processed value which is within said first range.

2. The method of determining the acceptability of a product of claim 1 wherein said product gauge image is an image of a model of the product.

3. The method of determining the acceptability of a product of claim 1 wherein the product gauge image is drawn on a video monitor.

4. The method of determining the acceptability of a product of claim 3 wherein the product gauge image is drawn using a computer program.

5. The method of determining the acceptability of a product of claim 4 wherein said product gauge image is drawn using a computer program which converts a three dimensional image of a model of the product into two dimensional data points via a warp process.

6. The method of determining the acceptability of a product of claim 1 wherein the product gauge image is adapted to aid in the alignment of components used in determining the acceptability of the product.

7. The method of determining the acceptability of a product of claim 1 wherein if a product is unacceptable the product gauge image is altered to indicate why.

8. The method of determining the acceptability of a product of claim 1 wherein said superimposing step comprises superimposing the product gauge image over the image of the product on a video monitor.

9. The method of determining the acceptability of a product of claim 1 further comprising superimposing the product gauge image over said further image and comparing the superimposed images to determine if said further image is acceptable.

10. The method of determining the acceptability of a product of claim 9 wherein said superimposing step comprises superimposing the product gauge image over said further image on a video monitor.

11. The method of determining the acceptability of a product of claim 8 wherein said product gauge image is an image of a model of the product.

12. The method of determining the acceptability of a product of claim 8 wherein said product gauge image is drawn on a video monitor.

13. The method of determining the acceptability of a product of claim 12 wherein the product gauge image is drawn using a computer program.

14. The method of determining the acceptability of a product of claim 13 wherein said product gauge image is drawn using a computer program which converts a three dimensional image of a model of the product into two dimensional data points via a warp process.

15. The method of determining the acceptability of the appearance of each of a plurality of products comprising the steps of:

forming an image of each of a first subplurality of said products;

superimposing a product gauge image over each of the images of said first subplurality;

identifying acceptable in, ages by comparing the product gauge image with each of the images of the first subplurality;

combining the images of said acceptable images to produce an initial discriminant function;

forming an image of each of a second subplurality of said products;

using said initial discriminant function to process each of the images of said second subplurality in order to produce a processed value for each of said images from said second subplurality which is indicative of how similar said image from said second subplurality is to said initial discriminant function;

selecting first processed value thresholds between which a first majority of said processed values fall;

selecting second processed value thresholds between which a second majority of said processes values fall, said second majority being larger than said first majority;

forming an image of each of a third subplurality of said products;

using selected images of said third subplurality to progressively refine said discriminant function by (1) using said discriminant function to process each successive image from said third subplurality in order to produce a processed value for said image from said third subplurality, (2) determining whether said processed value is substantially between said second value thresholds, and (a) if not, discarding said image from said third subplurality and skipping step (3) below, or (b) if so, determining whether said processed value is substantially between first processed value thresholds, and (i) if so, continuing with step (3) below, or (ii) if not, discarding said image from said third subplurality and skipping step (3) below unless said image from said third subplurality appears acceptable, and (3) modifying said discriminant function in accordance with said image from said third subplurality;

forming an image of each of a fourth subplurality of said objects; and

using the refined discriminant function to determine whether or not each of the images of said fourth subplurality has an acceptable appearance.

16. The method according to claim 15, wherein said step of using selected images comprises the additional steps at (2)(b)(ii) of superimposing the product gauge image over said image from said third subplurality and identifying acceptability of said image by comparing the product gauge image with said image.

17. The method according to claim 15, further comprising the step, if it is determined that an image of said fourth subplurality has an unacceptable appearance, of superimposing the product gauge image over this image and further identifying the image as acceptable or unacceptable by comparing the product gauge image with the image.

18. The method according to claim 17, wherein said step of using selected images comprises the additional steps at (2)(b)(ii) of superimposing the product gauge image over said in, age from said third subplurality and identifying acceptability of said image by comparing the product gauge image with said image.

19. The method of determining the acceptability of a product of claim 15 wherein said product gauge image is an image of a model of the product.

20. The method of determining the acceptability of a product of claim 15 wherein said product gauge image is drawn on a video monitor.

21. The method of determining the acceptability of a product of claim 20 wherein the product gauge image is drawn using a computer program.

22. The method of determining the acceptability of a product of claim 21 wherein said product gauge image is drawn using a computer program which converts a three dimensional image of a model of the product into two dimensional data points via a warp process.

23. The method according to claim 19 further comprising the step, if it is determined that an image of said fourth subplurality has an unacceptable appearance, of superimposing the product gauge image over this image and further identifying this in, age as acceptable or unacceptable by comparing the product gauge image with this image.

24. The method of determining the acceptability of the appearance of each of a plurality of products comprising the steps of:

forming an image of each of a first subplurality of said products;

combining the images of said first subplurality to produce an initial discriminant function;

forming an image of each of a second subplurality of said products;

using said initial discriminant function to process each of the images of said second subplurality in order to produce a processed value for each of said images from said second subplurality which is indicative of how similar said image from said second subplurality is to said initial discriminant function;

selecting first processed value thresholds between which a first majority of said processed values fall;

selecting second processed value thresholds between which a second majority of said processed values fall, said second majority being larger than said first majority;

forming an image of each of a third subplurality of said products;

using selected images of said third subplurality to progressively refine said discriminant function by (1) using said discriminant function to process each successive image from said third subplurality in order to produce a processed value for said image from said third subplurality, (2) determining whether said processed value is substantially between said second value thresholds, and (a) if not, discarding said image from said third subplurality and skipping step (3) below, or (b) if so, determining whether said processed value is substantially between first processed value thresholds, and (i) if so, continuing with step (3) below, of (ii) if not, discarding said image from said third subplurality and skipping step (3) below unless said image from said third subplurality appears acceptable, wherein the acceptability of said image of said third subplurality is determined by superimposing a product gauge in, age over said image from said third plurality and identifying the acceptability of said image by con, paring the product gauge image with said image, and (3) modifying said discriminant function in accordance with said image from said third subplurality;

forming an image of each of a fourth subplurality of said products; and

using the refined discriminant function to determine whether or not each of the images of said fourth subplurality has an acceptable appearance.

25. The method of determining the acceptability of a product of claim 24 wherein said product gauge image is an image of a model of the product.

26. The method of determining the acceptability of a product of claim 24 wherein said product gauge image is drawn on a video monitor.

27. The method of determining the acceptability of a product of claim 26 wherein the product gauge image is drawn using a computer program.

28. The method of determining the acceptability of a product of claim 27 wherein said product gauge in, age is drawn using a computer program which converts a three dimensional in, age of a model of the product into two dimensional data points via a warp process.

29. The method of processing a plurality of images to produce an image discriminant function comprising the steps of:

superimposing a desired gauge image over each of a plurality of images;

identifying acceptable images by comparing the superimposed desired gauge image with each of the plurality of images;

subdividing a first of said acceptable images into a plurality of pixels, each of which has an initial digital value proportional to a predetermined image characteristic of the associated portion of the associated image;

assigning a first numerical value to each pixel having an initial digital value which is on one side of a predetermined threshold value and assigning a second numerical value to each pixel having an initial digital value which is on the other side of said threshold value to produce an initial discriminant function;

subdividing each remaining acceptable image in said plurality of images into a plurality of pixels, each of which as an initial digital value proportional to said predetermined image characteristic of the associated portion of the associated image;

assigning said first numerical value to each pixel in each remaining acceptable image having an initial digital value which is on one side of said threshold value and assigning said second numerical value to each pixel in each remaining acceptable image having an initial digital value which is on the other side of said threshold value; and

producing said image discriminant function by sequentially performing the logical OR operation between each of said remaining acceptable images after assigning said numerical values and the initial discriminant function, the result of each logical OR operation replacing said initial discriminant function for the next performance of said logical OR operation.

30. The method of determining the acceptability of a product of claim 29 wherein said superimposing step comprises superimposing the product gauge image over said further image on a video monitor.

31. The method of determining the acceptability of a product of claim 29 wherein said product gauge image is an image of a model of the product.

32. The method of determining the acceptability of a product of claim 31 wherein said product gauge image is drawn on a video monitor.

33. The method of determining the acceptability of a product of claim 32 wherein the product gauge image is drawn using a computer program.

34. The method of determining whether or not a sample image is substantially similar to a predetermined standard image comprising the steps of:

(a) forming a discriminant function which is representative of said standard image;

(b) comparing each or a first plurality of possible examples of said sample image to said discriminant function to produce a first processed value for each of said first plurality of examples of said sample image, each of said processed values being indicative of how similar the associated example is to said standard image;

(c) comparing a further possible example of said sample image to said discriminant function to produce a further processed value indicative of how similar said further example of said sample in, age is to said standard image;

(d) using said first processed values to at least partly determine whether said further possible example of said sample image is substantially similar to said standard in, age, and if so, modifying said discriminant function in accordance with said further example of said sample image;

(e) repeating steps (c) and (d) for each of a plurality of further possible examples of said sample image to progressively modify said discriminant function;

(f) comparing said sample image to the modified discriminant function to produce a sample processed value indicative of how similar said sample image is to said standard image, and if this comparison indicates that said sample image is not substantially similar to said standard image, performing the additional steps of;

(g) superimposing a standard gauge image over said sample image; and

(h) comparing the superimposed standard gauge image to said sample image to determine if said sample image is substantially similar to said standard gauge image.

35. The method of determining the acceptability of a product of claim 34 wherein said superimposing step comprises superimposing the product gauge image over said further image on a video monitor.

36. The method of determining the acceptability of a product of claim 34 wherein said product gauge image is an image of a model of the product.

37. The method of determining the acceptability of a product of claim 36 wherein said product gauge image is drawn on a video monitor.

38. The method of determining the acceptability of a product of claim 37 wherein the product gauge image is drawn using a computer program.