DEFECT CLASSIFICATION IN AN IMAGE OR PRINTED OUTPUT

• US 20200133182A1
• Filed: 04/20/2017
• Published: 04/30/2020
• Est. Priority Date: 04/20/2017
• Status: Active Application

• Current Assignee: HP Indigo B.V. (HP Inc.)
• Original Assignee: HP Indigo B.V. (HP Inc.)
• Inventors: Haik, Oren, Perry, Oded, Chen, Eli
• Application Number:
  US16/605,606
• Publication Number:
  US 20200133182A1
• Time in Patent Office: Days
• CPC Class Codes: B33Y 50/02 for controlling or regulating additive manufacturing processes
• CPC Class Codes: G03G 15/5016 User-machine interface; Display panels; Control console
• CPC Class Codes: G05B 13/027 using neural networks only
• CPC Class Codes: G06F 18/2413 based on distances to training or reference patterns
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/20084 Artificial neural networks [ANN]
• CPC Class Codes: G06T 2207/30144 Printing quality
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06V 10/454 Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: H04N 1/00034 Measuring, i.e. determining a quantity by comparison with a standard H04N1/00031 takes precedence
• CPC Class Codes: H04N 1/00042 Monitoring, i.e. observation H04N1/00029 - H04N1/00039 take precedence
• CPC Class Codes: H04N 1/00092 relating to the original or to the reproducing medium, e.g. imperfections or dirt detecting properties of a sheet H04N1/00681
• CPC Class Codes: H04N 1/40068 Modification of image resolution, i.e. determining the values of picture elements at new relative positions H04N1/3935 takes precedence
• CPC Class Codes: H04N 1/6002 Corrections within particular colour systems

Abstract

A monitoring device includes circuitry to compare a printed output with a reference representing a target output and to determine potential defects in the printed output based on the comparison. The monitoring device further includes and circuitry to implement a convolutional neural network to classify each potential defect as a true defect or a false alarm.

Claims

1. A monitoring device, comprising:

circuitry to compare a printed output with a reference representing a target output and to determine potential defects in the printed output based on the comparison; and

circuitry to implement a convolutional neural network to classify each potential defect as a true defect or a false alarm.

2. The monitoring device of claim 1, wherein the convolutional neural network includes:

an input layer of artificial neurons for receiving a description of each potential defect;

an output layer of artificial neurons for outputting a classification of each potential defect; and

a plurality of hidden layers of artificial neurons between the input layer and the output layer.

3. The monitoring device of claim 1, wherein

the convolutional neural network is a Siamese neural network including a first subnetwork and a second subnetwork;

the first subnetwork to process a potential defect, determined by the circuitry to compare, to produce a first output;

the second subnetwork process a portion of the reference corresponding with the potential defect to produce a second output; and

the Siamese neural network is to classify the defect based on a comparison of the first output and the second output.

4. The monitoring device of claim 1, wherein

the reference is a first digital image describing a target output image to be printed on a medium,

the printed output is a printed output image printed on the medium, and

the circuitry to compare is to receive the first digital image and a second digital image, the second digital image representing the printed output image, and determine the potential defects by comparing the first digital image and the second digital image.

5. The monitoring device of claim 4, wherein the circuitry to compare is to:

modify at least one of the first digital image and the second digital image to at least one of;

match a color space of the first digital image and a color space of the second digital image,

match a resolution of the first digital image and second digital image,

improve registration between corresponding elements of the first digital image and the second digital image, or

reduce color inconsistencies between the first digital image and second digital image, and

the circuitry to compare is to compare the first digital image and the second digital image after the modifying.

6. The monitoring device of claim 4, wherein the circuitry to compare is to determine the potential defects by applying a structural similarity, SSIM, index to differences identified by the comparison between the first digital image and the second digital image.

7. The monitoring device of claim 4, wherein the convolutional neural network is to perform a first classification to classify each potential defect as being one of a first set of classes, the first set of classes including Real Defect and one or more of Moiré

, Dust, Noise, Illumination and Color Inconsistency and Misalignment, wherein;

the potential defect is classified as a true defect if the first classification classifies the difference as a Real Defect, and

the potential defect is classified as a false alarm if the first classification classifies the difference as Moiré

, Dust, Noise, Illumination and Color Inconsistency or Misalignment.

8. A printing device comprising:

the monitoring device of claim 3;

an input to receive print instructions, the print instructions including the reference representing the target output;

an image fixing section to apply the printed output image to the medium;

a scanner to generate the second digital image by scanning the printed output image.

9. The printing device of claim 1, wherein the reference is a digital description of a 3D object to be printed and the printed output is a 3D printed object.

10. A method comprising:

receiving a first image and a second image, the first image and the second image being digital images;

comparing the first image with the second image to detect differences between the first image and the second image;

classifying differences detected by the comparing as a true defect or a false alarm using a neural network; and

outputting the result of the classification.

11. The method of claim 10, further wherein:

the comparing includes categorising each detected difference as significant or not significant based on a structural similarity, SSIM, measure, and

the classifying omits differences categorised as not significant.

12. Machine-readable instructions provided on at least one machine-readable medium, the instructions to cause processing circuitry to:

compare a printed image with a reference image and determine potential defects in the printed image based on the comparison; and

implement a neural network to classify each potential defect as a true defect or a false alarm.

13. The machine readable instructions of claim 12, wherein the neural network includes a plurality of layers connected in sequence, the plurality of layers including:

a convolutional layer to apply a convolutional kernel to an input to the convolutional layer,

a pooling layer to down-sample an input to the pooling layer, and

a classification layer to classify an input to the classification layer, wherein

the convolutional layer has fewer connections to its previous layer than the classification layer has to its previous layer.

14. The machine readable instructions of claim 12, wherein the neural network is to classify each potential defect as a true defect or one of a predetermined set of false alarm classes.

15. The machine readable instructions of claim 12, wherein the instructions are further to indicate a defect to a user in response to classification of a potential defect as a true defect.