Image processing apparatus, image processing method, and program for detecting defect from image

• US 11,443,500 B2
• Filed: 12/31/2019
• Issued: 09/13/2022
• Est. Priority Date: 07/07/2017
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Takayama, Kei, Matsugu, Masakazu, Nogami, Atsushi, Anabuki, Mahoro
• Primary Examiner(s): Terrell, Emily C
• Assistant Examiner(s): Bloom, Nathan J
• Application Number:
  US16/731,662
• Publication Number:
  US 20200134350A1
• Time in Patent Office: 987 Days
• Field of Search: None
• CPC Class Codes: G01N 2021/8887 based on image processing techniques
• CPC Class Codes: G01N 21/8851 Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/30132 Masonry; Concrete
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

An image processing apparatus includes detecting means for detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively; image setting means for setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region; accepting means for accepting, from a user, designation of a region in the target image and a correction instruction for the designated region; correction region setting means for identifying, in the reference image, a region corresponding to the designated region, and for setting a to-be-corrected region on the basis of the identified region and the second detected region; and correcting means for correcting the first detected region in the target image on the basis of the to-be-corrected region set in the reference image.

Claims

1. An image processing apparatus comprising:

one or more processors configured to cause the image processing apparatus to;

detect a first detected region from an input image on the basis of a first detection criterion and a second detected region from the input image on the basis of a second detection criterion, wherein the first detection criterion is based on a first threshold and the second detection criterion is based on a second threshold that is smaller in value than the first threshold;

set, as a target image subjected to correction, an image including the first detected region, and set, as a reference image that is referred to in a correction process, an image including the second detected region;

set a unit region in the detected region in each of the target image and the reference image by segmenting the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in the correction process;

set a to-be-corrected region in the reference image; and

correct the unit region in the target image on the basis of the to-be-corrected region set in the reference image.

2. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to cause the image processing apparatus to set, as the unit region, a continuous region in which it is determined that a detection target is detected.

3. The image processing apparatus according to claim 2, wherein the one or more processors are further configured to cause the image processing apparatus to set the unit region on the basis of a branch point in the continuous region in which it is determined that the detection target is detected.

4. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to cause the image processing apparatus to

set, in accordance with a second condition that is predetermined, a plurality of the unit regions included in the reference image as a continuous region, and

set the to-be-corrected region on the basis of the continuous region.

5. The image processing apparatus according to claim 2, wherein the one or more processors are further configured to cause the image processing apparatus to set, as a correction region, a plurality of unit regions in the target image that correspond to the continuous region.

8. The image processing apparatus according to claim 1, wherein the one or more processors are further configured to cause the image processing apparatus to:

accept, from a user, designation of a region in the target image and a correction instruction for the designated region.

9. The image processing apparatus according to claim 8, wherein the one or more processors are further configured to cause the image processing apparatus to set, in the reference image, the to-be-corrected region on the basis of the designated region.

10. The image processing apparatus according to claim 9, further comprising:

a display for displaying, as a correction-target region, a region corresponding to the to-be-corrected region in the target image,

wherein the one or more processors are further configured to cause the image processing apparatus to correct the correction-target region in response to accepting, from a user, confirmation of the correction-target region displayed by the display.

11. The image processing apparatus according to claim 9, wherein, as the correction process, the one or more processors are further configured to cause the image processing apparatus to couple a plurality of detected regions included in the correction region to correct the plurality of detected regions into a continuous detected region.

12. The image processing apparatus according to claim 9, wherein, as the correction process, the one or more processors are further configured to cause the image processing apparatus to delete a detected region included in the correction region.

13. The image processing apparatus according to claim 9, wherein the one or more processors are further configured to cause the image processing apparatus to:

further accept a correction instruction for the correction region in response to a user operation; and

modify the correction region in accordance with the correction instruction.

6. An image processing method comprising:

detecting a first detected region from an input image on the basis of a first detection criterion and a second detected region from the input image on the basis of a second detection criterion, wherein the first detection criterion is based on a first threshold and the second detection criterion is based on a second threshold that is smaller in value than the first threshold;

setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in a correction process, an image including the second detected region;

setting a unit region in the detected region in each of the target image and the reference image by segmenting the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in the correction process;

setting a to-be-corrected region in the reference image; and

correcting the unit region in the target image on the basis of the to-be-corrected region set in the reference image.

7. A non-transitory computer readable storage medium storing a program that, when executed by one or more processors, causes a computer to:

detect a first detected region from an input image on the basis of a first detection criterion and a second detected region from the input image on the basis of a second detection criterion, wherein the first detection criterion is based on a first threshold and the second detection criterion is based on a second threshold that is smaller in value than the first threshold;

set, as a target image subjected to correction, an image including the first detected region, and set, as a reference image that is referred to in a correction process, an image including the second detected region;

set a unit region in the detected region in each of the target image and the reference image by segmenting the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in the correction process;

set a to-be-corrected region in the reference image; and

correct the unit region in the target image on the basis of the to-be-corrected region set in the reference image.