IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM FOR DETECTING DEFECT FROM IMAGE

• US 20200134350A1
• Filed: 12/31/2019
• Published: 04/30/2020
• Est. Priority Date: 07/07/2017
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Takayama, Kei, Matsugu, Masakazu, Nogami, Atsushi, Anabuki, Mahoro
• Granted Patent: US 11,443,500 B2
• Time in Patent Office: Days
• CPC Class Codes: G01N 2021/8887 based on image processing techniques
• CPC Class Codes: G01N 21/8851 Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/30132 Masonry; Concrete
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

An image processing apparatus includes detecting means for detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively; image setting means for setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region; accepting means for accepting, from a user, designation of a region in the target image and a correction instruction for the designated region; correction region setting means for identifying, in the reference image, a region corresponding to the designated region, and for setting a to-be-corrected region on the basis of the identified region and the second detected region; and correcting means for correcting the first detected region in the target image on the basis of the to-be-corrected region set in the reference image.

Claims

1. An image processing apparatus comprising:

detecting means for detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively;

image setting means for setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region;

accepting means for accepting, from a user, designation of a region in the target image and a correction instruction for the designated region;

correction region setting means for identifying, in the reference image, a region corresponding to the designated region, and for setting a to-be-corrected region on the basis of the identified region and the second detected region; and

correcting means for correcting the first detected region in the target image on the basis of the to-be-corrected region set in the reference image.

2. The image processing apparatus according to claim 1, further comprising

unit region setting means for setting, in accordance with a first condition that is predetermined, a unit region in the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in a correction process,

wherein the correction region setting means sets the to-be-corrected region on the basis of the unit region.

3. The image processing apparatus according to claim 2, wherein the unit region setting means sets, as the unit region, a continuous region in which it is determined that a detection target is detected.

4. The image processing apparatus according to claim 3, wherein the unit region setting means sets the unit region on the basis of a branch point in the continuous region in which it is determined that the detection target is detected.

5. The image processing apparatus according to claim 1, further comprising

continuous region setting means for setting, in accordance with a second condition that is predetermined, a plurality of the unit regions included in the reference image as a continuous region,

wherein the correction region setting means sets the to-be-corrected region on the basis of the continuous region.

6. The image processing apparatus according to claim 5, wherein the correction region setting means sets, as a correction region, a plurality of unit regions in the target image that correspond to the continuous region.

7. The image processing apparatus according to claim 1, further comprising

display means for displaying, as a correction-target region, a region corresponding to the to-be-corrected region in the target image,

wherein the correcting means corrects the correction-target region in response to the accepting means accepting, from a user, confirmation of the correction-target region displayed by the display means.

8. The image processing apparatus according to claim 7, wherein, as the correction process, the correcting means couples a plurality of detected regions included in the correction region to correct the plurality of detected regions into a continuous detected region.

9. The image processing apparatus according to claim 7, wherein, as the correction process, the correcting means deletes a detected region included in the correction region.

10. The image processing apparatus according to claim 1,

wherein the accepting means further accepts a correction instruction for the correction region in response to a user operation, and

wherein the image processing apparatus further comprises modifying means for modifying the correction region in accordance with the correction instruction.

20. A non-transitory computer readable storage medium storing a program that, when executed by one or more processors, causes a computer to function as the image processing apparatus according to claim 1.

11. An image processing apparatus comprising:

detecting means for detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively;

image setting means for setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region;

search region setting means for setting, on the basis of a condition set in advance in relation to the first detected region, a region that is searched for in the target image;

corresponding region setting means for setting, in the reference image, a region corresponding to the region that is searched for; and

correcting means for correcting the first detected region in the target image on the basis of information on the corresponding region set in the reference image.

12. The image processing apparatus according to claim 11, further comprising unit region setting means for setting a unit region in the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in a correction process.

13. The image processing apparatus according to claim 12, wherein the unit region setting means sets, as the unit region, a continuous region in the detected region.

14. The image processing apparatus according to claim 13, wherein the unit region setting means sets the unit region in the detected region on the basis of a branch point in the continuous region.

15. The image processing apparatus according to claim 11,

wherein the target image is a captured image having undergone a binarization process based on a first threshold relating to a probability of being a detection target, and

wherein the reference image is the captured image having undergone a binarization process based on a second threshold relating to the probability of being the detection target, the second threshold being less than the first threshold.

16. The image processing apparatus according to claim 11,

wherein the target image is an image obtained from a first captured image, and

wherein the reference image is an image obtained from a second captured image that is obtained by capturing an image of an image-capturing range identical to that of the first captured image at a timing prior to a capturing timing of the first captured image.

17. The image processing apparatus according to claim 11, wherein the reference image is an image including a plurality of regions in which it is determined that a non-detection target different from the detection target is detected.

18. An image processing method comprising:

a detection step of detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively;

an image setting step of setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region;

an accepting step of accepting, from a user, designation of a region in the target image and a correction instruction for the designated region;

a correction region setting step of identifying, in the reference image, a region corresponding to the designated region, and for setting a to-be-corrected region on the basis of the identified region and the second detected region; and

a correction step of correcting the first detected region in the target image on the basis of the to-be-corrected region set in the reference image.

19. An image processing method comprising:

a detection step of detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively;

an image setting step of setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region;

a search region setting step of setting, on the basis of a condition set in advance in relation to the first detected region, a region that is searched for in the target image;

a corresponding region setting step of setting, in the reference image, a region corresponding to the region that is searched for; and

a correction step of correcting the first detected region in the target image on the basis of information on the corresponding region set in the reference image.