IMAGE PROCESSING DEVICE FOR DISPLAYING OBJECT DETECTED FROM INPUT PICTURE IMAGE

• US 20170249766A1
• Filed: 02/24/2017
• Published: 08/31/2017
• Est. Priority Date: 02/25/2016
• Status: Active Grant

• Current Assignee: Fanuc Corporation
• Original Assignee: Fanuc Corporation
• Inventors: Namiki, Yuta, Warashina, Fumikazu
• Granted Patent: US 10,930,037 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/241 relating to the classification model, e.g. parametric or non-parametric approaches
• CPC Class Codes: G06F 18/24143 Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]
• CPC Class Codes: G06F 18/28 Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
• CPC Class Codes: G06F 18/41 Interactive pattern learning with a human teacher
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 30/19133 Interactive pattern learning with a human teacher
• CPC Class Codes: G06V 30/1914 Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries, e.g. user dictionaries
• CPC Class Codes: G06V 30/19173 Classification techniques

Abstract

An image processing device including an object detection unit for detecting one or more images of objects from an input picture image, on the basis of a model pattern of the object, and a detection result display unit for graphically superimposing and displaying a detection result. The detection result display unit includes a first frame for displaying the entire input picture image and a second frame for listing and displaying one or more partial picture images each including an image detected. In the input picture image displayed in the first frame, a detection result is superimposed and displayed on all the detected images, and in the partial picture image displayed in the second frame, a detection result of an image corresponding to each partial picture image is superimposed and displayed.

Claims

1. An image processing device comprising:

an object detection means for detecting one or more images of objects from an input picture image in which the objects have been captured, on the basis of a model pattern of the object; and

a detection result display means for graphically superimposing and displaying a detection result on each image thus detected,

wherein the detection result display means includes;

a first frame for displaying the entire input picture image; and

a second frame for listing and displaying one or more partial picture images each including an image detected from the input picture image, and

wherein in the input picture image displayed in the first frame, a detection result is superimposed and displayed on all the detected images, and

in the partial picture image displayed in the second frame, a detection result of an image corresponding to each partial image is superimposed and displayed.

2. The image processing device according to claim 1, wherein the detection result display means further superimposes and displays, on the partial picture image displayed in the second frame, first label information stored in association with an image corresponding to each partial picture image, and allows an operator to change the first label information on the basis of an operation performed by the operator.

3. The image processing device according to claim 1, wherein the detection result display means displays picture images in each of the first frame and the second frame with a setting magnification rate for each of them.

4. The image processing device according to claim 1, wherein the detection result display means includes a partial picture image selection means for selecting one of a plurality of the partial picture images displayed in the second frame, and

in the input picture image displayed in the first frame, a detection result of an image of an object corresponding to the partial picture image selected by the partial picture image selection means is displayed in a highlighted manner.

5. The image processing device according to claim 2, wherein the detection result display means superimposes, on the input picture image displayed in the first frame, the first label information corresponding to each of the one or more images detected from the input picture image.

6. The image processing device according to claim 1, wherein the image processing device includes a detection result storage means associating a plurality of input picture images with detection results of one or more images of the objects detected from each of the plurality of input picture images and storing the plurality of input picture images and the detection results, and an input picture image selection means for selecting one of the plurality of input picture images, and

the detection result display means displays the one of the input picture images selected by the input picture image selection means and a detection result stored in the detection result storage means in association with the one of the input picture images.

7. The image processing device according to claim 6, wherein the image processing device includes an input picture image display means listing and displaying the plurality of input picture images stored in the detection result storage means upon superimposing one or more images and detection results of the objects detected from the input picture images, and

wherein the detection result display means displays the input picture image selected by the input picture image selection means, and enables switching between the input picture image display means and the detection result display means on the basis of an operation performed by an operator.

8. The image processing device according to claim 7, wherein the detection result storage means associates second label information with a plurality of input picture images and stores the second label information and the plurality of input picture images, and

the input picture image display means further superimposes and displays the second label stored in association with each of the plurality of input picture images and allows an operator to change the second label information, and when the operator changes the second label information of one of the input picture images, the first label information respectively corresponding to the images of the plurality of objects stored in association with the input picture image are collectively changed.

9. The image processing device according to claim 1, comprising:

a learning data storage means adding first label information to each of the detected images, associating them with each other to make learning data, and storing the learning data; and

a learning means performing machine learning or statistical processing on the basis of the learning data.