IMAGE PROCESSING DEVICE, INFORMATION STORAGE DEVICE, AND IMAGE PROCESSING METHOD

• US 20160026900A1
• Filed: 10/08/2015
• Published: 01/28/2016
• Est. Priority Date: 04/26/2013
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: ANDO, Jun
• Granted Patent: US 9,552,536 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/214 Generating training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06F 18/217 Validation; Performance evaluation; Active pattern learning techniques
• CPC Class Codes: G06V 10/464 using a plurality of salient features, e.g. bag-of-words [BoW] representations
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/768 using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 10/774 Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06V 10/776 Validation; Performance evaluation

Abstract

An image processing device includes an input reception section that receives a learning image and a correct answer label, a processing section that performs a process that generates classifier data and a processing target image, and a storage section. The processing section generates the processing target image that is the entirety or part of the learning image, calculates a feature quantity of the processing target image, generates the classifier data based on training data that is a set of the feature quantity and the correct answer label assigned to the learning image that corresponds to the feature quantity, generates an image group based on the learning image or the processing target image, classifies each image of the image group using the classifier data to calculate a classification score of each image, and regenerates the processing target image based on the classification score and the image group.

Claims

1. An image processing device comprising:

an input reception section that performs a process that receives a learning image and a correct answer label assigned to the learning image;

a processing section that performs a process that generates classifier data that is used to classify an image, and a processing target image that is used to generate the classifier data; and

a storage section that stores the generated classifier data,

the processing section generating the processing target image that is the entirety or part of the learning image, calculating a feature quantity of the processing target image, generating the classifier data based on training data that is a set of the feature quantity and the correct answer label that is assigned to the learning image that corresponds to the feature quantity, generating an image group based on the learning image or the processing target image, classifying each image of the generated image group using the classifier data to calculate a classification score of each image of the image group, and regenerating the processing target image based on the calculated classification score and the image group.

2. The image processing device as defined in claim 1,

the processing section regenerating the classifier data based on new training data that is a set of the regenerated processing target image and the correct answer label that is assigned to an image selected from the image group when regenerating the processing target image.

3. The image processing device as defined in claim 1,

the processing section comparing the classification score of each image of the image group with a given threshold value, selecting an image for which the classification score has been calculated to be equal to or higher than the given threshold value from the image group, and regenerating the processing target image based on a selected image group.

4. The image processing device as defined in claim 3,

the processing section changing the given threshold value that is compared with the classification score each time the processing target image has been regenerated.

5. The image processing device as defined in claim 1,

the processing section setting the entirety of the learning image to be a first processing target image.

6. The image processing device as defined in claim 1,

the processing section generating the processing target image that is smaller in number of pixels or area than a preceding processing target image.

7. The image processing device as defined in claim 1,

the processing section generating the image group based on the learning image, and generating the processing target image that is larger in number of pixels or area than a preceding processing target image.

8. The image processing device as defined in claim 1,

the processing section repeating the process that generates the classifier data and the processing target image a given number of times.

9. The image processing device as defined in claim 1,

the processing section stopping repeating the process that generates the classifier data and the processing target image when a difference in area or number of pixels between a preceding processing target image and a current processing target image is less than a given threshold value.

10. The image processing device as defined in claim 1,

the processing section segmenting the learning image or the processing target image into a plurality of areas to generate the image group that is a set of images that respectively correspond to the plurality of areas.

11. The image processing device as defined in claim 1,

the processing section overlap-segmenting the learning image or the processing target image into a plurality of areas to generate the image group that is a set of images that respectively correspond to the plurality of areas.

12. The image processing device as defined in claim 1,

the processing section over-segmenting the learning image or the processing target image into a plurality of areas to generate the image group that is a set of images that respectively correspond to the plurality of areas.

13. The image processing device as defined in claim 10,

the processing section changing a segmentation size of the learning image or the processing target image each time the process that generates the classifier data and the processing target image has been performed.

14. The image processing device as defined in claim 1,

the processing section displaying a processing target image group on a display section, acquiring correction instruction information that instructs to correct the processing target image group, and performing a correction process on the processing target image group based on the correction instruction information.

15. The image processing device as defined in claim 14,

the processing section displaying a list of the processing target image group on the display section, acquiring designation information that designates an unnecessary processing target image from the processing target image group as the correction instruction information, and deleting the processing target image designated by the designation information from the processing target image group.

16. The image processing device as defined in claim 1,

the processing section calculating the feature quantity of the processing target image using a bag of features.

17. The image processing device as defined in claim 1,

the processing section performing an object detection process based on the classification score of each image of the image group.

18. A non-transitory information storage device storing a program that causes a computer to perform steps of:

performing a process that receives a learning image and a correct answer label assigned to the learning image;

performing a process that generates classifier data that is used to classify an image, and a processing target image that is used to generate the classifier data; and

storing the generated classifier data,

while regenerating the processing target image that is the entirety or part of the learning image, calculating a feature quantity of the processing target image, generating the classifier data based on training data that is a set of the feature quantity and the correct answer label that is assigned to the learning image that corresponds to the feature quantity, generating an image group based on the learning image or the processing target image, classifying each image of the generated image group using the classifier data to calculate a classification score of each image of the image group, and regenerating the processing target image based on the calculated classification score and the image group.

19. An image processing method comprising:

performing a process that receives a learning image and a correct answer label assigned to the learning image;

generating a processing target image that is used to generate classifier data that is used to classify an image, the processing target image being the entirety or part of the learning image;

calculating a feature quantity of the processing target image;

generating the classifier data based on training data that is a set of the feature quantity and the correct answer label that is assigned to the learning image that corresponds to the feature quantity;

generating an image group based on the learning image or the processing target image;

classifying each image of the generated image group using the classifier data to calculate a classification score of each image of the image group;

regenerating the processing target image based on the calculated classification score and the image group; and

storing the generated classifier data.