IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND RECORDING MEDIUM

• US 20160148070A1
• Filed: 11/16/2015
• Published: 05/26/2016
• Est. Priority Date: 11/21/2014
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tate, Shunta, Mori, Katsuhiko
• Granted Patent: US 10,007,678 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06V 10/768 using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60

Abstract

An image processing apparatus, an image processing method, and a recording medium realize identification of an object region and a region category with high precision, estimate a relationship between partial regions in an acquired image by using a database about relationships between the images, and determine a target region in the acquired image based on the relationship.

Claims

1. An image processing apparatus comprising:

an acquisition unit configured to acquire an image for storage in a storage unit;

a region dividing unit configured to divide the image acquired by the acquisition unit into a plurality of partial regions;

an extraction unit configured to extract one or more pieces of similar image data from each of the plurality of divided partial regions from a storage unit; and

a determination unit configured to determine a region, in the image, including partial regions having a relationship with each other, based on the image data extracted by the extraction unit and information about a relationship of the image data.

2. The image processing apparatus according to claim 1,

wherein the storage unit is included in the image processing apparatus.

3. The image processing apparatus according to claim 1 further comprising:

an output unit configured to output information about the region including partial regions having the relationship, with respect to the acquired image.

4. The image processing apparatus according to claim 1,

wherein the information about the relationship of a plurality of pieces of the image data includes information used for determining a correspondence relationship between the plurality of partial regions.

5. The image processing apparatus according to claim 4,

wherein the information about the relationship of the plurality of pieces of the image data includes information about graph data including a node that is one of a plurality of partial regions produced by dividing the plurality of pieces of the image data and an edge representing a correspondence relationship between the partial regions into which the image data is divided.

6. The image processing apparatus according to claim 5,

wherein the graph data includes an edge that is weighted based on similarity of the partial regions in the plurality of pieces of the image data.

7. The image processing apparatus according to claim 6,

wherein the weighted edge is acquired based on a teacher value about a category of an object in the plurality of pieces of the image data.

8. The image processing apparatus according to claim 5,

wherein the information about the relationship of the plurality of pieces of the image data is information about a subgroup acquired by clustering the plurality of pieces of the image data based on the graph data.

9. The image processing apparatus according to claim 8 further comprising:

an identification unit configured to identify a category of the region including partial regions having the relationship with each other based on the information about the subgroup.

10. The image processing apparatus according to claim 9,

wherein the identification unit further uses a trained identification dictionary to identify a category of the region including partial regions having the relationship with each other.

11. The image processing apparatus according to claim 5,

wherein the information about the relationship of the plurality of pieces of the image data includes information for determining an incorrect correspondence relationship between the plurality of partial regions.

12. The image processing apparatus according to claim 1,

wherein the information about the relationship of the plurality of pieces of the image data includes meta-information about the image in the plurality of pieces of the image data;

and

wherein the image processing apparatus further includes an identification unit configured to identify a category of the region including partial regions having a relationship with each other, based on the meta-information about the image.

13. The image processing apparatus according to claim 12,

wherein the meta-information is an annotation label about an object or a portion of the object in the plurality of pieces of the image data.

14. The image processing apparatus according to claim 1,

wherein the information about the relationship of the plurality of pieces of the image data is information used for determining a relative positional relationship between the plurality of the partial regions.

15. The image processing apparatus according to claim 14 further comprising:

a collation unit configured to collate whether a plurality of the regions, in a plurality of the acquired images, including partial regions having a relationship with each other is related to each other based on the information used for determining the relative positional relationship.

16. An image processing apparatus comprising:

an acquisition unit configured to acquire an image for storage in a storage unit;

a region dividing unit configured to divide the image acquired by the acquisition unit into a plurality of partial regions;

an extraction unit configured to extract one or more pieces of similar image data from each of the plurality of divided partial regions from the storage unit; and

a determination unit configured to determine a region, in the image, including partial regions having a relationship with each other, based on a teacher value about a category of an object relating to the image data extracted by the extraction unit.

17. The image processing apparatus according to claim 16, wherein the determination unit determines a category of the determined region.

18. An image processing method comprising:

acquiring an image;

dividing the acquired image into a plurality of partial regions;

extracting one or more pieces of similar image data from each of the plurality of divided partial regions;

determining a region, in the image, including partial regions having a relationship with each other based on the extracted image data and information about a relationship of the image data.

19. A non-transitory computer-readable recording medium that stores a program for causing a computer to function as the units of an image processing apparatus, the image processing apparatus comprising:

an acquisition unit configured to acquire an image for storage in a storage unit;

a region dividing unit configured to divide the image acquired by the acquisition unit into a plurality of partial regions;

an extraction unit configured to extract one or more pieces of similar image data from each of the plurality of divided partial regions from the storage unit; and

a determination unit configured to determine a region, in the image, including partial regions having a relationship with each other, based on the image data extracted by the extraction unit and information about a relationship of the image data.