Image region extraction device, image region extraction method, and image region extraction program

• US 9,292,929 B2
• Filed: 11/30/2012
• Issued: 03/22/2016
• Est. Priority Date: 12/16/2011
• Status: Active Grant

• Current Assignee: Sovereign Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Hayata, Keisuke
• Primary Examiner(s): MOYER, ANDREW M
• Application Number:
  US14/361,362
• Publication Number:
  US 20140355882A1
• Time in Patent Office: 1,208 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/20096 Interactive definition of curve of interest
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 7/11 Region-based segmentation

Abstract

An image region extraction device for extracting a target region on the basis of a designated region with high precision. An image region extraction device (100) extracts a target region from an image on the basis of a designated region and is provided with: a spatial change learning unit (180) for acquiring, for each section of the image, a pixel value changing pattern which is a characteristic of the spatial changes in a pixel value component, and a distance changing pattern which is a characteristic of the spatial changes in a distance component extending from a reference position to a photographic object; and a region dividing unit (210) for extracting a target region on the basis of the similarities between the pixel value changing pattern and the distance changing pattern among the designated region and each section of the image.

Claims

1. An image region extracting apparatus that extracts, from an image photographed by a camera, a target region based on a designation region, the apparatus comprising:

a control circuit configured to acquire a pixel value change pattern and a distance change pattern of each part of the image, the pixel value change pattern being a spatial change characteristic of a pixel value component, and the distance change pattern being a spatial change characteristic of a distance component indicating a distance from a view point of the camera to a subject; and

the control circuit being further configured to extract the target region based on similarities of the pixel value change pattern and the distance change pattern between the designation region and each part of the image.

2. The image region extracting apparatus according to claim 1, wherein the target region is extracted based on similarities of the pixel value component and the distance component between the designation region and each part of the image.

3. The image region extracting apparatus according to claim 2, wherein the control circuit is further configured to:

acquire the pixel value component and the distance component of each part of the image from the image;

calculate the similarities of the pixel value component and the distance component; and

calculate a spatial change of the pixel value component and a spatial change of the distance component, wherein

the control circuit calculates the similarities of the pixel value change pattern and the distance change pattern.

4. The image region extracting apparatus according to claim 3, wherein the control circuit is further configured to determine a score indicating a likelihood that each part of the image is the target region, for each part of the image based on the similarities of the pixel value change pattern and the distance change pattern and the similarities of the pixel value component and the distance component, wherein

the control circuit extracts the target region based on the score.

5. The image region extracting apparatus according to claim 4, wherein the control circuit is configured to:

calculate the similarity of the pixel value component and the similarity of the distance component between the designation region and each part of the image; and

determine the score based on a value obtained by adding a value resulting from multiplying the similarity of the pixel value component by a first weight to a value resulting from multiplying the similarity of the distance component by a second weight.

6. The image region extracting apparatus according to claim 5, wherein the control circuit is further configured to:

acquire a distribution of the pixel value components and a distribution of the distance components in the designation region; and

determine a degree of contribution of a characteristic of the pixel value components in the designation region to a characteristic of the target region as the first weight from the distribution of the pixel value components and determine a degree of contribution of a characteristic of the distance components in the designation region to the characteristic of the target region as the second weight from the distribution of the distance components.

7. The image region extracting apparatus according to claim 6, wherein:

the distribution of the pixel value components includes dispersion of the pixel value components and the distribution of the distance components includes dispersion of the distance components; and

a lower weight is determined as the first weight for higher dispersion of the pixel value components and a lower weight is determined as the second weight for higher dispersion of the distance components.

8. The image region extracting apparatus according to claim 7, wherein the control circuit is further configured to:

evaluate the similarity of the pixel value component using an average and standard deviation of the pixel value components in the designation region and calculate the similarity of the distance component using an average and standard deviation of the distance components in the designation region; and

calculate the similarity of the pixel value change pattern using an average and standard deviation of the pixel value change patterns in the designation region and calculates the similarity of the distance change pattern using an average and standard deviation of the distance change patterns in the designation region.

9. The image region extracting apparatus according to claim 1, further comprising:

a stereo camera that captures a stereo image including the image as input;

a display that displays the image; and

a user interface that receives input of the designation region from a user, wherein the control circuit is further configured to;

determine the distance for each position in the image from the stereo image, and

output information indicating an extraction result of the target region.

10. An image region extracting method for extracting, from an image photographed by a camera, a target region based on a designation region, the method comprising:

acquiring a pixel value change pattern and a distance change pattern of each part of the image, the pixel value change pattern being a spatial change characteristic of a pixel value component, and the distance change pattern being a spatial change characteristic of a distance component indicating a distance from a view point of the camera to a subject; and

extracting the target region based on similarities of the pixel value change pattern and the distance change pattern between the designation region and each part of the image.

11. An image region extracting program stored on a non-transitory computer medium for extracting, from an image photographed by a camera, a target region based on a designation region, the program causing a computer to execute processing comprising:

acquiring a pixel value change pattern and a distance change pattern of each part of the image, the pixel value change pattern being a spatial change characteristic of a pixel value component, and the distance change pattern being a spatial change characteristic of a distance component indicating a distance from a view point of the camera to a subject; and

extracting the target region based on similarities of the pixel value change pattern and the distance change pattern between the designation region and each part of the image.