APPARATUS FOR AND METHOD OF PROCESSING IMAGE BASED ON OBJECT REGION

• US 20160379078A1
• Filed: 06/24/2016
• Published: 12/29/2016
• Est. Priority Date: 06/29/2015
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Yano, Kotaro
• Granted Patent: US 10,163,027 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/77 using statistical methods
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

An image processing apparatus includes an image data acquisition unit configured to acquire image data, a distance information acquisition unit configured to acquire distance information corresponding to the image data, a detection unit configured to detect one or more object regions, each representing an object, from the image data based on the distance information, an extraction unit configured to extract an object region representing an object which does not overlap a specific three-dimensional region, from among detected object regions, based on the distance information, and an image processing unit configured to perform image processing for the image data based on the extracted object region.

Claims

1. An image processing apparatus comprising:

an image data acquisition unit configured to acquire image data;

a distance information acquisition unit configured to acquire distance information corresponding to the image data;

a detection unit configured to detect one or more object regions, each representing an object, from the image data based on the distance information;

an extraction unit configured to extract an object region representing an object which does not overlap a specific three-dimensional region, from among detected object regions, based on the distance information; and

an image processing unit configured to perform image processing for the image data based on the extracted object region.

2. The image processing apparatus according to claim 1, wherein the detection unit detects the object region from the image data based on the distance information and an image feature amount of the image data.

3. The image processing apparatus according to claim 2,

wherein the image feature amount is an image feature amount representing a contour of an object, and

wherein the detection unit extracts an identification feature amount for identifying the contour of the object from the distance information, and detects the object region from the image data based on the identification feature amount and the image feature amount.

4. The image processing apparatus according to claim 3,

wherein the distance information is a range image, and

wherein the detection unit extracts edge information from the range image as the identification feature amount.

5. The image processing apparatus according to claim 1, wherein the image processing unit performs image processing for synthesizing the image data and a background image based on the extracted object region.

6. The image processing apparatus according to claim 5, wherein the image processing unit performs image processing for synthesizing the extracted object region in the image data and a corresponding region in the background image at a predetermined ratio.

7. The image processing apparatus according to claim 5, wherein the image processing unit performs image processing for replacing the extracted object region in the image data with the corresponding region in the background image.

8. The image processing apparatus according to claim 3, wherein the image data acquisition unit acquires image data including no object as a background image.

9. The image processing apparatus according to claim 1, further comprising an output unit configured to output a processing result of the image processing performed by the image processing unit.

10. The image processing apparatus according to claim 1, further comprising a setting unit configured to set the specific three-dimensional region.

11. The image processing apparatus according to claim 10, wherein the setting unit arranges an object corresponding to the specific three-dimensional region, acquires distance information corresponding to the object via the distance information acquisition unit, and sets the specific three-dimensional region based on the distance information.

12. The image processing apparatus according to claim 1, wherein the image processing unit distinguishes an object region of an object existing inside the specific three-dimensional region and an object region of an object existing outside the specific three-dimensional region, among objects whose object positions have been detected by the detection unit, and performs the image processing.

13. The image processing apparatus according to claim 12, wherein the image processing unit performs image processing for making one of the object region of the object existing inside the specific three-dimensional region and the object region of the object existing outside the specific three-dimensional region translucent.

14. The image processing apparatus according to claim 12, wherein the image processing unit performs image processing for blurring one of the object region of the object existing inside the specific three-dimensional region and the object region of the object existing outside the specific three-dimensional region.

15. An image processing method comprising:

acquiring image data;

acquiring distance information corresponding to the image data;

detecting one or more object regions, each representing an object, from the image data based on the distance information;

extracting an object region representing an object which does not overlap a specific three-dimensional region, from among detected object regions, based on the distance information; and

processing the acquired image data based on the extracted object region.

16. A non-transitory computer-readable storage medium storing a program for causing a computer to function as:

an image data acquisition unit configured to acquire image data;

a distance information acquisition unit configured to acquire distance information corresponding to the image data;

a detection unit configured to detect one or more object regions, each representing an object, from the image data based on the distance information;

an extraction unit configured to extract an object region representing an object which does not overlap a specific three-dimensional region, from among detected object regions, based on the distance information; and

an image processing unit configured to perform image processing for the image data based on the extracted object region.