IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND COMPUTER PROGRAM PRODUCT THEREOF

• US 20120113117A1
• Filed: 03/23/2011
• Published: 05/10/2012
• Est. Priority Date: 11/10/2010
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Nakayama, Io, Baba, Masahiro, Shimoyama, Kenichi, Mita, Takeshi
• Application Number:
  US13/069,681
• Publication Number:
  US 20120113117A1
• Time in Patent Office: Days
• US Class Current: 345/420
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

According to an embodiment, an image processing apparatus includes a detecting unit configured to detect at least one object included in an image; a selecting unit configured to select a depth model to be a base of information about depth of the object in accordance with a property of the object; a segment unit configured to segment an area of the object detected from the image; and a depth map creating unit configured to create a depth map representing a depth of the image. The depth map creating unit arranges the depth model at a position on the depth map corresponding to a position of the segmented area of the object in the image, compares an area of the depth model and the area of the object, and gives a corrected depth value to a position not superimposed on other.

Claims

1. An image processing apparatus comprising:

a detecting unit configured to detect at least one object included in an image;

a selecting unit configured to select a depth model to be a base of information about depth of the object in accordance with a property of the object;

a segment unit configured to segment an area of the object detected from the image; and

a depth map creating unit configured to create a depth map representing a depth of the image, wherein

the depth map creating unit arranges the depth model at a position on the depth map corresponding to a position of the segmented area of the object in the image, compares an area of the depth model and the area of the object, and gives a corrected depth value to a position not superimposed on other.

2. The image processing apparatus according to claim 1, wherein when the area of the object includes a first area that is not included in the area of the depth model, the depth map creating unit gives the depth value to a not-superimposed position corresponding to the first area on the depth map, by using information about depth of a position in the depth model in a vicinity of the not-superimposed position.

3. The image processing apparatus according to claim 2, wherein the depth value is a depth value of a pixel in the depth model nearest to the not-superimposed position.

4. The image processing apparatus according to claim 2, wherein the depth value is an average of a depth value of a pixel in the depth model nearest to the not-superimposed position and depth values of a plurality of pixels around the pixel.

5. The image processing apparatus according to claim 2, wherein the depth value is a farthest value among a depth value of a pixel in the depth model nearest to the not-superimposed position and depth values of a plurality of pixels around the pixel.

6. The image processing apparatus according to claim 2, wherein the depth value is a farthest value among depth values of pixels in the depth model.

7. The image processing apparatus according to claim 1, wherein when the area of the depth model includes a second area that is not included in the area of the object, the depth map creating unit deletes a depth value of a not-superimposed position corresponding to the second area on the depth map.

8. The image processing apparatus according to claim 1, wherein when the area of the depth model includes a second area that is not included in the area of the object, the depth map creating unit gives the depth value to a not-superimposed position corresponding to the second area on the depth map, by using information about depth of a position in a vicinity of the not-superimposed position and outside the area of the object.

9. The image processing apparatus according to claim 1, wherein

the detecting unit detects at least a shape of a person from the image as the object,

the selecting unit selects the depth model in accordance with the shape of the person that is detected by the detecting unit from a group of preliminarily-registered depth models of person, and

the segment unit segments an area of the person from the image as the area of the object.

10. The image processing apparatus according to claim 1, wherein when adding information about depth to an area in the area of the object and outside the depth'"'"'model, the information about depth to be added is information indicating a farthest position in the depth model.

11. The image processing apparatus according to claim 1, further comprising a base depth creating unit configured to create a base depth to be added to the image as a base of information about depth of the image, wherein

the base depth creating unit creates the base depth to be located at a position farther than the depth model.

12. The image processing apparatus according to claim 1, further comprising a base depth creating unit configured to create a base depth to be added to the image as a base of information about depth of the image, wherein

the base depth creating unit creates the base depth whose depth is farthest.

13. An image processing method comprising:

detecting at least one object included in an image;

selecting a depth model to be a base of information about depth of the object in accordance with a property of the object;

segmenting an area of the object detected from the image; and

creating a depth map representing a depth of the image, wherein

the creating includes

arranging the depth model at a position on the depth map corresponding to a position of the segmented area of the object in the image,

comparing an area of the depth model and the area of the object, and

giving a corrected depth value to a position not superimposed on other.

14. A computer program product comprising a non-transitory computer-readable medium having programmed instructions, wherein the instructions, when executed by a computer, cause the computer to execute:

detecting at least one object included in an image;

selecting a depth model to be a base of information about depth of the object in accordance with a property of the object;

segmenting an area of the object detected from the image; and

creating a depth map representing a depth of the image, wherein

the creating includes

arranging the depth model at a position on the depth map corresponding to a position of the segmented area of the object detected in the image,

comparing an area of the depth model and the area of the object, and

giving a corrected depth value to a position not superimposed on other.