METHOD AND APPARATUS FOR EDITING DEPTH IMAGE

• US 20110150321A1
• Filed: 09/27/2010
• Published: 06/23/2011
• Est. Priority Date: 12/21/2009
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: BANG, Gun, KIM, Jin Woong, HUR, Namho, LEE, Soo In, CHEONG, Won-Sik, UM, Gi Mun, SHIN, Hong-Chang
• Application Number:
  US12/890,872
• Publication Number:
  US 20110150321A1
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/12 Edge-based segmentation

Abstract

Provided is a method of editing a depth image, comprising: receiving a selection on a depth image frame to be edited and a color image corresponding to the depth image frame; receiving a selection on an interest object in the color image; extracting boundary information of the interest object; and correcting a depth value of the depth image frame using the boundary information of the interest object.

Claims

1. A method of editing a depth image, comprising:

receiving a selection on a depth image frame to be edited and a color image corresponding to the depth image frame;

receiving a selection on an interest object in the color image;

extracting boundary information of the interest object; and

correcting a depth value of the depth image frame using the boundary information of the interest object.

2. The method of claim 1, wherein:

the correcting comprises extracting, from the depth image frame, boundary information of an area corresponding to the interest object, and

the depth value of the depth image frame is corrected by comparing the boundary information of the area corresponding to the interest object with the boundary information of the interest object.

3. The method of claim 2, wherein the depth value of the depth image frame is corrected using an extrapolation scheme.

4. The method of claim 1, further comprising:

receiving a reselection on the interest object; and

extracting boundary information of the reselected interest object,

wherein the depth value is corrected using the boundary information of the reselected interest object.

5. A method of editing a depth image, comprising:

receiving a selection on a depth image frame to be edited and a color image corresponding to the depth image frame;

extracting object boundary information of a current frame corresponding to the depth image frame using a frame of a previous viewpoint or an adjacent viewpoint of the color image; and

correcting a depth value of the depth image frame using the object boundary information of the current frame.

6. The method of claim 5, wherein the extracting comprises extracting the object boundary information of the current frame by tracing the frame of the previous viewpoint or the adjacent viewpoint of the color image using a motion estimation scheme.

7. The method of claim 5, wherein the correcting comprises determining an object boundary area to be corrected based on the object boundary information of the current frame, and correcting the depth value of the depth image frame by applying an extrapolation scheme to the determined object boundary area.

8. The method of claim 5, wherein the correcting comprises determining an object boundary area to be corrected based on the object boundary information of the current frame, and correcting a depth value of a depth image corresponding to the determined object boundary area using a depth value of a corresponding location in the frame of the previous viewpoint or the adjacent viewpoint of the color image.

9. The method of claim 5, further comprising:

receiving a selection on an object boundary area from which the object boundary information of the current frame is to be extracted; and

re-extracting the object boundary information from the object boundary area,

wherein the depth value of the depth image frame is corrected using the re-extracted object boundary information.

10. An apparatus for editing a depth image, comprising:

an input unit to receive a selection on a depth image frame to be edited, a color image corresponding to the depth image frame, and an interest object in the color image;

an extraction unit to extract boundary information of the interest object; and

an edition unit to correct a depth value of the depth image frame using the boundary information of the interest object.

11. The apparatus of claim 10, wherein:

the edition unit comprises;

a boundary information extraction unit to extract, from the depth image frame, boundary information of an area corresponding to the interest object, and

the edition unit corrects the depth value of the depth image frame by comparing the boundary information of the area corresponding to the interest object with the boundary information of the interest object.

12. The apparatus of claim 11, wherein the edition unit corrects the depth value of the depth image frame using an extrapolation scheme.

13. An apparatus for editing a depth image, comprising:

an input unit to receive a selection on a depth image frame to be edited and a color image corresponding to the depth image frame;

an extraction unit to extract object boundary information of a current frame corresponding to the depth image frame using a frame of a previous viewpoint or an adjacent viewpoint of the color image; and

an edition unit to correct a depth value of the depth image frame using the object boundary information of the current frame.

14. The apparatus of claim 13, wherein the extraction unit extracts the object boundary information of the current frame by tracing the frame of the previous viewpoint or the adjacent viewpoint of the color image using a motion estimation scheme.

15. The apparatus of claim 13, wherein the edition unit determines an object boundary area to be corrected based on the object boundary information of the current frame, and corrects the depth value of the depth image frame by applying an extrapolation scheme to the determined object boundary area.

16. The apparatus of claim 13, wherein the edition unit determines an object boundary area to be corrected based on the object boundary information of the current frame, and corrects a depth value of a depth image corresponding to the determined object boundary area using a depth value of a corresponding location in the frame of the previous viewpoint or the adjacent viewpoint of the color image.