METHOD AND APPARATUS FOR CONVERTING 2D VIDEO IMAGE INTO 3D VIDEO IMAGE

• US 20150229903A1
• Filed: 01/30/2015
• Published: 08/13/2015
• Est. Priority Date: 02/11/2014
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: NAM, Seung Woo, BAN, Yun Ji, JANG, Kyung Ho, KIM, Hye-sun
• Application Number:
  US14/609,876
• Publication Number:
  US 20150229903A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion

Abstract

An apparatus for converting a 2D video into a 3D video updates a plurality of segmentation images of a previous frame by using motion information with respect to each frame, applies depth information of each segmentation image of the previous frame to a corresponding segmentation image of a subsequent frame to create a depth map image of each frame, and creates a stereoscopic image of each frame by using the depth map image of each frame.

Claims

1. A converting method of an apparatus for converting a 2D video into a 3D video, the converting method comprising:

creating a depth map image with respect to a first frame image, among a plurality of continuous frame images of the 2D video, by using color information of the first frame image;

creating depth map images with respect to second to final frame images, among the plurality of frame images, by using motion information between a current frame image and a previous frame image with respect to each frame image; and

creating a stereoscopic image by using the depth map images respectively created from the plurality of frame images.

2. The converting method of claim 1, wherein the creating of the depth map image with respect to the first frame image comprises:

splitting the first frame image into a plurality of segmentation images by using color information of the image; and

applying depth information to each of the plurality of segmentation images to create a depth map image with respect to the first frame image.

3. The converting method of claim 2, wherein the creating of depth map images with respect to the second frame image to the final frame image comprises:

updating a plurality of segmentation images of a previous frame image by using motion information between a current frame image and the previous frame image with respect to each frame image to create a plurality of segmentation images of each frame image; and

applying depth information to each of the plurality of updated segmentations of each frame image to create a depth map image with respect to each frame image.

4. The converting method of claim 3, wherein the creating of depth map images with respect to the second frame image to the final frame image further comprises extracting motion information between the current frame image and the previous frame image.

5. The converting method of claim 3, wherein the creating of a depth map image with respect to each frame image comprises applying the depth information, which has been applied to the plurality of segmentations of the previous frame image, as is to a plurality of segmentations of each frame image updated from the previous frame image.

6. The converting method of claim 3, further comprising correcting the plurality of segmentation images of each frame image.

7. The converting method of claim 6, wherein the correcting comprises combining a segmentation image having a size equal to or smaller than a pre-set size with a neighboring segmentation image by using color information.

8. The converting method of claim 6, wherein the correcting comprises combining pixels without motion information to a neighboring segmentation image or creating a new segmentation image.

9. The converting method of claim 1, wherein the creating of the stereoscopic image comprises shifting pixels of the depth map images respectively created from the plurality of frame images to the left or right to create left and right binocular images.

10. An apparatus for converting a 2D video into a 3D video, the apparatus comprising:

an image splitting unit configured to update a plurality of segmentation images of a previous frame by using motion information with respect to each frame of the 2D video;

a depth map creating unit configured to apply depth information of each segmentation image of the previous frame to a corresponding segmentation image of a subsequent frame to create a depth map image of each frame; and

a 3D converting unit configured to create a stereoscopic image of each frame by using the depth map image of each frame.

11. The apparatus of claim 10, wherein the image splitting unit creates a plurality of segmentation images of a first frame of the 2D video without motion information by using color information of the first frame.

12. The apparatus of claim 11, wherein the depth map creating unit applies depth information to the plurality of segmentation images of the first frame according to a pre-set rule.

13. The apparatus of claim 10, further comprising

a motion extracting unit configured to extract the motion information by using a difference in images of a current frame and a previous frame with respect to each frame.

14. The apparatus of claim 10, wherein the image splitting unit corrects the plurality of corrected segmentation images of each frame.

15. The apparatus of claim 14, wherein the image splitting unit combines a segmentation image having a size equal to or smaller than a pre-set size with a neighboring segmentation image by using color information.

16. The apparatus of claim 14, wherein the image splitting unit combines pixels without motion information to a neighboring segmentation image or creates a new segmentation image.

17. The apparatus of claim 10, wherein the 3D converting unit shifts the depth map image of each frame to the left or right to create left and right binocular images.