METHOD AND APPARATUS FOR GENERATING 3D STEREOSCOPIC IMAGE

• US 20130258062A1
• Filed: 06/05/2012
• Published: 10/03/2013
• Est. Priority Date: 03/29/2012
• Status: Abandoned Application

• Current Assignee: Korea Advanced Institute of Science and Technology
• Original Assignee: Korea Advanced Institute of Science and Technology
• Inventors: NOH, Junyong, LEE, Sangwoo, KIM, Young-Hui
• Application Number:
  US13/489,092
• Publication Number:
  US 20130258062A1
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity

Abstract

Provided is a method for generating a 3D stereoscopic image, which includes: generating at least one 3D mesh surface by applying 2D depth map information to a 2D planar image; generating at least one 3D solid object by applying a 3D template model to the 2D planar image; arranging the 3D mesh surface and the 3D solid object on a 3D space and fixing a viewpoint; providing an interface so that cubic effects of the 3D mesh surface and the 3D solid object are correctable on the 3D space, and correcting the cubic effects of the 3D mesh surface and the 3D solid object according to a control value input through the interface; and obtaining a 3D solid image by photographing the corrected 3D mesh surface and 3D solid object with at least two cameras.

Claims

1. A method for generating a 3D stereoscopic image, comprising:

generating at least one 3D mesh surface by applying 2D depth map information to a 2D planar image;

generating at least one 3D solid object by applying a 3D template model to the 2D planar image;

arranging the 3D mesh surface and the 3D solid object on a 3D space and fixing a viewpoint;

providing an interface so that cubic effects of the 3D mesh surface and the 3D solid object are correctable on the 3D space, and correcting the cubic effects of the 3D mesh surface and the 3D solid object according to a control value input through the interface; and

obtaining a 3D solid image by photographing the corrected 3D mesh surface and 3D solid object with at least two cameras.

2. The method for generating a 3D stereoscopic image according to claim 1, wherein, in said correcting of cubic effects of the 3D mesh surface and the 3D solid object, after the 3D mesh surface and the 3D solid object become correctable, a pixel or feature of the 3D mesh surface and the 3D solid object are selected according to the control value input through the interface, and a height of the selected pixel or feature is corrected.

3. The method for generating a 3D stereoscopic image according to claim 1, further comprising:

recalculating a 2D depth map and a 3D template model from the corrected 3D mesh surface and 3D solid object, and storing the recalculated 2D depth map and 3D template model in an internal memory.

4. The method for generating a 3D stereoscopic image according to claim 1, wherein, in said generating of at least one 3D mesh surface, 2D depth map information is applied to a 2D planar image in the unit of layer to generate a 3D mesh surface of each layer.

5. The method for generating a 3D stereoscopic image according to claim 1, wherein, in said generating of at least one 3D solid object, an object having a similar shape to the 3D template model is checked among objects included in the 2D planar image, and the 3D template model is applied to the checked object to generate a 3D solid object.

6. A method for generating a 3D stereoscopic image, comprising:

a 3D model generating unit for generating at least one of a 3D mesh surface and a 3D solid object by applying 2D depth map information and a 3D template model to a 2D planar image;

a 3D space arranging unit for arranging the 3D mesh surface and the 3D solid object on a 3D space and fixing a viewpoint;

a depth adjusting unit for providing an interface so that cubic effects of the 3D mesh surface and the 3D solid object are adjustable on the 3D space, and correcting the cubic effects of the 3D mesh surface and the 3D solid object according to a control value input through the interface; and

a rendering unit for generating a 3D solid image by rendering the corrected 3D mesh surface and 3D solid object with at least two cameras.

7. The method for generating a 3D stereoscopic image according to claim 6, wherein the 3D model generating unit generates a 3D mesh surface of each layer by applying the 2D depth map information to the 2D planar image in the unit of layer.

8. The method for generating a 3D stereoscopic image according to claim 6, wherein, in said generating of at least one 3D solid object, an object having a similar shape to the 3D template model is checked among objects included in the 2D planar image, and the 3D template model is applied to the checked object to generate a 3D solid object.

9. An apparatus for generating a 3D stereoscopic image, comprising:

a 3D model generating unit for generating at least one of a 3D mesh surface and a 3D solid object by applying 2D depth map information and a 3D template model to a 2D planar image;

a 3D space arranging unit for arranging the 3D mesh surface and the 3D solid object on a 3D space and fixing a viewpoint;

a depth adjusting unit for providing an interface so that cubic effects of the 3D mesh surface and the 3D solid object are adjustable on the 3D space, and correcting the cubic effects of the 3D mesh surface and the 3D solid object according to a control value input through the interface; and

a rendering unit for generating a 3D solid image by rendering the corrected 3D mesh surface and 3D solid object with at least two cameras.

10. The apparatus for generating a 3D stereoscopic image according to claim 9, wherein the 3D model generating unit includes:

a 3D mesh service generating unit for generating a 3D mesh surface of each layer by applying the 2D depth map information to the 2D planar image in the unit of layer; and

a 3D template model matching unit for checking an object having a similar shape to the 3D template model among objects included in the 2D planar image, and applying the 3D template model to the checked object to generate a 3D solid object.

11. The apparatus for generating a 3D stereoscopic image according to claim 9, wherein the interface allows a user to check the 3D mesh surface and the 3D solid object arranged on the 3D space by the naked eye and allows the cubic effects of the 3D mesh surface and the 3D template model to be corrected on the 3D space in the unit of pixel or feature.

12. The apparatus for generating a 3D stereoscopic image according to claim 9, further comprising a memory for classifying and storing the 2D planar image, the 2D depth map information and the 3D template model.

13. The apparatus for generating a 3D stereoscopic image according to claim 9, wherein the depth adjusting unit further includes a function of, in the case where the 3D mesh surface and the 3D template model are completely corrected, automatically calculating a new 2D depth map from the corrected 3D mesh surface and automatically calculating new 3D object depth information from the corrected template model, and then storing the calculated new 2D depth map and 3D object depth information in the memory.