Depth image-based modeling method and apparatus

• US 20060152507A1
• Filed: 01/09/2006
• Published: 07/13/2006
• Est. Priority Date: 01/08/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Fedyukov, Maxim, Lee, Shinjun, Ignatenko, Alexy, Lee, Heesae, Kim, Dokyoon
• Granted Patent: US 7,903,111 B2
• Time in Patent Office: Days
• US Class Current: 345/423
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 15/205 Image-based rendering

Abstract

A depth image-based modeling method and apparatus. A depth information-based modeling method using a three-dimensional (3D) polygonal mesh includes: extracting a bounding volume (BV) for the 3D polygonal mesh; obtaining a 3D grid by dividing the BV using a plurality of sampling lines; selecting some of a plurality of vertices of the 3D grid that intersect the 3D polygonal mesh as valid vertices; obtaining depth information and color information of the valid vertices by using a plurality of vertices of the 3D polygonal mesh; and modeling an object using the depth information and the color information of the valid vertices.

Claims

1. A depth information-based modeling method using a three-dimensional (3D) polygonal mesh, comprising:

extracting a bounding volume (BV) for the 3D polygonal mesh;

obtaining a 3D grid by dividing the BV using a plurality of sampling lines;

selecting some of a plurality of vertices of the 3D grid that intersect the 3D polygonal mesh as valid vertices;

obtaining depth information and color information of the valid vertices by using a plurality of vertices of the 3D polygonal mesh; and

modeling an object using the depth information and the color information of the valid vertices.

2. The depth information-based modeling method of claim 1, wherein the BV has a minimum size required to surround boundaries of the 3D polygonal mesh.

3. The depth information-based modeling method of claim 1, wherein, in the modeling of the object, a point texture format is used.

4. The depth information-based modeling method of claim 3, wherein the number of sampling lines is determined so as to be proportional to a point resolution of a depth image-based representation (DIBR) image resulting from the modeling of the object.

5. The depth information-based modeling method of claim 1, wherein the selecting some of a plurality of vertices of the 3D grid as the valid vertices comprises:

extracting some of the vertices of the 3D grid that contain a polygonal plane of the 3D polygonal mesh; and

selecting as the valid vertices the extracted vertices that are located inside the respective polygonal planes of the 3D polygonal mesh when projected onto the respective polygonal planes.

6. The depth information-based modeling method of claim 5, wherein, in the extracting some of the vertices of the 3D grid, when a distance between a center of a cube of the 3D grid and a vertex of the cube of the 3D grid is greater than a distance between the center of the cube of the 3D grid and a polygonal plane of the 3D polygonal mesh, the cube of 3D grid is determined so as to contain the polygonal plane of the 3D polygonal mesh and the vertex of the cube of the 3D grid is extracted.

7. The depth information-based modeling method of claim 1, wherein depth information of the vertices of the 3D polygonal mesh that are respectively closest to the vertices of the 3D grid chosen as the valid vertices is used as the depth information of the valid vertices.

8. The depth information-based modeling method of claim 1, wherein the color information of the valid vertices is obtained by using texture coordinates into which coordinates of the vertices of the 3D polygonal mesh that are respectively closest to the valid vertices are converted.

9. A depth information-based modeling method comprising:

converting a three-dimensional (3D) polygonal mesh into a two-dimensional (2D) polygonal mesh by generating a texture map for the 3D polygonal mesh;

generating a grid laid over the 2D polygonal mesh;

obtaining depth information and color information of a plurality of vertices of the grid by using a plurality of vertices of the 2D polygonal mesh; and

modeling an object by using the depth information and the color information of the vertices of the grid.

10. The depth information-based modeling method of claim 9, wherein, in the modeling of the object, a point texture format is used.

11. The depth information-based modeling method of claim 10, wherein the grid is generated so as to be proportional to a point resolution of a depth image-based representation (DIBR) image obtained by the modeling.

12. The depth information-based modeling method of claim 9, wherein the depth information and the color information of the vertices of the grid are obtained by using texture coordinates into which coordinates of the vertices of the 2D polygonal mesh that are respectively closest to the vertices of the grid are converted.

13. A depth information-based modeling apparatus comprising:

a division unit which extracts a bounding volume (BV) for a three-dimensional (3D) polygonal mesh and obtains a 3D grid by dividing the BV using a plurality of sampling lines;

a vertex extraction unit which selects some of a plurality of vertices of the 3D grid that intersect the 3D polygonal mesh as valid vertices;

a depth information extraction unit which obtains depth information of the valid vertices by using a plurality of vertices of the 3D polygonal mesh;

a color information extraction unit which generates a texture map for the vertices of the 3D grid and obtains color information of the valid vertices by using texture coordinates on the texture map that correspond to the vertices of the 3D grid; and

a modeling unit which models an object using the depth information and the color information of the valid vertices.

14. The depth information-based modeling apparatus of claim 13, wherein the division unit extracts a BV having a minimum size required to surround boundaries of the 3D polygonal mesh and divides the BV using a number of sampling lines, and

wherein the number of sampling lines used to divide the BV is determined with reference to a point resolution of a depth image-based representation (DIBR) image.

15. The depth information-based modeling apparatus of claim 13, wherein the vertex extraction unit extracts the vertices of the 3D grid that contain a polygonal plane of the 3D polygonal mesh and selects as the valid vertices the extracted vertices that are located inside respective polygonal planes of the 3D polygonal mesh when projected onto the respective polygonal planes.

16. The depth information-based modeling apparatus of claim 16, wherein the color information of the vertices is obtained by converting coordinates of each of the valid vertices into texture coordinates on the texture map using a Barycentric coordinate system and then converting the texture coordinates of each of the valid vertices into a set of Red, Green, and Blue (RGB) values.

17. A depth information-based modeling apparatus comprising:

a texture map generator which converts a three-dimensional (3D) polygonal mesh into a two-dimensional (2D) polygonal mesh by generating a texture map for the 3D polygonal mesh;

a grid generator which generates a grid laid over the 2D polygonal mesh;

a depth information extracting unit which obtains depth information and color information of a plurality of vertices of the grid by using a plurality of vertices of the 2D polygonal mesh; and

a modeling unit which models an object by using the depth information and the color information of the vertices of the grid.

18. A computer-readable storage medium encoded with processing instructions for causing a processor to execute a depth information-based modeling method using a three-dimensional (3D) polygonal mesh, the depth information-based modeling method comprising:

extracting a bounding volume (BV) for the 3D polygonal mesh;

obtaining a 3D grid by dividing the BV using a plurality of sampling lines;

selecting some of a plurality of vertices of the 3D grid that intersect the 3D polygonal mesh as valid vertices;

obtaining depth information and color information of the valid vertices by using a plurality of vertices of the 3D polygonal mesh; and

modeling an object using the depth information and the color information of the valid vertices.

19. A computer-readable storage medium encoded with processing instructions for causing a processor to execute a depth information-based modeling method, the depth information-based modeling method comprising:

converting a three-dimensional (3D) polygonal mesh into a two-dimensional (2D) polygonal mesh by generating a texture map for the 3D polygonal mesh;

generating a grid laid over the 2D polygonal mesh;

obtaining depth information and color information of a plurality of vertices of the grid by using a plurality of vertices of the 2D polygonal mesh; and

modeling an object by using the depth information and the color information of the vertices of the grid.