SYSTEMS AND METHODS FOR 2-D TO 3-D CONVERSION USING DEPTH ACCESS SEGMENTS TO DEFINE AN OBJECT

• US 20080228449A1
• Filed: 03/11/2008
• Published: 09/18/2008
• Est. Priority Date: 03/12/2007
• Status: Abandoned Application

• Current Assignee: Conversion Works Incorporated
• Original Assignee: Conversion Works Incorporated
• Inventors: Wallner, Natascha, Lowe, Danny D., Spooner, David A., Keech, Gregory R., Simmons, Christopher L., Birtwistle, Steven, Adelman, Jonathan
• Application Number:
  US12/046,235
• Publication Number:
  US 20080228449A1
• Time in Patent Office: Days
• US Class Current: 703/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/579 from motion

Abstract

The present invention is directed to systems and methods for controlling 2-D to 3-D image conversion. The system and method includes receiving an image and masking the objects in the image using segmentation layers Each segmentation layer can have weighted values for static and dynamic features. Iterations are used to form the final image which, if desired, can be formed using less than all of the segmentation layers. A final iteration can be run with the weighted values equal for static and dynamic features.

Claims

1. A method of converting 2-D images to 3-D images, said method comprising:

rendering a point cloud according to a camera model;

obtaining a boolean image from said point cloud;

identifying a plurality of segmentation layers within said boolean image, each said layer having static and dynamic features;

assigning weighted values to said static and dynamic features such that static features receive a higher weight value than do dynamic features; and

calculating a scene geometry by iterating said segmentation layers.

2. The method of claim 1 further comprising:

terminating said iterations when at least one of the following occurs;

a feature classification does not change between iterations;

a specified number of iterations has been performed;

a specified condition has been achieved.

3. The method of claim 2 further comprising:

identifying a sequence of boundary points in said point cloud;

obtaining a polycurve from said sequence of boundary points; and

refining said polycurve.

4. The method of claim 3 further comprising:

rendering a 3-D volume image from an assembled set of generated masks.

5. The method of claim 4 wherein said rendering comprises:

forming, from each said mask, a 2-D mesh, and

converting each said mesh into a 3-D volume mesh.

6. The method of claim 5 said 2-D mesh is constructed using vertices and wherein said 3-D volume mesh converting comprises:

forming a planar 3-D mesh from said 2-D mesh; and

lofting by replicating said surface vertices of said 2-D mesh.

7. The method of claim 2 further comprising:

resetting said weighted values to be even to each other;

running at least one additional iteration with said reset values.

8. The method of claim 7 wherein said weighted values associated with the dynamic features are reset to zero and another iteration is run.

9. A method of creating a 3-D image, said method comprising:

obtaining object models of each said image to be created;

generating a plurality of segmentation layer masks from each said obtained model, each said layer having static and dynamic features; and

rendering a 3-D image from an assembled set of said generated masks.

10. The method of claim 9 further comprising:

assigning weighted values to said static and dynamic features such that static features receive a higher weight value than do dynamic features; and

wherein said generating comprises;

calculating a scene geometry by iterating said segmentation layer masks.

11. The method of claim 10 wherein said masks are generated using polycurve techniques.

12. The method of claim 11 wherein said mask generation comprises:

rendering a point cloud according to a camera model;

obtaining a boolean image from said point cloud;

identifying a sequence of boundary points in said point cloud;

obtaining said polycurve from said sequence of boundary points; and

refining said polycurve.

13. The method of claim 9 wherein said rendering comprises:

forming, from each said mask, a 2-D mesh, and

converting each said mesh into a 3-D planar mesh.

14. The method of claim 13 wherein said converting comprises reverse projection.

15. The method of claim 13 further comprising:

forming a 3-D mesh from said planar mesh.

16. The method of claim 15 wherein said 2-D mesh is constructed using vertices and wherein said 3-D forming comprises:

lofting by replicating surface vertices of said 2-D mesh.

17. The method of claim 9 wherein said rendering comprises:

utilizing less than a full set of said segmentation masks.

18. Code for controlling a processor to create a 3-D image, said code comprising:

control sequences for obtaining object models of each said image to be created;

control sequences for generating a plurality of segmentation layer masks from each said obtained model, each said layer having static and dynamic features; and

control sequences for rendering a 3-D image from an assembled set of said generated masks.

19. The code of claim 18 further comprising:

control sequences for assigning weighted values to said static and dynamic features such that static features receive a higher weight value than do dynamic features; and

wherein said control sequences for generating comprises;

control sequences for calculating a scene geometry by iterating said segmentation layer masks.

20. The code of claim 19 wherein said control sequences for mask generation comprises:

control sequences for rendering a point cloud according to a camera model;

control sequences for obtaining a boolean image from said point cloud;

control sequences for identifying a sequence of boundary points in said point cloud;

obtaining said polycurve from said sequence of boundary points; and

control sequences for refining said polycurve.

21. The code of claim 20 wherein said control sequences for rendering comprises:

control sequences for forming, from each said mask, a 2-D mesh, and

control sequences for converting each said mesh into a 3-D planar mesh.

22. The code of claim 21 further comprising:

control sequences for forming a 3-D mesh from said planar mesh.

23. The code of claim 22 wherein said 2-D mesh is constructed using vertices and wherein said 3-D forming comprises:

control sequences for replicating surface vertices of said 2-D mesh.

24. The code of claim 22 wherein said control sequences for rendering comprises:

control sequences for utilizing less than a full set of said segmentation masks.