SYSTEM AND METHOD FOR USING FEATURE TRACKING TECHNIQUES FOR THE GENERATION OF MASKS IN THE CONVERSION OF TWO-DIMENSIONAL IMAGES TO THREE-DIMENSIONAL IMAGES

• US 20080226128A1
• Filed: 03/11/2008
• Published: 09/18/2008
• Est. Priority Date: 03/12/2007
• Status: Abandoned Application

• Current Assignee: Conversion Works Incorporated
• Original Assignee: Conversion Works Incorporated
• Inventors: Wallner, Natascha, Lowe, Danny D., Spooner, David A., Keech, Gregory R., Simmons, Christopher L., Birtwistle, Steven
• Application Number:
  US12/046,247
• Publication Number:
  US 20080226128A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion

Abstract

The present invention is directed to systems and methods for controlling 2-D to 3-D image conversion and/or generation. The methods and systems use auto-fitting techniques to create a mask based upon tracking features from frame to frame. When features are determined to be missing they are added prior to auto-fitting the mask.

Claims

1. A method of generating a mask for use in generating 2-D to 3-D conversion of an object within an image, said image being present as an image-set across multiple frames of said image;

said method comprising;

selecting at least one feature of said image-set; and

tracking selected ones of said features across said image-set so as to determine if said selected feature is missing from certain frames.

2. The method of claim 1 further comprising:

adding said selected feature into said certain frames when said feature is determined to be missing from said certain frames; and

auto-fitting a mask to fit tracked ones of said features.

3. The method of claim 2 wherein said adding comprises;

manually adding said feature.

4. The method of claim 2 wherein said tracking comprises:

establishing a polycurve polygon of said desired object to be masked within a subset of said image set.

5. The method of claim 4 wherein said subset represents an equal distribution of a total set of said images.

6. The method of claim 5 wherein said equal distribution comprises at least a first, a middle and a last one of said images.

7. The method of claim 4 wherein said tracking assumes that every end point of a polycurve of said polygon corresponds to a feature in said image.

8. The method of claim 7 wherein said tracking comprises:

tracking all endpoints of vertices of said polycurve.

9. The method of claim 8 further comprising:

refining at least one of said vertices.

10. The method of claim 9 wherein said refining comprises using image analysis tools.

11. The method of claim 1 wherein said tracking occurs in a sequential manner from one end of said image set to another end.

12. Code for use in a processor system, said processor system operable, under control of said code, to establish a mask for use in generating 2-D to 3-D conversion of an object within an image, said image being present as an image-set across multiple frames of said image;

said code comprising;

control sequences for selecting at least one feature of said image-set; and

control sequences for tracking selected ones of said features across said image-set so as to determine if said selected feature is missing from certain frames.

13. The code of claim 12 further comprising:

control sequences for adding said selected feature into said certain frames when said feature is determined to be missing from said certain frames.

14. The code of claim 13 wherein said t control sequences for racking comprises:

control sequences for establishing a polycurve polygon of said desired object to be masked within a subset of said image set.

15. The code of claim 12 wherein said control sequences for tracking assumes that every end point of a polycurve of said polygon corresponds to a feature in said image.

16. The code of claim 12 wherein said control sequences for tracking comprises:

control sequences for tracking all endpoints of vertices of said polycurve.

17. A method of generating a mask for use in generating 2-D to 3-D conversion of an object within an image, said image being present as an image-set across multiple frames of said image;

said method comprising;

selecting at least one feature of said image-set;

tracking selected ones of said features across said image-set; and

auto-fitting a mask to fit tracked ones of said features.

18. The method of claim 17 further comprising:

determining certain frames in which said feature is missing;

temporarily inhibiting said auto-fitting when said feature is determined to be missing from said certain frames;

adding said feature into said certain frames; and

enabling said auto-fitting when said feature has been added to said certain frames.

19. The method of claim 18 wherein said tracking comprises:

establishing a polycurve polygon of said desired object to be masked within a subset of said image set.

20. The method of claim 19 wherein said subset represents an equal distribution of a total set of said images.

21. The method of claim 20 wherein said equal distribution comprises at least a first, a middle and a last one of said images.

22. The method of claim 19 wherein said tracking assumes that every end point of a polycurve of said polygon corresponds to a feature in said image.

23. The method of claim 22 wherein said tracking comprises:

tracking all endpoints of vertices of said polycurve.