System and method for creating 3D models from 2D sequential image data

• US 6,466,205 B2
• Filed: 11/19/1998
• Issued: 10/15/2002
• Est. Priority Date: 11/19/1998
• Status: Expired due to Term

• Current Assignee: Intellectual Discovery Co., Ltd.
• Original Assignee: Push Entertainment, Inc.
• Inventors: Simpson, Todd, Vanwieren, Edward C., Spooner, David Alan, Bruton, Leonard Thomas
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Santiago, Enrique L.
• Application Number:
  US09/195,889
• Publication Number:
  US 20010052899A1
• Time in Patent Office: 1,426 Days
• Field of Search: 345/419, 345/420, 345/425, 345/426, 345/429, 345/473, 345/474, 345/475, 345/433, 345/434, 345/435, 345/427, 345/428, 345/581, 345/584, 345/619, 345/620, 345/629, 345/479
• US Class Current: 345/419
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes

Abstract

A system and method providing for the generation of an image having enhanced three-dimensional attributes from a source image having only two-dimensional spatial domain information is disclosed. Object image discrimination through the use of machine vision techniques is utilized to identify objects within the source image. Thereafter, object images are dissected into image cells wherein the object images are supplemented to include missing information. Generation techniques are utilized to reassemble the image cells into an image having the desired enhanced three-dimensional attributes.

Claims

1. A system for digitally processing a sequence of source images, said system comprising:

means for differentiating between objects represented in said source images to produce differentiated objects;

means for parsing said source image sequences according to said differentiated objects into image cells, wherein each said image cell substantially consists of information associated with a differentiated object;

means for identifying selected differentiated objects that are associated with scaling transformations in a temporal domain;

means for determining relative planes of said selected differentiated objects;

means for producing stereoscopically enhanced image cells, wherein said means for producing stereoscopically enhanced image cells utilizes at least said relative planes to produce said stereoscopically enhanced image cells.

2. The system of claim 1 wherein said means for producing stereoscopically enhanced image cells creates stereoscopic pairs of image cells for at least certain differentiated objects.

3. The system of claim 2 wherein said means for producing stereoscopically enhanced image cells positions said certain differentiated objects between said pairs of image cells with a difference in parallax.

4. The system of claim 1 further comprising:

means for providing depth enhancement to said differentiated objects.

5. The system of claim 4 wherein said means for providing depth enhancement creates a wire frame for certain ones of said differentiated objects.

6. The system of claim 4 wherein said means for providing depth enhancement creates shading information.

7. The system of claim 6 wherein said means for providing depth enhancement creates a shadow of one of said differentiated objects on a second one of said differentiated objects.

8. A method for digitally processing a sequence of source images, said method comprising:

differentiating between objects represented in said source images to produce differentiated objects;

parsing said source image sequences according to said differentiated objects into image cells, wherein each said image cell substantially consists of information associated with a differentiated object;

identifying selected differentiated objects that are associated with scaling transformations in a temporal domain;

determining relative planes of said selected differentiated objects; and

producing stereoscopically enhanced image cells from said image cells utilizing at least said relative planes.

9. The method of claim 8 wherein said step of producing stereoscopically enhanced image cells creates stereoscopic pairs of image cells for certain differentiated objects.

10. The method of claim 9 wherein said step of producing stereoscopically enhanced image cells positions said certain differentiated objects between said pairs of image cells with a difference in parallax.

11. The method of claim 8 further comprising:

providing depth enhancement to said differentiated objects.

12. The method of claim 11 wherein said step of providing depth enhancement creates a wire frame for certain ones of said differentiated objects.

13. The method of claim 11 wherein said step of providing depth enhancement creates shading information.

14. The method of claim 13 wherein said step of providing depth enhancement creates a shadow of one of said differentiated objects on a second one of said differentiated objects.

15. A computer readable medium containing processor executable instructions for digitally processing a sequence of source images, said computer readable medium comprising:

code for differentiating between objects represented in said source images to produce differentiated objects;

code for parsing said source image sequences according to said differentiated objects into image cells, wherein each said image cell substantially consists of information associated with a differentiated object;

code for identifying selected differentiated objects that are associated with scaling transformations in a temporal domain;

code for determining relative planes of said selected differentiated objects; and

code for producing stereoscopically enhanced image cells, wherein said code for producing stereoscopically enhanced image cells utilizes at least said relative planes to produce said stereoscopically enhanced image cells.

16. The computer readable medium of claim 15 wherein said code for producing stereoscopically enhanced image cells creates stereoscopic pairs of image cells for certain differentiated objects.

17. The computer readable medium of claim 16 wherein said code for producing stereoscopically enhanced image cells positions said certain differentiated objects between said pairs of image cells with a difference in parallax.

18. The computer readable medium of claim 15 further comprising:

code for providing depth enhancement to said differentiated objects.

19. The computer readable medium of claim 18 wherein said code for providing depth enhancement creates a wire frame for certain ones of said differentiated objects.

20. The computer readable medium of claim 18 wherein said code for providing depth enhancement creates shading information.