Image-based 3D modeling rendering system

• US 20030231175A1
• Filed: 06/17/2002
• Published: 12/18/2003
• Est. Priority Date: 06/17/2002
• Status: Active Grant

• Current Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Inventors: Matusik, Wojciech, Pfister, Hanspeter, Ngan, Wai Kit Addy, Beardsley, Paul, McMillan, Leonard Jr.
• Granted Patent: US 6,903,738 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation

Abstract

A method models a three-dimensional object by first acquiring alpha mattes of the object for multiple viewpoints. The alpha mattes are then projected onto a surface hull completely enclosing the object to construct an opacity hull storing opacity values of the surface of the object. The object is illuminated for various lighting conditions while images are acquired. The images are projected onto the opacity hull to render the object under arbitrary lighting conditions for arbitrary viewpoints.

Claims

1. A system for modeling a three-dimensional object using images, comprising:

means for illuminating the object with a plurality of lighting conditions;

a plurality of cameras for acquiring a plurality of sets of images of the object under the plurality of lighting conditions and a plurality of viewpoints;

means for acquiring a surface hull of the object, the surface hull completely enclosing the object; and

means for projecting the plurality of sets of images onto the surface hull to render the object under arbitrary lighting conditions for arbitrary viewpoints.

2. The system of claim 1 further comprising:

means for generating alpha mattes from the plurality of sets of images.

3. The system of claim 2 further comprising:

means for projecting the alpha mattes onto the surface hull.

4. The system of claim 1 further comprising:

a turntable for placing the object while acquiring the plurality of sets of images.

5. The system of claim 1 wherein the means for illuminating further comprises:

a plurality of backlights having colored patterns to generate alpha mattes, reflectance images, and refraction images.

6. The system of claim 1 wherein the means for illuminating further comprises:

a plurality of overhead lights.

7. The system of claim 1 wherein the means for illuminating further comprises:

a plurality of backlights having colored patterns;

a plurality of overhead lights.

8. The system of claim 6 further comprising:

means for rotating the overhead lights.

9. The system of claim 1 further comprising:

means for acquiring radiance images while rotating the object.

10. The system of claim 1 further comprising:

means for acquiring reflection images while rotating the object.

11. The system of claim 1 further comprising:

means for acquiring refraction images while rotating the object.