System and method for animating real objects with projected images

• US 7,068,274 B2
• Filed: 08/15/2001
• Issued: 06/27/2006
• Est. Priority Date: 08/15/2001
• Status: Expired due to Fees

• Current Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation), University of North Carolina At Chapel Hill (University of North Carolina System)
• Original Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Inventors: Raskar, Ramesh, Low, Kok-Lim, Welch, Gregory F.
• Primary Examiner(s): Nguyen, Kimbinh T.
• Application Number:
  US09/930,322
• Publication Number:
  US 20030034974A1
• Time in Patent Office: 1,777 Days
• Field of Search: 345/420, 345/426, 345/473, 345/418, 345/632, 345/430, 345/63, 345/582, 345/8, 345/419, 345/427, 345/581, 345/589, 348/51
• US Class Current: 345/426
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation

Abstract

A computer implemented method animates a 3D physical object by first acquiring a 3D graphics model of the object. The model is edited with graphics authoring tools to reflect a desired appearance of the object. The edited model is rendered as an image considering a user location and a location of a virtual light. Then, intensity values of the image are corrected according to an orientation of a surface of the object and a radiance at the surface. The 3D physical object can finally be illuminated with the corrected image to give the 3D physical object the desired appearance under the virtual light when viewed from the user location.

Claims

1. A method for animating a 3D physical object, comprising:

acquiring a 3D graphics model of the 3D physical object;

editing the 3D graphics model with graphics authoring tools to reflect a desired appearance of the 3D physical object;

rendering the virtual 3D graphics model as an image considering a user location with respect to the 3D physical object and a location of a virtual light;

correcting intensity values of the image according to an orientation of a surface of the object and a radiance at the surface to generate a corrected image; and

illuminating the 3D physical object with the corrected image to give the 3D physical object the desired appearance under the virtual light when viewed from the user location, wherein the illuminating further comprises;

rendering the virtual 3D graphics model as plurality of images parallel considering the user location and the location of the virtual light;

correcting intensity values of each of the plurality of the plurality of images according to the orientation of the surface of the object and the radiance at the surface to generate a corresponding corrected image for each image of the plurality of images; and

illuminating the 3D physical object with the corrected plurality of images in parallel to give the 3D physical object the desired appearance under the virtual light when viewed from multiple user locations.

2. The method of claim 1 further comprising:

scanning the 3D physical object with a 3D touch probe sensor to acquire the 3D graphics model.

3. The method of claim 1 further comprising:

storing the 3D graphics model in a computer memory as a triangle mesh model entirely specified by connected vertices and orientations of the vertices.

4. The method of claim 1 further comprising:

registering a projector with the 3D physical object, the projector configured to illuminate the 3D physical object with the corrected image.

5. The method of claim 4 further comprising:

specifying separate transformation matrices for the projector and shading parameters that are dependent on the user location.

6. The method of claim 4 wherein the projector is a steerable laser.

7. The method of claim 1 further comprising:

editing view-independent texture and view-dependent material characteristics of the 3D graphics model to reflect the desired appearance.

8. The method of claim 1 wherein the editing is interactive by applying a hand-held virtual paint brush tool directly to the 3D physical object.

9. The method of claim 1 further comprising:

tracking locations of a moving user.

10. The method of claim 1 wherein the moving user is tracked with a stereo-sensor.

11. The method of claim 1 wherein the intensities are corrected using alpha-blending of a rendering engine.

12. The method of claim 1 wherein the 3D physical object includes an arbitrarily shaped surface oriented at various angles.

13. The method of claim 1 further comprising:

blending intensity values in the corrected plurality of images in regions of overlap.

14. The method of claim 1 wherein the desired appearance simulates a rotation of the 3D physical object.

15. The method of claim 1 wherein the 3D physical object is illuminated with a digital projector.

16. A method for animating a 3D physical object, comprising:

acquiring a 3D graphics model of the 3D physical object;

editing the 3D graphics model with graphics authoring tools to reflect a desired appearance of the 3D physical object;

rendering the virtual 3D graphics model as an image considering a user location with respect to the 3D physical object and a location of a virtual light;

correcting intensity values of the image according to an orientation of a surface of the object and a radiance at the surface to generate a corrected image; and

illuminating the 3D physical object with the corrected image to give the 3D physical object the desired appearance under the virtual light when viewed from the user location, wherein the illuminating further comprises;

rendering the virtual 3D graphics model as a plurality of serial images considering a plurality of user location and a plurality of locations of the virtual light;

correcting intensity values of each image according to the orientation of the surface of the object and the radiance at the surface to generate a plurality of corrected images; and

illuminating the 3D physical object serially with the corrected plurality of images give the 3D physical object the desired appearance under the virtual light when viewed from the plurality of user locations.