Interactive relighting with dynamic reflectance

• US 7,884,820 B2
• Filed: 06/15/2007
• Issued: 02/08/2011
• Est. Priority Date: 06/15/2007
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zhou, Kun, Lin, Stephen S., Chen, Yanyun, Guo, Baining
• Primary Examiner(s): NGUYEN, PHU K
• Application Number:
  US11/764,062
• Publication Number:
  US 20080309667A1
• Time in Patent Office: 1,334 Days
• Field of Search: 345/419, 345/426, 345/619, 345/629
• US Class Current: 345/426
• CPC Class Codes: G06T 15/506 Illumination models

Abstract

Interactive relighting with dynamic reflectance involves relighting a graphical scene with dynamic changes to the reflectance(s) in the graphical scene. A graphical scene may include source radiance, regions having reflectances, a surface spot, incident radiation from the source radiance at the surface sport, an incident direction, a viewing direction, exit radiance, and so forth. In an example embodiment, a graphical scene is relighted based on at least one adjusted reflectance of the graphical scene using an incident radiance at a surface spot that is separated into respective incident radiance components corresponding to different respective numbers of interreflections in the graphical scene. In another example embodiment, a graphical scene is relighted based on at least one adjusted reflectance of the graphical scene using a tensor representation for a reflectance of a surface spot with the tensor representation being segmented into three adjustable factors for lighting, viewing, and reflectance.

Claims

1. A computer-implemented method performed by a processor unit comprising:

lighting a graphical scene based on a source radiance, one or more scene reflectances, and a view direction, the graphical scene including a surface spot having a reflectance;

adjusting at least one reflectance of the graphical scene;

relighting the graphical scene based on the at least one adjusted reflectance of the graphical scene using an incident radiance at the surface spot that is separated into respective incident radiance components corresponding to different respective numbers of interreflections in the graphical scene, the act of relighting comprising using precomputed transfer tensors (PTTs) to relate the incident radiance components along a path to a first component, the source radiance and a second component, where the first component and the second component represent a global illumination along different light paths that arrive at the surface spot; and

interactively rendering the graphical scene with relighting conditions, the view direction, and the at least one adjusted reflectance.

2. The computer-implemented method as recited in claim 1, wherein the respective incident radiance components comprise three incident radiance components corresponding to direct incident radiance, one-interreflection incident radiance, and two-interreflection incident radiance.

3. A computer-implemented method performed by a processor unit comprising:

lighting a graphical scene based on a source radiance, one or more scene reflectances, and a view direction, the graphical scene including a surface spot having a reflectance;

adjusting at least one reflectance of the graphical scene;

relighting the graphical scene based on the at least one adjusted reflectance of the graphical scene using a tensor representation for the reflectance of the surface spot that is segmented into three adjustable factors comprising a lighting factor, a viewing factor, and a reflectance factor; and

interactively rendering the graphical scene with relighting conditions, the view direction, and the at least one adjusted reflectance.

4. The computer-implemented method as recited in claim 3, wherein the act of relighting comprises:

approximating the tensor representation of the reflectance of the surface spot using a third-order tensor and a tensor factorization algorithm.

5. The computer-implemented method as recited in claim 3, wherein the act of relighting comprises:

extracting a mirror part from at least one reflectance function;

evaluating visual effects for the graphical scene that are derived from the mirror part; and

computing the tensor representation independent of the extracted mirror part.

6. The computer-implemented method as recited in claim 3, wherein the lighting factor reflects an incident direction for the source radiance with respect to the surface spot, the viewing factor reflects a view direction with respect to the surface spot, and the reflectance factor reflects an index into a reflectance function for the reflectance of the surface spot.

7. The computer-implemented method as recited in claim 3, wherein the lighting factor comprises a lighting matrix based on a sampling resolution of an incident direction, the viewing factor comprises a viewing matrix based on a sampling resolution of a view direction, and the reflectance factor comprises a reflectance matrix based on a sampling resolution of a reflectance index.

8. A computer-implemented method comprising:

lighting a graphical scene based on a source radiance, one or more scene reflectances, and a view direction, the graphical scene including a surface spot having a reflectance;

adjusting at least one reflectance of the graphical scene;

relighting the graphical scene based on the at least one adjusted reflectance of the graphical scene (i) using an incident radiance at the surface spot that is separated into respective incident radiance components corresponding to different respective numbers of interreflections in the graphical scene and (ii) using a tensor representation for the reflectance of the surface spot that is segmented into three adjustable factors comprising a lighting factor, a viewing factor, and a reflectance factor;

wherein the incident radiance components comprise a one-bounce interreflection incident radiance component, and the act of relighting comprises;

determining the one-bounce interreflection incident radiance component by performing acts comprising;

computing inner products between a one-bounce precomputed transfer tensor and reflectance function coefficients of each region of the graphical scene;

adding the computed inner products together to obtain one-bounce incident radiance; and

calculating an inner product between the one-bounce incident radiance and a matrix based on the lighting factor; and

displaying the relighted graphical scene having the at least one adjusted reflectance.

9. The computer-implemented method as recited in claim 8, wherein the act of displaying the relighted graphical scene comprises displaying the relighted graphical scene on a display screen;

and wherein the method further comprises;

prior to the act of displaying the relighted graphical scene, displaying the lighted graphical scene on the display screen.

10. The computer-implemented method as recited in claim 8, wherein the act of relighting is performed in real-time.

11. The computer-implemented method as recited in claim 8, wherein the one or more scene reflectances comprise bidirectional reflectance distribution functions (BRDFs) that are generated from at least one of measurements of real materials or a given reflectance model.

12. The computer-implemented method as recited in claim 8, wherein the act of adjusting comprises adjusting any of the one or more scene reflectances, including the reflectance of the surface spot.

13. The computer-implemented method as recited in claim 8, wherein the incident radiance components comprise a direct incident radiance component;

and wherein the act of relighting comprises;

determining the direct incident radiance component responsive to one or more portions of the source radiance that are visible at the surface spot.