Method system and computer program product for shading

• US 5,880,736 A
• Filed: 06/20/1997
• Issued: 03/09/1999
• Est. Priority Date: 02/28/1997
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Silicon Graphics Incorporated (Graphics Properties Holdings, Inc.)
• Inventors: Airey, John Milligan, Cabral, Brian Keith, Peercy, Mark Stuart
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US08/879,657
• Time in Patent Office: 627 Days
• Field of Search: 345/426, 345/427, 345/428, 345/429, 345/430, 345/117, 345/121
• US Class Current: 345/426
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/60 Shadow generation

Abstract

A method, system, and computer program product are provided for accelerated shading of an object surface by bump mapping in tangent space or object space. A tangent space transform module builds a tangent space transform matrix M(p) having elements comprised of normal, tangent, and binormal vector components determined at a surface point on the object surface. The tangent space transform module further transforms shading vectors, such as, lighting and viewing vectors, into a tangent space defined by the tangent space transform matrix and outputs corresponding tangent space shading vectors. A bump mapping module performs vector operations between one or more tangent space shading vectors and a perturbed normal N'"'"' in tangent space. A texture memory stores a surface dependent or a surface independent tangent space perturbed normal texture map. The lighting module computes a shading value for the surface point based on the vector operations. The shading value can be then be mapped to a pixel to shade the object surface rendered on a computer graphics display. In one example, the bump mapping module outputs diffuse and specular components. The diffuse component corresponds to a first dot product between a normalized, interpolated tangent space lighting vector and three perturbed normal components Nx'"'"', Ny'"'"', and Nz'"'"'. The specular component corresponds to a second dot product between a normalized, interpolated tangent space half angle vector and three perturbed normal components Nx'"'"', Ny'"'"', and Nz'"'"'. Different types of shading vectors and lighting equations can be used depending upon the chosen illumination model. For bump mapping in object space, an object space transformation, such as the inverse of a modelview matrix, is used to define a transformation from eye space to object space for shading vectors. A bump mapping module performs a vector operation between an object space shading vector and a perturbed normal in object space to compute a shading value.

Claims

1. A method for shading a computer graphics image, the computer graphics image including an object surface, comprising the steps of:

building an object space transform matrix that defines a transformation from eye space to object space;

transforming a shading vector defined at a point in eye space into object space defined by said object space transform matrix to form a corresponding object space shading vector;

performing a vector operation between said object space shading vector and a perturbed normal in object space at said point; and

computing a shading value for said point based on said vector operation performed in said performing step;

whereby, said shading value can be mapped to a pixel to shade the object surface.

2. The method of claim 1, further comprising the step of:

storing an object space perturbed normal texture map.

3. The method of claim 2, wherein said storing step stores a surface dependent object space perturbed normal texture map, said surface dependent object space perturbed normal texture map having texels defined by three perturbed normal components Nx'"'"'_OS, Ny'"'"'_OS, and Nz'"'"'_OS, said three perturbed normal components Nx'"'"'_OS, Ny'"'"'_OS, and Nz'"'"'_OS representing in object space the differential surface behavior of the object surface when perturbed by a height field f(u,v).

4. The method of claim 3, wherein said three perturbed normal components Nx'"'"'_OS, Ny'"'"'_OS, and Nz'"'"'_OS are components of an object space perturbed normal N'"'"'_OS defined by the following equation:

space="preserve" listing-type="equation">N'"'"'.sub.OS =((P.sub.u ×

P.sub.v)+D.sub.OS)/|(P.sub.u ×

P.sub.v)+D.sub.OS |

where, P_u and P_v are partial derivatives in object space of the surface in the u and v parametric directions and a displacement vector D_os in object space is given by;

space="preserve" listing-type="equation">D.sub.OS =--ƒ

.sub.u (P.sub.v ×

N)--ƒ

.sub.v (N×

P.sub.u)

where, ƒ

_u and ƒ

_v are partial derivatives of said image height field in u and v and N is the unperturbed normal vector in object space.

5. The method of claim 2, wherein said storing step is performed during preprocessing prior to rendering the computer graphics image.

6. The method of claim 2, wherein said storing step is performed on-the-fly during rendering of the computer graphics image.

7. The method of claim 1, wherein said object space transform matrix building step comprises the step of calculating an inverse of a modelview matrix where the modelview matrix defines a transformation from object space to eye space.

8. The method of claim 1, wherein said shading vector includes at least one of a lighting vector, a viewing vector, and a half angle vector and a reflection vector.

9. The method of claim 1, wherein the object surface is represented by triangles, and for each vertex of a triangle, said transforming step transforms a lighting vector and a viewing vector into an object space defined by said object space transform matrix to form corresponding object space lighting and viewing vectors, and further comprising the steps of:

for each pixel, computing a object space half angle vector based on said object space lighting and viewing vectors.

10. The method of claim 9, wherein,

said vector operation performing step calculates a first dot product between said object space lighting vector and said perturbed normal in object space for each pixel and a second dot product between said object space half angle vector and said perturbed normal in object space for each pixel, and

said shaded value computing step computes said shading value based on a lighting equation having a diffuse component and a specular component raised to a specular power, said diffuse component includes said first dot product and said specular component includes said second dot product.

11. The method of claim 9, further comprising:

for each pixel, prior to computing said object space half angle vector the step of;

interpolating said object space lighting and viewing vectors across at least one corresponding triangle.

12. The method of claim 11, further comprising the step of:

normalizing said object space lighting and viewing vectors after said interpolating step.

13. The method of claim 12, further comprising:

for each pixel, the steps of;

interpolating said object space half angle vector across at least one corresponding triangle; and

normalizing said object space half angle after said object space half angle vector interpolating step.

14. The method of claim 9, further comprising:

for each pixel, the step of;

interpolating said object space half angle vector across at least one corresponding triangle.

15. The method of claim 14, further comprising the step of:

normalizing said object space half angle after said object space half angle vector interpolating step.

16. A system for shading a computer graphics image, the computer graphics image including an object surface, the system comprising:

an object space transform module;

a bump mapping module; and

a lighting module;

wherein said object space transform module builds an object space transform matrix and transforms a shading vector at said point into object space defined by said object space transform matrix to form a corresponding object space shading vector, said object space shading vector being output to said bump mapping module, and

said bump mapping module performs a vector operation between said object space shading vector and a perturbed normal in object space at said point, and provides an output representative of said vector operation, and

said lighting module computes a shading value for said point based on said vector operation output;

whereby, said shading value can be mapped to a pixel to shade the object surface.

17. The system of claim 16, further comprising a texture memory that stores an object space perturbed normal texture map.

18. The system of claim 17, wherein said object space perturbed normal texture map comprises a surface dependent object space perturbed normal texture map having texels defined by three perturbed normal components representing in object space the differential surface behavior of the object surface when perturbed by a height field f(u,v).

19. The system of claim 18, wherein said three perturbed normal components Nx'"'"'_OS, Ny'"'"'_OS s, and Nz'"'"'_OS are components of an object space perturbed normal N'"'"'_OS defined by the following equation:

space="preserve" listing-type="equation">N'"'"'.sub.OS =((P.sub.u ×

P.sub.v)+D.sub.OS)/|(P.sub.u ×

P.sub.v)+D.sub.OS |

where, P_u and P_v are partial derivatives in object space of the surface in the u and v parametric directions and a displacement vector D_OS in object space is given by;

space="preserve" listing-type="equation">D.sub.OS =--ƒ

.sub.u (P.sub.v ×

N)--ƒ

.sub.v (N×

P.sub.u)

where, ƒ

_u and ƒ

_v are partial derivatives of said image height field in u and v and N is the unperturbed normal vector in object space.

20. The system of claim 17, further comprising a texture map generator that generates said perturbed texture map and stores said perturbed texture map in said memory during pre-processing prior to rendering the computer graphics image.

21. The system of claim 17, further comprising a texture map generator that generates said perturbed texture map and stores said perturbed texture map in said memory on-the-fly during rendering of the computer graphics image.

22. The system of claim 16, wherein said object space transform module calculates an inverse of a modelview matrix where the modelview matrix defines a transformation from object space to eye space.

23. The system of claim 16, wherein said shading vector includes at least one of a lighting vector, a viewing vector, a half angle vector, and a reflection vector.

24. The system of claim 16, wherein the object surface is represented by triangles, and for each vertex of a triangle, said object space transform module transforms a lighting vector and a viewing vector into an object space defined by said object space transform matrix to form corresponding object space lighting and viewing vectors;

and

for each pixel, said bump mapping module further computes an object space half angle vector based on said object space lighting and viewing vectors.

25. The system of claim 24, wherein, for each pixel,

said bump mapping module calculates a first dot product between said object space lighting vector and said perturbed normal in object space for each pixel and a second dot product between said object space half angle vector and said perturbed normal in object space for each pixel, and

said lighting module computes said shading value based on a lighting equation having a diffuse component and a specular component raised to a specular power, said diffuse component includes said first dot product and said specular component includes said second dot product.

26. The system of claim 24, wherein said bump mapping module further comprises:

an interpolator that interpolates said object space lighting and viewing vectors for each pixel across at least one corresponding triangle, and outputs an interpolated object space lighting vector and an interpolated object space viewing vector.

27. The system of claim 26, wherein said bump mapping module further comprises:

a normalizer, coupled to said interpolator, said normalizer normalizes said interpolated object space lighting and viewing vectors.

28. The system of claim 27, wherein said bump mapping module further comprises:

an interpolator that interpolates said object space half angle vector for each pixel across at least one corresponding triangle, and outputs an interpolated object space half angle vector.

29. The system of claim 24, wherein said bump mapping module further comprises:

an interpolator that interpolates said object space half angle vector for each pixel across at least one corresponding triangle, and outputs an interpolated object space half angle vector.

30. The system of claim 29, wherein said bump mapping module further comprises:

a normalizer that normalizes said interpolated object space half angle vector.

31. A system for shading an object surface, the system comprising:

means for building an object space transform matrix that defines a transformation from eye space to object space;

means for transforming a shading vector defined at a point in eye space into object space defined by said object space transform matrix to form a corresponding object space shading vector;

means for performing a vector operation between said object space shading vector and a perturbed normal in object space at said point; and

means for computing a shading value for said point based on said vector operation;

whereby, said shading value can be mapped to a pixel to shade the object surface when rendered on a computer graphics display.

32. A computer program product comprising a computer useable medium having computer program logic recorded thereon for enabling a graphics processor in a computer system to shade an object surface in a computer graphic image, said computer program logic comprising:

means for enabling the graphics processor to build an object space transform matrix that defines a transformation from eye space to object space;

means for enabling the graphics processor to transform a shading vector defined at a point in eye space into object space defined by said object space transform matrix to form a corresponding object space shading vector;

means for enabling the graphics processor to perform a vector operation between said object space shading vector and a perturbed normal in object space at said point; and

means for enabling the graphics processor to compute a shading value for said point based on said vector operation;

whereby, said shading value can be mapped to a pixel to shade the object surface when rendered on a computer graphics display.

33. A system for shading a computer graphics image, the comprising:

Phong shading hardware;

a texture memory for storing an object space perturbed normal texture map; and

a switch coupled between said Phong shading hardware and said texture memory;

whereby, object space bump mapping can shade the computer graphics image when said switch is in a state connecting said texture memory to said Phong shading hardware.

34. The system of claim 33, wherein said switch couples said texture memory to a normalizer unit in said Phong shading hardware.

35. The system of claim 33, wherein said switch comprises a multiplexer.

36. A method for shading a computer graphics image, the computer graphics image including an object surface, comprising the steps of:

fetching a normal vector for the object surface from memory, said normal vector being defined in terms of a coordinate space;

transforming a shading vector into said coordinate space; and

performing a lighting computation in said coordinate space using said normal vector and said transformed shading vector.

37. A system for shading a computer graphics image, the computer graphics image including an object surface, comprising:

means for fetching a normal vector for the object surface from memory, said normal vector being defined in terms of a coordinate space;

means for transforming a shading vector into said coordinate space; and

means for performing a lighting computation in said coordinate space using said normal vector and said transformed shading vector.

38. A computer program product comprising a computer useable medium having computer program logic recorded thereon for enabling a graphics processor in a computer system to shade an object surface in a computer graphic image, said computer program logic comprising:

means for enabling the graphics processor to fetch a normal vector for the object surface from memory, said normal vector being defined in terms of a coordinate space;

means for enabling the graphics processor to transform a shading vector into said coordinate space; and

means for enabling the graphics processor to perform a lighting computation in said coordinate space using said normal vector and said transformed shading vector.

39. A method for shading a computer graphics image, the computer graphics image including an object surface, comprising the steps of:

fetching a perturbed normal vector for the object surface from memory, said perturbed normal vector being defined in terms of a coordinate space;

transforming a shading vector into said coordinate space; and

performing a lighting computation in said coordinate space using said perturbed normal vector and said transformed shading vector.

40. A system for shading a computer graphics image, the computer graphics image including an object surface, comprising:

means for fetching a perturbed normal vector for the object surface from memory, said perturbed normal vector being defined in terms of a coordinate space;

means for transforming a shading vector into said coordinate space; and

means for performing a lighting computation in said coordinate space using said perturbed normal vector and said transformed shading vector.

41. A computer program product comprising a computer useable medium having computer program logic recorded thereon for enabling a graphics processor in a computer system to shade an object surface in a computer graphic image, said computer program logic comprising:

means for enabling the graphics processor to fetch a perturbed normal vector for the object surface from memory, said perturbed normal vector being defined in terms of a coordinate space;

means for enabling the graphics processor to transform a shading vector into said coordinate space; and

means for enabling the graphics processor to perform a lighting computation in said coordinate space using said perturbed normal vector and said transformed shading vector.