Apparatus and method for performing lighting calculations for surfaces of three-dimensional objects

• US 5,563,989 A
• Filed: 09/30/1993
• Issued: 10/08/1996
• Est. Priority Date: 10/02/1992
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Billyard, Adam M.
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): Fetting, Anton W.
• Application Number:
  US08/129,383
• Time in Patent Office: 1,104 Days
• Field of Search: 395/126, 395/119, 395/129, 395/130, 395/131, 395/132
• US Class Current: 345/426
• CPC Class Codes: G06T 15/506 Illumination models

Abstract

Image data representing multi-dimensional objects are processed by calculating lighting characteristics in response to lighting parameters of surfaces and the parameters of light sources.

Surface highlight characteristics are produced by a non-linear process. However, the non-linear process is performed without reference to a view position.

Processing highlight characteristics without reference to the view position allows characteristics to be produced without transforming the view position and without calculating additional vectors.

Claims

1. Apparatus for processing image data representing three-dimensional objects in order to perform lighting calculations for a surface of one of said objects with reference to a light source, said surface having a degree of diffuse reflectivity defined by a diffuse reflectivity coefficient and a degree of specular reflectivity defined by a specular reflectivity coefficient, said apparatus comprising:

means for defining a vector normal to the surface as a surface normal vector;

means for defining a vector directed between the surface and the light source as a light source vector;

means for combining the surface normal vector and the light source vector to form a scalar product thereof;

calculating means for calculating from said scalar product, without reference to a view position, a lighting value for the surface including (i) a diffuse lighting component dependent upon the diffuse reflectivity coefficient and (ii) a specular lighting component dependent upon the specular reflectivity coefficient, said specular component being a non-linear function of said scalar product.

2. Apparatus according to claim 1, wherein not all surfaces have significant levels of specular reflection and said apparatus includes:

means for testing surfaces to group surfaces having significant levels of specular reflection into a first group, and surfaces which do not have a significant level of specular reflection into a second group; and

processing means for performing lighting calculations on surfaces in the first group and the second group in accordance with a first process and a second process, respectively,

wherein said processing means calculates lighting characteristics for successive images of a sequence of images by the appropriate process without re-testing each surface.

3. Apparatus according to claim 1, including means for storing data defining:

(a) a light source position,

(b) a viewing position,

(c) an arrangement of surface primitives defining an object in a local space, and

(d) a local transform for transforming said object into a viewable space;

said apparatus further including;

means for calculating the inverse of said local transform,

means for transforming at least one of the position and an orientation of said light source in accordance with said inverse transform, and

means for determining lighting characteristics of non-transformed primitives of the object in response to the transformed light source.

4. Apparatus according to claim 1, including means for storing data defining:

(a) a light source position,

(b) a viewing position,

(c) an arrangement of surface primitive defining an object in a local space, and

(d) a local transform for transforming said object into viewable 3-dimensional space, said apparatus further including;

means for defining a bounding volume for an object,

means for performing said local transform on said bounding volume,

means for determining the extent to which said volume is transformed into said viewable space; and

means for selecting on the basis of said determination the object for further processing.

5. Apparatus according to claim 1, wherein the light source has an intensity, and the calculating means comprises:

means for combining (i) the scalar product, (ii) the diffuse reflectivity coefficient and (iii) an intensity value representing the intensity of the light source, to produce the diffuse lighting component;

means for transforming the scalar product according to a non-linear function to form a transformed value; and

means for combining (i) the transformed value (ii) the specular reflectivity coefficient and (iii) the intensity value representing the intensity of the light source to form the specular lighting component.

6. Apparatus according to claim 5, wherein the means for transforming the scalar product comprises means for raising the scalar product to a power.

7. Apparatus according to claim 6, wherein the power represents the degree of specularity of the surface.

8. Apparatus according to claim 1, wherein the surface has a color, and the apparatus further comprises:

a look-up table defining, for each lighting value, a color level value, each color level value specifying both luminance and saturation;

means for selecting a color level value from the look-up table in dependence upon the lighting value to form a selected color level value; and

means for combining the color of the surface and the selected color level value to form a pixel value.

9. Apparatus according to claim 8, wherein in the color level values specified in the look-up table, luminance initially increases and saturation latterly decreases for increasing values of the lighting value.

10. Apparatus according to claim 8, wherein in the color level values specified in the look-up table, luminance varies non-linearly with values of the lighting value.

11. Apparatus according to claim 1, further including means for calculating positions of said objects in space, and wherein the lighting calculations are performed in response to positional and surface data with positional calculations in a floating point arithmetic and the lighting calculations in a fixed point arithmetic.

12. Apparatus according to claim 1, further comprising means for rendering the surface to produce rendered image data, and display means for generating a display from the rendered image data.

16. A method according to claim 8, wherein data is stored defining:

(a) a light source position;

(b) a viewing position;

(c) an arrangement of surface primitives defining an object;

(d) a local transform for transforming said object into a viewable 3-dimensional space;

and further comprising the steps of;

(e) defining a bounding volume for an object;

(f) performing said local transform on said bounding volume;

(g) determining an extent to which said bounding volume is transformed into said viewable space; and

(h) selecting, on the basis of said determination, the object for further processing.

17. A method according to claim 8, wherein the light source has an intensity, and the step of calculating the lighting value for the surface comprises:

combining (i) the scalar product, (ii) the diffuse reflectivity coefficient and (iii) an intensity value representing the intensity of the light source, to produce the diffuse lighting component;

transforming the scalar product according to a non-linear function to form a transformed value; and

combining (i) the transformed value (ii) the specular reflectivity coefficient and (iii) the intensity value representing the intensity of the light source to form the specular lighting component.

18. A method according to claim 17, wherein the step of transforming the scalar product comprises raising the scalar product to a power.

19. A method according to claim 18, wherein the power represents the degree of specularity of the surface.

20. A method according to claim 8, wherein the surface has a color, and the method further comprises:

selecting a color level value from a look-up table to give a selected color level value, said look-up table defining, for each lighting value, a color level value, each color level value specifying both luminance and saturation, and said color level value being selected in dependence upon the lighting value; and

combining the color of the surface and the selected color level value to form a pixel value.

21. A method according to claim 25, wherein in the color level values specified in the look-up table, luminance initially increases and saturation latterly decreases for increasing values of the lighting value.

22. A method according to claim 20, wherein in the color level values specified in the look-up table, luminance varies non-linearly with values of the lighting value.

23. A method according to claim 8, further including calculating positions of said objects in space, and wherein the lighting calculations are performed in response to positional and surface data with positional calculations in a floating point arithmetic and the lighting calculations in a fixed point arithmetic.

24. A method according to claim 8, further comprising the step of rendering the surface to produce rendered image data.

25. A method according to claim 24, further comprising the step of generating a signal conveying the rendered image data.

26. A method according to claim 25, further comprising the step of recording the signal.

27. A method according to claim 24, further comprising the step of generating a display from the rendered image data.

13. In an image processing apparatus having a processor for processing signals defining three-dimensional objects, a method of processing the signals to perform lighting calculations for a surface of one of said objects with reference to a light source, said surface having a degree of diffuse reflectivity defined by a diffuse reflectivity coefficient and a degree of specular reflectivity defined by a specular reflectivity coefficient, said method comprising the steps of:

defining a vector normal to the surface as a surface normal vector;

defining a vector directed between the surface and the light source as a light source vector;

combining the surface normal vector and the light source vector to form a scalar product thereof;

calculating from said scalar product, without reference to a view position, a lighting value for the surface including (i) a diffuse lighting component dependent upon the diffuse reflectivity coefficient and (ii) a specular lighting component dependent upon the specular reflectivity coefficient, said specular component being a non-linear function of said scalar product.

14. A method according to claim 13, wherein not all surfaces have significant levels of specular reflection and the method includes:

testing surfaces to group the surfaces having significant levels of specular reflection into a first group and the surfaces which do not have a significant level of specular reflection into a second group, and

processing the first group and the second group in accordance with a first process and a second process, respectively,

wherein the lighting characteristics for successive images of a sequence of images are calculated by the appropriate process without re-testing each surface.

15. A method according to claim 13, further comprising the steps of:

(a) defining a light source position;

(b) defining a viewing position;

(c) defining an arrangement of primitives for an object in a local space;

(d) defining a local transform for transforming said object into viewable space;

(e) calculating an inverse of said local transform,

(f) transforming at least one of a position and an orientation of said light source in accordance with said inverse transform; and

(g) determining lighting characteristics of non-transformed primitives of the object in response to the transformed light source.

28. A computer usable medium having computer readable instruction code means stored therein for causing a computer to process signals defining three dimensional objects to perform lighting calculations for a surface of one of said objects with reference to a light source, said surface having a degree of diffuse reflectivity defined by a diffuse reflectivity coefficient and a degree of specular reflectivity defined by a specular reflectivity coefficient, comprising:

computer readable instruction code means for causing the computer to define a vector normal to the surface as a surface normal vector;

computer readable instruction code means for causing the computer to define a vector directed between the surface and the light source as a light source vector;

computer readable instruction code means for causing the computer to combine the surface normal vector and the light source vector to form a scalar product thereof; and

computer readable instruction code means for causing the computer to calculate from said scalar product, without reference to a view position, a lighting value for the surface including (i) a diffuse lighting component dependent upon the diffuse reflectivity coefficient and (ii) a specular lighting component dependent upon the specular reflectivity coefficient, said specular component being a non-linear function of said scalar product.

29. A computer usable medium having computer readable instruction code means stored therein according to claim 28, wherein not all surfaces of the objects defined by the signals in the computer have significant levels of specular reflection and wherein the computer usable medium further comprises:

computer readable instruction code means for causing the computer to test surfaces to group the surfaces having significant levels of specular reflection into a first group and the surfaces which do not have a significant level of specular reflection into a second group; and

computer readable instruction code means for causing the computer to process the first group and the second group in accordance with a first process and a second process, respectively,

wherein the computer readable instruction code means cause the computer to calculate the lighting characteristics for successive images of a sequence of images by the appropriate process without re-testing each surface.

30. A computer usable medium having computer readable instruction code means stored therein according to claim 28, further comprising:

(a) computer readable instruction code means for causing the computer to define a light source position;

(b) computer readable instruction code means for causing the computer to define a viewing position;

(c) computer readable instruction code means for causing the computer to define an arrangement of primitives for an object in a local space;

(d) computer readable instruction code means for causing the computer to define a local transform for transforming said object into viewable space;

(e) computer readable instruction code means for causing the computer to calculate the inverse of said local transform;

(f) computer readable instruction code means for causing the computer to transform at least one of the position and an orientation of said light source in accordance with said inverse transform; and

(g) computer readable instruction code means for causing the computer to determine lighting characteristics of non-transformed primitives of the object in response to the transformed light source.

31. A computer usable medium having computer readable instruction code means stored therein according to claim 28, wherein data is stored in said computer defining:

(a) n light source position;

(b) a viewing position;

(c) an arrangement of surface primitives defining an object; and

(d) a local transform for transforming said object into viewable 3-dimensional space;

and said computer readable instruction code means further comprising;

computer readable instruction code means for causing the computer to define a bounding volume for an object;

computer readable instruction code means for causing the computer to perform said local transform on said bounding volume;

computer readable instruction code means for causing the computer to determine an extent to which said bounding volume is transformed into said viewable space; and

computer readable instruction code means for causing the computer to select, on the basis of said determination, the object for further processing.

32. A computer usable medium having computer readable instruction code means stored therein according to claim 28, wherein the signals in the computer define an intensity of the light source and the computer readable instruction code means for causing the computer to calculate a lighting value for the surface comprises:

computer readable instruction code means for causing the computer to combine (i) the scalar product, (ii) the diffuse reflectivity coefficient and (iii) an intensity value representing the intensity of the light source, to produce the diffuse lighting component;

computer readable instruction code means for causing the computer to transform the scalar product according to a non-linear function to form a transformed value; and

computer readable instruction code means for causing the computer to combine (i) the transformed value (ii) the specular reflectivity coefficient and (iii) the intensity value representing the intensity of the light source to give the specular lighting component.

33. A computer usable medium having computer readable instruction code means stored therein according to claim 32, wherein the computer readable instruction code means to transform the scalar product includes computer readable instruction code means for raising the scalar product to a power.

34. A computer usable medium having computer readable instruction code means stored therein according to claim 33, wherein the power represents the degree of specularity of the surface.

35. A computer usable medium having computer readable instruction code means stored therein according to claim 28, wherein the signals in the computer define a color of the surface and the computer readable instruction code means further comprises:

computer readable instruction code means for causing the computer to select a color level value from a look-up table to give a selected color level value, said look-up table defining, for each lighting value, a color level value, each color level value specifying both luminance and saturation, and said color level value being selected in dependence upon the lighting value; and

computer readable instruction code means for causing the computer to combine the color of the surface and the selected color level value to form a pixel value.

36. A computer usable medium having computer readable instruction code means stored therein according to claim 35, wherein in the color level values specified in the look-up table, luminance initially increases and saturation latterly decreases for increasing values of the lighting value.

37. A computer usable medium having computer readable instruction code means stored therein according to claim 35, wherein in the color level values specified in the look-up table, luminance varies non-linearly with values of the lighting value.

38. A computer usable medium having computer readable instruction code means stored therein according to claim 28, further including computer readable instruction code means for causing the computer to calculate positions of said objects in space and wherein the computer readable instruction code means cause the computer to perform the lighting calculations in response to positional and surface data with positional calculations in a floating point arithmetic and the lighting calculations in a fixed point arithmetic.

39. A computer usable medium having computer readable instruction code means stored therein according to claim 28, further comprising computer readable instruction code means for causing the computer to render the surface to produce rendered image data.

40. A computer usable medium having computer readable instruction code means stored therein according to claim 39, further comprising computer readable instruction code means for causing the computer to generate a signal conveying the rendered image data.

41. A computer usable medium having computer readable instruction code means stored therein according to claim 40, further comprising computer readable instruction code means for causing the computer to record the signal.

42. A computer usable medium having computer readable instruction code means stored therein according to claim 39, further comprising computer readable instruction code means for causing the computer to generate a display from the rendered image data.