System, method, and computer program product for determining a quantity of light received by an element of a scene

• US 9,501,865 B2
• Filed: 01/27/2014
• Issued: 11/22/2016
• Est. Priority Date: 09/13/2013
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Gautron, Pascal Albert, Waechter, Carsten Alexander, Droske, Marc, Kettner, Lutz, Keller, Alexander, Binder, Nikolaus, Dahm, Ken Patrik
• Primary Examiner(s): Xiao, Ke
• Assistant Examiner(s): Liu, Gordon
• Application Number:
  US14/165,403
• Publication Number:
  US 20150215512A1
• Time in Patent Office: 1,030 Days
• Field of Search: 345/426
• US Class Current: 1/1
• CPC Class Codes: G06T 15/50 Lighting effects

Abstract

A system, method, and computer program product are provided for determining a quantity of light received by an element of a scene. In use, a quantity of light received by a first element of the scene is determined by averaging a quantity of light received by elements of the scene that are associated with a selected set of light paths.

Claims

1. A method that is executed by a graphics processor including a plurality of shader modules, comprising:

identifying, via the graphics processor, a first element of a scene that is associated with a first light path of the scene, where the first light path corresponds to a predetermined pixel of an image within the scene and is associated with a plurality of elements of the scene;

selecting, via the graphics processor, a second element of the scene that is associated with the light path, using a selection heuristic;

determining, via the graphics processor, properties of the first and second elements of the scene;

selecting, via the graphics processor, a first set of light paths, where each element of the first set of light paths satisfies a first similarity measure with the first light path of the scene;

determining, via the graphics processor, statistical information from the determined properties of the first and second elements of the scene and the selected first set of light paths;

selecting, via the graphics processor, a second set of light paths by selecting a subset of a plurality of light paths corresponding to pixels neighboring the predetermined pixel corresponding to the first light path, where each element of the second set of light paths satisfies a second similarity measure with the first light path of the scene and the determined statistical information, and the second similarity measure includes a distance criterion that is computed based on a light path length estimated as a sum of a first distance from an eye to a first path vertex and a second distance from the first path vertex to a second path vertex; and

determining, via the graphics processor, a quantity of light received by the first element of the scene by averaging a quantity of light received by elements of the scene that are associated with the selected set of light paths.

2. The method of claim 1, wherein each second element of the scene is selected based on a quantity of light received by the second element, optical properties of the second element, and an arbitrary value.

3. The method of claim 2, wherein each arbitrary value is obtained by combining a position of each first element in a generated image with at least one of a pseudo-random number generator or quasi-Monte Carlo points.

4. The method of claim 1, wherein the properties of the first and second elements include a location of each element in space, a surface normal of the element, a diffuse reflectance of the element, and a quantity of light received by the element.

5. The method of claim 1, wherein the first similarity measure is based on relative positions of image pixels corresponding to each light path, a divergence of surface normals at selected elements associated with each light path, and the distance criterion.

6. The method of claim 1, wherein determining the statistical information includes:

determining a median of quantities of light transmitted by each light path of the first set of light paths;

determining an average of quantities of light transmitted by each light path of the first set of light paths; and

determining information representative of a distribution of quantities of light in the first set of light paths.

7. The method of claim 6, wherein determining information representative of a distribution of quantities of light in the first set of light paths includes:

for each light path of the first set of light paths, determining a representation range for the quantities of light transmitted by the light path using a difference between the determined median and the determined average of the quantities of light transmitted by the path; and

determining projection coefficients in a function basis, where the coefficients are representative of the distribution of the quantities of light within the representation range.

8. The method of claim 6, wherein the second set of light paths contains the first light path only if a ratio between a quantity of light transmitted by the first light path and the median of quantities of light transmitted by each light path of the first set of light paths is below a predetermined threshold.

9. The method of claim 1, wherein selecting the second set of light paths that satisfy the second similarity measure includes:

determining a surface normal similarity by comparing a surface normal of the selected elements associated with each of the light paths;

determining a length of each of the light paths;

determining a difference between the determined statistical information for each of the light paths; and

determining that the light paths are similar if the determined surface normal similarity, the distance criterion, length, and statistical information difference are below predetermined threshold values.

10. The method of claim 9, wherein the determination of the difference between the determined statistical information for each of the light paths includes:

comparing values of a median and average quantity of light transmitted by each light path of the first set of light paths; and

determining a difference between information representative of a distribution of quantities of light transmitted by each path of the first set of light paths.

11. The method of claim 10, wherein the difference between information representative of the distribution of quantities of light transmitted by each path of the first set of light paths is determined by comparing projection coefficients of each path.

12. The method of claim 1, wherein selecting the second set of light paths that satisfy the second similarity measure includes:

determining whether a virtual light path connecting the first element and the second element through a camera lens can be created; and

determining that the light paths are similar, if the virtual light path can be created.

13. The method of claim 1, wherein the subset of the plurality of light paths corresponding to pixels is determined by determining a maximum distance between elements associated with the second set of light paths that satisfy the second similarity measure.

14. The method of claim 13, wherein the subset of the plurality of light paths corresponding to pixels is reduced by arbitrarily removing pixels.

15. The method of claim 14, wherein the arbitrarily removed pixels are selected using at least one of a pseudo-random number generator or quasi-Monte Carlo points and an offset value representative of a number of elements of the subset of the plurality of light paths corresponding to pixels.

16. The method of claim 1, wherein each element of the scene includes a pixel of the scene.

17. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform steps comprising:

identifying a first element of a scene that is associated with a first light path of the scene, where the first light path corresponds to a predetermined pixel of an image within the scene and is associated with a plurality of elements of the scene;

selecting a second element of the scene that is associated with the light path, using a selection heuristic;

determining properties of the first and second elements of the scene;

selecting a first set of light paths, where each element of the first set of light paths satisfies a first similarity measure with the first light path of the scene;

determining statistical information from the determined properties of the first and second elements of the scene and the selected first set of light paths;

selecting a second set of light paths by selecting a subset of a plurality of light paths corresponding to pixels neighboring the predetermined pixel corresponding to the first light path, where each element of the second set of light paths satisfies a second similarity measure with the first light path of the scene and the determined statistical information, and the second similarity measure includes a distance criterion that is computed based on a light path length estimated as a sum of a first distance from an eye to a first path vertex and a second distance from the first path vertex to a second path vertex; and

determining a quantity of light received by the first element of the scene by averaging a quantity of light received by elements of the scene that are associated with the selected set of light paths.

18. A system, comprising:

a graphics processor configured to;

identifying a first element of a scene that is associated with a first light path of the scene, where the first light path corresponds to a predetermined pixel of an image within the scene and is associated with a plurality of elements of the scene;

selecting a second element of the scene that is associated with the light path, using a selection heuristic;

determining properties of the first and second elements of the scene;

selecting a first set of light paths, where each element of the first set of light paths satisfies a first similarity measure with the first light path of the scene;

determining statistical information from the determined properties of the first and second elements of the scene and the selected first set of light paths;

selecting a second set of light paths by selecting a subset of a plurality of light paths corresponding to pixels neighboring the predetermined pixel corresponding to the first light path, where each element of the second set of light paths satisfies a second similarity measure with the first light path of the scene and the determined statistical information, and the second similarity measure includes a distance criterion that is computed based on a light path length estimated as a sum of a first distance from an eye to a first path vertex and a second distance from the first path vertex to a second path vertex; and

determining a quantity of light received by the first element of the scene by averaging a quantity of light received by elements of the scene that are associated with the selected set of light paths.