Method for measuring the fidelity of warped image layer approximations in a real-time graphics rendering pipeline
First Claim
1. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer that approximates motion of 3D object geometry, comprising:
- factoring a scene into scene elements, where the scene elements include a 3D object or set of 3D objects in the scene;
independently rendering the scene elements to separate image layers;
computing a 2D transform that approximates motion of a scene element from an initial frame to a current frame in an animation sequence;
computing sampling distortion of the 2D transform;
using the sampling distortion to determine whether to re-render the scene element for the current frame;
approximating motion of the scene element by using the sprite transform to transform an initial rendering of the scene element at the initial frame to a new position in the current frame;
compositing the image layers, including at least one transformed layer, into an output image in output device coordinates to construct each frame in the animation sequence.
2 Assignments
0 Petitions
Accused Products
Abstract
A layered graphics rendering pipeline measures image fidelity ("fiducials") to determine how accurately a transformed image layer approximates a rendering of a 3D object. The graphics rendering pipeline approximates the change in position or color of 3D object by transforming a rendering of the 3D object from a previous frame. The pipeline uses the fiducials to control rendering of factored scene elements to independent image layers. The pipeline then combines the layers to compute frames of animation. The types of fiducials include sampling, visibility, and photometric fiducials. The sampling fiducial measures the distortion of an image sample when warped to screen coordinates. The visibility fiducial measures the change in visibility of a scene element since a previous rendering of the scene element. The photometric fiducial measures either the change in lighting from the time of the previous rendering to the current time, or it measures the difference between warped color samples and actual color samples of the scene element for a current frame.
-
Citations
58 Claims
-
1. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer that approximates motion of 3D object geometry, comprising:
-
factoring a scene into scene elements, where the scene elements include a 3D object or set of 3D objects in the scene; independently rendering the scene elements to separate image layers; computing a 2D transform that approximates motion of a scene element from an initial frame to a current frame in an animation sequence; computing sampling distortion of the 2D transform; using the sampling distortion to determine whether to re-render the scene element for the current frame; approximating motion of the scene element by using the sprite transform to transform an initial rendering of the scene element at the initial frame to a new position in the current frame; compositing the image layers, including at least one transformed layer, into an output image in output device coordinates to construct each frame in the animation sequence. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer comprising:
-
factoring a scene into scene elements, where the scene elements include a 3D object or set of 3D objects in the scene; independently rendering the scene elements to separate image layers; computing a 2D transform that approximates motion of a scene element from an initial frame to a current frame in an animation sequence; computing visibility distortion caused by approximating motion of the scene element with the 2D transform by determining transitions between back-facing to front-facing surfaces of characteristic geometry of the scene element from the initial frame to the current frame; using the visibility distortion to determine whether to re-render the scene element for the current frame; approximating motion of the scene element by using the 2D transform to transform an initial rendering of the scene element at the initial frame to a new position in the current frame; compositing the image layers, including one or more transformed layers, into an output image in output device coordinates to construct each frame in the animation sequence. - View Dependent Claims (10, 11, 12, 13)
-
-
14. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer comprising:
-
factoring a scene into scene elements, where the scene elements include a 3D object or set of 3D objects in the scene; independently rendering the scene elements to separate image layers; computing a 2D transform that approximates motion of a scene element from an initial frame to a current frame in an animation sequence by transforming an image layer representing an initial rendering of the scene element; measuring change in lighting of the scene element to compute photometric distortion of the 2D transform; using the photometric distortion to determine whether to re-render the first scene element; approximating motion of the scene element by using the 2D transform to transform an initial rendering of the scene element at the initial frame to a new position in the current frame; to construct frames in the animation sequence, compositing the image layers, including at least one transformed layer, into an output image in output device coordinates. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21)
-
-
22. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer comprising:
-
factoring a scene into scene elements, where each scene element includes a 3D object or set of 3D objects in the scene; independently rendering the scene elements to separate image layers; computing a color warp that approximates change in lighting of a scene element from an initial frame to a current frame in an animation sequence by modifying color values in an image layer representing an initial rendering of the scene element; measuring a difference between warped color values computed by performing the color warp on the initial rendering and color values of the scene element for the current frame to compute photometric distortion; using the photometric distortion to determine whether to re-render the scene element; approximating the change in lighting of the scene element by using the color warp to modify the color values in the initial rendering of the scene element at the initial frame to new color values for the current frame; compositing the image layers, including at least one layer modified using a color warp, into an output image in output device coordinates to construct each frame in the animation sequence. - View Dependent Claims (23, 24, 25, 26, 27, 28)
-
-
29. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer in an output image comprising:
-
factoring a scene into scene elements, where the scene elements include a 3D object or set of 3D objects in the scene; independently rendering the scene elements to separate image layers, including rendering a scene element to a 2D sprite space at a different resolution than a resolution of the output image; computing a 2D transform that transforms the scene element from the 2D sprite space to the screen space of a display device; computing sampling distortion of the 2D transform; using the sampling distortion to determine whether to render the scene element at a different spatial resolution; using the 2D transform to transform a rendering of the scene element from the 2D sprite space to the screen space; compositing the image layers, including at least one transformed layer, into an output image in screen space to construct each frame in the animation sequence.
-
-
30. In a real time graphics rendering pipeline, a method for measuring fidelity of a transformed image layer comprising:
-
factoring a scene into scene elements; independently rendering the scene elements to separate image layers; computing a 2D transform that approximates motion of a scene element from an initial frame to a current frame in an animation sequence; computing sampling distortion, photometric distortion, geometric distortion and visibility distortion of a transformed image layer representing the scene element; using the sampling distortion, photometric distortion, geometric distortion and visibility distortion to determine whether to re-render the scene element; approximating motion of the scene element by transforming an initial rendering of the scene element at the initial frame to a new position in the current frame; compositing the image layers into a output image in output device coordinates to construct frames in the animation sequence.
-
-
31. A method for measuring fidelity of a transformed image layer, comprising:
-
computing a 2D transform that approximates motion of a scene element from an initial frame to a current frame in an animation sequence; computing a sampling distortion measure of the 2D transform; and using the sampling distortion measure to determine accuracy of approximating motion of the scene element with the 2D transform. - View Dependent Claims (32, 33, 34, 35, 36)
-
-
37. A method for measuring fidelity between instances of a scene element comprising:
-
computing a visibility distortion measure of the scene element; and using the visibility distortion measure to determine distortion of an approximation of the scene element. - View Dependent Claims (38, 39, 40, 41, 42, 43)
-
-
44. A method for measuring fidelity between instances of a scene element comprising:
-
computing a photometric distortion measure of the scene element; and using the photometric distortion measure to determine distortion of an approximation of the scene element. - View Dependent Claims (45, 46, 47, 48, 49, 50, 51, 52, 53)
-
-
54. A method for measuring fidelity of a transformed image layer comprising:
-
computing a color warp that approximates change in lighting of a scene element from an initial frame to a current frame in an animation sequence by modifying color values in an image layer representing an initial rendering of the scene element; and measuring a difference between warped color values computed by performing the color warp on the initial rendering and color values of the scene element for the current frame to compute photometric distortion. - View Dependent Claims (55)
-
-
56. A graphics rendering system comprising:
-
a preprocessor for computing a sprite transform used to approximate motion of a scene element and for computing the fidelity of a transformed image layer by measuring sampling, lighting, or visibility distortion of the transformed image layer as a result of the sprite transform being applied to a rendering of the scene element; a rendering sub-system for rendering a scene element to an image layer, and for transforming the image layer by applying the sprite transform to the image layer to approximate motion of the scene element in frames of animation. - View Dependent Claims (57)
-
-
58. A method for measuring the fidelity of an image layer that is re-used in an animation sequence comprising:
-
computing a visibility or photometric distortion measure of a scene element of the image layer; and using the visibility or the photometric distortion measure to determine the accuracy of re-using the image layer rather than re-rendering the scene element for the image layer.
-
Specification