Method and system for multi-pass rendering

• US 5,977,977 A
• Filed: 06/27/1996
• Issued: 11/02/1999
• Est. Priority Date: 08/04/1995
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Snyder, John M., Kajiya, James T.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US08/670,491
• Time in Patent Office: 1,223 Days
• Field of Search: 345/418-20, 345/435-7, 345/501-3
• US Class Current: 345/418
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/60 Shadow generation

Abstract

A method for improved multi-pass rendering in a graphics system includes rendering geometry in a scene to generate rendered image data and then feeding back this rendered image data for a subsequent rendering pass for the same or other geometry in a scene. Geometric primitives are rasterized to generate pixel data, which is stored in a rasterization buffer. The pixel data, including lists of fragment records, is resolved and stored in a shared memory. Resolved pixel data can be combined to generate a display image at real-time, interactive rates. The resolved pixel data can also be used as a texture for subsequent rendering operations. Geometry in a scene can be rasterized in more than one pass to generate pixel data including fragments for partially covered pixels. Fragments from subsequent passes can be blended with corresponding fragments stored in the rasterization buffer from a previous pass.

Claims

1. In a graphics processing system, a method for rendering geometric primitives in a view volume to compute a display image for a view space at a computational rate greater than 10 Hz, the method comprising:

rendering a first set of geometric primitives in a first pass including rasterizing the first set of geometric primitives to generate pixel data, storing the pixel data in a rasterization buffer, including sub-pixel anti-aliasing data, resolving the pixel data, including the sub-pixel anti-aliasing data, in the rasterization buffer to compute anti-aliased pixel data, and transferring the anti-aliased pixel data to a memory device, wherein the first set of geometric primitives represents a first object, the first object is rendered to a first anti-aliased image layer such that the first anti-aliased image layer is independently accessible as a texture map for use in texture mapping operations in other rendering passes within a computational period of the display image, the first object is rendered to sub-divided 2D regions of the view space, and each of the anti-aliased images corresponding to the 2D regions are independently accessible for texture mapping operations;

performing a subsequent rendering pass including rasterizing the first set of geometric primitives using the anti-aliased pixel data as a texture to produce rendered image data;

generating the display image from the rendered image data at the computational rate; and

repeating the above steps to produce subsequent display images at the computational rate.

2. The method of claim 1 wherein the first rasterizing step includes:

rasterizing the first set of geometric primitives to generate a first set of pixel data and storing the first set of pixel data in the rasterization buffer;

rasterizing the first set of geometric primitives to generate a second set of pixel data; and

blending the first and second sets of pixel data, including blending sub-pixel anti-aliasing data for corresponding pixel locations in the first and second sets of pixel data before the pixel data is resolved into a single instance of color values per pixel.

3. The method of claim 2 wherein the first and second sets of pixel data include fragment records having color and depth data;

and the blending of the first and second sets of pixel data includes blending the fragment records for corresponding pixel locations.

4. The method of claim 3 wherein the step of storing the first set of pixel data in the rasterization buffer includes storing fragment records in fragment lists, the fragment lists corresponding to pixel locations;

and

the step of blending the fragment records includes;

for a fragment record in the second set of pixel data corresponding to a first pixel location, searching a fragment list corresponding to the first pixel location for a stored fragment record having the same depth value as the fragment record; and

blending the fragment record with a stored fragment record having the same depth value.

5. The method of claim 1 wherein the computational rate is at least about equal to the frame refresh rate of a physical output device.

6. The method of claim 1 wherein the computational rate is greater than or equal to 50 Hz.

7. The method of claim 1 further including:

rendering a second set of geometric primitives representing a second object in the scene to a second anti-aliased image layer, such that the first and second anti-aliased image layers are independently accessible as texture maps for use in texture mapping operations in other rendering passes within a computational period of the display image.

8. In an image processing system, a method for rendering geometric primitives in a view volume to compute an image for a view space at a computational rate, the method comprising:

in a first rendering pass, rasterizing geometric primitives to generate pixel data including fragment records having color and depth data and corresponding to pixel locations in the image;

storing the pixel data from the first rendering pass including the fragment records in a rasterization buffer;

in a second rendering pass, generating pixel data including fragment records corresponding to the pixel locations in the image; and

blending the color data of the fragment records from the first rendering pass stored in the rasterization buffer with the color data of the fragment records generated in the second rendering pass, including searching fragments records corresponding to a location of an incoming fragment generated in the second pass to find a fragment record from the first rendering pass that is likely to originate from the same geometric primitive as the incoming fragment;

storing blended fragment records in the rasterization buffer; and

resolving the blended fragment records in the rasterization buffer to produce resolved image data,

wherein the first and second rendering passes comprise rasterizing a subset of the geometric primitives in the view volume corresponding to an object, and rasterizing portions of the object to sub-regions of the view space corresponding to each of the portions of the object, such that the rasterization buffer is used to render each of the portions, one portion of the object at a time.

9. The method of claim 8 wherein fragment records include alpha data and the blending step includes blending the color and alpha data of the fragment records from the first rendering pass stored in the rasterization buffer with the color and alpha data of the fragment records generated in the second rendering pass.

10. The method of claim 8 wherein the blending step includes:

for an incoming fragment record generated in the second pass for a pixel location, searching fragment records stored in the rasterization buffer corresponding to the pixel location to find a stored fragment record with the same depth value as the incoming fragment; and

blending the incoming fragment record with a stored fragment having the same depth value as the incoming fragment.

11. The method of claim 9 wherein the fragment records have coverage masks, and including the step of:

finding a fragment record having a matching coverage mask; and

blending the incoming fragment record with the stored fragment having the matching coverage mask.

12. The method of claim 11 further including checking whether the stored fragment having the matching coverage mask has been merged in a previous rendering pass;

and if so, not performing the blending step.

13. The method of claim 8 further including:

storing the resolved image data in memory;

in a third rendering pass, rasterizing geometric primitives to generate pixel data including fragment records for the pixel locations;

and storing the pixel data from the third rendering pass including the fragment records in the rasterization buffer;

retrieving the resolved image data from memory and combining the resolved image data with pixel data from the third rendering pass stored in the rasterization buffer.

14. A system for rendering geometric primitives in a view volume to compute a display image for a view space at a computational rate, the system comprising:

a rasterization buffer;

a rasterizer operable to read geometric primitive data, operable to read rendering control commands, and operable to generate sets of pixel data in multiple rendering passes for a corresponding set of the geometric primitive data in response to a multi-pass rendering control command, wherein each of the sets of pixel data correspond to a 2D image region of a view space, the rasterizer is operable to generate the sets of pixel data in series for one region at a time, the 2D regions correspond to sub-regions of a 2D projection of an object, and the sets of geometric primitives comprise portions of the object;

a pixel engine in communication with the rasterizer to receive the sets of pixel data for the multiple rendering passes, operable to control transfer of at least a first set of selected fragment records to the rasterization buffer, and operable to blend selected fragment records from one or more subsequent rendering passes with corresponding selected fragment records from one or more previous rendering passes stored in the rasterization buffer, the rasterization buffer operable to store blended fragment records after the one or more subsequent rendering passes; and

a pixel post processor in communication with the rasterization buffer operable to resolve blended fragment records and compute anti-aliased sets of a pixel data for each of the image regions and operable to store the anti-aliased set of pixel data for each image region in a memory device such that each image region is independently accessible to the rasterizer and the rasterizer is operable to independently retrieve each of the anti-aliased sets of pixel data for use as texture samples.

15. The system of claim 14 wherein the rasterization buffer includes a fragment buffer to store the blended fragment records and a pixel buffer to store pixel records;

and wherein the pixel engine is in communication with the rasterizer to control transfer of the pixel records to the rasterization buffer.

16. The system of claim 15 wherein the fragment buffer is dual ported, and further including an antialiasing engine in communication with the fragment buffer to resolve the blended fragment records stored in the fragment buffer for a first pixel region, while the pixel engine transfers selected fragment records to the fragment buffer for a second pixel region.

17. The system of claim 15 wherein the fragment buffer is double buffered, and further including an antialiasing engine in communication with the fragment buffer to resolve blended fragment records stored in the fragment buffer for a first pixel region, while the pixel engine transfers selected fragment records to the fragment buffer for a second pixel region.

18. The system of claim 14 further including a texture cache, wherein the rasterizer is in communication with the texture cache to read texture data and to generate a set of pixel data of the sets of pixel data using the texture data.

19. A system for rendering geometric primitives in a view volume to compute a display image for a view space at a computational rate, the system comprising:

gsprite memory;

a texture cache;

a rasterization buffer;

a rasterizer operable to read geometric primitive data, operable to read rendering control commands, and to generate pixel data for a corresponding set of the geometric primitive data in response to a rendering control command, the rasterizer including an interpolator for generating interpolated color values interpolated from the geometric primitive data for pixel locations in the image and a texture modulator for multiplying the interpolated color values by texture or shadow modulation factors derived from texture samples in the texture cache;

a pixel engine in communication with the rasterizer to receive the pixel data, and to control transfer of selected pixel data to the rasterization buffer, including adding texture modulated pixels from the texture modulator with pixel data from a previous rendering pass in the rasterization buffer to composite pixel data from different rendering passes, and

an antialiasing engine in communication with the rasterization buffer to resolve the selected pixel data, including composited pixel data, stored in the rasterization buffer and in communication with the gsprite memory to store resolved pixel data;

the rasterizer being in communication with the gsprite memory to read the resolved pixel data and to control transfers of the resolved pixel data to the texture cache;

the rasterizer being in communication with the texture cache to texture map the resolved pixel data in the texture cache to geometric primitives in the view volume, and to add the texture modulated, resolved pixels to pixel data from the rasterization buffer.