METHODS OF AND APPARATUS FOR PROCESSING COMPUTER GRAPHICS

• US 20130141445A1
• Filed: 11/30/2012
• Published: 06/06/2013
• Est. Priority Date: 12/05/2011
• Status: Active Grant

• Current Assignee: Arm Ltd. (United Kingdom) (SoftBank Group Corp.)
• Original Assignee: Arm Ltd. (United Kingdom) (SoftBank Group Corp.)
• Inventors: Engh-halstvedt, Andreas, Nystad, Jorn, Heggelund, Frode, Pedersen, Ronny
• Granted Patent: US 9,805,447 B2
• Time in Patent Office: Days
• US Class Current: 345/506
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 5/70 Denoising; Smoothing

Abstract

When carrying out a second, higher level of anti-aliasing such as 8× MSAA, in a graphics processing pipeline 1 configured to “natively” support a first level of anti-aliasing, such as 4× MSAA, the rasterisation stage 3, early Z (depth) and stencil test stage 4, late Z (depth) and stencil test stage 7, blending stage 9, and downsampling and writeback (multisample resolve) stage 11 of the graphics processing pipeline 1 process each graphics fragment or pixel that they receive for processing in plural processing passes, each such processing pass processing a sub-set of the sampling points that the fragment represents, but the fragment shader 6 is configured to process each graphics fragment in a processing pass that processes all the sampling points that the fragment represents in parallel, so as to ensure compliance with the desired higher level of multisampled anti-aliasing.

Claims

1. A method of carrying out a higher level of multisampled anti-aliasing in a graphics processing pipeline having a plurality of processing stages, at least some of which are configured to natively support a lower level of multisampled anti-aliasing, the method comprising:

when performing the higher level of multisampled anti-aliasing;

the rasteriser of the graphics processing pipeline generating graphics fragments each representing a set of sampling points for the higher level of anti-aliasing, and passing those fragments to later stages of the graphics processing pipeline for processing;

one or more of the later processing stages of the graphics processing pipeline processing each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel; and

one or more other later processing stages of the graphics processing pipeline processing each graphics fragment that they receive for processing in one or more processing passes, each such processing pass processing a sub-set of the sampling points of the set of sampling points that the fragment represents.

2. The method of claim 1, comprising:

associating each graphics fragment with a coverage mask indicating which of the sampling points in the set of sampling points that the fragment corresponds to are covered by the primitive being sampled; and

wherein;

each fragment generated by the rasteriser is associated with a sampling point coverage mask corresponding to the highest level of anti-aliasing that can be performed; and

the method further comprises;

clearing the appropriate bits in the coverage mask when performing a lower level of anti-aliasing.

3. The method of claim 1, wherein the rasteriser, when performing the higher level of anti-aliasing, performs plural rasterisation passes for each fragment to be generated, each pass testing a sub-set of the set of sampling positions to be generated for the fragment, and then combines the results of these rasterisation passes to generate the fragment that is passed on to the later stages of the graphics processing pipeline.

4. The method of claim 1, wherein the later processing stages of the graphics processing pipeline that process each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel when carrying out the higher level anti-aliasing, comprise at least one of:

a fragment shader, and a varying interpolator of the graphics processing pipeline.

5. The method of claim 1, wherein the later graphics processing stages that subject each fragment to one or more processing passes, each pass processing a sub-set of the sampling points that the fragment represents, when performing higher level anti-aliasing, comprise at least one of:

a blender, and a depth tester of the graphics processing pipeline.

6. The method of claim 1, wherein at least one of the graphics processing stages configured to process each fragment in one or more passes, each pass processing a sub-set of the sampling positions associated with the fragment, when performing higher level anti-aliasing, is configured to be able to omit and/or abort a processing pass for a sub-set of the sampling positions for a fragment for which none of the sampling positions is actually covered.

7. The method of claim 1, comprising at least one of the graphics processing stages that are configured, when performing higher level anti-aliasing, to process each fragment in one or more passes, each pass processing a sub-set of the sampling positions associated with the fragment, when performing higher level anti-aliasing splitting input fragments that they receive for processing from a preceding stage of the graphics processing pipeline into plural sub-fragments, each representing a different sub-set of the sampling points associated with the input fragment, then processing the sub-fragments independently of each other, and then recombining the processed sub-fragments into output fragments for passing to a next stage of the graphics processing pipeline.

8. The method of claim 1, wherein the graphics processing pipeline is a tile-based rendering pipeline, and the method comprises, when performing a higher level of anti-aliasing, processing each tile to be rendered as a plurality of sub-tiles, each representing a part of a tile to be rendered, so as to allow higher level anti-aliasing to be performed without the need to increase the size of the tile buffers.

9. The method of claim 1, wherein:

the graphics processing pipeline includes a downsampling stage to resolve the rendered sample values to output pixel values to be written out to main memory; and

the method further comprises;

when performing higher level anti-aliasing, performing the downsampling operation multiple times for a given output pixel value to be generated, for different parts of the pixel, and then combining the results to give the overall output pixel value to be written back to the main memory.

10. A graphics processing pipeline comprising:

a rasteriser that generates graphics fragments each representing a set of sampling points for a given level of anti-aliasing, and passes those fragments to later stages of the graphics processing pipeline for processing;

one or more processing stages after the rasteriser that process each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel; and

one or more other processing stages after the rasteriser that are configured to natively support a level of multisampled anti-aliasing that is lower than the given level of anti-aliasing and that are configured to process each graphics fragment representing a set of sampling points for the given level of anti-aliasing that they receive for processing in one or more processing passes, each such processing pass processing a sub-set of the sampling points of the set of sampling points that the fragment represents.

11. A graphics processing pipeline comprising:

a rasteriser that generates graphics fragments each representing a set of sampling points to be processed, and that passes those fragments to later stages of the graphics processing pipeline for processing;

one or more processing stages after the rasteriser that when performing a first level of multisampled anti-aliasing process each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel, and that when performing a higher level of anti-aliasing process each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel; and

one or more other processing stages after the rasteriser that when performing the first level of multisampled anti-aliasing process each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel, but that when performing the higher level of anti-aliasing process each graphics fragment that they receive for processing in one or more processing passes, each such processing pass processing a sub-set of the sampling points of the set of sampling points that the fragment represents.

12. The graphics processing pipeline of claim 11, wherein the rasteriser is configured to associate each fragment generated by the rasteriser with a sampling point coverage mask indicating which of the sampling points in the set of sampling points that the fragment corresponds to are covered by the primitive being sampled corresponding to the highest level of anti-aliasing that can be performed, and to clear the appropriate bits in the coverage mask when performing a lower level of anti-aliasing.

13. The graphics processing pipeline of claim 11, wherein the rasteriser is configured to, when performing the higher level of anti-aliasing, perform plural rasterisation passes for each fragment to be generated, each pass testing a sub-set of the set of sampling positions to be generated for the fragment, and to then combine the results of these rasterisation passes to generate the fragment that is passed on to the later stages of the graphics processing pipeline.

14. The graphics processing pipeline of claim 11, wherein the later processing stages of the graphics processing pipeline that process each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel when carrying out the higher level anti-aliasing, comprise at least one of:

a fragment shader, and a varying interpolator of the graphics processing pipeline.

15. The graphics processing pipeline of claim 11, wherein the later graphics processing stages that subject each fragment to one or more processing passes, each pass processing a sub-set of the sampling points that the fragment represents, when performing higher level anti-aliasing, comprise at least one of:

a blender, and a depth tester of the graphics processing pipeline.

16. The graphics processing pipeline of claim 11, wherein one or more of the graphics processing stages configured to process each fragment in one or more passes, each pass processing a sub-set of the sampling positions associated with the fragment, when performing higher level anti-aliasing, are configured to be able to omit and/or to abort a processing pass for a sub-set of the sampling positions for a fragment for which none of the sampling positions is actually covered.

17. The graphics processing pipeline of claim 11, wherein one or more of the graphics processing stages configured to process each fragment in one or more passes, each pass processing a sub-set of the sampling positions associated with the fragment, when performing higher level anti-aliasing, are configured to split input fragments that they receive for processing from a preceding stage of the graphics processing pipeline into plural sub-fragments, each representing a different sub-set of the sampling points associated with the input fragment, to then process the sub-fragments independently of each other, and to then recombine the processed sub-fragments into output fragments for passing to a next stage of the graphics processing pipeline.

18. The graphics processing pipeline of claim 11, wherein the graphics processing pipeline is a tile-based rendering pipeline, and the graphics processing pipeline is configured to, when performing a higher level of anti-aliasing, process each tile to be rendered as a plurality of sub-tiles, each representing a part of a tile to be rendered, so as to allow higher level anti-aliasing to be performed without the need to increase the size of the tile buffers.

19. The graphics processing pipeline of claim 11, wherein:

the graphics processing pipeline includes a downsampling stage to resolve the rendered sample values to output pixel values to be written out to a main memory; and

the downsampling stage is configured to, when performing higher level anti-aliasing, perform the downsampling operation multiple times for a given output pixel value to be generated, for different parts of the pixel, and to then combine the results to give the overall output pixel value to be written back to the main memory.

20. A computer readable storage medium storing computer software code which when executing on a processor performs a method of carrying out a higher level of multisampled anti-aliasing in a graphics processing pipeline having a plurality of processing stages, at least some of which are configured to natively support a lower level of multisampled anti-aliasing, the method comprising:

when performing the higher level of multisampled anti-aliasing;

the rasteriser of the graphics processing pipeline generating graphics fragments each representing a set of sampling points for the higher level of anti-aliasing, and passing those fragments to later stages of the graphics processing pipeline for processing;

one or more of the later processing stages of the graphics processing pipeline processing each graphics fragment that they receive for processing in a processing pass that processes all the sampling points that the fragment represents in parallel; and

one or more other later processing stages of the graphics processing pipeline processing each graphics fragment that they receive for processing in one or more processing passes, each such processing pass processing a sub-set of the sampling points of the set of sampling points that the fragment represents.