Hidden surface removal in graphics processing systems

• US 9,552,665 B2
• Filed: 03/18/2013
• Issued: 01/24/2017
• Est. Priority Date: 03/18/2013
• Status: Active Grant

• Current Assignee: Arm Limited (SoftBank Group Corp.)
• Original Assignee: Arm Limited (SoftBank Group Corp.)
• Inventors: Heggelund, Frode, Tapply, Joe, Glas, Jean-Christophe, Halstvedt, Andreas Engh
• Primary Examiner(s): Crawford, Jacinta M
• Assistant Examiner(s): NGUYEN, PHONG X
• Application Number:
  US13/845,561
• Publication Number:
  US 20140267256A1
• Time in Patent Office: 1,408 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/40 Hidden part removal

Abstract

In a graphics processing pipeline 1, a primitive depth sorting stage 9 is arranged prior to the rasterization stage 3 and rendering stage 6. The primitive depth sorting stage 9 operates to sort successive sub-sets of primitives in a stream of primitives 2 received by the graphics processing pipeline 1 based on their depth values. The so-sorted primitives are then output from the primitive depth sorting stage 9 in their sorted depth order to the rasterizer 3. This makes the depth test stages 4, 13 of the graphics processing pipeline 1 more efficient in their hidden surface removal operations, because the primitives entering the rasterizer 3 will be in depth order.

Claims

1. A method of operating a graphics processing pipeline that includes rasteriser processing circuitry that rasterises input primitives to generate graphics fragments to be processed, each graphics fragment having one or more sampling points associated with it, and renderer processing circuitry that processes fragments generated by the rasteriser processing circuitry to generate output fragment data, the method comprising:

when the graphics processing pipeline is processing a set of graphics primitives, depth sorting primitives of successive sub-sets of the primitives in the set of graphics primitives prior to the rasteriser processing circuitry generating graphics fragments for processing the primitives;

wherein the step of depth sorting primitives of successive sub-sets of the primitives in the set of graphics primitives prior to the rasteriser processing circuitry generating graphics fragments for processing the primitives comprises;

once a sub-set of primitives has been sorted into a sorted sub-set of primitives, passing a primitive in the sorted sub-set of primitives onwards for processing, and adding a next primitive in the set of primitives to the remaining primitives of the sorted sub-set of primitives to generate a new sub-set of primitives for sorting.

2. The method of claim 1, wherein the set of primitives to be processed comprises the primitives that are to be processed to generate a given output tile of a render target to be generated by the graphics processing pipeline.

3. The method of claim 1 wherein the sorting process is performed by one of:

testing a primitive against other primitives in a sub-set of primitives being sorted one-by-one, in a linear order; and

testing a primitive against other primitives in a sub-set of primitives being sorted using a logarithmic search process.

4. The method of claim 1, further comprising:

associating each primitive in a sub-set of primitives being sorted with a respective index value; and

updating the index values associated with the primitives based on the sorting of the primitives within the sub-set.

5. The method of claim 1 wherein a queue is used to retain a sub-set of primitives being sorted while they are being sorted.

6. The method of claim 1 wherein the primitive depth sorting process comprises:

receiving a graphics primitive in the set of graphics primitives for processing, adding the primitive to a primitive queue, determining the position that the primitive should have in the queue based at least on depth values associated with the primitives in the queue, and once the position the primitive should have in the queue based at least on depth values associated with the primitives in the queue has been determined, outputting a primitive from the head of the queue to the rest of the pipeline.

7. The method of claim 1, comprising only re-ordering by the primitive sub-set sorting process primitives in the primitive set that have particular properties.

8. The method of claim 1, further comprising associating with each primitive in a primitive sub-set, information indicating whether the primitive can be re-ordered in the primitive set or not.

9. The method of claim 1, wherein the graphics processing pipeline is a tile-based graphics processing pipeline, and further comprising performing the primitive sub-set depth sorting process on a per tile basis, and depth sorting the primitives within a tile on the basis of the depth values the primitives have within the tile in question.

10. The method of claim 1, wherein the graphics processing pipeline is a tile-based graphics processing pipeline, and the primitive sub-set depth sorting process is carried out during the tiling process before the tile lists are written to memory.

11. A method of operating a graphics processing pipeline that includes rasteriser processing circuitry that rasterises input primitives to generate graphics fragments to be processed, each graphics fragment having one or more sampling points associated with it, and renderer processing circuitry that processes fragments generated by the rasteriser processing circuitry to generate output fragment data, the method comprising:

when the graphics processing pipeline receives a graphics primitive for processing, prior to the rasteriser processing circuitry generating graphics fragments for processing the primitive, adding the primitive to a primitive queue, determining the order in which the primitive should exit the queue based on depth values associated with the primitives in the queue, and outputting primitives from the queue to the rest of the pipeline in the exit order determined based on the depth values associated with the primitives in the queue.

12. A graphics processing pipeline comprising:

rasteriser processing circuitry that rasterises input primitives to generate graphics fragments to be processed, each graphics fragment having one or more sampling points associated with it;

renderer processing circuitry that processes fragments generated by the rasteriser processing circuitry to generate output fragment data; and

primitive depth sorter processing circuitry configured to;

when the graphics processing pipeline is processing a set of graphics primitives, depth sort primitives of successive sub-sets of the primitives in the set of graphics primitives prior to the rasteriser processing circuitry generating graphics fragments for processing the primitives;

wherein the step of depth sorting primitives of successive sub-sets of the primitives in the set of graphics primitives prior to the rasteriser processing circuitry generating graphics fragments for processing the primitives comprises;

once a sub-set of primitives has been sorted into a sorted sub-set of primitives, passing a primitive in the sorted sub-set of primitives onwards for processing, and adding a next primitive in the set of primitives to the remaining primitives of the sorted sub-set of primitives to generate a new sub-set of primitives for sorting.

13. The graphics processing pipeline of claim 12, wherein the set of primitives to be processed comprises the primitives that are to be processed to generate a given output tile of a render target to be generated by the graphics processing pipeline.

14. The graphics processing pipeline of claim 12, wherein the primitive depth sorter processing circuitry is configured to perform at least one of:

testing a primitive against other primitives in a sub-set of primitives being sorted one-by-one, in a linear order; and

testing a primitive against other primitives in a sub-set of primitives being sorted using a logarithmic search process.

15. The graphics processing pipeline of claim 12, wherein the primitive depth sorter processing circuitry is configured to:

associate each primitive in a sub-set of primitives being sorted with a respective index value; and

update the index values associated with the primitives based on the sorting of the primitives within the sub-set.

16. The graphics processing pipeline of claim 12, further comprising:

a queue that retains a sub-set of primitives being sorted while they are being sorted.

17. The graphics processing pipeline of claim 12, wherein the primitive depth sorter processing circuitry is configured to:

receive a graphics primitive in the set of graphics primitives for processing, add the primitive to a primitive queue, determine the position that the primitive should have in the queue based at least on depth values associated with the primitives in the queue, and once the position the primitive should have in the queue based at least on depth values associated with the primitives in the queue has been determined, output a primitive from the head of the queue to the rest of the pipeline.

18. The graphics processing pipeline of claim 12, wherein the primitive depth sorter processing circuitry is configured to:

only re-order by the primitive sub-set sorting process primitives in the primitive set that have particular properties.

19. The graphics processing pipeline of claim 12, wherein the primitive depth sorter processing circuitry is configured to:

associate with each primitive in a primitive sub-set, information indicating whether the primitive can be re-ordered in the primitive set or not.

20. The graphics processing pipeline of claim 12, wherein the graphics processing pipeline is a tile-based graphics processing pipeline, and wherein the primitive depth sorter processing circuitry is configured to:

perform the primitive sub-set depth sorting process on a per tile basis; and

depth sort the primitives within a tile on the basis of the depth values the primitives have within the tile in question.

21. The graphics processing pipeline of claim 12, wherein the graphics processing pipeline is a tile-based graphics processing pipeline, and the primitive depth sorter processing circuitry is configured to:

carry out the sub-set depth sorting process during the tiling process before the tile lists are written to memory.

22. A graphics processing pipeline comprising:

rasteriser processing circuitry that rasterises input primitives to generate graphics fragments to be processed, each graphics fragment having one or more sampling points associated with it;

renderer processing circuitry that processes fragments generated by the rasteriser processing circuitry to generate output fragment data; and

primitive depth sorter processing circuitry configured to, when the graphics processing pipeline receives a graphics primitive for processing, prior to the rasteriser processing circuitry generating graphics fragments for processing the primitive, add the primitive to a primitive queue, determine the order in which the primitive should exit the queue based on depth values associated with the primitives in the queue, and output primitives from the queue to the rest of the pipeline in the exit order determined based on the depth values associated with the primitives in the queue.

23. A non-transitory computer readable storage medium storing computer software code which when executing on a processor performs a method of operating a graphics processing pipeline that includes rasteriser processing circuitry that rasterises input primitives to generate graphics fragments to be processed, each graphics fragment having one or more sampling points associated with it, and renderer processing circuitry that processes fragments generated by the rasteriser processing circuitry to generate output fragment data, the method comprising:

when the graphics processing pipeline is processing a set of graphics primitives, depth sorting primitives of successive sub-sets of the primitives in the set of graphics primitives prior to the rasteriser processing circuitry generating graphics fragments for processing the primitives;

wherein the step of depth sorting primitives of successive sub-sets of the primitives in the set of graphics primitives prior to the rasteriser processing circuitry generating graphics fragments for processing the primitives comprises;

once a sub-set of primitives has been sorted into a sorted sub-set of primitives, passing a primitive in the sorted sub-set of primitives onwards for processing, and adding a next primitive in the set of primitives to the remaining primitives of the sorted sub-set of primitives to generate a new sub-set of primitives for sorting.