Method for efficient construction of high resolution display buffers

• US 10,438,396 B2
• Filed: 12/07/2017
• Issued: 10/08/2019
• Est. Priority Date: 04/05/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Inventors: Berghoff, Tobias
• Primary Examiner(s): Wu, Sing-Wai
• Application Number:
  US15/835,341
• Publication Number:
  US 20180101977A1
• Time in Patent Office: 670 Days
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/405 using Z-buffer
• CPC Class Codes: G06T 15/80 Shading

Abstract

Graphics processing systems and methods are disclosed which may minimize invocations to a pixel shader in order to improve efficiency in a rendering pipeline. In implementations of the present disclosure, a plurality of samples within a pixel may be covered by a primitive. The plurality of samples may include one or more color samples and a plurality of depth samples. The nature of the samples which were covered by the primitive may be taken into account before invoking a pixel shader to perform shading computations on the pixel. In implementations of the present disclosure, if at least one sample is covered by a primitive, but none of the samples are color samples, an invocation to a pixel shader may be avoided.

Claims

1. A method of rendering graphics with a processing unit, the method comprising:

invoking a pixel shader for a first pixel for a first primitive when one or more covered samples include at least one of one or more color samples, wherein the first pixel includes a plurality of samples, wherein the plurality of samples includes the one or more color samples and a plurality of depth samples, wherein the plurality of samples of the first pixel includes the one or more covered samples that are covered by the first primitive; and

not invoking the pixel shader for the first pixel for the first primitive when the one or more covered samples do not include at least one of the one or more color samples but do include at least one depth sample of the plurality of depth samples;

deriving a color value, for the first primitive, for a display pixel not associated with a color sample but associated with a depth sample by assigning a color value of a color sample at a same depth value as the depth sample.

2. The method of claim 1, wherein the one or more color samples of the first pixel is a plurality of color samples and a color sample count of the first pixel is less than a depth sample count of the first pixel.

3. The method of claim 1, further comprising:

performing an early depth test for at least one of the covered samples to determine whether the covered samples are depth occluded.

4. The method of claim 1, further comprising, after said invoking a pixel shader:

performing pixel shader computations for at least one fragment generated for the first pixel from the first primitive.

5. The method of claim 1, further comprising, after said invoking a pixel shader:

performing pixel shader computations for at least one fragment generated for the first pixel from the first primitive, and

after said performing pixel shader computations, applying at least one color value of at least one fragment computed in the pixel shader computations to at least one color sample of the first pixel covered by the first primitive.

6. The method of claim 1, wherein, when a plurality of the color samples are covered by the primitive, the method further comprises, after said invoking a pixel shader:

performing pixel shader computations for one or more single sample fragments respectively generated for each of the plurality of color samples covered by the primitive, and

after said performing pixel shader computations, applying a respective color value of each of the single sample fragments computed in the pixel shader computations to each of the color samples covered by the first primitive, respectively.

7. The method of claim 1, wherein, when a plurality of the color samples are covered by the primitive, the method further comprises, after said invoking a pixel shader:

performing pixel shader computations on one fragment generated for each of the plurality of color samples covered by the primitive, and

after said performing pixel shader computations, applying a color value of the fragment computed in the pixel shader computations to each of the color samples covered by the first primitive.

8. The method of claim 1, wherein the first primitive is a triangle.

9. A system comprising:

a processor, and

a memory coupled to the processor,

wherein the processor is configured to perform a method of rendering graphics, the method comprising;

invoking a pixel shader for the first pixel for the first primitive when one or more covered samples include at least one of one or more color samples, wherein the first pixel includes a plurality of samples, wherein the plurality of samples include the one or more color samples and a plurality of depth samples, wherein the plurality of samples of the first pixel includes the one or more covered samples that are covered by the first primitive; and

not invoking the pixel shader for the first pixel for the first primitive when the one or more covered samples do not include at least one of the one or more color samples but do include at least one depth sample of the plurality of depth samples;

deriving a color value, for the first primitive, for a display pixel not associated with a color sample but associated with a depth sample by assigning a color value of a color sample at a same depth value as the depth sample.

10. The system of claim 9,

wherein the processor includes a central processing unit (CPU) and a graphics processing unit (GPU).

11. The system of claim 9, further comprising a display device,

wherein the method further comprises presenting the graphics on the display device.

12. The system of claim 9, wherein the method further comprises:

performing an early depth test for at least one of the covered samples to determine whether the covered samples are depth occluded.

13. The system of claim 9, wherein the one or more color samples of the first pixel is a plurality of color samples and a color sample count of the first pixel is less than a depth sample count of the first pixel.

14. A graphics processing unit (GPU) comprising:

a memory module; and

a rasterization module implemented in hardware and/or software configured to;

invoke a pixel shader for the first pixel for the first primitive when one or more covered samples that are covered by the first primitive include at least one of one or more color samples, wherein the first pixel includes a plurality of samples, wherein the plurality of samples includes the one or more color samples and a plurality of depth samples, wherein the plurality of samples of the first pixel include as the one or more covered samples; and

not invoke the pixel shader for the first pixel for the first primitive when the one or more covered samples do not include at least one of the one or more color samples but do include at least one depth sample of the plurality of depth samples;

deriving a color value, for the first primitive, for a display pixel not associated with a color sample but associated with a depth sample by assigning a color value of a color sample at a same depth value as the depth sample.

15. The GPU of claim 14, wherein the rasterization module is implemented in hardware.

16. The GPU of claim 14, wherein the rasterization module is further configured to:

perform an early depth test for at least one of the covered samples to determine whether each of said at least one of the covered samples are depth occluded.

17. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method of rendering graphics, the method comprising:

invoking a pixel shader for the first pixel for the first primitive when one or more covered samples that are covered by the first primitive include at least one of one or more color samples, wherein the first pixel includes the one or more color samples and a plurality of depth samples, wherein the plurality of samples includes the one or more covered samples; and

not invoking the pixel shader for the first pixel for the first primitive if said determining determines that the one or more covered samples do not include at least one of the color samples;

deriving a color value, for the first primitive, for a display pixel not associated with a color sample but associated with a depth sample by assigning a color value of a color sample at a same depth value as the depth sample.

18. The non-transitory computer readable medium of claim 17, wherein the method further comprises:

before said determining whether the covered samples include at least one of the color samples, performing an early depth test for at least one of the covered samples to determine whether the covered samples are depth occluded, wherein it is determined in said performing the early depth test that the covered samples include one or more surviving covered samples that are not depth occluded;

wherein said determining whether the covered samples include at least one of the color samples of the first pixel comprises determining whether the surviving covered samples include at least one of the color samples of the first pixel.