Varying effective resolution by screen location by changing active color sample count within multiple render targets

• US 10,614,549 B2
• Filed: 08/31/2018
• Issued: 04/07/2020
• Est. Priority Date: 04/05/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Berghoff, Tobias
• Primary Examiner(s): Wu, Sing-Wai
• Application Number:
  US16/119,274
• Publication Number:
  US 20180374195A1
• Time in Patent Office: 585 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0189 Sight systems
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/80 Shading
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2210/36 Level of detail
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A graphics processing unit (GPU) is configured to receive metadata specifying an active sample configuration for a particular region of a display device among a plurality of regions of the display device and receive pixel data for one or more pixels in the particular region. The pixel data specifies the same number of color samples for each pixel. For each pixel in the particular region, the GPU invokes a pixel shader only for color samples specified to be active samples by the configuration.

Claims

1. A method for graphics processing with a graphics processing system having a graphics processing unit coupled to a display device, comprising:

receiving metadata specifying an active sample configuration for a particular region of a screen of the display device among a plurality of regions of the screen, wherein the metadata specifies different active sample configurations for regions of the screen that have different resolutions;

receiving pixel data for one or more pixels of an image in the particular region, wherein the pixel data specifies the same number of color samples for each pixel;

wherein the number of color samples for each pixel specified by the pixel data is the same over an entire surface of the screen, and for each pixel in the particular region that is covered by a primitive, invoking a pixel shader only for color samples for the pixel specified to be active samples by the active sample configuration, wherein pixel shading computations of the pixel shader super-sample each pixel by virtue of being invoked for each active color sample of each pixel in the particular region that is covered by the primitive.

2. The method of claim 1, wherein the metadata specifies a mask of active samples for the particular region and wherein invoking the pixel shader only for active samples includes performing a logical AND between the mask and a set of samples covered by a primitive to determine the active samples for the primitive for which the pixel shader is to be invoked.

3. The method of claim 1, wherein the metadata specifies an active sample count for the particular region of the plurality of regions;

wherein the active sample count is less than or equal to the number of color samples, wherein the number of color samples is two or more;

wherein invoking the pixel shader only for active samples includes for each pixel in the particular region, invoking a pixel shader only for a number of the color samples for the pixel equal to the active sample count.

4. The method of claim 1, wherein the metadata is configured such that an active sample count for one or more regions of the plurality located near a center of the screen is greater than an active sample count for one or more regions of the plurality located near a periphery of the screen.

5. The method of claim 1, wherein the metadata is configured such that an active sample count for one or more regions of the plurality located near a center of the screen is greater than an active sample count for one or more regions of the plurality located near an edge of the screen and wherein the active count for the one or more regions located near the edge of the screen is greater than an active count for one or more regions of the plurality located near a corner of the screen.

6. The method of claim 1, wherein the display device is characterized by a field of view of 90 degrees or more.

7. The method of claim 1, wherein the display device is a head-mounted display device.

8. The method of claim 1, further comprising determining a portion of a screen of the display device that a user is looking at and wherein the metadata is configured to vary the pixel resolution such that pixel resolution is highest for one or more subsections of the screen containing the portion the user is looking at.

9. The method of claim 1, wherein the metadata is static for given optics and a given field of view of the display device.

10. The method of claim 1, wherein the metadata is configured to specify different active color samples for different regions of the screen.

11. The method of claim 1, wherein, each region of the plurality corresponds to a fixed size portion of the screen.

12. The method of claim 1, wherein each region of the plurality corresponds to a variable size portion of the screen.

13. The method of claim 1, wherein the metadata defines each region of the plurality of regions by ranges of pixels in vertical and horizontal directions.

14. The method of claim 1, wherein the metadata defines each region of the plurality by coarse rasterization tiles of some size.

15. The method of claim 1, wherein a portion of the metadata associated with a particular region of the plurality includes information specifying an active color sample count for the particular region.

16. The method of claim 1, wherein the metadata is stored in the form of a table in a memory and/or graphics memory.

17. A system for graphics processing, comprising

a graphics processing unit (GPU) configured to

receive metadata specifying an active sample configuration for a particular region of a screen of a display device among a plurality of regions of the screen, wherein the metadata specifies different active sample configurations for regions of the screen that have different resolutions;

receive pixel data for one or more pixels of an image in the particular region, wherein the pixel data specifies the same number of color samples for each pixel wherein the number of color samples for each pixel specified by the pixel data is the same over an entire surface of the screen; and

for each pixel in the particular region that is covered by a primitive, invoke a pixel shader only for color samples for the pixel specified to be active samples by the active sample configuration, wherein pixel shading computations of the pixel shader super-sample each pixel by virtue of being invoked for each active color sample of each pixel in the particular region that is covered by the primitive.

18. The system of claim 17, wherein the metadata specifies a mask of active samples for the particular region and wherein the graphics processing unit is configured to invoke the pixel shader only for active samples by performing a logical AND between the mask and a set of samples covered by a primitive to determine the active samples for the primitive for which the pixel shader is to be invoked.

19. The system of claim 17, wherein the metadata specifies an active sample count for the particular region of the plurality of regions, wherein the active sample count is less than or equal to the number of color samples, wherein the number of color samples is two or more;

and

wherein the GPU is configured to invoke the pixel shader only for active samples includes for each pixel in the particular region by invoking a pixel shader only for a number of the color samples for the pixel equal to the active sample count.

20. The system of claim 17, wherein the metadata is configured such that an active sample count for one or more regions of the plurality located near a center of the screen is greater than an active sample count for one or more regions of the plurality located near a periphery of the screen.

21. The system of claim 17, wherein the metadata is configured such that an active sample count for one or more regions of the plurality located near a center of the screen is greater than an active sample count for one or more regions of the plurality located near an edge of the screen and wherein the active count for the one or more regions located near the edge of the screen is greater than an active count for one or more regions of the plurality located near a corner of the screen.

22. The system of claim 17, further comprising the display device, wherein the display device is characterized by a field of view of 90 degrees or more.

23. The system of claim 17, further comprising the display device, wherein the display device is a head-mounted display device.

24. The system of claim 17, wherein the system is configured to determine a portion of a screen of the display device that a user is looking at and wherein the metadata is configured to vary the pixel resolution such that pixel resolution is highest for one or more subsections of the screen containing the portion the user is looking at.

25. The system of claim 17, wherein the system is configured to use static metadata for given optics and field of view of the display device.

26. The system of claim 17, wherein the metadata is configured to specify different active color samples for different regions of the screen.

27. The system of claim 17, wherein, each region of the plurality corresponds to a fixed size portion of the screen.

28. The system of claim 17, wherein each region of the plurality corresponds to a variable size portion of the screen.

29. The system of claim 17, wherein the metadata defines each region of the plurality of regions by ranges of pixels in vertical and horizontal directions.

30. The system of claim 17, wherein the metadata defines each region of the plurality by coarse rasterization tiles of some size.

31. The system of claim 17, wherein a portion of the metadata associated with a particular region of the plurality includes information specifying an active color sample count for the particular region.

32. The system of claim 17, further comprising a memory and/or graphics memory, wherein the metadata is stored in the form of a table in the memory and/or graphics memory.

33. A non-transitory computer-readable medium having computer executable instructions embodied therein that, when executed, implement a method for graphics processing with a graphics processing system having a graphics processing unit coupled to a display device, the method comprising:

receiving metadata specifying an active sample configuration for a particular region of a screen of the display device among a plurality of regions of the screen, wherein the metadata specifies different active sample configurations for regions of the screen that have different resolutions;

receiving pixel data for one or more pixels of an image in the particular region, wherein the pixel data specifies the same number of color samples for each pixel wherein the number of color samples for each pixel specified by the pixel data is the same over an entire surface of the screen; and

for each pixel in the particular region that is covered by a primitive, invoking a pixel shader only for color samples for the pixel specified to be active samples by the active sample configuration, wherein pixel shading computations of the pixel shader super-sample each pixel by virtue of being invoked for each active color sample of each pixel in the particular region that is covered by the primitive.