ENHANCED ANTI-ALIASING BY VARYING SAMPLE PATTERNS SPATIALLY AND/OR TEMPORALLY

• US 20160071246A1
• Filed: 09/05/2015
• Published: 03/10/2016
• Est. Priority Date: 09/10/2014
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: URALSKY, Yury Y., ALBEN, Jonah M., BANJEREE, Ankan, MASSAL, Gregory, PETERSON, Thomas, KUZNETSOV, Oleg, LUM, Eric B., MEHTA, Prakshep
• Granted Patent: US 10,147,203 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 2200/12 involving antialiasing

Abstract

A raster unit is configured to generate different sample patterns for adjacent pixels within a given frame. In addition, the raster unit may adjust the sample patterns between frames. The raster unit includes an index unit that selects a sample pattern table for use with a current frame. For a given pixel, the index unit extracts a sample pattern from the selected sample pattern table. The extracted sample pattern is used to generate coverage information for the pixel. The coverage information for all pixels is then used to generate an image. The resultant image may then be filtered to reduce or remove artifacts induced by the changing of sample locations.

Claims

1. A non-transitory computer-readable medium including instructions that, when executed by a processor, cause the processor to filter images, by performing the steps of:

detecting an amount of motion associated with a first pixel that resides within a first image frame;

based on the amount of motion detected, selecting between a first filtering operation to be performed based on the first pixel and at least one other pixel within a second image frame, and a second filtering operation to be performed based on the first pixel and at least one other pixel in the first image frame; and

performing the selected filtering operation on the first pixel and at least one other pixel.

2. The non-transitory computer-readable medium of claim 1, wherein selecting between the first filtering operation and the second filtering operation comprises:

determining that the amount of motion does not exceed a threshold level, and selecting the first filtering operation;

or

determining that the amount of motion exceeds the threshold level, and selecting the second filtering operation.

3. The non-transitory computer-readable medium of claim 1, wherein detecting the amount of motion associated with the first pixel comprises:

comparing a first value associated with the first pixel to a second value associated with a second pixel, wherein the second pixel resides within the second image frame; and

determining a difference between the first value and the second value.

4. The non-transitory computer-readable medium of claim 3, wherein the first pixel resides at a first position within the first image frame, and the second pixel resides at the first position within the second image frame.

5. The non-transitory computer-readable medium of claim 4, wherein coverage samples for both the first pixel and the second pixel are generated based on a first sample pattern.

6. The non-transitory computer-readable medium of claim 4, wherein at least one frame is rendered between the first frame and the second frame, the at least one frame includes at least one pixel for which coverage samples are generated based on a second sample pattern, and the at least one pixel resides at the first position within the at least one frame.

7. The non-transitory computer-readable medium of claim 1, wherein the first filtering operation comprises a temporal blend operation, and performing the temporal blend operation comprises:

identifying a previous pixel that resides within a previous frame rendered before the first frame; and

blending the first pixel with the previous pixel,

wherein the first pixel resides at a first position within the first frame, and the previous pixel resides at the first position within the previous frame.

8. The non-transitory computer-readable medium of claim 1, wherein the second filtering operation comprises a spatial blend operation, and performing the spatial blend operation comprises:

identifying an edge within the first frame along which the first pixel and one or more other pixels reside; and

blending the first pixel with the one or more other pixels.

9. The non-transitory computer-readable medium of claim 1, further comprising the steps of:

determining a sample shift direction associated with the first pixel;

identifying a neighboring pixel that resides within the first frame opposite to the sample shift direction relative to the first pixel; and

blending the first pixel with the neighboring pixel to generate a first color value for the first pixel.

10. The non-transitory computer-readable medium of claim 9, further comprising the steps of:

identifying a previous pixel that resides within a previous frame rendered before the first frame; and

blending the first pixel with the previous pixel to generate a second color value for the first pixel.

11. The non-transitory computer-readable medium of claim 10, further comprising the steps of:

determining that the amount of motion does not exceed a threshold value;

increasing a motion score associated with the first pixel; and

combining the first color value with the second color value based on the motion score to generate a color value for the first pixel.

12. The non-transitory computer-readable medium of claim 10, further comprising the steps of:

determining that the amount of motion exceeds a threshold value;

decreasing a motion score associated with the first pixel; and

combining the first color value with the second color value based on the motion score to generate a color value for the first pixel.

13. The non-transitory computer-readable medium of claim 1, further comprising the steps of:

determining that the amount of motion does not exceed a threshold value;

increasing a motion score associated with the first pixel;

determining a sample shift direction associated with the first pixel;

identifying a neighboring pixel that resides within the first frame opposite to the sample shift direction relative to the first pixel; and

blending the first pixel with the neighboring pixel to generate a color value for the first pixel.

14. The non-transitory computer-readable medium of claim 1, further comprising the steps of:

determining that the amount of motion exceeds a threshold value;

decreasing a motion score associated with the first pixel;

identifying a previous pixel that resides within a previous frame rendered before the first frame;

computing a reversed motion score based on the motion score; and

blending the first pixel with the previous pixel based on the reversed motion score to generate a color value for the first pixel.

15. The non-transitory computer-readable medium of claim 14, wherein computing the reversed motion score comprises subtracting the motion score from an integer value.

16. A computer-implemented method for filtering images, comprising:

detecting an amount of motion associated with a first pixel that resides within a first image frame;

based on the amount of motion detected, selecting between a first filtering operation to be performed based on the first pixel and at least one other pixel within a second image frame, and a second filtering operation to be performed based on the first pixel and at least one other pixel in the first image frame; and

performing the selected filtering operation on the first pixel and at east one other pixel.

17. The computer-implemented method of claim 16, wherein selecting between the first filtering operation and the second filtering operation comprises:

determining that the amount of motion does not exceed a threshold level, and selecting the first filtering operation;

or

determining that the amount of motion exceeds the threshold level, and selecting the second filtering operation.

18. The computer-implemented method of claim 16, wherein detecting the amount of motion associated with the first pixel comprises:

comparing a first value associated with the first pixel to a second value associated with a second pixel, wherein the first pixel resides at a first position within the first image frame, and the second pixel resides at the first position within the second image frame; and

determining a difference between the first value and the second value.

19. The computer-implemented method of claim 16, wherein the first filtering operation comprises a temporal blend operation, and performing the temporal blend operation comprises:

identifying a previous pixel that resides within a previous frame rendered before the first frame; and

blending the first pixel with the previous pixel,

wherein the first pixel resides at a first position within the first frame, and the previous pixel resides at the first position within the previous frame.

20. The computer-implemented method of claim 16, wherein the second filtering operation comprises a spatial blend operation, and performing the spatial blend operation comprises:

identifying an edge within the first frame along which the first pixel and one or more other pixels reside; and

blending the first pixel with the one or more other pixels.

21. The computer-implemented method of claim 16, further comprising:

determining a sample shift direction associated with the first pixel;

identifying a neighboring pixel that resides within the first frame opposite to the sample shift direction relative to the first pixel;

blending the first pixel with the neighboring pixel to generate a first color value for the first pixel;

identifying a previous pixel that resides within a previous frame rendered before the first frame; and

blending the first pixel with the previous pixel to generate a second color value for the first pixel.

22. The computer-implemented method of claim 21, further comprising:

determining that the amount of motion does no exceed a threshold value,

increasing a motion score associated with the first pixel, and

combining the first color value with the second color value based on the motion score to generate a color value for the first pixel;

or

determining that the amount of motion exceeds a threshold value,

decreasing a motion score associated with the first pixel; and

combining the first color value with the second color value based on the motion score to generate a color value for the first pixel.

23. A computing device, comprising:

a memory storing a software application, and

a processor, coupled to the memory and configured to execute the software application to perform the steps of;

detecting an amount of motion associated with a first pixel that resides within a first image frame;

based on the amount of motion detected, selecting between a first filtering operation to be performed based on the first pixel and at least one other pixel within a second image frame, and a second filtering operation to be performed based on the first pixel and at least one other pixel in the first image frame; and

performing the selected filtering operation on the first pixel and at least one other pixel.

24. The computing device of claim 23, wherein the first filtering operation comprises a temporal blend operation, and performing the temporal blend operation comprises:

identifying a previous pixel that resides within a previous frame rendered before the first frame; and

blending the first pixel with the previous pixel,

wherein the first pixel resides at a first position within the first frame, and the previous pixel resides at the first position within the previous frame

25. The computing device of claim 23, wherein the second filtering operation comprises a spatial blend operation, and performing the spatial blend operation comprises:

identifying an edge within the first frame along which the first pixel and one or more other pixels reside; and

blending the first pixel with the one or more other pixels.