GRAPHICS PROCESSING WITH ADVECTION TO RECONSTRUCT MISSING SAMPLE DATA POINTS

• US 20150379674A1
• Filed: 06/18/2015
• Published: 12/31/2015
• Est. Priority Date: 06/27/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: RAMANI, Karthik, GOLAS, Abhinav, BROTHERS, John W.
• Granted Patent: US 9,830,714 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2200/12 involving antialiasing
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06T 7/337 involving reference images or patches
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

In a graphics processing system pixel data and vertex coordinate information from a previous frame is buffered and provided to the current frame. A decision is made in the current frame whether pixel data from the previous frame may be reused. In one implementation if the speed of pixels in a tile is less than a quasi-static speed threshold a decision is made whether or not to reuse a fraction of pixels from the previous frame.

Claims

1. A method of performing graphics processing in a graphics pipeline via advection, comprising:

buffering pixel data and vertex coordinate data generated for a previous frame, n, into a buffer of a graphics pipeline processing a current frame n+1, where n is a positive integer;

updating a velocity of each pixel of the current frame;

determining, for of a set of pixels in the current frame, corresponding positions in the previous frame; and

selecting, in at least one tile, color data from at least one pixel of the previous frame for reuse in the current frame.

2. The method of claim 1, wherein said determining updating comprising performing a splatting operation during a Z-pass operation and updating the velocity.

3. The method of claim 1, where said selecting comprises utilizing a tile sampling pattern to determine in each tile a selection of pixel locations shaded in the current frame and a selection of pixel locations in which pixel data from the previous frame is reused.

4. The method of claim 3, wherein a first subset of the pixels in a tile are shaded in the current frame and a second subset of the pixels are reused from the previous frame.

5. The method of claim 1, further comprising performing a speed test in each tile and performing said selecting in individual tiles if a speed associated with a motion vector is less than a threshold speed.

6. The method of claim 1, further comprising performing a discrepancy check in individual tiles, wherein said selecting is not performed if the discrepancy check fails.

7. The method of claim 6, wherein the discrepancy check is performed for tiles have advected pixels in a current frame n and the discrepancy check is utilized to determine whether or not to perform advection in a next frame n+1.

8. The method of claim 1, wherein the mapping includes determining motion vectors for each pixel by subtracting vertex coordinates across successive frames.

9. A method of performing graphics processing in a graphics pipeline, comprising:

buffering pixel data and vertex coordinate data generated for a first frame into a buffer of a graphics pipeline processing a second frame;

determining, for of a set of pixels in the second frame, corresponding positions in the first based on a translation associated with changes in vertex coordinates between the first frame and the second frame; and

selecting color data from at least one pixel of the first frame for reuse in the second frame.

10. The method of claim 9, wherein stereoscopic rendering is performed and the first frame is a first eye image and the second frame is a second eye image.

11. The method of claim 9, wherein non-stereoscopic rendering is performed and the first frame is a previous frame and the second frame is a current frame.

12. The method of claim 9, further comprising performing a discrepancy test and disabling the selecting if the discrepancy test fails.

13. The method of claim 12, wherein the discrepancy test is performed for tiles have advected pixels in a current frame n and the discrepancy check is utilized to determine whether or not to perform advection in a next frame n+1.

14. The method of claim 9, wherein the determining and the selecting are performed on a tile basis.

15. A graphics system including a graphics pipeline, comprising:

an advection unit configured to;

buffer pixel data and vertex coordinate data generated for a first frame into a buffer of the graphics pipeline processing a second frame;

determine, for of a set of pixels in the current frame, corresponding position in the previous frame based on a translation associated with changes in vertex coordinates between the first frame and the second frame; and

select color data from at least one pixel of the first frame for reuse in the second frame.

16. The graphics system of claim 15 wherein said advection unit determines pixel locations on a tile-by-tile basis and selects color data on a tile-by-tile basis.

17. The graphics system of claim 16, wherein said advection unit utilizes a tile sampling pattern to determine in each tile a selection of pixel locations shaded in the second frame and a selection of pixel locations in which pixel data from the first frame is reused.

18. The graphics system of claim 15, wherein half of the pixels in a tile are shaded in the second frame and half of the pixels are reused from the first frame.

19. The graphics system of claim 15, wherein the advection unit performs a speed test of objects on a tile-by-tile basis and does not reuse pixel data from the first frame in a tile having a speed exceeding a threshold speed.

20. The graphics system of claim 19, wherein the advection unit performs a discrepancy check as a condition for reusing pixel data of the first frame.

21. The graphics system of claim 15, wherein the advection unit performs stereoscopic rendering and the first frame is a first eye image and the second frame is a second eye image.

22. The graphics system of claim 15, wherein the advection unit perform non-stereoscopic rendering and the first frame is a previous frame and the second frame is a current frame.