Graphics processing enhancement by tracking object and/or primitive identifiers

• US 10,510,183 B2
• Filed: 07/18/2017
• Issued: 12/17/2019
• Est. Priority Date: 04/05/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Inventors: Berghoff, Tobias
• Primary Examiner(s): Wu, Sing-Wai
• Application Number:
  US15/653,422
• Publication Number:
  US 20180130251A1
• Time in Patent Office: 882 Days
• CPC Class Codes: G06F 9/48 Program initiating; Program switching, e.g. by interrupt
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/405 using Z-buffer
• CPC Class Codes: G06T 15/80 Shading
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation

Abstract

Graphics processing includes setting up a plurality of objects in a scene in virtual space, each object being defined by a set of vertices. A unique object identifier is assigned to each object and written to an ID buffer. Draw calls are issued to draw the objects associated with the object identifiers. Parameter values of the vertices are manipulated to output vertex parameter values. Primitives are set up from the vertices, each primitive being defined by one or more of the vertices. Each primitive belongs to one or more of the objects. Each primitive is rasterized at a plurality of pixels. Processing the pixels includes spatial or temporal anti-aliasing that utilizes the one or more object identifiers of the plurality of object identifiers. The pixels are processed for each rasterized primitive to generate an output frame.

Claims

1. A method of rendering graphics with a processor, the method comprising:

setting up a plurality of objects in a scene in virtual space, each said object being defined by a set of vertices;

assigning a unique object identifier to each of the objects;

issuing one or more draw calls to draw the objects;

setting up a plurality of primitives from the vertices, each said primitive being defined by a set of one or more of the vertices and each said primitive belonging to one or more of the objects;

performing geometry shading to generate one or more output primitives from the plurality of primitives, wherein performing the geometry shading includes generating a primitive identifier for one or more primitives generated by the geometry shading by incrementing a primitive identifier for each input primitive by a maximum amount of geometric amplification of output primitives supported by an object with which the input primitives are associated;

rasterizing each of the primitives for a plurality of pixels;

writing one or more of the object identifiers to at least one ID buffer, such that each pixel of the plurality of pixels is associated with an object identifier in the ID buffer;

processing the pixels for each of the rasterized primitives to determine corresponding depth and color values for the plurality of pixels; and

determining a set of display pixels for an output frame using the depth and color values for the plurality of pixels and the object identifiers in the ID buffer.

2. The method of claim 1, wherein the determining the set of display pixels includes applying spatial and/or temporal antialiasing using the one or more object identifiers in the ID buffer, in combination with the color buffer and/or Z buffer.

3. The method of claim 1, wherein the ID buffer is a dedicated ID buffer dedicated to storing identifiers.

4. The method of claim 1, wherein the ID buffer is shared buffer.

5. The method of claim 1, wherein the ID buffer is a plurality of dedicated ID buffers.

6. The method of claim 1, wherein assigning the unique object identifier includes adding an object identifier and a primitive identifier.

7. The method of claim 1, wherein the assigning the unique object identifier includes performing a logical OR between an object identifier and a primitive identifier.

8. The method of claim 1, further comprising:

assigning a unique primitive identifier to each of the primitives and writing a primitive identifier to the ID buffer.

9. The method of claim 8, wherein the determining the set of display pixels includes applying spatial and/or temporal antialiasing using the object identifiers and the primitive identifiers in the ID buffer, in combination with the color buffer and/or Z buffer.

10. The method of claim 8, wherein the at least one ID buffer includes a dedicated object ID buffer dedicated to storing object identifiers and a dedicated primitive ID buffer dedicated to storing primitive identifiers.

11. The method of claim 8, wherein the at least one ID buffer is a dedicated ID buffer dedicated to storing object identifiers and primitive identifiers.

12. The method of claim 8, wherein said manipulating parameter values of the vertices comprises performing geometry shader computations by a geometry shader, wherein said assigning the unique primitive identifier comprises:

generating a primitive ID with the geometry shader during the geometry shader computations.

13. The method of claim 8, wherein said assigning the unique primitive identifier to each of the primitives comprises, before said manipulating parameter values of the vertices:

performing primitive processing operations to generate a primitive ID, and

incrementing the primitive ID each time the primitive processing operations output a patch.

14. The method of claim 8, wherein said manipulating parameter values of the vertices comprises performing tessellation computations with a tessellation unit, wherein said assigning the unique primitive identifier comprises:

before said tessellation computations, generating a primitive ID;

receiving the primitive ID with the tessellation unit; and

incrementing the primitive ID with each output primitive generated by the tessellation unit during the tessellation computations.

15. The method of claim 1, wherein said manipulating the parameter values of the vertices includes manipulating the parameter values with a vertex shader and generating a primitive ID for eventual write to the ID buffer.

16. The method of claim 1, wherein the assigning the unique object identifier includes assigning an object identifier for an instanced object with a vertex shader.

17. The method of claim 1, wherein the assigning the unique object identifier includes assigning an object identifier for an instanced object with a vertex shader by backtracking from an object identifier and a primitive identifier to determine an instance identifier for the instanced object.

18. The method of claim 1, wherein performing the geometry shading includes generating a primitive identifier for one or more primitives generated by the geometry shading.

19. The method of claim 1, further comprising performing geometry shading in which one or more output primitives are generated from one or more input primitives.

20. The method of claim 1, further comprising performing geometry shading in which one or more output primitives are generated from one or more input primitives, wherein the performing geometry shading includes generating a primitive identifier for one or more primitives generated by the geometry shading.

21. The method of claim 1, wherein said processing the pixels for each of the rasterized primitives includes manipulating pixel parameter values with a pixel shader,

wherein said manipulating the pixel parameter values with the pixel shader includes reading one or more primitive identifiers with the pixel shader.

22. The method of claim 1, further comprising tracking the plurality of object identifiers to at least one subsequent frame subsequent to said output frame, such that object identifiers are consistently assigned to objects from frame to frame.

23. The method of claim 1, wherein the setting up a plurality of objects includes assigning the unique object identifier to each of the objects and writing the object identifier to an ID buffer.

24. The method of claim 1, wherein the issuing the draw call includes assigning the unique object identifier to each of the objects and writing the object identifier to an ID buffer, whereby there is a plurality of object identifiers.

25. The method of claim 1 wherein the assigning a unique object identifier to each of the objects includes assigning the same object identifier to two or more instances of the same object in the same frame or in two or more different frames.

26. The method of claim 1, wherein said determining the set of display pixels includes using the one or more object identifiers to keep track of which primitives or pixels belong to which objects.

27. The method of claim 1, wherein said determining the set of display pixels includes using one or more of the object identifiers to provide pixel values for pixels in one frame by repeating a pixel value for the same pixel in the same object in a previous frame.

28. The method of claim 1, wherein said determining the set of display pixels includes utilizing one or more object identifiers where the same object is re-drawn multiple times in a given frame.

29. The method of claim 1, further comprising using object identifiers to keep track of the flow of objects from frame to frame.

30. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method of rendering graphics with a processor as set forth in claim 1.

31. A system comprising:

a processor, and

a memory coupled to the processor,

wherein the processor is configured to perform a method of rendering graphics, the method comprising;

setting up a plurality of objects in a scene in virtual space, each said object being defined by a set of vertices;

assigning a unique object identifier to each of the objects;

issuing one or more draw calls to draw the objects;

setting up a plurality of primitives from the vertices, each said primitive being defined by a set of one or more of the vertices and each said primitive belonging to one or more of the objects;

performing geometry shading to generate one or more output primitives from the plurality of primitives, wherein performing the geometry shading includes generating a primitive identifier for one or more primitives generated by the geometry shading by incrementing a primitive identifier for each input primitive by a maximum amount of geometric amplification of output primitives supported by an object with which the input primitives are associated;

rasterizing each of the primitives for a plurality of pixels;

writing one or more of the object identifiers to at least one ID buffer, such that each pixel in the plurality of pixels is associated with an object identifier in the ID buffer;

processing the pixels for each of the rasterized primitives to determine a set of corresponding depth and color values for the plurality of pixels; and

determining a set of display pixels for an output frame using the depth and color values for the plurality of pixels and the object identifiers in the ID buffer.

32. The system of claim 31, wherein the processor includes a central processing unit (CPU) and a graphics processing unit (GPU).

33. The system of claim 31, further comprising a display device, wherein the method further comprises presenting the graphics on the display device.

34. The system of claim 31, wherein the ID buffer is a dedicated ID buffer dedicated to storing identifiers.

35. The system of claim 31, wherein the ID buffer is shared buffer.

36. The system of claim 31, wherein the ID buffer is a plurality of dedicated ID buffers.

37. The system of claim 31, wherein the at least one ID buffer includes a dedicated object ID buffer dedicated to storing object identifiers and a dedicated primitive ID buffer dedicated to storing primitive identifiers.

38. The system of claim 31, wherein the at least one ID buffer is a dedicated ID buffer dedicated to storing object identifiers and primitive identifiers.

39. A graphics processing unit (GPU) comprising:

an ID module configured to;

receive information corresponding to a plurality of objects in a scene in virtual space, each said object being defined by a set of vertices;

receive one or more object identifiers in a command buffer for each said object in the plurality, and write the one or more object identifiers to an ID buffer;

wherein the GPU is further configured to perform geometry shading in which one or more output primitives are generated from one or more input primitives, wherein performing the geometry shading includes generating a primitive identifier for one or more primitives generated by the geometry shading by incrementing a primitive identifier for each input primitive by a maximum amount of geometric amplification of output primitives supported by an object with which the input primitives are associated; and

wherein the GPU is further configured to render the two or more instanced objects by;

manipulating parameter values of the vertices to generate output vertex parameter values;

setting up a plurality of primitives from the vertices, each said primitive being defined by a set of one or more of the vertices and each said primitive belonging to one or more of the objects;

rasterizing each of the primitives to generate a plurality of pixels;

writing one or more of the object identifiers to at least one ID buffer, such that each pixel of the plurality of pixels is associated with an object identifier in the ID buffer;

processing the pixels for each of the rasterized primitives to determine corresponding depth and color values for the plurality of pixels; and

determining a set of display pixels for an output frame using the depth and color values for the plurality of pixels and the object identifiers in the ID buffer.

40. The GPU of claim 39, wherein the ID module is a hardware module.

41. The GPU of claim 39, wherein the ID buffer is a dedicated ID buffer dedicated to storing identifiers.

42. The GPU of claim 39, wherein the ID buffer is shared buffer.

43. The GPU of claim 39, wherein the ID buffer is a plurality of dedicated ID buffers.

44. The GPU of claim 39, wherein the GPU is further configured to assign a unique primitive identifier to each of the primitives and writing the primitive identifier to the ID buffer.

45. The GPU of claim 39, wherein the at least one ID buffer includes a dedicated object ID buffer dedicated to storing object identifiers and a dedicated primitive ID buffer dedicated to storing primitive identifiers.

46. The GPU of claim 39, wherein the at least one ID buffer is a dedicated ID buffer dedicated to storing object identifiers and primitive identifiers.

47. The GPU of claim 39, wherein the GPU is further configured to perform geometry shading in which one or more output primitives are generated from one or more input primitives.

48. The GPU of claim 39, wherein the GPU is further configured to perform geometry shading in which one or more output primitives are generated from one or more input primitives, wherein performing geometry shading includes generating a primitive identifier for one or more primitives generated by the geometry shading.

49. The GPU of claim 39, wherein the GPU is further configured track the plurality of object identifiers to at least one subsequent frame subsequent to said output frame, such that object identifiers are consistently assigned to objects from frame to frame.

50. The GPU of claim 39, wherein the GPU is further configured to use object identifiers to keep track of the flow of objects from frame to frame.