TECHNIQUES FOR GENERATING VISUALIZATIONS OF RAY TRACING IMAGES

• US 20200134906A1
• Filed: 12/31/2019
• Published: 04/30/2020
• Est. Priority Date: 03/02/2018
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: KINROSS, Austin Neil, Hargreaves, Shawn Lee, Patel, Amar, Davidson, Thomas Lee
• Granted Patent: US 11,113,869 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/06 Ray-tracing
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/12 Bounding box

Abstract

Examples described herein generally relate to generating a visualization of an image. A proprietary structure that specifies ray tracing instructions for generating the image using ray tracing is intercepted from a graphics processing unit (GPU) or a graphics driver. The proprietary structure can be converted, based on assistance information, to a visualization structure for generating the visualization of the image. The visualization of the image can be generated from the visualization structure.

Claims

1. A method for providing a structure to a visualization application, comprising:

obtaining, by a graphics processing unit (GPU), a structure that specifies ray tracing instructions for generating an image; and

providing, by the GPU and based on a request from the visualization application, the structure to the visualization application.

2. The method of claim 1, wherein providing the structure to the visualization application is based on accessing, by the GPU, a memory to store the structure for generating the image.

3. The method of claim 1, wherein providing the structure to the visualization application comprises calling a function registered by the visualization application for receiving the structure.

4. The method of claim 1, further comprising performing, by the GPU, ray tracing of the image based on receiving the structure from a graphics driver.

5. A method for providing a visualization structure to a visualization application, comprising:

receiving, by a graphics driver and from the visualization application, a structure proprietary to the graphics driver that specifies ray tracing instructions for generating an image by a graphics processing unit (GPU);

converting the structure to the visualization structure for use by the visualization application; and

providing, to the visualization application, the visualization structure.

6. The method of claim 5, further comprising:

generating, by the graphics driver and from an acceleration structure received from a different application, the structure proprietary to the graphics driver; and

providing the structure to the GPU for ray tracing the image,

wherein converting the structure to the visualization structure includes generating the visualization structure as at least a portion of the acceleration structure.

7. The method of claim 6, wherein converting the structure to the visualization structure comprises optimizing away one or more features of the acceleration structure.

8. The method of claim 7, wherein the one or more features include one or more object layers defined by the acceleration structure that are not displayed in ray tracing the image.

9. The method of claim 5, further comprising receiving assistance information of one or more intersection shaders for the structure, wherein converting the structure to the visualization structure comprises applying the one or more intersection shaders to the structure to generate the visualization structure.

10. The method of claim 9, wherein applying the one or more intersection shaders comprises applying a shape or orientation to objects of the image in bounding boxes.

11. The method of claim 9, wherein receiving the assistance information comprises receiving the assistance information from the visualization application.

12. A computing device for providing a structure to a visualization application, comprising:

a memory for storing a structure that specifies ray tracing instructions for generating an image; and

at least one graphics processing unit (GPU) coupled to the memory, wherein the at least one GPU is configured to;

obtain a structure that specifies ray tracing instructions for generating an image; and

providing, based on a request from the visualization application, the structure to the visualization application.

13. The computing device of claim 12, wherein the at least one GPU is configured to provide the structure to the visualization application based on accessing, by the GPU, the memory to store the structure for generating the image.

14. The computing device of claim 12, wherein the at least one GPU is configured to provide the structure to the visualization application at least in part by calling a function registered by the visualization application for receiving the structure.

15. The computing device of claim 12, wherein the at least one GPU is further configured to provide perform ray tracing of the image based on receiving the structure from a graphics driver.

16. A computing device for providing a visualization structure to a visualization application, comprising:

a memory storing one or more parameters or instructions for executing an operating system and a graphics driver for communicating with a graphics processing unit (GPU); and

at least one processor coupled to the memory, wherein the at least one processor is configured to;

receive, from the visualization application, a structure proprietary to the graphics driver that specifies ray tracing instructions for generating an image by the GPU;

convert the structure to the visualization structure for use by the visualization application; and

provide, to the visualization application, the visualization structure.

17. The computing device of claim 16, wherein the at least one processor is further configured to:

generate, from an acceleration structure received from a different application, the structure proprietary to the graphics driver; and

provide the structure to the GPU for ray tracing the image,

wherein the at least one processor is configured to convert the structure to the visualization structure at least in part by generating the visualization structure as at least a portion of the acceleration structure.

18. The computing device of claim 17, wherein the at least one processor is configured to convert the structure to the visualization structure at least in part by optimizing away one or more features of the acceleration structure.

19. The computing device of claim 18, wherein the one or more features include one or more object layers defined by the acceleration structure that are not displayed in ray tracing the image.

20. The computing device of claim 16, wherein the at least one processor is further configured to receive assistance information of one or more intersection shaders for the structure, wherein the at least one processor is configured to convert the structure to the visualization structure at least in part by applying the one or more intersection shaders to the structure to generate the visualization structure.

21. The computing device of claim 20, wherein the at least one processor is configured to apply the one or more intersection shaders at least in part by applying a shape or orientation to objects of the image in bounding boxes.

22. The computing device of claim 20, wherein the at least one processor is configured to receive the assistance information from the visualization application.