Graphics scenegraph rendering for web applications using native code modules

• US 9,619,858 B1
• Filed: 08/01/2014
• Issued: 04/11/2017
• Est. Priority Date: 07/02/2009
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Labour, Antoine, Papakipos, Matthew
• Primary Examiner(s): Thompson, James A
• Application Number:
  US14/449,754
• Time in Patent Office: 984 Days
• Field of Search: None
• CPC Class Codes: G06F 21/53 by executing in a restricted environment, e.g. sandbox or secure virtual machine
• CPC Class Codes: G06F 2221/2119 Authenticating web pages, e.g. with suspicious links
• CPC Class Codes: G06F 9/44526 Plug-ins; Add-ons
• CPC Class Codes: G06F 9/44589 Program code verification, e.g. Java bytecode verification, proof-carrying code high-level semantic checks G06F8/43; testing and debugging software G06F11/36
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management

Abstract

One embodiment provides a system that facilitates the execution of a web application. During operation, the system loads a native code module that includes a scenegraph renderer into a secure runtime environment. Next, the system uses the scenegraph renderer to create a scenegraph from a graphics model associated with the web application and generate a set of rendering commands from the scenegraph. The system then writes the rendering commands to a command buffer and reads the rendering commands from the command buffer. Finally, the system uses the rendering commands to render, for the web application, an image corresponding to the graphics model by executing the rendering commands using a graphics-processing unit (GPU).

Claims

1. A computer-implemented method, comprising:

loading a validated native code module into a secure runtime environment, the secure runtime environment preventing the native code module from accessing a graphics-processor unit (GPU);

creating a scenegraph from a graphics model;

generating, by the native code module, a set of rendering commands from the scenegraph;

transmitting the rendering commands from the native code module within the secure runtime environment to a trusted code module outside the secure runtime environment to provide graphics hardware acceleration, the trusted code module configured to communicate with the GPU;

providing, by the trusted code module, the rendering commands to the GPU; and

executing, using the GPU the provided rendering commands to render an image.

2. The computer-implemented method of claim 1, further comprising transmitting buffer data from the validated native code module to the trusted code module, wherein the executing the rendering commands comprises using the buffer data as parameters to the rendering commands.

3. The computer-implemented method of claim 2, wherein the transmitting the rendering commands and transmitting the buffer data comprises:

writing, using the validated native code module, the rendering commands and the buffer data to a command buffer; and

reading, using the trusted code module, the rendering commands and the buffer data from the command buffer.

4. The computer-implemented method of claim 3, wherein the command buffer is implemented using an inter-module communication (IMC) buffer.

5. The computer-implemented method of claim 1, wherein the generating the rendering commands comprises transforming high-level shape nodes into low-level rendering commands.

6. The computer-implemented method of claim 1, wherein the trusted code module directly interfaces with the GPU or communicates with the GPU via a rendering engine.

7. The computer-implemented method of claim 1, wherein the graphics model is obtained from at least one of a web application, the validated native code module, and a separate native code module.

8. The computer-implemented method of claim 1, further comprising:

storing rendering commands associated with one or more components in the graphics model;

updating values associated with the one or more components; and

executing the rendering commands based on the updated values.

9. A system, comprising:

a graphics-processor unit (GPU);

one or more processors; and

a memory having instructions thereon that, when executed by the one or more processors, implements a secure runtime environment configured to execute a native code module, the secure runtime environment preventing the native code module from accessing the GPU,

wherein the native code module is configured to;

generate a set of rendering commands from a scenegraph based on a graphics model; and

transmit the rendering commands from within the secure runtime environment to a trusted code module, the trusted code module being outside the secure runtime environment; and

wherein the trusted code module is configured to communicate the rendering commands to the GPU, and

wherein the GPU is configured to execute rendering commands received from the trusted code module to render an image corresponding to the graphics model.

10. The system of claim 9, further comprising:

a validator configured to validate the native code module prior to executing the native code module.

11. The system of claim 9, wherein:

the native code module is further configured to write buffer data to a command buffer; and

the trusted code module is further configured to read the buffer data from the command buffer, wherein the GPU is further configured to execute the rendering commands using the buffer data as parameters to the rendering commands.

12. The system of claim 11, wherein the command buffer are implemented using an inter-module communication (IMC) buffer.

13. The system of claim 9, wherein the trusted code module is configured to directly interface with the GPU or communicate with the GPU via a rendering engine.

14. The system of claim 9, wherein the graphics model is obtained from at least one of a web application, the native code module, and a separate native code module.

15. The system of claim 14, wherein the graphics model is obtained using a plugin interface bridge.

16. The system of claim 9, wherein:

the native code module is further configured to;

store rendering commands associated with one or more components in the graphics model; and

update values associated with the one or more components; and

the GPU is further configured to execute the stored rendering commands based on the updated values.

17. A non-transitory computer-readable storage medium storing instructions that when executed by a computer system cause the computer system to perform a method, the method comprising:

loading a validated native code module into a secure runtime environment, the secure runtime environment preventing the native code module from accessing a graphics-processor unit (GPU);

creating a scenegraph from a graphics model;

generating, by the native code module, a set of rendering commands from the scenegraph;

transmitting the rendering commands from the native code module within the secure runtime environment to a trusted code module outside the secure runtime environment to provide graphics hardware acceleration, the trusted code module configured to communicate with the GPU; and

executing, using the GPU, the provided rendering commands to render an image.

18. The computer-readable storage medium of claim 17, the method further comprising transmitting buffer data from the validated native code module to the trusted code module, wherein the executing the rendering commands comprises using the buffer data as parameters to the rendering commands.

19. The computer-readable storage medium of claim 18, wherein the transmitting the rendering commands and transmitting the buffer data comprises:

writing, using the validated native code module, the rendering commands and the buffer data to a command buffer; and

reading, using the trusted code module, the rendering commands and the buffer data from the command buffer.

20. The computer-readable storage medium of claim 19, wherein the command buffer is implemented using an inter-module communication (IMC) buffer.