Application remoting using network vector rendering
First Claim
1. A computer-implemented method for improving one or more computer technologies, comprising:
- under control of a rendering computing device that is remotely located, separate, and distinct from an execution computing device;
providing to the execution computing device a request to initiate a remote application in the execution computing device while the rendering computing device executes an instance of a local application, the remote application instance having a compositor and a region renderer;
responsive to the request, obtaining one or more files from the execution computing device;
providing the one or more obtained files to the local application instance to facilitate the rendering computing device to display output of the remote application instance and to facilitate the local application instance to initiate a connection from the local application instance to the remote application instance and perform one or more of intercept events from an event loop to listen for events associated with the local application instance or generate a drawing canvas;
initiating the connection from the local application instance to the remote application instance to cause the connected remote application instance to;
intercept first draw commands from the compositor of the remote application instance, the first draw commands corresponding to one or more tiles to be rendered and representing only a portion of all draw commands used to provide a current output of the remote application instance;
capture first position information from the region renderer of the remote application instance for the one or more tiles that correspond to the first draw commands; and
intercept second draw commands from the region renderer of the remote application instance that correspond to one or more regions to be rendered and capture second position information for the one or more corresponding regions; and
obtaining the first and second draw commands with the first and second captured position information from the remote application instance;
rendering one or more portions of the output of the remote application instance based on the first and second draw commands and the first and second captured position information.
4 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and techniques for application isolation by remote-enabling applications are provided. Example embodiments provide an Adaptive Rendering Application Isolation System (“ARAIS”), which transparently and dynamically enables applications to run in an isolated execution environment yet be rendered locally in a manner that minimizes the amount of data to be transferred and the latency caused by expensive computation and/or by overburdening available bandwidth by remoting rendering using draw commands over rendering using pixel pushing or other techniques. In one embodiment, the ARAIS includes an orchestrator server which comprises remoting level determination logic and rules engine, pre-computed graphics libraries, connection support logic, data repositories for objects such as a render cache, whitelists, blacklists, client privileges, and application information, and one or more secure containers running remote application instances. These components cooperate to deliver isolation-ready technology to client applications.
-
Citations
20 Claims
-
1. A computer-implemented method for improving one or more computer technologies, comprising:
under control of a rendering computing device that is remotely located, separate, and distinct from an execution computing device; providing to the execution computing device a request to initiate a remote application in the execution computing device while the rendering computing device executes an instance of a local application, the remote application instance having a compositor and a region renderer; responsive to the request, obtaining one or more files from the execution computing device; providing the one or more obtained files to the local application instance to facilitate the rendering computing device to display output of the remote application instance and to facilitate the local application instance to initiate a connection from the local application instance to the remote application instance and perform one or more of intercept events from an event loop to listen for events associated with the local application instance or generate a drawing canvas; initiating the connection from the local application instance to the remote application instance to cause the connected remote application instance to; intercept first draw commands from the compositor of the remote application instance, the first draw commands corresponding to one or more tiles to be rendered and representing only a portion of all draw commands used to provide a current output of the remote application instance; capture first position information from the region renderer of the remote application instance for the one or more tiles that correspond to the first draw commands; and intercept second draw commands from the region renderer of the remote application instance that correspond to one or more regions to be rendered and capture second position information for the one or more corresponding regions; and obtaining the first and second draw commands with the first and second captured position information from the remote application instance; rendering one or more portions of the output of the remote application instance based on the first and second draw commands and the first and second captured position information. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
8. A computer-implemented method for improving one or more computer technologies, comprising:
under control of an output rendering computing device that is remotely located, separate, and distinct from a code execution computing device; providing to the code execution computing device a request to initiate a remote application in the code execution computing device while the output rendering computing device executes an instance of a local application, the remote application instance having a compositor and a region renderer, the request indicating an operating system of the output rendering computing device and an application type of the local application, the remote application instance having a current compositor, a current region renderer, or a current graphics library determined based on one or more of the operating system of the output rendering computing device and/or the application type of the local application in the output rendering computing device; responsive to the request, obtaining a set of files from the code execution computing device, the set of files being determined based on the request and the one or more of the current compositor, the current region renderer, or the current graphics library, the set of files containing compiled draw commands and information that modifies the local application instance to display output of the remote application instance; providing the set of files to the local application instance to facilitate the output rendering computing device to display output of the remote application instance, wherein one or more files in the set of files is configured to interface with an application programming interface (“
API”
) of the local application instance to cause the local application instance to load one or more files in the set of files, is configured to intercept events from an event loop to listen for events associated with the local application instance and invoke draw handling code, and is configured to initiate a connection from the local application instance to the remote application instance,wherein one or more files in the set of files includes the draw handling code in a compiled instance of a graphics library of the remote application instance, the compiled instance of the graphics library being configured to cause draw commands to be rendered in the same manner on the local application instance as on the remote application instance to facilitate consistent rendering on the local application instance and on the remote application instance, and wherein one or more files in the set of files is configured to cause the local application instance to generate a drawing canvas; causing a connection between the remote application instance and the local application instance to facilitate the output rendering computing device to display the output of the remote application instance; obtaining draw commands from the connected remote application instance; and rendering one or more portions of the output of the remote application instance based on the obtained draw commands. - View Dependent Claims (9, 10, 11, 12)
-
13. A computer-implemented method for improving one or more computer technologies, comprising:
under control of a client computing device that is remotely located, separate, and distinct from a server computing device; providing the server computing device a request to initiate a remote application in the server computing device while the client computing device executes an instance of a client application, the request indicating an operating system of the client computing device and an application type of the client application, the remote application instance having a current compositor, a current region renderer, or a current graphics library determined based on one or more of the operating system of the client computing device and/or the application type of the local application in the client computing device; responsive to the request, obtaining a set of files from the server computing device based on the received request and the one or more of the current compositor, the current region renderer, or the current graphics library, the set of files including a script file, an executable code file, and a Hypertext Markup Language (“
HTML”
) file that include information that modifies the client application instance to display output of the remote application instance,wherein the script file is configured to interface with an application programming interface (“
API”
) of the client application instance to cause the client application instance to load the executable code file, is configured to intercept events from an event loop to listen for events associated with the client application instance and invoke draw handling code, and is configured to initiate a connection from the client application instance to the remote application instance,wherein the executable code file includes the draw handling code in a compiled instance of a graphics library of the remote application instance, the compiled instance of the graphics library being configured to cause draw commands to be rendered in the same manner on the client application instance as on the remote application instance to facilitate consistent rendering on the client application instance and on the remote application instance, and obtaining draw commands from the remote application instance; and rendering one or more portions of the output of the remote application instance based on the obtained draw commands. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
Specification