Distributed browsing architecture for the delivery of graphics commands to user devices for assembling a plurality of layers of a content page

• US 9,720,888 B1
• Filed: 05/22/2014
• Issued: 08/01/2017
• Est. Priority Date: 05/22/2014
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Killian, David Andrew, Sokolowski, Dmitry, Jain, Saral, Pallemulle, Sajeeva Lakmal Bandara
• Primary Examiner(s): Paula, Cesar
• Assistant Examiner(s): Blackwell, James H
• Application Number:
  US14/285,504
• Time in Patent Office: 1,167 Days
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54

Abstract

An intermediary system operates as an intermediary between content servers and user devices, and provides services for improving page load times as seen by end users. One such service involves converting all or a portion of a retrieved content page (e.g., web page) into a stream of graphics commands, such as OpenGL commands, that can be executed by the user device'"'"'s graphics processing unit (GPU). The intermediary system sends these commands to a browser component running on the user device for execution by the GPU.

Claims

1. A distributed browsing system for providing access to network-accessible content, the system comprising:

a browser component adapted to run on a user device that includes a graphics processing unit, said browser component configured to provide a user interface on a display of the user device; and

an intermediary system separate from the user device and configured to;

receive a request from the user device for a content page and to retrieve the content page from a host system, a graphics pipeline of the intermediary system comprising;

a content processing module configured to generate a document object model representation of the content page, wherein the document object model representation includes data representing a plurality of layers of the content page,

a graphics processing module configured to generate, based at least partly on the document object model representation, a stream of graphics commands for rendering a visual representation of the content page, the stream of graphics commands including graphics library commands operable to instruct the graphics processing unit associated with the browser component how to assemble the plurality of layers of the content page, based on the data representing the plurality of layers in the document object model representation, to draw at least one graphical component of the visual representation of the content page,

wherein the intermediary system is further configured to;

intercept the stream of graphics commands including the graphics library commands from the graphics pipeline, and

send the intercepted stream of graphics commands including the graphics library commands to the user device over a communication network;

wherein the browser component is configured to render the plurality of layers of the content page on the display of the user device at least partly by providing the intercepted stream of graphics commands to the graphics processing unit of the user device.

2. The system of claim 1, wherein the intermediary system is configured to execute a first portion of the graphics commands and to transmit a second portion of the graphics commands to the user device for execution.

3. The system of claim 1, wherein the intermediary system is configured to assess, for a given set of the graphics commands, whether execution of the set of graphics commands on the user device will provide a performance benefit relative to execution of the set of graphics commands on the intermediary system.

4. The system of claim 3, wherein the assessment is based on one or more factors including whether execution of the set of graphics commands on the user device will reduce a perceived page load time relative to the at least one alternative content delivery technique, reduce an amount of processing time for rendering the content page, increase a level of interactivity of the content page, or decrease battery usage of the user device.

5. The system of claim 1, wherein the intermediary system is configured to pre-render a portion of the page and to transmit a graphical representation of the portion to the user device.

6. The system of claim 1, wherein the intermediary system implements a headless browser.

7. The system of claim 1, wherein the stream of graphics commands instruct the browser component to draw objects of different layers of the plurality of layers of the document object model to separate canvases.

8. A method of providing access to network-accessible content via an intermediary system, the method comprising:

receiving, at the intermediary system from a browser component adapted to run on a user device separate from the intermediary system, a request for a content page;

retrieving the content page from a host system;

generating a document object model representation of the content page, wherein the document object model representation includes data representing a plurality of layers of the content page;

generating, based at least partly on the document object model representation, a stream of graphics commands for rendering a visual representation of the content page, the stream of graphics commands including graphics library commands operable to instruct a graphics processing unit associated with the browser component how to assemble the plurality of layers of the content page, based on the data representing the plurality of layers in the document object model representation, to draw at least one graphical component of the visual representation of the content page;

intercepting the stream of graphics commands including the graphics library commands from the intermediary system; and

providing, via a communications network, the intercepted stream of graphics commands including the graphics library commands to the browser component for rendering the visual representation of the plurality of layers of the content page on a display associated with the user device.

9. The method of claim 8, further comprising assessing, via the intermediary system for a given set of the graphics commands, whether execution of the set of graphics commands on the user device is preferable compared to at least one alternative content delivery technique.

10. The method of claim 9, further comprising sending the set of graphics commands to the user device for execution on the user device if execution of the set of graphics commands on the user device is preferable.

11. The method of claim 9, further comprising:

pre-rendering, via the intermediary system, a portion of the content page corresponding to the set of graphics commands and transmitting a graphical representation of the portion to the user device if execution of the set of graphics commands on the user device is not preferable.

12. The method of claim 8, further comprising receiving, from the browser component, an indication of interaction with the visual representation of the content page rendered on the display by a user of the user device.

13. The method of claim 12, further comprising generating, via the intermediary system, a stream of updated graphics commands for rendering an updated visual representation of the content page, wherein generating the stream of updated graphics commands is based at least partly on the indication of interaction.

14. The method of claim 8, further comprising detecting, via the browser component, an indication of interaction with the visual representation of the content page rendered on the display by a user of the user device.

15. The method of claim 14, further comprising rendering, via the browser component, an updated visual representation of the content page based at least partly on the indication of interaction.

16. A non-transitory computer-readable medium storing computer executable instructions that, when executed by one or more computing devices, configure the one or more computing devices to perform operations comprising:

sending via a communication network, from a first browser component adapted to run on a user device to a second browser component adapted to run on an intermediary system separate from the user device, a request for a content page;

receiving via the communication network, by the first browser component, an intercepted stream of graphics commands generated by the second browser component adapted to run on the intermediary system, the intercepted stream of graphics commands including pre-rendering graphics library commands operable to instruct a graphics processing unit associated with the first browser component how to assemble a plurality of layers of the content page, based on data representing the plurality of layers in a document object model representation of the content page, to draw at least one graphical component for rendering a visual representation of the content page, wherein the stream of graphics commands is generated based at least partly on the document object model representation of the content page and intercepted from the intermediary system;

generating, via the first browser component and based on the intercepted stream of graphics commands, instructions to configure a display associated with the user device to display the visual representation of the content page; and

rendering the visual representation of the plurality of layers of the content page on the display of the user device.

17. The non-transitory computer-readable medium of claim 16, the operations further comprising assessing whether execution of the set of graphics commands on the user device is preferable compared to at least one alternative content delivery technique.

18. The non-transitory computer-readable medium of claim 17, the operations further comprising receiving, via the second browser component, a pre-rendering portion of the page corresponding to the set of graphics commands if execution of the set of graphics commands on the user device is not preferable.

19. The non-transitory computer-readable medium of claim 16, the operations further comprising receiving, at the first browser component, an indication of interaction with the visual representation of the content page rendered on the display by a user of the user device and sending the indication of interaction to the second browser component.

20. The non-transitory computer-readable medium of claim 19, the operations further comprising receiving, from the second browser component, a stream of updated graphics commands for rendering an updated visual representation of the content page based at least partly on the indication of interaction.

21. The non-transitory computer-readable medium of claim 16, wherein the intercepted stream of graphics commands instruct the first browser component to draw objects of different layers of the plurality of layers of the document object model to separate canvases.