Acceleration of rendering of web-based content

• US 9,418,171 B2
• Filed: 03/03/2009
• Issued: 08/16/2016
• Est. Priority Date: 03/04/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Fraser, Simon
• Primary Examiner(s): Patel, Manglesh M
• Assistant Examiner(s): Hasty, Nicholas
• Application Number:
  US12/397,327
• Publication Number:
  US 20090228782A1
• Time in Patent Office: 2,723 Days
• Field of Search: 715/234, 715/236
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents

Abstract

Systems and methods for hardware accelerated presentation of web pages on mobile computing devices are presented. A plurality of web pages may be received by a computing device capable of processing and displaying web pages using layout engines, hardware accelerated graphics application programming interfaces (APIs). Upon receipt of the web pages, the web pages may be divided into a plurality of rendering layers, based upon stylesheets of the web pages. An algorithm walks through rendering layers so as to select a plurality of layers that may receive compositing layers so as to take advantage of hardware acceleration when rendered. The web pages may be subsequently presented on a display of the mobile computing devices using remaining rendering layers and compositing layers. In this manner, visual representation of web content remains intact even when content which may not have been originally designed for use with layout engine may be displayed.

Claims

1. A method comprising:

determining, by a computer, a plurality of rendering layers that describe relations of elements to be displayed for a page of content, wherein successive rendering layers are displayed on top of preceding rendering layers;

determining a first rendering layer in the plurality of rendering layers that is appropriate for hardware compositing support instead of software rendering based on visual characteristics of the elements for the first rendering layer, the visual characteristics defined by style descriptions referred to by the page of content;

generating rendered content for the first rendering layer in the plurality of rendering layers using the hardware compositing support instead of the software rendering;

determining each subsequent rendering layer in the plurality of rendering layers that overlaps the first rendering layer;

generating rendered content for each of the subsequent rendering layers that overlap the first rendering layer using the hardware compositing support instead of the software rendering, wherein the rendered content of each of the subsequent layers generated using the hardware compositing support is composited on top of the rendered content for the first rendering layer as indicated by the plurality of rendering layers; and

for each subsequent rendering layer that does not overlap the first rendering layer, generating rendered content using the software rendering instead of the hardware compositing support.

2. The method of claim 1, further comprising determining hierarchy of rendering layers based on styles specified in the style descriptions that affect the front-to-back ordering of the page elements.

3. The method of claim 1, further comprising determining, for at least one rendering layer, whether that layer uses hardware compositing support.

4. The method of claim 1, further comprising downloading files that describe the page of content.

5. The method of claim 1, further comprising downloading the style descriptions referred to by the page of content.

6. The method of claim 1, further comprising:

minimizing a number and size of hardware compositing layers generated using hardware compositing support.

7. The method of claim 1, further comprising:

comparing a rendered display created from all the rendered layers with an intended display; and

selecting at least one of the subsequent rendering layers that does not overlap the first rendering layer to be generated using the hardware compositing support instead of the software rendering based on the comparing.

8. A non-transitory machine readable storage medium storing executable instructions which when executed by a processor cause the processor to perform operations comprising:

determining a plurality of rendering layers that describe relations of elements to be displayed for a page of content, wherein successive rendering layers are displayed on top of preceding rendering layers;

determining a first rendering layer in the plurality of rendering layers that is appropriate for hardware compositing support instead of software rendering based on visual characteristics of the elements for the first rendering layer, the visual characteristics defined by style descriptions referred to by the page of content;

generating rendered content for the first rendering layer in the plurality of rendering layers using the hardware compositing support instead of the software rendering;

determining each subsequent rendering layer in the plurality of rendering layers that overlaps the first rendering layer;

generating rendered content for each of the subsequent layers that overlap the first rendering layer using the hardware compositing support instead of the software rendering, wherein the rendered content of each of the subsequent layers generated using the hardware compositing support is composited on top of the rendered content for the first rendering layer as indicated by the plurality of rendering layers; and

for each subsequent rendering layer that does not overlap the first rendering layer, generating rendered content using the software rendering instead of the hardware compositing support.

9. The non-transitory machine readable storage medium of claim 8, the operations further comprising determining hierarchy of rendering layers based on styles specified in the style descriptions that affect the front-to-back ordering of the page elements.

10. The non-transitory machine readable storage medium of claim 8, the operations further comprising determining, for at least one rendering layer, whether that layer uses hardware compositing support.

11. The non-transitory machine readable storage medium of claim 8, the operations further comprising downloading files that describe the page of content.

12. The non-transitory machine readable storage medium of claim 8, the operations further comprising downloading the style descriptions referred to by the page of content.

13. The non-transitory machine readable storage medium of claim 8, the operations further comprising:

minimizing a number and size of hardware compositing layers generated using hardware compositing support.

14. The non-transitory machine readable storage medium of claim 8, the operations further comprising:

comparing a rendered display created from all the rendered layers with an intended display; and

selecting at least one of the subsequent rendering layers that does not overlap the first rendering layer to be generated using the hardware compositing support instead of the software rendering based on the comparing.

15. A data processing system comprising:

means for determining, by a hardware device, a plurality of rendering layers that describe relations of elements to be displayed for a page of content, wherein successive rendering layers are displayed on top of preceding rendering layers;

means for determining a first rendering layer in the plurality of rendering layers that is appropriate for hardware compositing support instead of software rendering based on visual characteristics of the elements for the first rendering layer, the visual characteristics defined by style descriptions referred to by the page of content;

means for generating rendered content for the first rendering layer in the plurality of rendering layers using the hardware compositing support instead of the software rendering;

means for determining each subsequent rendering layer in the plurality of rendering layers that overlaps the first rendering layer;

means for generating rendered content for each of the subsequent layers that overlaps the first rendering layer using the hardware compositing support instead of the software rendering, wherein the rendered content of each of the subsequent layers generated using the hardware compositing support is composited on top of the first rendering layer as indicated by the plurality of rendering layers; and

for each subsequent rendering layer that does not overlap the first rendering layer, means for generating rendered content using the software rendering instead of the hardware compositing support.

16. The data processing system of claim 15, further comprising means for determining hierarchy of rendering layers based on styles specified in the style descriptions that affect the front-to-back ordering of the page elements.

17. The data processing system of claim 15, further comprising means for determining, for at least one rendering layer, whether that layer uses hardware compositing support.

18. The data processing system of claim 15, further comprising means for downloading files that describe the page of content.

19. The data processing system of claim 15, further comprising means for downloading the style descriptions referred to by the page of content.

20. The data processing system of claim 15, further comprising:

means for minimizing a number and size of hardware compositing layers generated using hardware compositing support.