Script optimized browser rendering process

• US 9,785,720 B2
• Filed: 10/22/2014
• Issued: 10/10/2017
• Est. Priority Date: 06/26/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Meng, Biping, Fang, Hao, Xu, Hui
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): KHAN, SHAHID K
• Application Number:
  US14/521,223
• Publication Number:
  US 20150379155A1
• Time in Patent Office: 1,084 Days
• CPC Class Codes: G06F 16/9566 URL specific, e.g. using aliases, detecting broken or misspelled links
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226

Abstract

Implementations an optimizing a browser rendering process that identifies content neutral web pages and renders such web pages without scripting. An example method includes generating a first rendering result of a web page with scripting turned on and generating a second rendering result of the web page with scripting turned off. The method also includes comparing the first rendering result with the second rendering result to determine whether the web page is content neutral and storing a URL for the web page in a list of content neutral URLs when the web page is content neutral. The method can further include receiving a request to render a web page identified by a URL, prior to rendering, determining that the URL is a content neutral URL, and rendering the web page with scripting turned off responsive to determining that the URL is a content neutral URL.

Claims

1. A computer system comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the system to;

generate a first rendering result of a web page, the first rendering result being rendered with scripting turned on,

generate a second rendering result of the web page, the second rendering result being rendered with scripting turned off,

determine a similarity score between a set of major components of the first rendering result and a set of major components of the second rendering result,

responsive to determining that the similarity score satisfies a similarity threshold, store a URL for the web page in a content neutral URL data store,

receive a request from a browser, the request providing a URL, and

responsive to matching the provided URL to a URL in the content neutral URL data store, provide a response to the browser indicating the provided URL is a content neutral URL to allow the browser to render the URL with scripting turned off.

2. The computer system of claim 1, wherein the memory further stores instructions that, when executed by the at least one processor, cause the system to:

identify an outlink in the first rendering result missing from the second rendering result; and

store, responsive to identifying the outlink, the URL for the web page in a content neutral URL data store.

3. The computer system of claim 1, wherein the memory further stores instructions that, when executed by the at least one processor, cause the system to:

identify a token in the first rendering result that is missing from the second rendering result; and

store, responsive to identifying the token, the URL for the web page in a content neutral URL data store.

4. The computer system of claim 3, wherein stop words and numbers are removed prior to identifying the token.

5. The computer system of claim 1, wherein the memory further stores instructions that, when executed by the at least one processor, cause the system to:

identify a quantity of tokens in the first rendering result that are missing from the second rendering result;

determine that the quantity meets a threshold; and

store, responsive to determining the quantity meets the threshold, the URL for the web page in a content neutral URL data store.

6. The computer system of claim 1, wherein the set of major components includes the major components that make up a percentage of screen space.

7. The computer system of claim 1, wherein the instructions further include instructions that, when executed by the at least one processor, cause the system to:

for each of a plurality of web pages in fetch records;

generate a first rendering result of the web page, the first rendering result being rendered with scripting turned on,

generate a second rendering result of the web page, the second rendering result being rendered with scripting turned off,

compare the first rendering result with the second rendering result to determine whether the web page is content neutral based on comparison of the major portions,

store a URL for the web page in a list of content neutral URLs when the web page is content neutral, and

store a URL for the web page in a list of non-content neutral URLs when the web page is not content neutral;

determine at least one pattern using the list of content neutral URLs; and

store the pattern in the content neutral URL data store, wherein a URL matching the pattern is identified as a content neutral URL.

8. The computer system of claim 7, wherein the instructions further include instructions that, when executed by the at least one processor, cause the system to:

determine whether the pattern applies to a URL in the list of non-content neutral URLs; and

store the pattern in the content neutral URL data store when the pattern fails to apply to a URL in the list of non-content neutral URLs.

9. The computer system of claim 7, wherein the instructions further include instructions that, when executed by the at least one processor, cause the system to:

determine a percentage of URLs that match the pattern that are non-content neutral URLs; and

store the pattern in the content neutral URL data store when the percentage is less than one percent.

10. A method comprising:

generating, using at least one processor, a first rendering result of a web page, the first rendering result being rendered with scripting turned on;

generating, using the at least one processor, a second rendering result of the web page, the second rendering result being rendered with scripting turned off;

computing a similarity score for a set of major components of the first rendering result with a set of major components of the second rendering result;

determining that the web page is content neutral when the similarity score satisfies a threshold;

storing a Uniform Resource Locator (URL) for the web page in a list of content neutral URLs when the web page is content neutral;

receiving a request from a browser, the request providing a URL; and

responsive to matching the provided URL to a URL in the list of content neutral URLs, providing a response to the browser indicating the provided URL is a content neutral URL to allow the browser to render the provided URL with scripting turned off.

11. The method of claim 10, wherein the similarity score represents an amount of overlap in bounding boxes for the sets of major components.

12. The method of claim 10, further comprising:

for each of a plurality of web pages in fetch records;

generating a first rendering result of the web page, the first rendering result being rendered with scripting turned on,

generating a second rendering result of the web page, the second rendering result being rendered with scripting turned off,

comparing the first rendering result with the second rendering result to determine whether the web page is content neutral based on comparison of the major portions,

storing a URL for the web page in the list of content neutral URLs when the web page is content neutral, and

storing a URL for the web page in a list of non-content neutral URLs when the web page is not content neutral;

determining at least one pattern from the list of content neutral URLs; and

storing the pattern in the content neutral URL data store, wherein a URL matching the pattern is identified as a content neutral URL.

13. The method of claim 12, further comprising:

determining whether the pattern matches a URL from the list of non-content neutral URLs; and

storing the pattern in the content neutral URL data store when the pattern fails to match a URL from the list of non-content neutral URLs.

14. The method of claim 12, further comprising:

determining a first quantity of URLs in the list of content neutral URLs that match the pattern;

determining a second quantity of URLs in the list of non-content neutral URLs that match the pattern; and

storing the pattern in the content neutral URL data store when the second quantity is less than one percent of a sum of the first quantity and the second quantity.

15. The method of claim 10, the method further comprising:

identifying an outlink in the first rendering result missing from the second rendering result; and

determining, responsive to the identifying, that the web page is not content neutral.

16. The method of claim 10, the method further comprising:

identifying a quantity of tokens in the first rendering result that are missing from the second rendering result;

determining that the quantity satisfies a token threshold; and

determining, responsive to the quantity meeting the token threshold, that the web page is not content neutral.

17. The method of claim 16, further comprising:

removing stop words from the tokens prior to identifying the quantity of tokens.

18. The method of claim 16, wherein the token threshold is a quantity of one token.

19. The method of claim 10, wherein the set of major components includes components with a box size that satisfies a threshold size.

20. A method comprising:

receiving a request to render a web page identified by a URL;

prior to rendering, determining that the URL is identified as a content neutral URL in a data store that identifies content neutral URLs, wherein a URL is content neutral based on a similarity of a page layout of the web page with scripting turned off to a page layout of the web page with scripting turned on; and

rendering the web page with scripting turned off, regardless of browser settings for scripting, responsive to determining that the URL is a content neutral URL.

21. The method of claim 20, wherein determining that the URL is identified as a content neutral URL includes determining that the URL matches a predetermined pattern in the data store that identifies content neutral URLs.

22. The method of claim 20, wherein determining that the URL is a content neutral URL includes:

determining that the URL is content neutral for a type of browser handling the request to render the web page.

23. The method of claim 20, wherein determining that the URL is a content neutral URL includes:

sending a request to a service, the service determining whether the URL is a content neutral URL; and

receiving a response from the service indicating the URL is a content neutral URL.