Canonicalized online document sitelink generation

• US 10,776,435 B2
• Filed: 04/19/2017
• Issued: 09/15/2020
• Est. Priority Date: 01/31/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Vaish, Vaibhav, Ramachandran, Venky, Sisson, David Philip, Kandhan, Ramakrishnan, Adiddam, Pramod, Marur, Vinod Ramachandran, Garg, Gaurav
• Primary Examiner(s): Ubale, Gautam
• Application Number:
  US15/491,734
• Publication Number:
  US 20170220694A1
• Time in Patent Office: 1,245 Days
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

Methods and systems for improved processor efficiency via reductions in repeated calculations are provided. A plurality of candidate sitelinks are identified in response to a search for online content. Each sitelink has associated with it a plurality of candidate creatives with which the sitelink may be presented to the user. The creatives are canonicalized to form clusters of candidate creatives. The sitelinks are also canonicalized. The creatives are matched to the candidate canonicalized sitelinks so as to provide enhanced sitelinks having increased relevance to the user search.

Claims

1. A system for canonicalized online document sitelink generation, comprising:

a data processing system comprising at least one processor and memory to;

receive digital information generated by an audio codec that converts spoken information from a user to the digital information;

identify, based on the digital information, a content item associated with a first uniform resource locator (URL) including a campaign parameter;

generate a canonicalized content item URL comprising a canonical form by removing the campaign parameter from the first URL;

generate a content item URL group with the canonicalized content item URL;

receive a sitelink associated with a second URL indexed in a database, the second URL including a URL parameter;

crawl the second URL with the URL parameter to identify a landing page;

crawl the second URL without the URL parameter to identify the same landing page;

generate, responsive to crawl of the second URL with and without the URL parameter and identification of the same landing page, a canonicalized sitelink URL for the second URL by removal of the URL parameter, wherein the canonicalized content item URL is in the canonical form configured to reduce repeated calculations as compared to the first URL not in the canonical form;

match the canonicalized sitelink URL with the content item of the content item URL group based on an indication of similarity between text of the content item and text of the canonicalized sitelink URL;

determine, based on a filter configured to eliminate excluded content items based on a geographic policy, that the content item is compatible with the canonicalized sitelink URL; and

select, in response to receipt of the digital information generated by the audio codec that converts the spoken information from the user to the digital information, the content item matched with the sitelink associated with the canonicalized sitelink URL based on the filter.

2. The system of claim 1, comprising the data processing system to:

receive the digital information from a first device via a computer network, the first device configured with the audio codec that converts the spoken information from the user to the digital information; and

transmit, to a second device via the computer network, the content item selected based on the match with the sitelink associated with the canonicalized sitelink URL.

3. The system of claim 1, comprising the data processing system to:

prune a candidate set of content items matched with sitelinks by removal of at least one of duplicate content items and redundant content items.

4. The system of claim 1, comprising the data processing system to:

select the content item matched with the sitelink associated with the canonicalized sitelink URL based on filter rules, the filter rules comprising at least one of language rules, geographic rules, user device rules, platform rules, and campaign rules.

5. The system of claim 1, comprising the data processing system to:

index a plurality of sitelink URLs with and without a URL parameter associated with each of the plurality of sitelink URLS;

compare landing pages of each of the plurality of sitelink URLs; and

remove the URL parameter from each of the plurality of sitelink URLs responsive to a determination that the landing pages of each of the plurality of sitelinks match, the removal of the URL parameter.

6. The system of claim 1, comprising the data processing system to:

generate the canonicalized sitelink URL with webmaster supplied rules that specify a relevance of the URL parameter; and

generate the canonicalized content item URL with the webmaster supplied rules that indicate a relevance of the campaign parameter.

7. The system of claim 1, comprising the data processing system to:

generate the canonicalized content item URL based on a comparison of contents of a first landing page associated with the canonicalized content item URL to identify one or more similarities with a second landing page associated with a second canonicalized content item URL.

8. The system of claim 1, comprising the data processing system to:

select the content item based on a match between a plurality of sitelinks with an as-yet unmatched content item having a highest estimated score from amongst unmatched content items.

9. The system of claim 1, wherein the campaign parameter includes at least one of an identifier, name, type, size, first line, web address, display URL, and media type.

10. A method of canonicalized online document sitelink generation, comprising:

receiving, by a data processing system comprising at least one processor and memory, digital information generated by an audio codec that converts spoken information from a user to the digital information;

identifying, by the data processing system, based on the digital information, a content item associated with a first uniform resource locator (URL) including a campaign parameter;

generating, by the data processing system, the first URL into a canonicalized content item URL comprising a canonical form by removing the campaign parameter from the first URL;

generating, by the data processing system, a content item URL group with the canonicalized content item URL;

receiving, by the data processing system, a sitelink associated with a second URL indexed in a database, the second URL including a URL parameter;

crawling the second URL with the URL parameter to identify a landing page;

crawling the second URL without the URL parameter to identify the same landing page;

generating, by the data processing system responsive to crawling the second URL with and without the URL parameter and identifying the same landing page, a canonicalized sitelink URL for the second URL by removing the URL parameter, wherein the canonicalized content item URL is in the canonical form configured to reduce repeated calculations as compared to the first URL not in the canonical form;

matching, by the data processing system, the canonicalized sitelink URL with the content item of the content item URL group based on an indication of similarity between text of the content item and text of the canonicalized sitelink URL;

determining, by the data processing system, based on a filter configured to eliminate excluded content items based on a geographic policy, that the content item is compatible with the canonicalized sitelink URL; and

selecting, by the data processing system in response to receipt of the digital information generated by the audio codec that converts the spoken information from the user to the digital information, the content item matched with the sitelink associated with the canonicalized sitelink URL based on the filter.

11. The method of claim 10, comprising:

receiving the digital information from a first device via a computer network, the first device configured with the audio codec that converts the spoken information from the user to the digital information; and

transmitting, to a second device via the computer network, the content item selected based on the match with the sitelink associated with the canonicalized sitelink URL.

12. The method of claim 10, comprising:

pruning a candidate set of content items matched with sitelinks by removal of at least one of duplicate content items and redundant content items.

13. The method of claim 10, comprising

selecting the content item matched with the sitelink associated with the canonicalized sitelink URL based on filter rules, the filter rules comprising at least one of language rules, geographic rules, user device rules, platform rules, and campaign rules.

14. The method of claim 10, comprising:

indexing a plurality of sitelink URLs with and without a URL parameter associated with each of the plurality of sitelink URLS;

comparing landing pages of each of the plurality of sitelink URLs; and

removing the URL parameter from each of the plurality of sitelink URLs responsive to a determination that the landing pages of each of the plurality of sitelinks match.

15. The method of claim 10, comprising:

generating the canonicalized sitelink URL with webmaster supplied rules that specify a relevance of the URL parameter; and

generating the canonicalized content item URL with the webmaster supplied rules that indicate a relevance of the campaign parameter.

16. The method of claim 10, comprising:

generating the canonicalized content item URL based on a comparison of contents of a first landing page associated with the canonicalized content item URL to identify one or more similarities with a second landing page associated with a second canonicalized content item URL.

17. The method of claim 10, comprising:

selecting the content item based on a match between a plurality of sitelinks with an as-yet unmatched content item having a highest estimated score from amongst unmatched content items.

18. The method of claim 10, wherein the campaign parameter includes at least one of an identifier, name, type, size, first line, web address, display URL, and media type.