Embedded communication of link information

• US 8,260,766 B2
• Filed: 07/12/2011
• Issued: 09/04/2012
• Est. Priority Date: 06/30/2005
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Bharat, Krishna, Cutts, Matthew Daniel, Haahr, Paul G., Malpani, Radhika A., Mittal, Vibhu, Kaszkiel, Marcin
• Primary Examiner(s): Beausoliel, Jr., Robert
• Assistant Examiner(s): Liu, Hexing
• Application Number:
  US13/181,436
• Publication Number:
  US 20110271095A1
• Time in Patent Office: 420 Days
• Field of Search: 707/706, 707/709, 707/711, 707/736, 707/741
• US Class Current: 707/709
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

A method of processing documents is described. The method includes the operation of receiving a document in a search engine crawler. The document includes an embedded first link tag. The first link tag includes one or more information pairs. A respective information pair includes a respective parameter and a corresponding value. The parameters in the one or more information pairs may correspond to content at one or more content locations or one or more document locations. The method also includes selecting a method of processing content associated with the first link tag in accordance with one or more of the information pairs.

Claims

1. A computer-implemented method of processing documents, performed by a computer system having one or more processors and memory storing one or more programs for execution by the one or more processors, the method comprising:

receiving a document in a search engine crawler, the document having a first link tag embedded in the document, the first link tag including a location value and one or more information pairs that are distinct from the location value, wherein a respective information pair has a respective parameter and a corresponding parameter value;

selecting a method of processing content, wherein the content is specified by the location value of the first link tag and the selected method of processing is in accordance with one or more of the one or more information pairs of the first link tag;

retrieving the content specified by the location value of the first link tag; and

processing the retrieved content specified by the first link tag in accordance with the selected method.

2. The method of claim 1, wherein an information pair of the one or more information pairs included in the first link tag is included in a second tag that includes the first link tag, the second tag includes a second information pair having a respective parameter and a corresponding second parameter value, and the selected method of processing content is performed on the content specified by the location value of the first link tag in accordance with the second parameter value.

3. The method of claim 1, wherein the method of processing the retrieved content includes adjusting a weight specified by a respective information pair of the first link tag.

4. The method of claim 3, further comprising computing one or more document ranking values for one or more document locations, wherein the computing is performed in accordance with the weight specified by the first link tag.

5. The method of claim 1, wherein the link tag specifies one or more content locations and further comprising computing one or more document ranking values for the one or more content locations in accordance with a weight specified by a respective information pair of the first link tag.

6. The method of claim 1, wherein parameters in the one or more information pairs correspond to content at one or more content locations.

7. The method of claim 1, further comprising retrieving a respective decryption key associated with a respective publisher, including looking up the respective decryption key in a data structure in accordance with a location of the received document.

8. The method of claim 1, further comprising retrieving a respective decryption key associated with a respective publisher, including looking up the respective decryption key in a data structure in accordance with an identifier of the received document.

9. The method of claim 1, wherein the first link tag is HTML compatible.

10. The method of claim 1, wherein the first link tag is XML compatible.

11. The method of claim 1, wherein one or more of the parameter values in the one or more information pairs are encrypted.

12. The method of claim 11, wherein the one or more encrypted values are encrypted using a key from a non-symmetric key pair.

13. A non-transitory computer readable storage medium storing one or more programs to be executed by a computer system, the one or more programs comprising:

instructions for receiving a document in a search engine crawler, the document having a first link tag embedded in the document, the first link tag including a location value and one or more information pairs that are distinct from the location value, wherein a respective information pair has a respective parameter and a corresponding parameter value;

instructions for selecting a method of processing content, wherein the content is specified by the location value of the first link tag and the selected method of processing is in accordance with one or more of the one or more information pairs of the first link tag;

instructions for retrieving the content specified by the location value of the first link tag; and

instructions for processing the retrieved content specified by the first link tag in accordance with the selected method.

14. The non-transitory computer readable storage medium of claim 13, wherein an information pair of the one or more information pairs included in the first link tag is included in a second tag that includes the first link tag, the second tag includes a second information pair having a respective parameter and a corresponding second parameter value, and the selected method of processing content is performed on the content specified by the location value of the first link tag in accordance with the second parameter value.

15. The non-transitory computer readable storage medium of claim 13, wherein the selected method of processing the retrieved content includes adjusting a weight specified by a respective information pair of the first link tag.

16. A non-transitory computer readable storage medium storing one or more programs to be executed by a computer system, the one or more programs comprising:

web crawling instructions to identify a set of documents to be retrieved and processed,

wherein a document of the set of documents has an embedded first link tag, the first link tag including a location value and one or more information pairs that are distinct from the location value, a respective information pair having a respective parameter and a corresponding parameter value, and

instructions to process content specified by the first link tag, including instructions to select a method of processing the content, wherein the content is specified by the location value of the first link tag and the selected method of processing is in accordance with one or more of the one or more information pairs of the first link tag, and instructions to process the content in accordance with the selected method.

17. The non-transitory computer readable storage medium of claim 16, wherein an information pair of the one or more information pairs included in the first link tag is included in a second tag that includes the first link tag, the second tag includes a second information pair having a respective parameter and a corresponding second parameter value, and the selected method of processing content is performed on the content specified by the location value of the first link tag in accordance with the second parameter value.

18. The non-transitory computer readable storage medium of claim 16, wherein the method of processing the retrieved content includes adjusting a weight specified by a respective information pair of the first link tag.

19. A computer system, comprising:

memory;

one or more processors; and

one or more programs, stored in the memory and executed by the one or more processors, the one or more programs including;

web crawling instructions to identify a set of documents to be retrieved and processed,

wherein at least one document has an embedded first link tag, the first link tag including a location value and one or more information pairs that are distinct from the location value, a respective information pair having a respective parameter and a corresponding parameter value, and

instructions to process content specified by the first link tag, including instructions to select a method of processing the content, wherein the content is specified by the location value of the first link tag and the selected method of processing is in accordance with one or more of the one or more information pairs of the first link tag, and instructions to process the content in accordance with the selected method.

20. The computer system of claim 19, wherein an information pair of the one or more information pairs included in the first link tag is included in a second tag that includes the first link tag, the second tag includes a second information pair having a respective parameter and a corresponding second parameter value, and the selected method of processing content is performed on the content specified by the location value of the first link tag in accordance with the second parameter value.

21. The computer system of claim 19, wherein the method of processing the retrieved content includes adjusting a weight specified by a respective information pair of the first link tag.

22. A non-transitory computer readable storage medium storing one or more programs to be executed by a computer system, the one or more programs comprising:

instructions to generate a link tag, the link tag including a location value and one or more information pairs that are distinct from the location value, wherein a respective information pair has a respective parameter and a corresponding parameter value; and

instructions to embed the link tag in the document;

wherein the value in the embedded link tag specifies a method of processing content by a web crawler so as to modify information associated with the content, wherein the content to be processed is specified by the location value of the embedded link tag and the method of processing is in accordance with the respective parameter value in one or more of the one or more information pairs of the embedded link tag.

23. The non-transitory computer readable storage medium of claim 22, wherein an information pair of the one or more information pairs included in the embedded link tag is included in a second tag that includes the embedded link tag, the second tag includes a second information pair having a respective parameter and a corresponding second parameter value, and the selected method of processing content is performed on the content specified by the location value of the embedded link tag in accordance with the second parameter value.

24. The non-transitory computer readable storage medium of claim 22, wherein the method of processing content includes adjusting a weight specified by a respective information pair of the embedded link tag.