ENRICHED DOCUMENT REPRESENTATIONS USING AGGREGATED ANCHOR TEXT

• US 20100318533A1
• Filed: 06/10/2009
• Published: 12/16/2010
• Est. Priority Date: 06/10/2009
• Status: Abandoned Application

• Current Assignee: Oath Inc. (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Velipasaoglu, Emre, Novak, Jasmine, Cui, Hang, Metzler, Donald, Reddy, Srihari
• Application Number:
  US12/482,377
• Publication Number:
  US 20100318533A1
• Time in Patent Office: Days
• US Class Current: 707/759
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking

Abstract

A system and method for aggregating anchor text over the web graph and using the aggregated anchor text to enrich document representations. For a target page, its internal inlinks, which point to the target page and are within the site containing the target page, are identified first. Then external anchors that point to the internal inlinks from pages outside of the site are identified. Anchor text of the external anchors are collected, weighted, stored, and used to enrich document presentations. The method not only reduces the number of pages with no anchor text, but also adds lines of anchor text to URLs.

Claims

1. A computer implemented method comprising:

receiving a URL of a target page;

identifying at least one internal inlink, which is a page pointing to the target page and within a site containing the target page;

identifying at least one external anchor that points to the at least one internal inlink from a page outside of the site;

collecting anchor text of the at least one external anchor; and

storing in a database the external anchor text of the at least one internal inlink as aggregated anchor text of the target page.

2. The method of claim 1, further comprising:

when external anchor text of a first external anchor and a second external anchor has the same line of text but different weights, combining the weights.

3. The method of claim 2, further comprising:

using a function selected from the group consisting of following functions to combine the weights;

4. The method of claim 2, further comprising:

using the aggregated anchor text to enrich a document representation of the target page.

5. The method of claim 4, wherein the aggregated anchor text is added to a body of the document.

6. The method of claim 4, wherein the aggregated anchor text is added to a field for anchor text.

7. The method of claim 4, wherein the aggregated anchor text is added as a new field.

8. The method of claim 4, further comprising:

receiving a search query; and

searching web pages, whose document representations are enriched with aggregated anchor text, to identify web pages relevant to the query.

9. The method of claim 8, further comprising:

calculating estimates of relevance of the web pages, using the combined weight for the aggregated anchor text.

10. A computer system comprising:

a processor for receiving a URL of a target page;

identifying at least one internal inlink, which is a page pointing to the target page and within a site containing the target page;

identifying at least one external anchor that points to the first internal inlink from a page outside of the site; and

collecting anchor text of the at least one external anchor; and

a data storage device for storing the external anchor text of the at least one internal inlink as aggregated anchor text of the target page.

11. The computer system of claim 10, wherein the data storage device further storing a weight assigned to the aggregated anchor text.

12. A computer program product comprising a computer-readable medium having instructions which, when performed by a computer, perform a method comprising:

receiving a URL of a target page;

identifying at least one internal inlink, which is a page pointing to the target page and within a site containing the target page;

identifying at least one external anchor that points to the at least one internal inlink from a page outside of the site;

collecting anchor text of the at least one external anchor; and

storing in a database the external anchor text of the at least one internal inlink as aggregated anchor text of the target page.

13. The computer program product of claim 12, wherein the method further comprises:

when the external anchor text of a first external anchor and a second external anchor has the same line of text but different weights, combining the weights.

14. The computer program product of claim 13, wherein the method further comprises:

using a function selected from the group consisting of following functions to combine the weights;

15. The computer program product of claim 13, wherein the method further comprises:

using the aggregated anchor text to enrich a document representation of the target page.

16. The computer program product of claim 15, wherein the aggregated anchor text is added to a body of the document.

17. The computer program product of claim 15, wherein the aggregated anchor text is added to a field for anchor text.

18. The computer program product of claim 15, wherein the aggregated anchor text is added as a new field.

19. The computer program product of claim 15, wherein the method further comprises:

receiving a search query; and

searching web pages, whose document representations are enriched with aggregated anchor text, to identify web pages relevant to the query.

20. The computer program product of claim 19, wherein the method further comprises:

calculating estimates of relevance of the web pages, using the combined weight for the aggregated anchor text.