Detection of undesirable web pages

• US 7,974,970 B2
• Filed: 10/09/2008
• Issued: 07/05/2011
• Est. Priority Date: 10/09/2008
• Status: Active Grant

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Pavlovski, Dmitri, Chan, Su Han, Duan, Lei, Leung, Gilbert, Tsioutsiouliklis, Kostas
• Primary Examiner(s): Thai; Hanh B
• Application Number:
  US12/248,267
• Publication Number:
  US 20100094868A1
• Time in Patent Office: 999 Days
• Field of Search: 707/688, 707/696, 707/713, 707/715, 707/726
• US Class Current: 707/713
• CPC Class Codes: G06F 16/95 Retrieval from the web

Abstract

A system for detecting artificial promotion of a resource, including a search engine operative to index a set incoming links (“inlinks”) which reference the resource, a log module coupled with the search engine and configured to store log data associated with the set of inlinks, a partitioning module coupled with log module and operative to partition the set of inlinks into a plurality of groups of inlinks based on at least one partitioning scheme, a statistics module coupled with the partitioning module and operative to compute a statistic associated with the inlinks within each of the plurality of groups of inlinks, and a computation module coupled with the statistics module and operative to process the computed statistic associated with the inlinks of each of the plurality of groups of inlinks and compute a metric associated with set of inlinks where the metric indicates a level of uniformity of a distribution of values of the respective computed statistics among the plurality of groups of inlinks, and where the search engine places a list of search results, generated in response to a search query, in a pattern based on the metric.

Claims

1. A system for detecting artificial promotion of a resource, comprising:

computer readable program code operative in conjunction with a processor, the computer readable program code including code forming

a search engine operative to index a set of incoming links (“

inlinks”

) which reference the resource;

a log module coupled with the search engine and configured to store log data associated with the set of inlinks;

a partitioning module coupled with log module and operative to partition the set of inlinks into a plurality of groups of inlinks based on at least one partitioning scheme;

a statistics module coupled with the partitioning module and operative to compute a statistic associated with the inlinks within each of the plurality of groups of inlinks;

a computation module coupled with the statistics module and operative to process the computed statistic associated with the inlinks of each of the plurality of groups of inlinks and compute a metric associated with the set of inlinks, wherein the metric indicates a level of uniformity of a distribution of values of the respective computed statistics among the plurality of groups of inlinks, and

wherein the search engine places a list of search results, generated in response to a search query, in a pattern based on the metric.

2. The system of claim 1 wherein the log data further comprises inlink log data for analysis by the computational module, wherein the inlink log data is associated with the resource.

3. The system of claim 1 wherein the at least one partitioning scheme comprises partitioning the set of inlinks based on the domain name of the source of each inlink of the set of inlinks, an internet protocol (IP) address segment of the source of each inlink of the set of inlinks, a language used to create each inlink of the set of inlinks, a geographic region associated with the source of each inlink of the set of inlinks, a network routing group associated with the source of each inlink of the set of inlinks, an anchor text associated with each inlink of the set of inlinks, or combinations thereof.

4. The system of claim 1 wherein the statistics module is further operative to weight the set of inlinks based on at least one weighting scheme.

5. The system of claim 1 wherein the metric value is associated with the at least one partitioning scheme and the at least one computed statistic.

6. The system of claim 5 wherein the at least one computed statistic assigns a value to each of the groups of inlinks based on at least one statistical operation performed on each of the groups of inlinks.

7. The system of claim 1 wherein the statistics module computes the computed statistic for each group of inlinks independently or collectively among the plurality of groups of inlinks.

8. The system of claim 1 wherein the search engine is configured to receive the metric value as an input to a ranking function operative to prioritize the list of search results.

9. The system of claim 1 wherein the search engine demotes a ranking of the resource among the list of search results based on the metric value.

10. The system of claim 1 further comprising a metric processor in data communication with the code forming the computation module and the code forming the search engine, the metric processor processes the metric value and generates an output transmitted to the search engine.

11. The system of claim 10 wherein the processing performed by the metric processor includes at least one of combining the metric value with other computed algorithmic metrics, using the metric value as input to another algorithm, transforming the metric value via a mathematical function, and comparing the metric value to a threshold.

16. The method of claim 1 wherein the metric value is associated with the at least one partitioning scheme and the at least one computed statistic.

17. The method of claim 16 wherein computing the at least one computed statistic comprises assigning a value to each of groups of inlinks based on at least one statistical operation performed on each of the groups of inlinks.

18. The method of claim 16 further comprising, at the processor, computing the at least one statistic for each group of inlinks independently or collectively among the plurality of groups of inlinks.

12. A method for detecting the artificial promotion of a resource, comprising:

at a processor of a computer system, indexing a set of incoming links (“

inlinks”

) navigating to the resource;

at a memory, storing log data associated with the set of inlinks;

at the processor, partitioning the set of inlinks into a plurality of groups of inlinks based on at least one partitioning scheme;

at the processor, computing at least one statistic associated with the inlinks within each of the plurality of groups of inlinks;

at the processor, processing the at least one computed statistic associated with the inlinks of each of the plurality of groups of inlinks and computing a metric associated with the set of inlinks, wherein the metric indicates a level of uniformity of a distribution of values of the respective computed statistics among the plurality of groups of inlinks, and

at the processor, placing a list of search results, generated in response to a search query, in a pattern based on the metric value.

13. The method of claim 12 wherein the log data includes inlink log data associated with the resource.

14. The method of claim 12 wherein the at least one partitioning scheme comprises partitioning the set of inlinks based on the domain name of a source of each inlink of the set of inlinks, an internet protocol (IP) address segment of the source of each inlink of the set of inlinks, a language used to create each inlink of the set of inlinks, a geographic region associated with the source of each inlink of the set of inlinks, a network routing group associated with the source of each inlink of the set of inlinks, an anchor text associated with each inlink of the set of inlinks, or combinations thereof.

15. The method of claim 12 further comprising, at the processor, weighting the set of inlinks based on at least one weighting scheme.

19. The method of claim 12 further comprising, at the processor, receiving the metric value as an input to a ranking function operative to prioritize the list of search results.

20. The method of claim 12 further comprising, at the processor, demoting a ranking of the resource among the list of search results based on the metric value.

21. The method of claim 12 further comprising, at the processor, further processing the metric value by a metric processor and generating an output transmitted to a search engine.

22. The method of claim 21 wherein the processing performed by the metric processor includes at least one of combining the metric value with other computed algorithmic metrics, using the metric value as input to another detection algorithm, transforming the metric via a mathematical function, and comparing the metric value to a threshold.