Active spam testing system

• US 7,680,851 B2
• Filed: 03/07/2007
• Issued: 03/16/2010
• Est. Priority Date: 03/07/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Liu, Tie-Yan, Li, Hang
• Primary Examiner(s): Trujillo; James
• Assistant Examiner(s): Phillips; Albert
• Application Number:
  US11/682,971
• Publication Number:
  US 20080222451A1
• Time in Patent Office: 1,105 Days
• Field of Search: None
• US Class Current: 707/706
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A method and system for introducing spam into a search engine for testing purposes is provided. An active spam testing system receives from a tester a specification of spam that is to be introduced into the search engine for testing purposes. The testing system may then generate auxiliary data structures for storing indications of the spam that is to be introduced. A search engine has original data structures that may include a content index and a link data structure. The testing system stores the indications of the spam in the auxiliary data structures so that use of the search engine for non-testing purposes is not affected. When the search engine is used for testing purposes, the search engine generates search results based on a combination of the original data structures and the auxiliary data structures.

Claims

1. A method in a computing device having a memory and a processor for introducing spam into a search engine for testing purposes without affecting the search engine for non-testing purposes, the method comprising:

providing an original data structure of the search engine, the original data structure including an original index of an original web graph;

prior to receiving any query for testing purposes, receiving from a tester a specification of spam to be introduced into the data structure of the search engine, wherein the specification of spam received from the tester is used to generate search results in response to a query, and the specification of spam indicating an auxiliary web graph;

generating an auxiliary data structure that represents the specified spam, the auxiliary data structure including an auxiliary index of the auxiliary web graph and

after generating the auxiliary data structure,

receiving a query for testing purposes, and

generating search results for the received query based on an aggregation of information of the original data structure and the auxiliary data structure, wherein the search results are affected by the introduced spam without introducing spam into the original data structure and

wherein the providing and generating are performed by the processor executing instructions stored in the memory.

2. The method of claim 1 wherein the original data structure is a term index that maps terms to pages.

3. The method of claim 2 wherein the introduced spam is content spam.

4. The method of claim 1 wherein the original data structure includes a web graph and an importance score list for the pages.

5. The method of claim 4 wherein the introduced spam is link spam.

6. The method of claim 5 including recalculating page importance using an incremental importance calculation technique.

7. The method of claim 1 wherein the specification of spam to be introduced is provided by a script.

8. The method of claim 6 including providing a library of specifications of spam to be used by testers developing scripts.

9. The method of claim 1 including evaluating the generated search results to determine whether the search engine effectively counters the introduced spam.

10. A computer-readable storage medium encoded with instructions for controlling a computing device to introduce spam into a search engine for testing purposes without affecting the search engine for non-testing purposes, the encoded instructions executed by a processor to perform a method comprising:

providing an original data structure of the search engine, the original data structure including an original index of an original web graph;

prior to receiving any query for testing purposes, receiving from a tester a specification of spam to be introduced into the data structure of the search engine, wherein the specification of spam received from the tester is used to generate search results in response to a query, and the specification of spam indicating an auxiliary web graph;

generating an auxiliary data structure that represents the specified spam, the auxiliary data structure including an auxiliary index of the auxiliary web graph and

after generating the auxiliary data structure,

receiving a query for testing purposes; and

generating search results for the received query based on an aggregation of information of the original data structure and the auxiliary data structure,

wherein the search results are affected by the introduced spam without introducing spam into the original data structure.

11. The computer-readable storage medium of claim 10 wherein the original information is a mapping of terms to pages and the introduced spam is content spam.

12. The computer-readable storage medium of claim 10 wherein the original information is a web graph and importance scores for the pages and the introduced spam is link spam.