Search engine spam detection using external data

• US 7,349,901 B2
• Filed: 05/21/2004
• Issued: 03/25/2008
• Est. Priority Date: 05/21/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ramarathnam, Bama, Crumb, Janine Ruth, Watson, Eric B.
• Primary Examiner(s): Rones; Charles
• Assistant Examiner(s): ORTIZ DITREN, BELIX M
• Application Number:
  US10/850,623
• Publication Number:
  US 20060004748A1
• Time in Patent Office: 1,404 Days
• Field of Search: None
• US Class Current: 707/706
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9536 Search customisation based on social or collaborative filtering
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: Y10S 707/913 Multimedia
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Evaluating an electronic document in connection with a search. An external source provides data for use in evaluating an electronic document retrieved by a search engine. A first confidence level of the electronic document is determined based on the externally provided data. The first confidence level indicates a likelihood that the electronic document is undesirable. A second confidence level of the electronic document is determined based on attributes of the electronic document. The second confidence level indicates a likelihood that the electronic document is unsatisfactory with respect to a search. A rating for the electronic document generated as a function of the determined first confidence level and the determined second confidence level is used to categorize the electronic document as unsatisfactory in connection with a received search request.

Claims

1. A method of evaluating an electronic document in connection with a search, said method comprising:

parsing an electronic document to identify a first and a second attribute of the electronic document, said electronic document being retrievable by a search engine in response to a search request from a user and a determination by the search engine that the electronic document is relevant to the requested search, said first attribute corresponding to an electronic mail message attribute, said second attribute characterizing a pattern for manipulating a relevance determination of the electronic document with respect to the search request;

receiving information from a source external to the search engine, said received information including the electronic mail message attribute relating to an undesirable electronic mail message;

determining a first confidence level of the electronic document based on the first attribute of said electronic document, said first confidence level indicating a likelihood that the electronic document is associated with the undesirable electronic mail message;

determining a second confidence level of the electronic document based on the second attribute of said electronic document, said second confidence level indicating a likelihood that the electronic document is unsatisfactory with respect to the search request;

generating a rating for the electronic document as a function of the determined first confidence level and the determined second confidence level; and

designating the electronic document as unsatisfactory in connection with the search request based on the generated rating of the electronic document.

2. The method of claim 1, wherein said external source comprises an electronic mail spam detection system.

3. The method of claim 1, wherein said electronic document comprises one or more of the following:

a web page and a multimedia file.

4. The method of claim 1, further comprising specifying the first confidence level for one or more other electronic documents linked from the electronic document.

5. The method of claim 1, wherein parsing the electronic document is responsive to

receiving user-provided information with respect to the electronic document, said received user-provided information specifying the electronic document as undesirable in a search result.

6. The method of claim 1, further comprising:

providing a search result to the user in response to the received search request; and

performing one or more of the following;

demoting the electronic document designated as unsatisfactory in the provided search result, excluding the electronic document designated as unsatisfactory from the provided search result, and preserving a ranking of the electronic document in the provided search result when the ranking of the electronic document exceeds a predetermined rank in the provided search result.

7. The method of claim 1, wherein one or more computer-readable media have computer-executable instructions for performing the method recited in claim 1.

13. The method of claim 1 wherein the received information further includes a predetermined likelihood that the electronic mail message attribute is associated with the undesirable electronic mail message and wherein the first confidence is based on said predetermined likelihood.

14. The method of claim 13 wherein the electronic mail message attribute is a host name and the first attribute of the electronic document corresponds to said host name indicating that the electronic document is provided by said host name.

15. The method of claim 13 wherein the electronic mail message attribute is a network address and the first attribute of the electronic document corresponds to said network address indicating that the electronic document is located at said network address.

16. The method of claim 13 wherein the electronic mail message attribute is one or more terms and the first attribute of the electronic document corresponds to said one or more terms.

17. The method of claim 1 wherein the electronic attribute is identified by the external source in response to receiving user-provided information specifying as undesirable the electronic mail message related to the electronic mail message attribute.

8. A system for evaluating an electronic document in connection with a search, said system comprising:

a processor for receiving a search request from a user and for identifying an electronic document based on a determination that the electronic document is relevant to the received search request;

a memory area storing data provided by a source external to the processor, said data including an electronic mail message attribute relating to an undesirable electronic mail message;

said processor being configured to parse the electronic document to identify a first and a second attribute of the electronic document, said first attribute corresponding to the electronic mail message attribute, said second attribute characterizing a pattern for manipulating a relevance determination of the electronic document with respect to the search request;

said processor being further configured to determine a first confidence level of the electronic document based on the first attribute of said electronic document, said first confidence level indicating a likelihood that the electronic document is associated with an undesirable electronic mail message;

said processor being further configured to establish a second confidence level of the electronic document based on the second attribute of the electronic document, said second confidence level indicating a likelihood that the electronic document is unsatisfactory with respect to a search based on one or more attributes of the electronic document;

said processor being further configured to generate a rating for the electronic document as a function of the determined first confidence level and the established second confidence level and to categorize the electronic document as unsatisfactory in connection with the received search request based on the generated rating of the electronic document.

9. The system of claim 8, wherein said external source comprises an electronic mail spam detection system.

10. The system of claim 8, wherein the processor is configured to provide a search result to the user in response to the received search request and to perform one or more of the following:

demoting the electronic document categorized as unsatisfactory in the provided search result, excluding the electronic document categorized as unsatisfactory from the provided search result, and preserving a ranking of the electronic document in the provided search result when the ranking of the electronic document exceeds a predetermined rank in the provided search result.

18. The system of claim 8 wherein the data provided by the external source further includes a predetermined likelihood that the electronic mail message attribute is associated with an undesirable electronic mail message and wherein the first confidence level is based on said predetermined likelihood.

19. The system of claim 18 wherein the electronic mail message attribute is a host name and the first attribute of the electronic document corresponds to said host name indicating that the electronic document is provided by said host name.

20. The system of claim 18 wherein the electronic mail message attribute is a network address and the first attribute of the electronic document corresponds to said network address indicating that the electronic document is located at said network address.

21. The method of claim 18 wherein the electronic mail message attribute is one or more terms and the first attribute of the electronic document corresponds to said one or more terms.

11. One or more computer volatile or nonvolatile media having computer-executable components for evaluating an electronic document in connection with a search, said computer-readable media comprising:

a query component to receive a search request from a user and to identify an electronic document based on a determination that the electronic document is relevant to the received search request;

an external component to provide data, said data including an electronic mail message attribute relating to an for use in evaluating whether the electronic document is undesirable electronic mail message;

an internal component configured to;

parse the electronic document to identify a first and a second attribute of the electronic document, said first attribute corresponding to the electronic mail message attribute, said second attribute characterizing a pattern for manipulating a relevance determination of the electronic document with respect to the search request;

determine a first confidence level of the electronic document based on the first attribute of said electronic document, said first confidence level indicating a likelihood that the electronic document is associated with an undesirable electronic mail message; and

establish a second confidence level of the electronic document based on the second attribute of the electronic document, said second confidence level indicating a likelihood that the electronic document is unsatisfactory with respect to a search based on one or more attributes of the electronic document;

an analyzing component to generate a rating for the electronic document as a function of the determined first confidence level and the established second confidence level; and

wherein the query component is configured to classify the electronic document as unsatisfactory in connection with the received search request based on the generated rating of the electronic document.

12. The computer-readable media of claim 11, wherein the query component is configured to provide a search result to the user in response to the received search request and to perform one or more of the following:

demoting the electronic document classified as unsatisfactory in the provided search result, excluding the electronic document classified as unsatisfactory from the provided search result, and preserving a ranking of the electronic document in the provided search result when the ranking of the electronic document exceeds a predetermined rank in the provided search result.

22. The computer-readable media of claim 11, wherein the data provided by the external component further includes a predetermined likelihood that the electronic mail message attribute is associated with an undesirable electronic mail message and wherein the first confidence level is based on said predetermined likelihood.

23. The computer-readable media of claim 22 wherein the electronic mail message attribute is a host name and the first attribute of the electronic document corresponds to said host name indicating that the electronic document is provided by said host name.

24. The computer-readable media of claim 22 wherein the electronic mail message attribute is a network address and the first attribute of the electronic document corresponds to said network address indicating that the electronic document is located at said network address.

25. The computer-readable media of claim 22 wherein the electronic mail message attribute is one or more terms and the first attribute of the electronic document corresponds to said one or more terms.