Relevance value for each category of a particular search result in the ranked list is estimated based on its rank and actual relevance values

• US 7,206,780 B2
• Filed: 06/27/2003
• Issued: 04/17/2007
• Est. Priority Date: 06/27/2003
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Sbc Knowledge Ventures, L.P.
• Inventors: Slackman, Richard O.
• Primary Examiner(s): CHANNAVAJJALA, SRIRAMA T
• Application Number:
  US10/607,811
• Publication Number:
  US 20040267717A1
• Time in Patent Office: 1,390 Days
• Field of Search: 707 1- 7, 707/10, 707100-1041, 707/200, 709215-220, 709222-223, 705/10, 705 26- 27, 705/1, 715512-513, 706 45- 50
• US Class Current: 1/1
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99937 Sorting
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A ranked list of search results is received from a search engine based on a search query. A relevance value of a particular search result in the ranked list is estimated based on its rank and actual relevance values and ranks of at least two others of the search results.

Claims

1. A method of weighting search results, the method comprising:

submitting a search query to a plurality of search engines;

receiving, from each of the plurality of search engines, an associated ranked list of search results based on the search query;

receiving a plurality of actual relevance values for a plurality of the search results based on the search query;

for at least one of the search results absent the actual relevance value, estimating its relevance value based on its rank, and the ranks and the actual relevance values of at least two others of the search results;

determining, for each of the plurality of search engines, an associated weighting value;

determining, for each of the ranked lists, an associated weighted relevance value for each of its search results based on the estimated relevance value or the actual relevance value of the search result and the weighting value associated with the search engine that provided the ranked list;

combining the ranked lists into a single list; and

sorting the search results in the single list based on the associated weighted relevance values;

wherein said determining the associated weighting value for a search engine comprises;

determining a plurality of categories associated with the search query;

determining an associated category search engine weighting value for each of the categories;

determining a first associated relevance value for each of the categories based on the search guery and one or more guery terms associated with the category;

determining a second associated relevance value for each of the categories by dividing its first associated relevance value by a sum of all first associated relevance values; and

determining the associated weighting value based on a sum, over the categories, of each product of the associated category search engine weighting value and the second associated relevance value, outputting the search results.

2. The method of claim 1 wherein the actual values comprise normalized search-engine-supplied relevance values.

3. The method of claim 1 wherein said estimating comprises:

fitting a curve, to represent relevance as a function of rank, to the actual relevance values and the ranks of the at least two others of the search results; and

evaluating the curve at the rank of the particular search result to estimate the relevance value.

4. The method of claim 1 wherein said estimating comprises:

determining an interpolation function, to represent relevance as a function of rank, for the actual relevance values and the ranks of the at least two others of the search results; and

evaluating the interpolation function at the rank of the particular search result to estimate the relevance value.

5. The method of claim 1 wherein the actual relevance values are search-engine-supplied.

6. The method of claim 1 wherein the actual relevance values are not search-engine-supplied.

7. An apparatus to weight search results, the apparatus comprising:

a computer programmed to perform acts of;

submitting a search query to a plurality of search engines;

receiving, from each of the plurality of search engines, an associated ranked list of search results based on the search query;

receiving a plurality of actual relevance values for a plurality of the search results based on the search query;

for at least one of the search results absent an actual relevance value, estimating its relevance value based on its rank, and the ranks and the actual relevance values of at least two others of the search results;

determining, for each of the plurality of search engines, an associated weighting value;

determining, for each of the ranked lists, an associated weighted relevance value for each of its search results based on the estimated relevance value or the actual relevance value of the search result and the weighting value associated with the search engine that provided the ranked list;

combining the ranked lists into a single list; and

sorting the search results in the single list based on the associated weighted relevance values;

wherein said determining the associated weighting value for a search engine comprises;

determining a plurality of categories associated with the search query;

determining an associated category search engine weighting value for each of the categories;

determining a first associated relevance value for each of the categories based on the search query and one or more query terms associated with the category;

determining a second associated relevance value for each of the categories by dividing its first associated relevance value by a sum of all first associated relevance values; and

determining the associated weighting value based on a sum, over the categories, of each product of the associated category search engine weighting value and the second associated relevance value, outputting the search results.

8. The apparatus of claim 7, wherein the actual values comprise normalized, search-engine-supplied relevance values.

9. The apparatus of claim 7 wherein said estimating comprises:

fitting a curve, to represent relevance as a function of rank, to the actual relevance values and the ranks of the at least two others of the search results; and

evaluating the curve at the rank of the particular search result to estimate the relevance value.

10. The apparatus of claim 7 wherein said estimating comprises:

determining an interpolation function, to represent relevance as a function of rank, for the actual relevance values and the ranks of the at least two others of the search results; and

evaluating the interpolation function at the rank of the particular search result to estimate the relevance value.

11. The apparatus of claim 7 wherein the actual relevance values are search-engine-supplied.

12. The apparatus of claim 7 wherein the actual relevance values are not search-engine-supplied.

13. An article to weight search results, the article comprising:

a computer-readable storage medium having computer-readable program code to cause a computer to perform acts of;

submitting a search query to a plurality of search engines;

receiving;

from each of the search engines, an associated ranked list of search results based on the search query;

receiving a plurality of actual relevance values for a plurality of the search results based on the search query;

for at least one of the plurality of search results absent an actual relevance value, estimating its relevance value based on its rank, and the ranks and the actual relevance values of at least two others of the search results;

determining, for each of the plurality of search engines, an associated weighting value;

determining, for each of the ranked lists, an associated weighted relevance value for each of its search results based on the estimated relevance value or the actual relevance value of the search result and the weighting value associated with the search engine that provided the ranked list;

combining the ranked lists into a single list; and

sorting the search results in the single list based on the associated weighted relevance values;

wherein said determining the associated weighting value for a search engine comprises;

determining a plurality of categories associated with the search guery;

determining an associated category search engine weighting value for each of the categories;

determining a first associated relevance value for each of the categories based on the search guery and one or more guery terms associated with the category;

determining a second associated relevance value for each of the categories by dividing its first associated relevance value by a sum of all first associated relevance values; and

determining the associated weighting value based on a sum, over the categories, of each product of the associated category search engine weighting value and the second associated relevance value, outputting the search results.

14. The article of claim 13 wherein the actual relevance values comprise normalized, search-engine-supplied relevance values.

15. The article of claim 13 wherein said estimating comprises:

fitting a curve, to represent relevance as a function of rank, to the actual relevance values and the ranks of the at least two others of the search results; and

evaluating the curve at the rank of the particular search result to estimate the relevance value.

16. The article of claim 13 wherein said estimating comprises:

determining an interpolation function, to represent relevance as a function of rank, for the actual relevance values and the ranks of the at least two others of the search results; and

evaluating the interpolation function at the rank of the particular search result to estimate the relevance value.

17. The article of claim 13 wherein the actual relevance values are search-engine-supplied.

18. The article of claim 13 wherein the actual relevance values are not search-engine-supplied.