KNOWLEDGE AND INTERESTS BASED SEARCH TERM RANKING FOR SEARCH RESULTS VALIDATION
First Claim
1. A method for verifying the ranking of a plurality of search results that are produced by a search, comprising:
- specifying a particular search term as belonging to one or more of the plurality of categories;
for a plurality of users that initiate the search on the particular search term to then produce a plurality of search results that have a current ranking, determining a relevance score for each of the search results based on one or more particular users that select or click such each search result and the particular users'"'"' knowledge or interest in each category in which the particular search term belongs; and
ranking the search results based on the determined relevance scores of the search results so as to calculate a new ranking of the search results; and
specifying whether the current ranking of the search results is valid based on comparing the current ranking to the calculated new ranking of the search results.
3 Assignments
0 Petitions
Accused Products
Abstract
Disclosed are apparatus and methods for verifying the ranking of search results, produced by a search algorithm executed for a particular search term. In certain embodiments, a plurality of users'"'"' knowledge and/or interest in specific categories are ranked to be used to calculate new rankings of search results, e.g., web pages based on search terms. Users may also be ranked by education level and field. These user rankings are then used to determine a new ranking of search results that are generated for a particular search term. For instance, the users that select (e.g., or click on) a particular search result cause a relevance score to be compiled based on such users'"'"' rankings in the categories to which the search results or search term belongs. Relevance scores are compiled for each search result that is selected by a plurality of users executing a plurality of searches. The new ranking of the search results for a particular search term is determined based on the relevance scores of such search results. It can then be determined whether the current ranking, produced for a particular search term by the search algorithm, is valid by comparing this new ranking to the current ranking.
-
Citations
24 Claims
-
1. A method for verifying the ranking of a plurality of search results that are produced by a search, comprising:
-
specifying a particular search term as belonging to one or more of the plurality of categories; for a plurality of users that initiate the search on the particular search term to then produce a plurality of search results that have a current ranking, determining a relevance score for each of the search results based on one or more particular users that select or click such each search result and the particular users'"'"' knowledge or interest in each category in which the particular search term belongs; and ranking the search results based on the determined relevance scores of the search results so as to calculate a new ranking of the search results; and specifying whether the current ranking of the search results is valid based on comparing the current ranking to the calculated new ranking of the search results. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An apparatus comprising at least a processor and a memory, wherein the processor and/or memory are configured to perform the following operations:
-
specifying a particular search term as belonging to one or more of the plurality of categories; for a plurality of users that initiate a plurality of searches on the particular search term to then produce a plurality of search results that have a current ranking, determining a relevance score for each of the search results based on one or more particular users that select such each search result and the particular users'"'"' knowledge or interest in each category in which the particular search term belongs; and ranking the search results based on the determined relevance scores of the search results so as to calculate a new ranking of the search results; and specifying whether the current ranking of the search results is valid based on comparing the current ranking to the calculated new ranking of the search results. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. At least one computer readable storage medium having computer program instructions stored thereon that are arranged to perform the following operations:
-
specifying a particular search term as belonging to one or more of the plurality of categories; for a plurality of users that initiate a plurality of searches on the particular search term to then produce a plurality of search results that have a current ranking, determining a relevance score for each of the search results based on one or more particular users that select such each search result and the particular users'"'"' knowledge or interest in each category in which the particular search term belongs; and ranking the search results based on the determined relevance scores of the search results so as to calculate a new ranking of the search results; and specifying whether the current ranking of the search results is valid based on comparing the current ranking to the calculated new ranking of the search results. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24)
-
Specification