×

Prediction of human ratings or rankings of information retrieval quality

  • US 9,116,945 B1
  • Filed: 06/04/2012
  • Issued: 08/25/2015
  • Est. Priority Date: 07/13/2005
  • Status: Active Grant
First Claim
Patent Images

1. A method performed by one or more server devices, the method comprising:

  • determining, by at least one of the one or more server devices, search results associated with search queries,the search queries and the search results forming respective search query/search result pairs;

    determining, by at least one of the one or more server devices and for each of the search query/search result pairs, signals relating to the search query/search result pair,the signals, for a particular search query/search result pair of the search query/search result pairs, including;

    a first signal defining a time duration for selection of the search result, of the particular search query/search result pair, from search results identified for the search query of the particular search query/search result pair,the time duration being based on a time between when the search results are presented for the search query, of the particular search query/search result pair, and when the search result, of the particular search query/search result pair, is selected, andat least one of;

    a second signal indicating selection of the search result, of the particular search query/search result pair, before selection of any other ones of the search results for the search query of the particular search query/search result pair, ora third signal indicating selection of another search result, of the search results identified for the search query of the particular search query/search result pair, before selection of the search result of the particular search query/search result pair,the first signal, the second signal, and the third signal being based on information, in one or more click logs, regarding user selections of particular search results,the particular search results being identified based on particular search queries;

    training, by at least one of the one or more server devices and based on the signals, a search engine to predict relevance ratings for search results;

    identifying, using the search engine, a particular search result that is relevant to a particular search query; and

    predicting, using the search engine, a relevance rating for the particular search result.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×