LEARNING A DOCUMENT RANKING FUNCTION USING FIDELITY-BASED ERROR MEASUREMENTS
First Claim
1. A method in a computer system for determining loss between a target probability and a model probability for a pair of documents, the model probability being generated by a ranking function that ranks documents, the method comprising:
- applying the ranking function to the pair of documents to provide rankings of the documents;
calculating a model probability from the rankings of the documents; and
calculating a loss between the calculated model probability and the target probability, the loss varying between 0 and 1 and the loss being 0 when the calculated model probability is the same as the target probability.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for generating a ranking function using a fidelity-based loss between a target probability and a model probability for a pair of documents is provided. A fidelity ranking system generates a fidelity ranking function that ranks the relevance of documents to queries. The fidelity ranking system operates to minimize a fidelity loss between pairs of documents of training data. The fidelity loss may be derived from “fidelity” as used in the field of quantum physics. The fidelity ranking system may use a learning technique in conjunction with a fidelity loss when generating the ranking function. After the fidelity ranking system generates the fidelity ranking function, it uses the fidelity ranking function to rank the relevance of documents to queries.
36 Citations
20 Claims
-
1. A method in a computer system for determining loss between a target probability and a model probability for a pair of documents, the model probability being generated by a ranking function that ranks documents, the method comprising:
-
applying the ranking function to the pair of documents to provide rankings of the documents; calculating a model probability from the rankings of the documents; and calculating a loss between the calculated model probability and the target probability, the loss varying between 0 and 1 and the loss being 0 when the calculated model probability is the same as the target probability. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer system for generating a ranking function for documents, the ranking function indicating a ranking of documents based on relevance of the documents to a query, the system comprising:
-
a component that provides features of documents and indications of target probabilities of relative rankings of the relevance of pairs of documents to queries; a component that calculates a fidelity loss between a model probability and a target probability for a pair of documents, the probabilities indicating a probability of relative ranking of the documents of the pair; and a component that generates the ranking function by operating to minimize the fidelity loss between the model probabilities derived from the ranking of documents and the target probabilities. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A computer system for ranking relevance of documents to queries, the system comprising:
-
a component that receives a query; a component that identifies documents that match the query; and a component that applies a fidelity ranking function to the documents that match the query to rank relevance of the documents to the queries, the fidelity ranking function being generated to minimize a fidelity loss between model probabilities generated by the fidelity ranking function and target probabilities. - View Dependent Claims (19, 20)
-
Specification