EVALUATING THE RANKING QUALITY OF A RANKED LIST
First Claim
1. One or more processor-accessible tangible media comprising processor-executable instructions for evaluating a ranking quality of a ranked list, wherein the processor-executable instructions, when executed, direct a system to perform acts comprising:
- accessing log data that reflects user interactions with a ranked list having multiple entries, the user interactions including at least indications of which of the multiple entries are selected entries and information from which dwell times for the selected entries may be derived;
ascertaining which entries of the multiple entries of the ranked list are viewed entries;
ascertaining which entries of the multiple entries of the ranked list are skipped entries, including fully skipped entries and partially skipped entries, based on the selected entries and the dwell times; and
determining a ranking quality metric for the ranked list responsive to the skipped entries and the viewed entries.
2 Assignments
0 Petitions
Accused Products
Abstract
The ranking quality of a ranked list may be evaluated. In an example embodiment, a method is implemented by a system to access log data, ascertain which entries of a ranked list are skipped, and determine a ranking quality metric from the skipped entries. More specifically, log data that reflects user interactions with a ranked list having multiple entries is accessed. The user interactions include at least indications of which of the multiple entries are selected entries. It is ascertained which entries of the multiple entries of the ranked list are skipped entries based on the selected entries. The ranking quality metric for the ranked list is determined responsive to the skipped entries.
-
Citations
20 Claims
-
1. One or more processor-accessible tangible media comprising processor-executable instructions for evaluating a ranking quality of a ranked list, wherein the processor-executable instructions, when executed, direct a system to perform acts comprising:
-
accessing log data that reflects user interactions with a ranked list having multiple entries, the user interactions including at least indications of which of the multiple entries are selected entries and information from which dwell times for the selected entries may be derived; ascertaining which entries of the multiple entries of the ranked list are viewed entries; ascertaining which entries of the multiple entries of the ranked list are skipped entries, including fully skipped entries and partially skipped entries, based on the selected entries and the dwell times; and determining a ranking quality metric for the ranked list responsive to the skipped entries and the viewed entries. - View Dependent Claims (2, 3)
-
-
4. A method implemented by a system for evaluating a ranking quality of a ranked list, the method comprising acts of:
-
accessing log data that reflects user interactions with a ranked list having multiple entries, the user interactions including at least indications of which of the multiple entries are selected entries; ascertaining which entries of the multiple entries of the ranked list are skipped entries based on the selected entries; and determining a ranking quality metric for the ranked list responsive to the skipped entries. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A system that is capable of evaluating a ranking quality of a ranked list, the system comprising:
-
a ranking quality application to access log data that reflects user interactions with a ranked list having multiple entries, the user interactions including at least indications of which of the multiple entries are selected entries;
the ranking quality application including a skipped entries ascertainer and a ranking quality metric determiner;the skipped entries ascertainer to ascertain which entries of the multiple entries of the ranked list are skipped entries based on the selected entries; and the ranking quality metric determiner to determine a ranking quality metric for the ranked list responsive to the skipped entries. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification