System and method for ranking a posting
First Claim
1. A method for training a ranking application to rank a plurality of help postings for display in a forum, comprising:
- ranking the plurality of help postings to create an initial ranking, wherein the plurality of help postings in the initial ranking are ranked by the ranking application using initial parameter values;
displaying the plurality of help postings in the forum according to the initial ranking;
storing user interactions with the plurality of help postings to obtain stored interactions;
performing simulations using the stored interactions to generate revised parameter values for the ranking application, wherein performing the simulations comprises;
calculating a plurality of relevance values from the stored interactions;
creating a test posting;
assigning, to the test posting, an initial score and a relevance value randomly selected from the plurality of relevance values to generate a test ranking;
determining a probability that a user will view the plurality of help postings and the test posting in the test ranking;
generating, based on the probability, simulated rankings of the plurality of help postings and the test posting; and
analyzing the simulated rankings based on the relevance value to obtain revised parameter values; and
ranking, by the ranking application using the revised parameter values, the plurality of help postings to generate a revised ranking; and
displaying the plurality of help postings in the forum according to the revised ranking.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for training a ranking application. The method includes ranking the help postings to create an initial ranking using initial parameter values, and storing user interactions with the help postings to obtain stored interactions. Simulations are performed using the stored interactions to generate revised parameter values for the ranking application. Performing the simulations includes calculating relevance values from the stored interactions, creating a test posting, assigning, to the test posting, an initial score and a relevance value randomly selected from the relevance values to generate a test ranking, and simulating user interactions with the test ranking to generate simulated rankings. The simulated rankings are analyzed to obtain revised parameter values. The method further includes ranking, using the revised parameter values, the help postings to generate a revised ranking, and displaying the help postings in the forum according to the revised ranking.
-
Citations
17 Claims
-
1. A method for training a ranking application to rank a plurality of help postings for display in a forum, comprising:
-
ranking the plurality of help postings to create an initial ranking, wherein the plurality of help postings in the initial ranking are ranked by the ranking application using initial parameter values; displaying the plurality of help postings in the forum according to the initial ranking; storing user interactions with the plurality of help postings to obtain stored interactions; performing simulations using the stored interactions to generate revised parameter values for the ranking application, wherein performing the simulations comprises; calculating a plurality of relevance values from the stored interactions; creating a test posting; assigning, to the test posting, an initial score and a relevance value randomly selected from the plurality of relevance values to generate a test ranking; determining a probability that a user will view the plurality of help postings and the test posting in the test ranking; generating, based on the probability, simulated rankings of the plurality of help postings and the test posting; and analyzing the simulated rankings based on the relevance value to obtain revised parameter values; and ranking, by the ranking application using the revised parameter values, the plurality of help postings to generate a revised ranking; and displaying the plurality of help postings in the forum according to the revised ranking. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for training a ranking application to rank a plurality of help postings for display in a forum, the system comprising:
-
a hardware processor; a ranking application, executing on the hardware processor and configured to; rank the plurality of help postings to create an initial ranking, wherein the plurality of help postings in the initial ranking is ranked by the ranking application using initial parameter values; display the plurality of help postings in the forum according to the initial ranking; store user interactions with the plurality of help postings to obtain stored interactions; rank, using revised parameter values, the plurality of help postings to generate a revised ranking; and display the plurality of help postings in the forum according to the revised ranking; and a simulation application, executing on the hardware processor and configured to; perform simulations using the stored interactions to generate revised parameter values for the ranking application, wherein performing the simulations comprises; calculating a plurality of relevance values from the stored interactions; creating a test posting; assigning, to the test posting, an initial score and a relevance value randomly selected from the plurality of relevance values to generate a test ranking; determining a probability that a user will view the plurality of help postings and the test posting in the test ranking; generate, based on the probability, simulated rankings of the plurality of help postings and the test posting; analyzing the simulated rankings based on the relevance value to obtain the revised parameter values; and provide the revised parameter values to the ranking application. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable medium comprising computer readable program code embodied therein for causing a computer system to:
-
rank a plurality of help postings to create an initial ranking, wherein the plurality of help postings in the initial ranking is ranked using initial parameter values; display the plurality of help postings in the forum according to the initial ranking; store user interactions with the plurality of help postings to obtain stored interactions; perform simulations using the stored interactions to generate revised parameter values, wherein performing the simulations comprises; calculating a plurality of relevance values from the stored interactions; creating a test posting; assigning, to the test posting, an initial score and a relevance value randomly selected from the plurality of relevance values to generate a test ranking; determining a probability that a user will view the plurality of help postings and the test posting in the test ranking; generating, based on the probability, simulated rankings of the plurality of help postings and the test posting; and analyzing the simulated rankings based on the relevance value to obtain revised parameter values; and rank, using the revised parameter values, the plurality of help postings to generate a revised ranking; and displaying the plurality of help postings in the forum according to the revised ranking. - View Dependent Claims (16, 17)
-
Specification