Methods and systems for simulating a search to generate an optimized scoring function
First Claim
Patent Images
1. A computer-implemented method comprising:
- with a processor-based data importing module, importing data representing a plurality of search result sets resulting from a plurality of executed search queries, each search result set including a plurality of item listings satisfying a search query from the plurality of executed search queries and a listing slot identifier identifying a position within a search results page of a particular item listing that has resulted in a transaction being concluded, the listing slot identifier determined utilizing a production scoring function specified with one or more parameters that are weighted with a first set of one or more weighting factors;
with a processor-based parameter optimization module, processing the plurality of search result sets to derive a new scoring function, the new scoring function having a second set of one or more weighting factors for one or more parameters, the second set of one or more weighting factors selected to satisfy a set of constraints, the second set of one or more weighting factors being different than the first set of one or more weighting factors, wherein the second set of one or more weighting factors are selected to maximize an average rank shift metric for the plurality of search result sets, the average rank shift metric determined by comparing the listing slot identifier as derived by the production scoring function with a listing slot identifier as derived by a new scoring function for each item listing that has resulted in a transaction being concluded for each search result set of the plurality of search result sets; and
with a processor-based scoring function evaluation module, evaluating the performance of the new scoring function relative to a production scoring function.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for deriving a scoring function, for use in ordering a set of search results, are described. Consistent with some embodiments, a simulation platform includes an offline simulator module that receives search result sets for search queries that result in the conclusion of a transaction. The result set is then processed by the offline simulation platform to derive a set of weighting factors for use with one or more parameters in a parametric scoring function. The weighting factors are determined, for example, by specifying an equation setting one or more constraints and then solving the equation for the weighting factors.
-
Citations
13 Claims
-
1. A computer-implemented method comprising:
-
with a processor-based data importing module, importing data representing a plurality of search result sets resulting from a plurality of executed search queries, each search result set including a plurality of item listings satisfying a search query from the plurality of executed search queries and a listing slot identifier identifying a position within a search results page of a particular item listing that has resulted in a transaction being concluded, the listing slot identifier determined utilizing a production scoring function specified with one or more parameters that are weighted with a first set of one or more weighting factors; with a processor-based parameter optimization module, processing the plurality of search result sets to derive a new scoring function, the new scoring function having a second set of one or more weighting factors for one or more parameters, the second set of one or more weighting factors selected to satisfy a set of constraints, the second set of one or more weighting factors being different than the first set of one or more weighting factors, wherein the second set of one or more weighting factors are selected to maximize an average rank shift metric for the plurality of search result sets, the average rank shift metric determined by comparing the listing slot identifier as derived by the production scoring function with a listing slot identifier as derived by a new scoring function for each item listing that has resulted in a transaction being concluded for each search result set of the plurality of search result sets; and with a processor-based scoring function evaluation module, evaluating the performance of the new scoring function relative to a production scoring function. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A data processing system comprising:
-
at least one processor; and a machine-readable medium in communication with the at least one processor, the machine readable medium storing a simulation platform module that is executable by the at least one processor, the simulation platform module being executed by the at least one processor to cause operations to be performed, the operations comprising; importing data representing a plurality of search result sets resulting from a plurality of executed search queries, each search result set including a plurality of item listings satisfying a search query from the plurality of executed search queries and a listing slot identifier identifying a position within a search results page of a particular item listing that has resulted in a transaction being concluded, the listing slot identifier determined utilizing a production scoring function specified with one or more parameters that are weighted with a first set of one or more weighting factors; processing the plurality of search result sets to derive a new scoring function, the new scoring function having a second set of one or more weighting factors for one or more parameters, the second set of one or more weighting factors selected to satisfy a set of constraints, the second set of one or more weighting factors being different than the first set of one or more weighting factors, wherein the second set of one or more weighting factors are selected to maximize an average rank shift metric for the plurality of search result sets, the average rank shift metric determined by comparing the listing slot identifier as derived by the production scoring function with a listing slot identifier as derived by a new scoring function for each item listing that has resulted in a transaction being concluded for each search result set of the plurality of search result sets; and evaluating the performance of the new scoring function relative to a production scoring function. - View Dependent Claims (8, 9, 10, 11, 13)
-
-
12. An e-commerce platform, comprising:
-
at least one processor in communication with a machine-readable storage medium storing an on-line trading application module that is executable by the at least one processor, the on-line trading application module being executed by the at least one processor to utilize a production scoring function to order sets of item listings that satisfy search queries, the production scoring function specified with one or more parameters weighted with one or more weighting factors; and at least one processor in communication with a machine-readable storage medium storing a simulator module that is executable by the at least one processor, the simulator module to perform operations comprising; receiving data representing sets of ordered search results and for each set of search results a listing slot identifier identifying a listing associated with an item conversion, the search results ordered based on a listing performance score assigned to each item listing in the search results, the listing performance score derived utilizing a production scoring function having one or more parameters weighted with a first set of one or more weighting factors; and deriving new weighting factors for a new scoring function having a second set of one or more parameters weighted with the new weighting factors, the new scoring function and the second set of one or more weighting factors derived based on one or more specified constraints, the second set of one or more weighting factors being different than the first set of one or more weighting factors, wherein the second set of one or more weighting factors are selected to maximize an average rank shift metric for the set of search results, the average rank shift metric determined by comparing the listing slot identifier as derived by the production scoring function with a listing slot identifier as derived by a new scoring function for each item listing that has resulted in a transaction being concluded for each search result of the set of search results.
-
Specification