CUSTOMIZED PREDICTORS FOR USER ACTIONS IN AN ONLINE SYSTEM
First Claim
1. A computer-implemented method comprising:
- receiving, by an online system, a plurality of requests for generating predictors, each request specifying a type of action performed by users of the online system and criteria for identifying a successful instance of the type of action;
for each request associated with a type of action, generating, by the online system, a predictor for the type of action, the generating comprising;
identifying a training data set comprising a plurality of successful instances and a plurality of failure instances of the type of action performed by users of the online system;
training one or more candidate predictors using the identified data set, wherein each candidate predictor comprises a machine learned model;
evaluating performance of each candidate predictor by executing each predictor on a test data set comprising a plurality of successful instances and a plurality of failure instances of the type of action performed by users of the online system; and
selecting a predictor for the type of action by comparing the performance of the one or more candidate predictors; and
returning a handle corresponding to the generated predictor to a requester of the selected predictor.
4 Assignments
0 Petitions
Accused Products
Abstract
Online systems generate predictors for predicting actions of users of the online system. The online system receives requests to generate predictor models for predicting whether a user is likely to take an action of a particular action type. The request specifies the type of action and criteria for identifying a successful instance of the action type and a failure instance of the action type. The online system collects data including successful and failure instances of the action type. The online system generates one or more predictors of different types using the generated data. The online system evaluates and compares the performance of the different predictors generated and selects a predictor based on the performance. The online system returns a handle to access the generated predictor to the requester of the predictor.
-
Citations
21 Claims
-
1. A computer-implemented method comprising:
-
receiving, by an online system, a plurality of requests for generating predictors, each request specifying a type of action performed by users of the online system and criteria for identifying a successful instance of the type of action; for each request associated with a type of action, generating, by the online system, a predictor for the type of action, the generating comprising; identifying a training data set comprising a plurality of successful instances and a plurality of failure instances of the type of action performed by users of the online system; training one or more candidate predictors using the identified data set, wherein each candidate predictor comprises a machine learned model; evaluating performance of each candidate predictor by executing each predictor on a test data set comprising a plurality of successful instances and a plurality of failure instances of the type of action performed by users of the online system; and selecting a predictor for the type of action by comparing the performance of the one or more candidate predictors; and returning a handle corresponding to the generated predictor to a requester of the selected predictor. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented method comprising:
-
storing, by an online system, a plurality of predictors, each predictor for predicting whether a user of the online system performs a type of action, each predictor associated with criteria for determining a successful instance of the type of action; selecting an existing predictor corresponding to a type of action; identifying a data set comprising successful instances and failure instances of the type of action performed by users of the online system; training one or more candidate predictors using the identified data set, wherein each candidate predictor comprises a machine learned model; evaluating performance of each candidate predictor by executing each predictor on a test data set comprising a plurality of successful instances and a plurality of failure instances of the type of action performed by users of the online system; selecting a candidate predictor from the one or more candidate predictors by comparing the performance of the one or more candidate predictors; comparing performance of the selected candidate predictor with performance of the existing predictors; and replacing the existing predictor by the selected candidate predictor responsive to performance of the selected candidate predictor exceeding the performance of the existing predictor. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. A computer program product having a non-transitory computer-readable storage medium storing computer-executable code, the code comprising:
a predictor factory module of an online system configured to; store a plurality of predictors, each predictor for predicting whether a user of the online system performs a type of action, each predictor associated with criteria for determining a successful instance of the type of action; select an existing predictor corresponding to a type of action; identify a data set comprising successful instances and failure instances of the type of action performed by users of the online system; train one or more candidate predictors using the identified data set, wherein each candidate predictor comprises a machine learned model; evaluate performance of each candidate predictor by executing each predictor on a test data set comprising a plurality of successful instances and a plurality of failure instances of the type of action performed by users of the online system; select a candidate predictor from the one or more candidate predictors by comparing the performance of the one or more candidate predictors; compare performance of the selected candidate predictor with performance of the existing predictors; and replace the existing predictor by the selected candidate predictor responsive to performance of the selected candidate predictor exceeding the performance of the existing predictor. - View Dependent Claims (20, 21)
Specification