Multi-campaign content allocation based on experiment difference data
First Claim
1. A computer-implemented method, comprising:
- receiving, by a data processing apparatus, a content request, the request specifying one or more environment parameters corresponding to the environment for which the requested content is being requested;
identifying, by a data processing apparatus and based on the environment parameters, a content distribution account for which a control campaign is eligible to provide a content item in response to the request, the content distribution account also including an experiment campaign;
selecting, by a data processing apparatus and as an available campaign for the received content request, the experiment campaign from among the control campaign and the experiment campaign, the selection being based on a portion of content item requests for which the experiment campaign is required to be selected;
identifying, for the control campaign, a set of campaign parameters that control distribution of content in the control campaign;
identifying, for the experiment campaign, experiment difference data specifying differences between the set of campaign parameters and experiment parameters for the experiment campaign, the experiment parameters being parameters that control distribution of content in the experiment campaign, and the experiment difference data excluding one or more of the experiment parameters that match a campaign parameter in the set of campaign parameters;
determining the experiment parameters based on a combination of the set of campaign parameters and the experiment difference data; and
providing, by a data processing apparatus, content from the experiment campaign in response to the request, the content being provided according to the experiment parameters.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating experiment content distribution campaigns (“experiment campaign”) and allocating content in accordance with the experiment campaign. In one aspect, a control campaign or an experiment campaign are selected as an available campaign for providing content in response to receiving a content request. The selection can be a probability constrained selection where the probability with which the experiment campaign is selected is specified as a portion of a total number of requests received during an experiment period for which the experiment campaign is available to provide content. Content is provided in response to the request, where the provided content being content corresponding to the selected campaign.
-
Citations
21 Claims
-
1. A computer-implemented method, comprising:
-
receiving, by a data processing apparatus, a content request, the request specifying one or more environment parameters corresponding to the environment for which the requested content is being requested; identifying, by a data processing apparatus and based on the environment parameters, a content distribution account for which a control campaign is eligible to provide a content item in response to the request, the content distribution account also including an experiment campaign; selecting, by a data processing apparatus and as an available campaign for the received content request, the experiment campaign from among the control campaign and the experiment campaign, the selection being based on a portion of content item requests for which the experiment campaign is required to be selected; identifying, for the control campaign, a set of campaign parameters that control distribution of content in the control campaign; identifying, for the experiment campaign, experiment difference data specifying differences between the set of campaign parameters and experiment parameters for the experiment campaign, the experiment parameters being parameters that control distribution of content in the experiment campaign, and the experiment difference data excluding one or more of the experiment parameters that match a campaign parameter in the set of campaign parameters; determining the experiment parameters based on a combination of the set of campaign parameters and the experiment difference data; and providing, by a data processing apparatus, content from the experiment campaign in response to the request, the content being provided according to the experiment parameters. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system, comprising:
-
a data store storing a set of campaign parameters for a control campaign and experiment difference data for a corresponding experiment campaign, the experiment difference data being data specifying differences between experiment parameters for the experiment campaign and the set of campaign parameters for the control campaign, the experiment parameters being parameters that control distribution of content in the experiment campaign, and the experiment difference data excluding one of more of the experiment parameters that match a campaign parameter in the set of campaign parameters; and an experiment subsystem coupled to the data store, the experiment subsystem comprising at least one processor configured to; select, from among the control campaign and the experiment campaign and as an available campaign for a content request received during an experiment period, the experiment campaign; determine, in response to selecting the experiment campaign as the available campaign, the experiment parameters based on a combination of the set of campaign parameters and the experiment difference data; and provide content from the experiment campaign according to the experiment parameters. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:
-
receiving a content request, the request specifying one or more environment parameters corresponding to the environment for which the requested content is being requested; identifying, based on the environment parameters, a content distribution account for which a control campaign is eligible to provide a content item in response to the request, the content distribution account also including an experiment campaign; selecting, by a data processing apparatus and as an available campaign for the received content request, the experiment campaign from among the control campaign and the experiment campaign, the selection being based on a portion of content item requests for which the experiment campaign is required to be selected; identifying, for the control campaign, a set of campaign parameters that control distribution of content in the control campaign; identifying, for the experiment campaign, experiment difference data specifying differences between the set of campaign parameters and experiment parameters for the experiment campaign, the experiment parameters being parameters that control distribution of content in the experiment campaign, and the experiment difference data excluding one or more of the experiment parameters that match a campaign parameter in the set of campaign parameters; determining the experiment parameters based on a combination of the set of campaign parameters and the experiment difference data; and providing content from the experiment campaign in response to the request, the content being provided according to the experiment parameters.
-
Specification