Multi-campaign content allocation
First Claim
1. A method, comprising:
- receiving, by one or more data processing apparatus, a request to create an experiment campaign based on an existing campaign;
receiving, by the one or more data processing apparatus through a communications network, data specifying an experiment parameter in the experiment campaign that differs from existing parameters of the existing campaign;
storing, by the one or more data processing apparatus and in computer memory, the experiment campaign, comprising storing a set of experiment difference data that i) excludes at least one of the existing parameters that is also a parameter of the experiment campaign, and ii) specifies a difference between the experiment parameter and the existing parameters;
receiving, by the one or more data processing apparatus through the communications network, a request to serve content to be presented on an electronic document requested by a user device executing an application at the user device, wherein the request includes a network address identifying the user device;
generating, after receiving the request for content by the one or more data processing apparatus, a set of experiment parameters for the experiment campaign using the at least one of the existing parameters from the existing campaign and the stored experiment difference data; and
in response to the request, transmitting, to the user device through the communications network, content that is integrated into a presentation of the electronic document by the user device, wherein the content is transmitted to the user device based on the set of experiment parameters.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating experiment content distribution campaigns (“experiment campaign”) and allocating content in accordance with the experiment campaign. In one aspect, a control campaign or an experiment campaign are selected as an available campaign for providing content in response to receiving a content request. The selection can be a probability constrained selection where the probability with which the experiment campaign is selected is specified as a portion of a total number of requests received during an experiment period for which the experiment campaign is available to provide content. Content is provided in response to the request, where the provided content being content corresponding to the selected campaign.
-
Citations
20 Claims
-
1. A method, comprising:
-
receiving, by one or more data processing apparatus, a request to create an experiment campaign based on an existing campaign; receiving, by the one or more data processing apparatus through a communications network, data specifying an experiment parameter in the experiment campaign that differs from existing parameters of the existing campaign; storing, by the one or more data processing apparatus and in computer memory, the experiment campaign, comprising storing a set of experiment difference data that i) excludes at least one of the existing parameters that is also a parameter of the experiment campaign, and ii) specifies a difference between the experiment parameter and the existing parameters; receiving, by the one or more data processing apparatus through the communications network, a request to serve content to be presented on an electronic document requested by a user device executing an application at the user device, wherein the request includes a network address identifying the user device; generating, after receiving the request for content by the one or more data processing apparatus, a set of experiment parameters for the experiment campaign using the at least one of the existing parameters from the existing campaign and the stored experiment difference data; and in response to the request, transmitting, to the user device through the communications network, content that is integrated into a presentation of the electronic document by the user device, wherein the content is transmitted to the user device based on the set of experiment parameters. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
a data store storing existing parameters for an existing campaign; and one or more data processing apparatus that interact with the data store and execute instructions that cause the one or more data processing apparatus to perform operations comprising; receiving, through a communications network, a request to create an experiment campaign based on the existing campaign; receiving data specifying an experiment parameter in the experiment campaign that differs from existing parameters of the existing campaign; storing, in the data store, the experiment campaign, comprising storing a set of experiment difference data that i) excludes at least one of the existing parameters that is also a parameter of the experiment campaign, and ii) specifies a difference between the experiment parameter and the existing parameters; receiving, through the communications network, a request to serve content to be presented on an electronic document requested by a user device executing an application at the user device, wherein the request includes a network address identifying the user device; generating, after receiving the request for content, a set of experiment parameters for the experiment campaign using the at least one of the existing parameters from the existing campaign and the stored experiment difference data; and in response to the request, transmitting, to the user device through the communications network, content that is integrated into a presentation of the electronic document by the user device, wherein the content is transmitted to the user device based on the set of experiment parameters. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable medium storing instructions that upon execution of the instructions by one or more data processing apparatus cause the one or more data processing apparatus to perform operations comprising:
-
receiving, through a communications network, a request to create an experiment campaign based on an existing campaign; receiving data specifying an experiment parameter in the experiment campaign that differs from existing parameters of the existing campaign; storing, in a data store, the experiment campaign, comprising storing a set of experiment difference data that i) excludes at least one of the existing parameters that is also a parameter of the experiment campaign, and ii) specifies a difference between the experiment parameter and the existing parameters; receiving, through the communications network, a request to serve content to be presented on an electronic document requested by a user device executing an application at the user device, wherein the request includes a network address identifying the user device; generating, after receiving the request for content, a set of experiment parameters for the experiment campaign using the at least one of the existing parameters from the existing campaign and the stored experiment difference data; and in response to the request, transmitting, to the user device through the communications network, content that is integrated into a presentation of the electronic document by the user device, wherein the content is transmitted to the user device based on the set of experiment parameters. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification