Monitoring landing page experiments
First Claim
1. A computer-implemented method comprising:
- for each of a plurality of client devices;
providing an instrumented landing page to a client device in response to a selection of an advertisement, the instrumented landing pare comprising one or more sections, each section having a corresponding plurality of alternative versions, and wherein each particular combination of the one or more sections having a respective alternative version forms a landing page variant, andreceiving a notification of a particular landing pare variant of a plurality of landing page variants chosen by the client device; and
computing, by one or more processors, respective conversion rates for each of the plurality of corresponding landing page variants selected by the respective plurality of client devices, the computing based on the number of times a conversion page is reached from the corresponding landing page variant, and based on the number of times the corresponding landing page variant is reached in response to selections of one or more displayed advertisements, wherein;
a combination of alternative versions corresponds to each landing page variant, the combination associating one alternative version with each of the sections; and
each landing page variant comprises the landing page with each of the one or more sections having the version associated with the section by the combination; and
computing a confidence interval for each conversion rate.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and apparatus, including computer program products for monitoring an experiment relating to the conversion rates of landing page variants to test landing page designs. One method includes computing respective conversion rates for each of a plurality of corresponding landing page variants, based on the number of times a conversion page is reached from the corresponding landing page variant, and based on the number of times the corresponding landing page variant is reached from one or more advertisements; and computing a confidence interval for each conversion rate. A user monitoring the experiment can be notified if winning or losing variants emerge. A time to completion of the experiment can be estimated. Presentation to browsing users of winning variants can be favored, and losing variants can be disfavored, during the experiment as they emerge.
105 Citations
26 Claims
-
1. A computer-implemented method comprising:
- for each of a plurality of client devices;
providing an instrumented landing page to a client device in response to a selection of an advertisement, the instrumented landing pare comprising one or more sections, each section having a corresponding plurality of alternative versions, and wherein each particular combination of the one or more sections having a respective alternative version forms a landing page variant, and receiving a notification of a particular landing pare variant of a plurality of landing page variants chosen by the client device; and computing, by one or more processors, respective conversion rates for each of the plurality of corresponding landing page variants selected by the respective plurality of client devices, the computing based on the number of times a conversion page is reached from the corresponding landing page variant, and based on the number of times the corresponding landing page variant is reached in response to selections of one or more displayed advertisements, wherein; a combination of alternative versions corresponds to each landing page variant, the combination associating one alternative version with each of the sections; and each landing page variant comprises the landing page with each of the one or more sections having the version associated with the section by the combination; and computing a confidence interval for each conversion rate. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
- for each of a plurality of client devices;
-
10. A system comprising:
- one or more computing devices configured to perform operations including;
for each of a plurality of client devices;providing an instrumented landing page to a client device in response to a selection of an advertisement, the instrumented landing page comprising one or more sections, each section having a corresponding plurality of alternative versions, and wherein each particular combination of the one or more sections having a respective alternative version forms a landing page variant, and receiving a notification of a particular landing page variant of a plurality of landing page variants chosen by the client device; and computing respective conversion rates for each of the plurality of corresponding landing page variants selected by the respective plurality of client devices, the computing based on the number of times a conversion page is reached from the corresponding landing page variant, and based on the number of times the corresponding landing page variant is reached in response to selections of one or more displayed advertisements, wherein; a combination of alternative versions corresponds to each landing page variant, the combination associating one alternative version with each of the sections; and each landing page variant comprises the landing page with each of the one or more sections having the version associated with the section by the combination; and computing a confidence interval for each conversion rate. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
- one or more computing devices configured to perform operations including;
-
19. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:
- for each of a plurality of client devices;
providing an instrumented landing pare to a client device in response to a selection of an advertisement, the instrumented landing page comprising one or more sections, each section having a corresponding plurality of alternative versions, and wherein each particular combination of the one or more sections having a respective alternative version forms a landing pare variant, and receiving a notification of a particular landing page variant of a plurality of landing page variants chosen by the client device; and computing respective conversion rates for each of the plurality of corresponding landing page variants selected by the respective plurality of client devices, the computing based on the number of times a conversion page is reached from the corresponding landing page variant, and based on the number of times the corresponding landing page variant is reached in response to selections of one or more displayed advertisements, wherein; a landing page comprises one or more sections, there being for each of the sections a corresponding plurality of alternative versions; a combination of alternative versions corresponds to each landing page variant, the combination associating one alternative version with each of the sections; and each landing page variant comprises the landing page with each of the one or more sections having the version associated with the section by the combination; and computing a confidence interval for each conversion rate. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26)
- for each of a plurality of client devices;
Specification