Systems and methods for conducting internet content usage experiments
First Claim
1. A computer-implemented method for serving data, comprising:
- on a computing system, receiving requests for a content item from a plurality of computing devices;
on a computing system, identifying for each of the plurality of computing devices identifying data;
on a computing system, determining for each of the plurality of computing devices using the identifying data whether to transmit experimental data or non-experimental data;
on a computing system, transmitting experimental data to a first set of the plurality of computing devices;
on a computing system, transmitting non-experimental data to a second set of the plurality of computing devices; and
on a computing system, tracking usage of the experimental data by the first set of plurality of computing devices and tracking usage of the non-experimental data by the second set of plurality of computing devices to create content usage data.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for efficiently executing a plurality of live parallel Internet content usage experiments using a large pool of randomly selected participating users (separated into control and test groups) while minimally disturbing offered content is provided. In an illustrative implementation, a content provider communicates the parameters for a content usage experiment to a content server. A complimentary test subject verification script operates on the content server that determines which client computing devices are to be included in the experiment group. In operation, a participating client computing device requests content from the content provider'"'"'s server. The content provider'"'"'s server executes the test subject verification script to determine if the client computing device is to be considered as a test subject. The content usage of the experiment content and non-experiment content is tracked and compared to each other to determine if the experiment content impacted content usage.
-
Citations
20 Claims
-
1. A computer-implemented method for serving data, comprising:
-
on a computing system, receiving requests for a content item from a plurality of computing devices; on a computing system, identifying for each of the plurality of computing devices identifying data; on a computing system, determining for each of the plurality of computing devices using the identifying data whether to transmit experimental data or non-experimental data; on a computing system, transmitting experimental data to a first set of the plurality of computing devices; on a computing system, transmitting non-experimental data to a second set of the plurality of computing devices; and on a computing system, tracking usage of the experimental data by the first set of plurality of computing devices and tracking usage of the non-experimental data by the second set of plurality of computing devices to create content usage data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for serving data, comprising:
-
a processor adapted to execute computer-readable instructions; computing memory communicatively coupled to said processor, said memory having stored therein computer-readable instructions that, if executed by the processor, cause the processor perform operations comprising; receiving requests for a content item from a plurality of computing devices; identifying for each of the plurality of computing devices identifying data; determining for each of the plurality of computing devices using the identifying data whether to transmit experimental data or non-experimental data; transmitting experimental data to a first set of the plurality of computing devices; transmitting non-experimental data to a second set of the plurality of computing devices; and tracking usage of the experimental data by the first set of plurality of computing devices and tracking usage of the non-experimental data by the second set of plurality of computing devices to create content usage data. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A computer readable medium device comprising instructions that when executed by a computing processor cause the computing processor to perform operations comprising:
-
receiving requests for a content item from a plurality of computing devices;
identifying for each of the plurality of computing devices identifying data;determining for each of the plurality of computing devices using the identifying data whether to transmit a first version of the content item or second version of the content item;
transmitting the first version of the content item to a first set of the plurality of computing devices;
transmitting the second version of the content item to a second set of the plurality of computing devices; and
tracking usage of the first version of the content item by the first set of plurality of computing devices and tracking usage of the second version of the content item by the second set of plurality of computing devices to create content usage data. - View Dependent Claims (18, 19, 20)
-
Specification