On-line experimentation
First Claim
Patent Images
1. A computer system for automatically managing delivery of content to users during interactive sessions between the system and users, the computer system comprising:
- a computer memory content store to hold a set of digital content elements;
a programmed experiment engine to hold or generate experimental design rules governing the composition of combinations of the content elements to form a variation; and
a programmed allocator module to automatically interact with the programmed experiment engine to retrieve and deliver different discrete, perceptibly-renderable digital variations to the users during the interactive sessions, according to the experimental design rules.
3 Assignments
0 Petitions
Accused Products
Abstract
An automated system for experimentation includes an experiment engine which can define an experiment relating to various treatments for a set of content elements. The experiment engine conducts the experiment over a data network. An observation module collects observation data relating to user behavior for each treatment. A scripting/scheduling engine coordinates the operation of the experiment engine and the observation module.
-
Citations
65 Claims
-
1. A computer system for automatically managing delivery of content to users during interactive sessions between the system and users, the computer system comprising:
-
a computer memory content store to hold a set of digital content elements; a programmed experiment engine to hold or generate experimental design rules governing the composition of combinations of the content elements to form a variation; and a programmed allocator module to automatically interact with the programmed experiment engine to retrieve and deliver different discrete, perceptibly-renderable digital variations to the users during the interactive sessions, according to the experimental design rules. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A method for automatically managing delivery of content to users during interactive sessions between the system and users, the computer system comprising:
-
providing a computer memory content store holding a set of digital content elements, the content store being in communication with a programmed experiment engine that holds or generates experimental design rules governing the composition of combinations of the content elements in the memory store to form a variation; providing a programmed allocator module, in communication with the programmed experiment engine, to automatically interact with the programmed experiment engine to retrieve and deliver different discrete, perceptibly-renderable variations to the users during the interactive sessions, according to the experimental design rules; automatically delivering the different discrete, perceptibly-renderable variations to users over a data network, based on the interactions of the allocator module with the programmed experiment engine. - View Dependent Claims (27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43)
-
-
44. A machine readable medium for managing delivery of digital content to users during interactive sessions between a computer system and users, the medium including a set of instructions for:
-
a programmed experiment engine to hold or generate experimental design rules governing the composition of combinations of digital content elements to form a variation, the content elements in a memory of a content store; a programmed allocator module to communicate with the programmed experiment engine, to automatically interact with the programmed experiment engine to retrieve and deliver different discrete, perceptibly-renderable digital variations to the users during interactive sessions with the users, according to the experimental design rules; automatically delivering the different discrete, perceptibly-renderable digital variations to users during the interactive sessions, based on the interactions of the allocator module with the programmed experiment engine. - View Dependent Claims (45, 46, 48, 49, 50, 59, 60, 61)
-
-
47. The machine readable medium of 46, wherein the system implements statistical sampling procedures to deliver the different variations to respective users.
- 51. The machine readable medium of 50, wherein the model engine creates one or more behavioral models which provide abstract descriptions of observed user behavior based on recorded actions in response to variations.
-
54. The machine readable medium of 53, wherein the allocation module delivers the recommended variation.
-
62. A computer system for automatically managing delivery of content to users during interactive sessions between the system and users, the computer system comprising:
-
a computer memory content store to hold a set of digital content elements; means for holding or generating experimental design rules governing the composition of combinations of the digital content elements to form a variation; means for automatically retrieving different discrete, perceptibly-renderable digital variations according to the experimental design rules; and means for automatically delivering the retrieved variations to users.
-
-
63. An automated system for delivery of content, comprising;
-
means for creating a model of behavior based on data collected from experiments conducted using digital content variations comprising discrete digital content elements that were automatically generated according to experimental design rules governing the composition and delivery of variations to users over a data network; means for using the model to generate predictions of how a user will react to a particular digital variation; and means for automatically allocating over a data network a discrete, perceptibly-renderable digital content variation to a user in accordance with a prediction.
-
-
64. An automated method for delivery of content, comprising;
-
creating a model of behavior based on data collected from experiments conducted using digital content variations comprising discrete content elements that were automatically generated according to experimental design rules governing the composition and delivery of variations to users over a data network; using the model to generate predictions of how a user will react to a particular digital variation; and automatically allocating over a data network a discrete, perceptibly-renderable digital content variation to a user in accordance with a prediction.
-
-
65. A machine readable medium comprising a set of instructions for:
-
creating a model of behavior based on data collected from experiments conducted using content variations comprising discrete digital content elements that were automatically generated according to experimental design rules governing the composition and delivery of variations to users over a data network; using the model to generate predictions of how a user will react to a particular digital variation; and automatically allocating over a data network a discrete, perceptibly-renderable digital content variation to a user in accordance with a prediction.
-
Specification