Methods and apparatus for preparing high-dimensional combinatorial experiments
First Claim
1. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
- providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including one or more experimental constraints representing limitations on operations that can be performed with the set of resources;
generating a plurality of configurations based on the parameters and the experimental constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
selecting a configuration from the plurality of configurations; and
defining a set of experiments based on the selected configuration.
4 Assignments
0 Petitions
Accused Products
Abstract
Computer-implemented methods, systems and apparatus, including computer program apparatus, provide techniques for designing a set of experiments to be performed with a set of resources. A plurality of experimental configurations are generated based on a set of parameters describing factors to be varied in the experiments and a set of constraints representing limitations on operations that can be performed with the set of resources. A set of experiments is defined based on a selected configuration. The constraints can be represented as patterns defining an application of a parameter to a set of one or more points of an experimental lattice.
-
Citations
95 Claims
-
1. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
-
providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including one or more experimental constraints representing limitations on operations that can be performed with the set of resources;
generating a plurality of configurations based on the parameters and the experimental constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
selecting a configuration from the plurality of configurations; and
defining a set of experiments based on the selected configuration. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 36, 37, 38, 39, 40, 41)
-
-
35. The method of claimed 1, wherein:
each configuration in the plurality of configurations represents a set of experiments that can be preformed with the set of resources.
-
42. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
-
providing a set of parameters, one or more experiment lattices, and one or more patterns, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, each experiment lattice including one or more lattice points and representing an arrangement in which experiments in a set of experiments will be performed, and each pattern representing the application of a parameter to one or more lattice points of an experiment lattice under a set of experimental constraints representing limitations on operations that can be performed with the set of resources, the experimental constraints for a given pattern being represented by a set of attributes;
generating a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of a parameter to be applied at one or more lattice points of an experiment lattice;
combining the pattern instances to generate a set of experimental points, each point having a set of values for the parameters, the parameter values for a point in the configuration being based on the parameter values specified by the combined pattern instances for a corresponding lattice location; and
defining a set of experiments based on the experimental points.
-
-
43. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
-
providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including a set of target points representing a desired set of experiments, one or more experiment lattices and one or more patterns, each of the set of target points having a set of parameters values defining a position in the parameter space, each experiment lattice including one or more lattice points and representing an arrangement in which experiments in a set of experiments will be performed, the patterns representing the application of parameters to one or more lattice points of an experiment lattice under a set of experimental constraints representing limitations on operations that can be performed with the set of resources, the experimental constraints for a given pattern being represented by a set of attributes;
generating a plurality of configurations based on the parameters and the constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters, each configuration being generated by;
a) generating a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of a parameter to be applied at one or more lattice points of an experiment lattice; and
b) combining the pattern instances to generate a configuration, such that the parameter values for a point in the configuration are based on the parameter values specified by the combined pattern instances for a corresponding lattice location, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
comparing the experimental points of the configurations to the set of target points;
selecting a configuration from the plurality of configurations based on the comparing; and
defining a set of experiments based on the selected configuration.
-
-
44. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
-
providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including a set of target points representing a desired set of experiments, one or more experiment lattices and a plurality of patterns, each of the set of target points having a set if parameters values defining a position in the parameter space, each experiment lattice including one or more lattice points and representing an arrangement in which experiments in a set of experiments will be performed, the patterns representing alternate applications of parameters to lattice points of an experiment lattice under sets of experimental constraints representing limitations on operations that can be performed with the set of resources, the experimental constraints for a given pattern being represented by a set of attributes, the set of patterns including a first pattern defined by a first set of attributes and a second pattern defined by a second set of attributes, the second set of attributes differing from the first set of attributes in at least one attribute;
generating a plurality of configurations based on the parameters and the constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters, each configuration being generated by;
a) generating a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of a parameter to be applied at one or more lattice points of an experiment lattice; and
b) combining the pattern instances to generate a configuration, such that the parameter values for a point in the configuration are based on the parameter values specified by the combined pattern instances for a corresponding lattice location, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
comparing the experimental points of the configurations to the set of target points;
selecting a configuration from the plurality of configurations based on the comparing; and
defining a set of experiments based on the selected configuration;
wherein the plurality of configurations includes one or more first configurations generated by combining instances of the first pattern and one or more second configurations generated by combining instances of the second pattern, and selecting a configuration includes identifying an optimum pattern from the first and second patterns.
-
-
45. A computer program product on a computer-readable medium for designing a set of experiments to be performed with a set of resources, the program comprising instructions operable to cause a programmable processor to:
-
provide a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including one or more experimental constraints representing limitations on operations that can be performed with the set of resources;
generate a plurality of configurations based on the parameters and the constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
select a configuration from the plurality of configurations; and
define a set of experiments based on the selected configuration. - View Dependent Claims (46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85)
-
-
86. A computer program product on a computer-readable medium for designing a set of experiments to be performed with a set of resources, the program comprising instructions operable to cause a programmable processor to
provide a set of parameters, one or more experiment lattices, and one or more patterns, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, each experiment lattice including one or more lattice points and representing an arrangement in which experiments in a set of experiments will be performed, and each pattern representing the application of a parameter to one or more lattice points of an experiment lattice under a set of experimental constraints representing limitations on operations that can be performed with the set of resources, the experimental constraints for a given pattern being represented by a set of attributes; -
generate a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of a parameter to be applied at one or more lattice points of an experiment lattice; and
combine the pattern instances to generate a set of experimental points, each point having a set of values for the parameters, the parameter values for a point in the configuration being based on the parameter values specified by the combined pattern instances for a corresponding lattice location; and
define a set of experiments based on the experimental points.
-
-
87. A system for performing a set of experiments, the system comprising:
-
one or more devices configured to apply a plurality of parameters to a plurality of locations on a substrate, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the application of parameters to the substrate locations being defined by one or more patterns, each pattern representing the application of a parameter to one or more substrate locations under a set of experimental constraints representing limitations on operations that can be performed with the devices, the experimental constraints for a given pattern being represented by a set of attributes; and
a programmable processor configured to;
a) generate a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of the parameter to be applied at one or more locations on the substrate;
b) combine the pattern instances to generate a configuration, each configuration including a plurality of experimental points, each point having a set of values for the parameters, the parameter values for a point in the configuration being based on the quantities specified by the combined pattern instances for a corresponding substrate location;
c) define a design for a set of experiments based on the configuration, the design including for each experiment in the set of experiments a set of parameter values quantifying each of a plurality of the parameters to be applied in the experiment; and
d) instruct the devices to carry out the set of experiments according to the design. - View Dependent Claims (88)
-
-
89. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
-
providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including a set of sampling requirements for a set of experiments, one or more experiment lattices and one or more patterns, each experiment lattice including one or more lattice points and representing an arrangement in which experiments in a set of experiments will be performed, the patterns representing the application of parameters to one or more lattice points of an experiment lattice under a set of experimental constraints representing limitations on operations that can be performed with the set of resources, the experimental constraints for a given pattern being represented by a set of attributes;
generating a plurality of configurations based on the parameters and the constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters, each configuration being generated by;
a) generating a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of a parameter to be applied at one or more lattice points of an experiment lattice; and
b) combining the pattern instances to generate a configuration, such that the parameter values for a point in the configuration are based on the parameter values specified by the combined pattern instances for a corresponding lattice location, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
comparing the experimental points of the configurations to the set of sampling requirements;
selecting a configuration from the plurality of configurations based on the comparing; and
defining a set of experiments based on the selected configuration. - View Dependent Claims (90)
-
-
91. A computer-implemented method of designing a set of experiments to be performed with a set of resources, the method comprising:
-
providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied in a set of experiments and representing axes defining a parameter space, the set of constraints including a set of sampling requirements for a set of experiments, one or more experiment lattices and a plurality of patterns, each experiment lattice including one or more lattice points and representing an arrangement in which experiments in a set of experiments will be performed, the patterns representing alternate applications of parameters to lattice points of an experiment lattice under sets of experimental constraints representing limitations on operations that can be performed with the set of resources, the experimental constraints for a given pattern being represented by a set of attributes, the set of patterns including a first pattern defined by a first set of attributes and a second pattern defined by a second set of attributes, the second set of attributes differing from the first set of attributes in at least one attribute;
generating a plurality of configurations based on the parameters and the constraints, each configuration including a plurality of experimental points, each point having a set of values for the parameters, each configuration being generated by;
a) generating a plurality of instances of one or more of the patterns, each pattern instance being defined by a set of attribute values for the attributes defining the pattern, the set of attribute values specifying a quantity of a parameter to be applied at one or more lattice points of an experiment lattice; and
b) combining the pattern instances to generate a configuration, such that the parameter values for a point in the configuration are based on the parameter values specified by the combined pattern instances for a corresponding lattice location, each configuration including a plurality of experimental points, each point having a set of values for the parameters;
comparing the experimental points of the configurations to the set of sampling requirements;
selecting a configuration from the plurality of configurations based on the comparing; and
defining a set of experiments based on the selected configuration;
wherein the plurality of configurations includes one or more first configurations generated by combining instances of the first pattern and one or more second configurations generated by combining instances of the second pattern, and selecting a configuration includes identifying an optimum pattern from the first and second patterns.
-
-
92. A computer-implemented method of generating a design for a library of materials to be prepared with a set of resources, the method comprising:
-
providing a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied during preparation of the library of materials and representing axes defining a parameter space, the set of constraints including one or more experiment lattices, each experiment lattice including one or more lattice points and representing one or more substrates on which the library of materials is to be prepared, the set of constraints also including one or more experimental constraints representing limitations on operations that can be performed with the set of resources;
generating a plurality of configurations based on the parameters and the experimental constraints, each configuration including a plurality of points, each point having a set of values for the parameters and being assigned to a lattice point of an experiment lattice;
selecting a configuration from the plurality of configurations; and
generating a library design based on the selected configuration, the library design including a plurality of points, each point representing a material to be included in the library of materials and having a set of values for the parameters, the set of values being derived from the values for the selected configuration. - View Dependent Claims (93)
-
-
94. A computer program product on a computer-readable medium for designing a set of experiments to be performed with a set of resources, the program comprising instructions operable to cause a programmable processor to:
-
provide a set of parameters and a set of constraints, the parameters including a plurality of factors to be varied during preparation of the library of materials and representing axes defining a parameter space, the set of constraints including one or more experiment lattices, each experiment lattice including one or more lattice points and representing one or more substrates on which the library of materials is to be prepared, the set of constraints also including one or more experimental constraints representing limitations on operations that can be performed with the set of resources;
generate a plurality of configurations based on the parameters and the experimental constraints, each configuration including a plurality of points, each point having a set of values for the parameters and being assigned to a lattice point of an experiment lattice;
select a configuration from the plurality of configurations; and
generate a library design based on the selected configuration, the library design including a plurality of points, each point representing a material to be included in the library of materials and having a set of values for the parameters, the set of values being derived from the values for the selected configuration. - View Dependent Claims (95)
-
Specification