Method and Apparatus for Generating a Test Plan Using a Statistical Test Approach
First Claim
1. A process for generating a set of tests for a system, the process comprising:
- identifying a plurality of factors to use in a design of experiments (DOE) test;
using each of the plurality of factors in the DOE;
identifying, through the DOE testing, one or more factors having a significant effect an output of the system;
including only the one or more factors in a combinatorial design methodology (CDM); and
generating a first test matrix based upon the CDM using the DOE inputs.
1 Assignment
0 Petitions
Accused Products
Abstract
A process for generating a set of tests for a system includes identifying a plurality of factors to use in a design of experiments (DOE) test, using each of the plurality of factors in the DOE, identifying, through the DOE testing, one or more factors which have a significant effect an output of the system, including only the one or more factors in a Combinatorial design methodology (CDM) and generating a first test matrix based upon the CDM using the DOE inputs. The unique part of the process is then adding interactions of order greater than 2-way, as identified by the DOE, to the CDM matrix thus creating an optimized set of test cases. By using the sensitivity output of the DOE as an input to the final test matrix from the CDM, an affordable yet comprehensive test approach is provided.
23 Citations
13 Claims
-
1. A process for generating a set of tests for a system, the process comprising:
-
identifying a plurality of factors to use in a design of experiments (DOE) test; using each of the plurality of factors in the DOE; identifying, through the DOE testing, one or more factors having a significant effect an output of the system; including only the one or more factors in a combinatorial design methodology (CDM); and generating a first test matrix based upon the CDM using the DOE inputs. - View Dependent Claims (2, 3, 4)
-
-
5. A process for designing a set of tests for a sensor for use in a perimeter intrusion detection system, the process comprising:
-
(a) determining a plurality of independent factors; (b) determining one or more possible levels for each of the plurality of independent factors; (c) assigning at least one level to each of the independent factors; (d) eliminating factors that have been previously proven insignificant by at least one of;
manufacturer'"'"'s data;
or an empirical result;(e) generating a designed experiment (DOE) which includes a plurality of experimental combinations; (f) executing each of the plurality of experimental combinations; (g) recording one or more sensor output characteristic for each of the plurality of experimental combinations; (h) performing a regression analysis on the results of (g) to provide a relationship between the factors included in the experimental combinations and each of the one or more sensor output characteristics; (i) using the results of (h) to complete a sensitivity analysis to rank the significance of the factors and interactions; (j) selecting significant factors and interactions based upon a P(2) tail value; and (k) using the selected significant factors and interactions as input to a combinatorial design method (CDM). - View Dependent Claims (6, 7, 8)
-
-
9. A process for designing a set of tests for a system, the process comprising:
-
using one or more designed experiments (DOEs) to identify one or more factors which affect an output of the system; including only the one or more factors in a Combinatorial Design Method (CDM) wherein the CDM identifies all two-way interactions between the factors provided thereto from the DOEs; generating a first test matrix based upon the CDM and the DOE inputs provided thereto; and adding one or more tests to the first test matrix wherein each of the one or more tests includes a combination of two or more additional significant factors not included in the first test matrix.
-
-
10. A process comprising:
-
identifying a plurality of independent variables; using one or more designed experiments to provide sensitivity analysis and to look for interactions that involve more than two independent variables; recording the interactions; ranking the interactions by significance to a measured characteristic of the system; including the most significant factors in a Combinatorial Design Method (CDM) which identifies all two-way interactions between variables; identifying any interactions that involve more than two variables; generating a CDM test matrix; adding the interactions that involve more than two variables to the CDM test matrix; and determining a required sample size based upon the requirement and nature of the test and compared to the test matrix. - View Dependent Claims (11, 12, 13)
-
Specification