Software performance testing with minimum iterations
First Claim
1. A method for providing performance testing, the method comprising:
- performing N number of iterations of a test;
determining that results of the test are valid if the test reached a defined test criteria after performing the N number of iterations;
adding, if the test has not reached the defined test criteria and if N is less than a maximum value, one to N and performing an additional iteration of the test until one of the following occurs;
the test reaches the defined test criteria and N reaches the maximum value, wherein if the test reaches the defined test criteria after any additional iteration of the test before N reaches the maximum value, the results of the test are deemed valid;
determining that the results of the test are valid if N reached the maximum value and if the test reached the defined test criteria with an outlier removed from the results;
determining that the results of the test are invalid if N reached the maximum value and if the test did not reach the defined test criteria with an outlier removed from results;
deeming the test as passing if the test results compare favorably to a goal value; and
deeming the test as failing if the test results compare unfavorably to the goal value.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are disclosed for providing software performance testing. The results of a test may be determined valid if the test reached a defined test criteria after performing N number of iterations. If the test has not reached the defined test criteria and if N is less than a maximum value, one may be added to N and additional iteration of the test may be performed until the test reaches the defined test criteria or until N reaches the maximum value. If the test reaches the defined test criteria after any additional iteration of the test before N reaches the maximum value, the results of the test may be deemed valid. Moreover, if the test reached the defined test criteria with an outlier removed from the results, the results of the test may be deemed valid. Otherwise, the results of the test may be deemed invalid.
-
Citations
20 Claims
-
1. A method for providing performance testing, the method comprising:
-
performing N number of iterations of a test;
determining that results of the test are valid if the test reached a defined test criteria after performing the N number of iterations;
adding, if the test has not reached the defined test criteria and if N is less than a maximum value, one to N and performing an additional iteration of the test until one of the following occurs;
the test reaches the defined test criteria and N reaches the maximum value, wherein if the test reaches the defined test criteria after any additional iteration of the test before N reaches the maximum value, the results of the test are deemed valid;
determining that the results of the test are valid if N reached the maximum value and if the test reached the defined test criteria with an outlier removed from the results;
determining that the results of the test are invalid if N reached the maximum value and if the test did not reach the defined test criteria with an outlier removed from results;
deeming the test as passing if the test results compare favorably to a goal value; and
deeming the test as failing if the test results compare unfavorably to the goal value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system for providing software performance testing, the system comprising:
-
a memory storage; and
a processing unit coupled to the memory storage, wherein the processing unit is operative to;
perform N number of iterations of a test;
determine that results of the test are valid if the test reached a defined test criteria after performing the N number of iterations wherein the defined test criteria comprises Err/ X ≦
Z whereX is an average value of the results and Err is the error margin associated with the results;
add, if the test has not reached the defined test criteria and if N is less than a maximum value, one to N and perform an additional iteration of the test until one of the following occurs;
the test reaches the defined test criteria and N reaches the maximum value, wherein if the test reaches the defined test criteria after any additional iteration of the test before N reaches the maximum value, the results of the test are deemed valid;
determine that the results of the test are valid if N reached the maximum value and if the test reached the defined test criteria with an outlier removed from the results;
determine that the results of the test are invalid if N reached the maximum value and if the test did not reach the defined test criteria with an outlier removed from results;
deem the test as passing if the test results compare favorably to a goal value; and
deem the test as failing if the test results compare unfavorably to the goal value. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A computer-readable medium which stores a set of instructions which when executed performs a method for providing software performance testing, the method executed by the set of instructions comprising:
-
performing N number of iterations of a test wherein the test is configured to measure the amount of time it takes for a computer program to perform a predetermined operation;
determining that results of the test are valid if the test reached a defined test criteria after performing the N number of iterations;
adding, if the test has not reached the defined test criteria and if N is less than a maximum value, one to N and performing an additional iteration of the test until one of the following occurs;
the test reaches the defined test criteria and N reaches the maximum value, wherein if the test reaches the defined test criteria after any additional iteration of the test before N reaches the maximum value, the results of the test are deemed valid;
determining that the results of the test are valid if N reached the maximum value and if the test reached the defined test criteria with an outlier removed from the results wherein the outlier comprises a data point within the results that is not in the range of [ X −
Err,X +Err] and the one most far away from a mean of the results whereX is the average value of the results, and Err is the error margin associated with the results;
determining that the results of the test are invalid if N reached the maximum value and if the test did not reach the defined test criteria with an outlier removed from results;
deeming the test as passing if the test results compare favorably to a goal value; and
deeming the test as failing if the test results compare unfavorably to the goal value. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification