AUTOMATIC IDENTIFICATION OF EXECUTION PHASES IN LOAD TESTS
First Claim
2-1. The method of claim 2, wherein the thread-wise statistical characterization of processor utilization is a mean CPU utilization for each of the plurality of threads.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for automatic identification of execution phases in load test data includes receiving load test data indicating processor utilization for threads over a period of time divided into a plurality of intervals. For each pair of proximate intervals, it is determined whether thread-wise processor utilization for a first interval is statistically indistinguishable from that of a second interval. The pair of proximate intervals is combined when it is determined that the processor utilization for the first interval is statistically indistinguishable from that of the second interval. Each of the pair of proximate intervals is divided into subintervals when it is determined that the first interval is not statistically indistinguishable the second interval. One or more execution phases are automatically identified as occurring between proximate intervals that are not substantially equivalent.
-
Citations
21 Claims
-
2-1. The method of claim 2, wherein the thread-wise statistical characterization of processor utilization is a mean CPU utilization for each of the plurality of threads.
-
12. A method for automatic identification of bottlenecks n application code, comprising:
-
executing the application code and recording load test data indicating CPU utilization for a plurality of threads over a period of time; dividing the period of time of the load test data into a plurality of intervals; for each pair of proximate intervals of the plurality of intervals, determining whether a statistical characterization of thread-wise CPU utilization for a first interval of the pair of intervals is statistically indistinguishable from a statistical characterization of thread-wise CPU utilization for a second interval of the pair of intervals; combining the pair of proximate intervals into a single interval when it is determined that the statistical characterization of CPU utilization for the first interval is statistically indistinguishable from the statistical characterization of CPU utilization for the second interval; dividing each of the pair of proximate intervals into subintervals when it is determined that the statistical characterization of CPU utilization for the first interval is not statistically indistinguishable from the statistical characterization of CPU utilization for the second interval, wherein one or more execution phases are automatically identified as occurring between proximate intervals that are not substantially equivalent; and using the identified execution phases to correlate execution phases with segments of the application code associated with the load test data to identify segments of the application code that are responsible for phases of relatively high thread-wise CPU utilization. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A computer system comprising:
-
a processor; and a non-transitory, tangible, program storage medium, readable by the computer system, embodying a program of instructions executable by the processor to perform method steps for automatic identification of execution phases in load test data, the method comprising; receiving load test data indicating CPU utilization for a plurality of threads over a period of time; dividing the period of time of the load test data into a plurality of intervals; for each pair of proximate e intervals of the plurality of intervals, determining whether a statistical characterization of thread-wise CPU utilization for a first interval of the pair of intervals is statistically indistinguishable from a statistical characterization of thread-wise CPU utilization for a second interval of the pair of intervals based on performing Welch'"'"'s modification of Student'"'"'s T test with unequal variances and unequal sample sizes; combining the pair of proximate intervals into a single interval when it is determined that the statistical characterization of CPU utilization for the first interval is statistically indistinguishable from the statistical characterization of CPU utilization for the second interval, for each of the plurality of threads; and dividing each of the pair of proximate intervals into subintervals when it is determined that the statistical characterization of CPU utilization for the first interval is not statistically indistinguishable from the statistical characterization of CPU utilization for the second interval, for at least one of the plurality of threads, wherein one or more execution phases are automatically identified as occurring between proximate intervals that are not substantially equivalent. - View Dependent Claims (20, 21)
-
Specification