Real-time, multi-tier load test results aggregation
First Claim
1. A computer-implemented method for real-time analysis of results from a load test as the load test is being performed on a target website, comprising:
- (a) computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website, the load including requests of a plurality of virtual users, the first-level aggregated test results including first-level response time statistics computed from data received by each of the plurality of load server instances from the target website in response to the generated load, the first-level aggregated test results including statistics computed by an embedded component within each of the plurality of load server instances every first time interval, the statistics including an average response time across a subset of the plurality of virtual users;
(b) sending the first-level aggregated test results from each of the plurality of load server instances to an associated one of a plurality of analytic server instances every second time interval, the second time interval being longer than the first time interval;
(c) computing second-level aggregated test results by each of the plurality of analytic server instances in response to receiving the first-level aggregated test results from the plurality of load server instances every second time interval, the second-level aggregated test results including second-level response time statistics computed from the first-level aggregated test results;
(d) storing the second-level aggregated test results in a data storage instance;
(e) running a query to the data storage instance to perform one or more statistical functions on the second-level aggregated test results, thereby producing third-level aggregated test results, the third-level aggregated test results including a website response time statistic across all of the virtual users; and
(f) communicating the third-level aggregated test results to a browser application for providing an analytic dashboard with a graphical user interface that outputs the website response time statistic,wherein steps (a)-(f) are each performed in real-time as the load test is being performed on the target website.
3 Assignments
0 Petitions
Accused Products
Abstract
A method for real-time analysis of results from a load test performed on a target website includes periodically computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are computed from data received by each of the load server instances from the target website every first time interval. The first-level aggregated test results are then periodically sent from each of the load server instances to an associated one of a plurality of analytic server instances every second time interval. The first-level aggregated test results are aggregated by each of the analytic server instances to produce second-level aggregated test results, which test results may then further aggregated to produce third-level aggregated test results at a data storage instance in real-time.
-
Citations
14 Claims
-
1. A computer-implemented method for real-time analysis of results from a load test as the load test is being performed on a target website, comprising:
-
(a) computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website, the load including requests of a plurality of virtual users, the first-level aggregated test results including first-level response time statistics computed from data received by each of the plurality of load server instances from the target website in response to the generated load, the first-level aggregated test results including statistics computed by an embedded component within each of the plurality of load server instances every first time interval, the statistics including an average response time across a subset of the plurality of virtual users; (b) sending the first-level aggregated test results from each of the plurality of load server instances to an associated one of a plurality of analytic server instances every second time interval, the second time interval being longer than the first time interval; (c) computing second-level aggregated test results by each of the plurality of analytic server instances in response to receiving the first-level aggregated test results from the plurality of load server instances every second time interval, the second-level aggregated test results including second-level response time statistics computed from the first-level aggregated test results; (d) storing the second-level aggregated test results in a data storage instance; (e) running a query to the data storage instance to perform one or more statistical functions on the second-level aggregated test results, thereby producing third-level aggregated test results, the third-level aggregated test results including a website response time statistic across all of the virtual users; and (f) communicating the third-level aggregated test results to a browser application for providing an analytic dashboard with a graphical user interface that outputs the website response time statistic, wherein steps (a)-(f) are each performed in real-time as the load test is being performed on the target website. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A non-transitory computer-readable storage medium encoded with a computer program product, which, when executed, is operable to:
-
(a) compute first-level aggregated test results within each of a plurality of load server instances during execution of a load test that generates a load on a target website, the load including requests of a plurality of virtual users, the first-level aggregated test results including first-level response time statistics computed from data received by each of the plurality of load server instances from the target website in response to the generated load, the first-level aggregated test results including statistics computed by an embedded component within each of the plurality of load server instances every first time interval, the statistics including an average response time across a subset of the plurality of virtual users; (b) send the first-level aggregated test results from each of the plurality of load server instances to an associated one of a plurality of analytic server instances every second time interval, the second time interval being longer than the first time interval; (c) compute second-level aggregated test results by each of the plurality of analytic server Instances in response to receiving the first-level aggregated test results from the plurality of load server instances every second time interval, the second-level aggregated test results including second-level response time statistics computed from the first-level aggregated test results; (d) store the second-level aggregated test results in a data storage instance; (e) run a query to the data storage instance to perform one or more statistical functions on the second-level aggregated test results, thereby producing third-level aggregated test results, the third-level aggregated test results including a website response time statistic across all of the virtual users; and (f) communicate the third-level aggregated test results to a browser application for providing an analytic dashboard with a graphical user interface that outputs the website response time statistic, wherein (a)-(f) are each performed in real-time during the running of the load test. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A computer-implemented method for real-time analysis of results from a load test as the load test is being performed on a target website, comprising:
-
computing first-level aggregated test results within each of a plurality of load server instances, each load server instance simulating a plurality of virtual users that generate a load on the target website, the first-level aggregated test results including statistics computed by an embedded component within each of the plurality of load server instances as the load test is being performed from data received by each of the plurality of load server instances from the target website in response to the generated load, the first-level aggregated test results being computed every N seconds, where N is a positive integer, the statistics including an average response time across a subset of the plurality of virtual users; sending, as the load test is being performed, a batch message that includes all of the first-level aggregated test results computed by each of the plurality of load server instances to an associated one of a plurality of analytic server instances every M seconds, where M is an integer greater than N; computing, as the load test is being performed, second-level aggregated test results by each of the plurality of analytic server instances in response to receiving the first-level aggregated test results from the plurality of load server instances every M seconds, the second-level aggregated test results including second-level response time statistics computed from the first-level aggregated test results; storing, as the load test is being performed, the second-level aggregated test results in a data storage instance; running, as the load test is being performed, a query to the data storage instance to perform one or more statistical functions on the second-level aggregated test results, thereby producing third-level aggregated test results, the third-level aggregated test results including a website response time statistic across all of the virtual users; and communicating, as the load test is being performed, the third-level aggregated test results to a browser application for providing an analytic dashboard with a graphical user interface that outputs the website response time statistic in real-time. - View Dependent Claims (14)
-
Specification