Active waterfall charts for continuous, real-time visualization of website performance data

• US 9,229,842 B2
• Filed: 06/08/2012
• Issued: 01/05/2016
• Est. Priority Date: 07/19/2010
• Status: Active Grant

• Current Assignee: Akamai Technologies, Inc.
• Original Assignee: Soasta Incorporated (Akamai Technologies, Inc.)
• Inventors: Broda, Tal, Esau, Darrell, Hemmert, Michael
• Primary Examiner(s): Baderman, Scott
• Assistant Examiner(s): McVicker, Matthew G
• Application Number:
  US13/492,249
• Publication Number:
  US 20120246310A1
• Time in Patent Office: 1,306 Days
• Field of Search: 715/736
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3428 Benchmarking
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

A processor-implemented method includes providing an analytic dashboard with a graphical user interface (GUI) that outputs aggregated results streaming in real-time of a load test performed on a target website. The load test consists of a plurality of virtual users simulated by one or more load servers that execute a test composition on one or more webpages of the website. A waterfall chart is produced on the analytic dashboard that includes a plurality of timeline bars. Each of the timeline bars represents an aggregated result for a resource of the one or more webpages across all of the virtual users. The timeline bars change in real-time as the load test progresses.

Claims

1. A method comprising:

load testing a website with a plurality of virtual users simulated by a plurality of load servers that execute a test composition on one or more webpages of the website;

computing, as the test composition executes, by each of the load servers, aggregated test results in real-time from execution of the test composition on the website, the aggregated test results including statistics calculated by an embedded component of each load server, the statistics including an average response time;

aggregating, as the test composition executes, the aggregated test results in real-time by one or more analytic servers to produce aggregated test metrics for all the virtual users;

providing, as the test composition executes, an analytic dashboard with a graphical user interface (GUI) that outputs the aggregated test metrics in real-time in an active waterfall chart, the active waterfall chart displaying information for a series of actions that occur when a virtual user accesses a particular webpage, the information including a statistical time to get an object, file, or resource of the particular webpage across the plurality of virtual users, each action being displayed on a separate row that extends horizontally across a timeline of the active waterfall chart, the information displayed on the active waterfall chart changing in real-time as the test composition progresses.

2. The method of claim 1 wherein the statistical time is an average time to get the object, file, or resource of the particular webpage sent from one or more e s associated with the website to the load servers.

3. The method of claim 1 wherein the series of actions include a Domain Name System (DNS) lookup time.

4. The method of claim 1 wherein the series of actions include a Transmission Control Protocol (TCP) connection time.

5. The method of claim 1 wherein the series of actions include a time to first byte.

6. The method of claim 1 wherein the series of actions of the active waterfall chart are displayed as a sequence of colored bars, each of the colored bars represents a different action that happens as an associated webpage object, file, or resource is delivered to a virtual user simulated by a load server.

7. The method of claim 1 further comprising looping the test composition such that virtual users simulated by the load servers repetitively request each object, file, or resource of the particular webpage of the website.

9. The method of claim 1 wherein a number of the virtual users increases over a time period of the test composition.

8. The method of claim wherein the analytic dashboard is provided by a browser application.

10. A processor-implemented method comprising:

providing an analytic dashboard with a graphical user interface (GUI) that outputs aggregated results of a load test performed on a target website, the load test comprising a plurality of virtual users simulated by a plurality of load servers that execute a test composition on one or more webpages of the website, the aggregated results including statistics computed by an embedded component of each load server, the statistics including an average response time, the aggregated results being streamed in real-time as the load test is being performed;

producing an active waterfall chart on the analytic dashboard that displays information for a series of actions that occur when a virtual user accesses a particular webpage, the displayed information including a sequence of timeline bars, each of the timeline bars being displayed on a separate row of the active waterfall chart and representing an aggregated result for an action taken to get an object, file, or resource of the particular webpage across all of the virtual users, the timeline bars changing in real-time as the load test progresses.

11. The processor-implemented method of claim 10 wherein the actions include a Domain Name System (DNS) lookup time.

12. The processor-implemented method of claim 10 wherein the actions include a Transmission Control Protocol (TCP) connection time.

13. The processor-implemented method of claim 10 wherein the analytic dashboard is provided by a browser application.

14. The processor-implemented method of claim 10 wherein a number of the virtual users increases over a time period of the test composition.

15. The processor-implemented method of claim 10 wherein statistics include an average time to get the object, file, or resource of the particular webpage.

16. A non-transitory computer-readable storage medium encoded with a computer program, when executed the computer program being operable to:

load test a website with a plurality of virtual users simulated by a plurality of load servers that execute a test composition on one or more webpages of the website;

compute, as the test composition executes, by each load server, aggregated test results in real-time from execution of the test composition on the website, the aggregated test results including statistics calculated by an embedded component of each load server, the statistics including an average response time;

aggregate, as the test composition executes, the aggregated test results in real-time by one or more analytic servers to produce aggregated test metrics for all the virtual users;

provide, as the test composition executes, an analytic dashboard with a graphical user interface (GUI) that outputs the aggregated test metrics in real-time in an active waterfall chart, the active waterfall chart displaying infomiation for a series of actions that occur when a virtual user accesses a particular webpage, the information including a statistical time to get an object, file, or resource of the particular webpage across the plurality of virtual users, each action being displayed on a separate row that extends horizontally across a timeline of the active waterfall chart, the information displayed on the active waterfall chart changing in real-time as the test composition progresses.

17. The non-transitory computer-readable storage medium of claim 16 wherein the statistical time is an average time to get the object, file, or resource of the particular webpage sent from one or more servers associated with the website to the load servers.

18. The non-transitory computer-readable storage medium of claim 16 wherein the series of actions includes a Domain Name System (DNS) lookup time.

19. The non-transitory computer-readable storage medium of claim 16 wherein the series of actions includes a Transmission Control Protocol (TCP) connection time.

20. The non-transitory computer-readable storage medium of claim 16 wherein the series of actions includes a sending time.

21. The non-transitory computer-readable storage medium of claim 16 wherein the aggregated test metrics includes a receiving time.

22. The non-transitory computer-readable storage medium of claim 16 wherein the aggregated test metrics includes a waiting time.