Integrated performance and load testing tool for application servers

• US 8,464,224 B2
• Filed: 06/30/2009
• Issued: 06/11/2013
• Est. Priority Date: 06/30/2009
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Dulip, Samantha, Moser, Martin, Fuchs, Stefan, Kohler, Markus, Gartner, Maik
• Primary Examiner(s): Khatri, Anil
• Application Number:
  US12/495,117
• Publication Number:
  US 20100333072A1
• Time in Patent Office: 1,442 Days
• Field of Search: 717124-132, 717140-143
• US Class Current: 717/128
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet

Abstract

Implementations of the present disclosure provide for testing an application, and include loading a testing tool by a client that is in communication with an application server that executes the application, introducing probe code into a routine by a first component of the testing tool, the routine being called during execution of the application, and transmitting a request to the application using a second component of the testing tool. An elapsed time of an execution of the routine is determined based on the probe code, and a response is generated from the application server based on the request. A response time is determined based on the request and the response, and performance statistics are calculated based on the elapsed time and the response time.

Claims

1. A method of testing an application, comprising:

loading a testing tool by a client that is in communication with an application server that executes the application;

processing, by a first component of the testing tool executed by the client, one or more probe builder directives to provide and inject probe code into a routine, the routine being called during execution of the application;

transmitting a request to the application using a second component of the testing tool;

determining an elapsed time of an execution of the routine based on the probe code;

generating a response from the application server based on the request;

determining a response time based on the request and the response;

calculating performance statistics based on the elapsed time and the response time;

determining a performance of the application based on the elapsed time and the response time; and

comparing the performance to a baseline performance, the baseline performance corresponding to a previous version of the application, and if the performance is determined to be deficient based on the comparing, generating an indication that the performance is deficient.

2. The method of claim 1, further comprising:

installing an agent on the application server;

receiving, at the agent, at least one of a start time of the routine, an end time of the routine, a total duration of the routine, a relative timestamp, and metadata;

generating trace data based on the at least one of the start time, the end time, the total duration, the relative timestamp, and the metadata; and

storing the trace data in a database that is remote from the application server.

3. The method of claim 1, further comprising:

issuing a command from the second component;

retrieving trace data corresponding to the elapsed time based on the command; and

providing the trace data to the second component.

4. The method of claim 3, wherein retrieving trace data comprises:

generating a query based on query parameters provided by a test infrastructure within which the testing tool is executed;

accessing a database in which the trace data is stored based on the query;

receiving a data string from the database based on the query;

parsing the data string to determine the elapsed time; and

providing the elapsed time to the second component.

5. The method of claim 1, wherein the elapsed time includes one or more phase durations each of which corresponds to a phase of the routine.

6. The method of claim 1, further comprising simulating a virtual user at the client using the second component of the testing tool, the virtual user transmitting the request to the application server.

7. The method of claim 1, further comprising:

providing the elapsed time and the response time to the second component of the testing tool; and

generating one or more graphs based on the elapsed time and the response time using the second component, the graphs corresponding to the performance of the application.

8. A computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

loading a testing tool by a client that is in communication with an application server that executes the application;

processing, by a first component of the testing tool executed by the client, one or more probe builder directives to provide and inject probe code into a routine, the routine being called during execution of the application;

transmitting a request to the application using a second component of the testing tool;

determining an elapsed time of an execution of the routine based on the probe code;

generating a response from the application server based on the request;

determining a response time based on the request and the response;

calculating performance statistics based on the elapsed time and the response time;

determining a performance of the application based on the elapsed time and the response time; and

comparing the performance to a baseline performance, the baseline performance corresponding to a previous version of the application, and if the performance is determined to be deficient based on the comparing, generating an indication that the performance is deficient.

9. The storage medium of claim 8, wherein the operations further comprise:

installing an agent on the application server;

receiving, at the agent, at least one of a start time of the routine, an end time of the routine, a total duration of the routine, a relative timestamp, and metadata;

generating trace data based on the at least one of the start time, the end time, the total duration, the relative timestamp, and the metadata; and

storing the trace data in a database that is remote from the application server.

10. The storage medium of claim 8, wherein the operations further comprise:

issuing a command from the second component;

retrieving trace data corresponding to the elapsed time based on the command; and

providing the trace data to the second component.

11. The storage medium of claim 10, wherein retrieving trace data comprises:

generating a query based on query parameters provided by a test infrastructure within which the testing tool is executed;

accessing a database in which the trace data is stored based on the query;

receiving a data string from the database based on the query;

parsing the data string to determine the elapsed time; and

providing the elapsed time to the second component.

12. The storage medium of claim 8, wherein the elapsed time includes one or more phase durations each of which corresponds to a phase of the routine.

13. The storage medium of claim 8, wherein the operations further comprise simulating a virtual user at the client using the second component of the testing tool, the virtual user transmitting the request to the application server.

14. The storage medium of claim 8, wherein the operations further comprise:

providing the elapsed time and the response time to the second component of the testing tool; and

generating one or more graphs based on the elapsed time and the response time using the second component, the graphs corresponding to the performance of the application.

15. A system for of testing an application, comprising:

one or more processors; and

a computer-readable storage medium coupled to the one or more processors having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

loading a testing tool by a client that is in communication with an application server that executes the application;

processing, by a first component of the testing tool executed by the client, one or more probe builder directives to provide and inject probe code into a routine, the routine being called during execution of the application;

transmitting a request to the application using a second component of the testing tool;

determining an elapsed time of an execution of the routine based on the probe code;

generating a response from the application server based on the request;

determining a response time based on the request and the response;

calculating performance statistics based on the elapsed time and the response time;

determining a performance of the application based on the elapsed time and the response time; and

comparing the performance to a baseline performance, the baseline performance corresponding to a previous version of the application, and if the performance is determined to be deficient based on the comparing, generating an indication that the performance is deficient.

16. The system of claim 15, wherein the operations further comprise:

installing an agent on the application server;

receiving, at the agent, at least one of a start time of the routine, an end time of the routine, a total duration of the routine, a relative timestamp, and metadata;

generating trace data based on the at least one of the start time, the end time, the total duration, the relative timestamp, and the metadata; and

storing the trace data in a database that is remote from the application server.

17. The system of claim 15, wherein the operations further comprise:

issuing a command from the second component;

retrieving trace data corresponding to the elapsed time based on the command; and

providing the trace data to the second component.

18. The system of claim 15, wherein the operations further comprise:

providing the elapsed time and the response time to the second component of the testing tool; and

generating one or more graphs based on the elapsed time and the response time using the second component, the graphs corresponding to the performance of the application.