INTEGRATED PERFORMANCE AND LOAD TESTING TOOL FOR APPLICATION SERVERS

• US 20100333072A1
• Filed: 06/30/2009
• Published: 12/30/2010
• Est. Priority Date: 06/30/2009
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Fuchs, Stefan, Kohler, Markus, Dulip, Samantha, Gartner, Maik, Moser, Martin
• Granted Patent: US 8,464,224 B2
• Time in Patent Office: Days
• US Class Current: 717/128
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet

Abstract

Implementations of the present disclosure provide for testing an application, and include loading a testing tool by a client that is in communication with an application server that executes the application, introducing probe code into a routine by a first component of the testing tool, the routine being called during execution of the application, and transmitting a request to the application using a second component of the testing tool. An elapsed time of an execution of the routine is determined based on the probe code, and a response is generated from the application server based on the request. A response time is determined based on the request and the response, and performance statistics are calculated based on the elapsed time and the response time.

Claims

1. A method of testing an application, comprising:

loading a testing tool by a client that is in communication with an application server that executes the application;

introducing probe code into a routine by a first component of the testing tool, the routine being called during execution of the application;

transmitting a request to the application using a second component of the testing tool;

determining an elapsed time of an execution of the routine based on the probe code;

generating a response from the application server based on the request;

determining a response time based on the request and the response; and

calculating performance statistics based on the elapsed time and the response time.

2. The method of claim 1, further comprising:

installing an agent on the application server;

receiving, at the agent, at least one of a start time of the routine, an end time of the routine, a total duration of the routine, a relative timestamp, and metadata;

generating trace data based on the at least one of the start time, the end time, the total duration, the relative timestamp, and the metadata; and

storing the trace data in a database that is remote from the application server.

3. The method of claim 1, further comprising:

issuing a command from the second component;

retrieving trace data corresponding to the elapsed time based on the command; and

providing the trace data to the second component.

4. The method of claim 3, wherein retrieving trace data comprises:

generating a query based on query parameters provided by a test infrastructure within which the testing tool is executed;

accessing a database in which the trace data is stored based on the query;

receiving a data string from the database based on the query;

parsing the data string to determine the elapsed time; and

providing the elapsed time to the second component.

5. The method of claim 1, wherein the elapsed time includes one or more phase durations each of which corresponds to a phase of the routine.

6. The method of claim 1, further comprising simulating a virtual user at the client using the second component of the testing tool, the virtual user transmitting the request to the application server.

7. The method of claim 1, further comprising:

providing the elapsed time and the response time to the second component of the testing tool; and

generating one or more graphs based on the elapsed time and the response time using the second component, the graphs corresponding to a performance of the application.

8. The method of claim 1, further comprising:

determining a performance of the application based on the elapsed time and the response time;

comparing the performance to a baseline performance, the baseline performance corresponding to a previous version of the application; and

generating an indication that the performance is deficient based on the comparing.

9. A computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

loading a testing tool by a client that is in communication with an application server that executes an application;

introducing probe code into a routine by a first component of the testing tool, the routine being called during execution of the application;

transmitting a request to the application using a second component of the testing tool;

determining an elapsed time of an execution of the routine based on the probe code;

generating a response from the application server based on the request;

determining a response time based on the request and the response; and

calculating performance statistics based on the elapsed time and the response time.

10. The storage medium of claim 9, wherein the operations further comprise:

installing an agent on the application server;

receiving, at the agent, at least one of a start time of the routine, an end time of the routine, a total duration of the routine, a relative timestamp, and metadata;

generating trace data based on the at least one of the start time, the end time, the total duration, the relative timestamp, and the metadata; and

storing the trace data in a database that is remote from the application server.

11. The storage medium of claim 9, wherein the operations further comprise:

issuing a command from the second component;

retrieving trace data corresponding to the elapsed time based on the command; and

providing the trace data to the second component.

12. The storage medium of claim 11, wherein retrieving trace data comprises:

generating a query based on query parameters provided by a test infrastructure within which the testing tool is executed;

accessing a database in which the trace data is stored based on the query;

receiving a data string from the database based on the query;

parsing the data string to determine the elapsed time; and

providing the elapsed time to the second component.

13. The storage medium of claim 9, wherein the elapsed time includes one or more phase durations each of which corresponds to a phase of the routine.

14. The storage medium of claim 9, wherein the operations further comprise simulating a virtual user at the client using the second component of the testing tool, the virtual user transmitting the request to the application server.

15. The storage medium of claim 9, wherein the operations further comprise:

providing the elapsed time and the response time to the second component of the testing tool; and

generating one or more graphs based on the elapsed time and the response time using the second component, the graphs corresponding to a performance of the application.

16. The storage medium of claim 9, wherein the operations further comprise:

determining a performance of the application based on the elapsed time and the response time;

comparing the performance to a baseline performance, the baseline performance corresponding to a previous version of the application; and

generating an indication that the performance is deficient based on the comparing.

17. A system for of testing an application, comprising:

an application server that executes and application;

one or more processors; and

a computer-readable storage medium coupled to the one or more processors having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

loading a testing tool by a client that is in communication with an application server that executes the application;

introducing probe code into a routine by a first component of the testing tool, the routine being called during execution of the application;

transmitting a request to the application using a second component of the testing tool;

determining an elapsed time of an execution of the routine based on the probe code;

generating a response from the application server based on the request;

determining a response time based on the request and the response; and

calculating performance statistics based on the elapsed time and the response time.

18. The system of claim 17, wherein the operations further comprise:

installing an agent on the application server;

receiving, at the agent, at least one of a start time of the routine, an end time of the routine, a total duration of the routine, a relative timestamp, and metadata;

generating trace data based on the at least one of the start time, the end time, the total duration, the relative timestamp, and the metadata; and

storing the trace data in a database that is remote from the application server.

19. The system of claim 17, wherein the operations further comprise:

issuing a command from the second component;

retrieving trace data corresponding to the elapsed time based on the command; and

providing the trace data to the second component.

20. The system of claim 17, wherein the operations further comprise:

providing the elapsed time and the response time to the second component of the testing tool; and

generating one or more graphs based on the elapsed time and the response time using the second component, the graphs corresponding to a performance of the application.

21. The system of claim 17, wherein the operations further comprise:

determining a performance of the application based on the elapsed time and the response time;

comparing the performance to a baseline performance, the baseline performance corresponding to a previous version of the application; and

generating an indication that the performance is deficient based on the comparing.