Interface for series of tests

• US 20070136024A1
• Filed: 12/09/2005
• Published: 06/14/2007
• Est. Priority Date: 12/09/2005
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Moser, Martin, Fuchs, Stefan
• Granted Patent: US 7,412,349 B2
• Time in Patent Office: Days
• US Class Current: 702/119
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Methods and apparatus, including computer program products, for an interface that generates a report including a series of load test results. An interface can generate such a report that includes a series of load test results by initiating load testing of a first and second application during a first and second test run, and initiating combining of test results of the first and second test runs. The report can individually characterize the test results as members of a series of test runs. Load testing and combining of test results can be initiated at a single interface.

Claims

1. A computer program product embodied on tangible media, the computer program product comprising instructions operable to cause data processing apparatus to:

initiate, at an interface, load testing of a first application during a first test run in accordance with a first definition of a first group of load tests;

initiate, at the interface, load testing of a second application during a second test run in accordance with a second definition of a second group of load tests; and

initiate, at the interface, combining of test results of the first and second test runs to generate a report that individually characterizes at least some of the test results as members of a series of test runs, the series of test runs comprising the first and second test runs.

2. The computer program product of claim 1, wherein the instructions operable to generate a report individually characterizing at least some of the test results comprises:

instructions operable to incorporate details of the first and second test runs into the series of test runs.

3. The computer program product of claim 1, wherein the report comprises a plotted graph that includes a trend line corresponding to a trend of a metric between the first test run and the second test run.

4. The computer program product of claim 1, wherein:

the initiation of load testing of the first application comprises transmitting first data to initiate load testing of the first application, wherein the first data is transmitted to a first node to perform load testing of the first application;

the initiation of load testing of the second application comprises transmitting second data to initiate load testing of the second application, wherein the second data is transmitted to the first node to perform load testing of the second application; and

the interface transmits third data to a second node to initiate the combining of the first and second test runs.

5. The computer program product of claim 1, wherein the interface is an application that performs the load testing of the first and second applications.

6. The computer program product of claim 1, wherein the interface is an application and the load testing of the first and second applications is performed by an external tool.

7. The computer program product of claim 1 further comprising instruction operable to cause the data processing apparatus to:

receive first test results from the load testing of the first application;

store the first test results from the load testing of the first application;

receive second test results from the load testing of the second application; and

store the second test results from the load testing of the second application.

8. The computer program product of claim 1, wherein:

the first and second applications are the same.

9. The computer program product of claim 1, wherein:

the first and second applications are different versions of a same application.

10. The computer program product of claim 1, wherein:

the first and second applications are a same application, and

the first and second applications are load tested in different testing environments.

11. The computer program product of claim 1, wherein:

the first and second definitions of a group of load tests are similar; and

the first application is load tested with a first load that is of a different scale than a second load tested with the second application.

12. The computer program product of claim 1, wherein generating the report individually characterizing at least some of the test results as members of a series of test runs comprises generating a report with the members of the series ordered chronologically.

13. The computer program product of claim 1, wherein initiating load testing of a first application during a first test run in accordance with a first definition of a first group of load tests comprises:

initiating the load testing of the first application with one or more scenarios during the first test run.

14. The computer program product of claim 1, further comprising instructions operable to cause the data processing apparatus to:

display graphical user interface components of the interface.

15. The computer program product of claim 1, further comprising instructions operable to cause the data processing apparatus to:

receive at the interface commands to initiate the load testing of the first and second applications, wherein the interface is a command line interface.

16. The computer program product claim 1, wherein generating a report that individually characterizes at least some of the test results as members of a series of test runs comprises:

collecting measurements of a similar metric from the test results,

associating the measurements with details about a corresponding test run, and

generating the report such that the details of a corresponding test run are presented with associated measurements.

17. An apparatus comprising:

an interface operative to;

initiate load testing of applications during test runs in accordance with definitions of groups of load tests, and

initiate combining, at a test result combiner, of test results from load testing initiated by the interface; and

the test result combiner operative to combine test results of a plurality of the test runs to generate a report individually characterizing the test results as members of a series of the test runs.

18. The apparatus of claim 17, wherein the test result combiner is operative to incorporate details of a first test run and a second test run into the series of test runs.

19. A computer-implemented method comprising:

initiating, at an interface, load testing of a first application during a first test run in accordance with a first definition of a first group of load tests;

initiating, at the interface, load testing of a second application during a second test run in accordance with a second definition of a second group of load tests; and

initiating, at the interface, combining of test results of the first and second test runs to generate a report individually characterizing at least some of the test results as members of a series of test runs, the series of test runs comprising the first and second test runs.

20. The method of claim 19, wherein individually characterizing at least some of the test results as members of a series of test runs comprises:

incorporating details of the first and second test runs into the series of test runs.