Automatic framework for parallel testing on multiple testing environments

• US 9,021,438 B2
• Filed: 06/20/2013
• Issued: 04/28/2015
• Est. Priority Date: 06/20/2013
• Status: Active Grant

• Current Assignee: SAP AG (SAP SE)
• Original Assignee: Sap Portals Israel Ltd (SAP SE)
• Inventors: Dayan, Nir
• Primary Examiner(s): Deng, Anna
• Assistant Examiner(s): Wu, Junchun
• Application Number:
  US13/922,788
• Publication Number:
  US 20140380278A1
• Time in Patent Office: 677 Days
• Field of Search: 717/124
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis

Abstract

A web application is tested on multiple testing environments provided by testing appliances. The testing environments are described by a platform, managing an appliance, a browser used for loading the web application, and a browser version. An automatic testing framework is used for handling the parallelized test execution on all of the testing environments. Within the testing framework the testing environments are defined and prepared for the test execution. A consolidated configuration file is generated for the web application'"'"'s configuration and the tests classes. The testing framework provides a local server to host the web application which is later loaded in the testing environments. The testing framework processes the test and uses a communication with the appliances to send commands and to execute the test on all of the testing environments. A unified test report is generated that accumulates the results from all of the testing environments.

Claims

1. A computer implemented method for testing a web application, the method comprising:

defining testing environments in a testing framework;

establishing a communication between the testing environments and the testing framework;

defining a test for the web application for a parallel automatic execution on the defined testing environments;

the testing framework, preparing the testing environments for the parallel automatic execution of the test, wherein the preparation includes automatic unification of configuration files of the web application with configuration files associated with the test by resolving duplications and dependencies existing in the configuration files of the web application and the configuration files associated with the test;

executing the test in parallel on the prepared testing environments by the testing framework, wherein the testing framework controls the testing environments through slave applications installed on appliances that provide the testing environments; and

generating a unified test report from the parallel automatic execution of the test.

2. The method of claim 1, wherein the testing environments are defined in a configuration file in the testing framework.

3. The method of claim 1, wherein defining the testing environments comprise at least a definition of a software platform, a browser type, and a browser version.

4. The method of claim 1, wherein the prepared testing environments comprise a browser for displaying the web application.

5. The method of claim 1, wherein preparing the testing environments for the parallel automatic execution of the test further comprises:

based on the automatic unification mechanism, defining consolidated configuration details of the web application by the testing framework to execute the test in parallel on the testing environments;

defining and providing resources required by the testing environments for testing the web application;

launching a local server part of the testing framework to publish the web application; and

publishing the web application on the local server.

6. The method of claim 1, wherein preparing the testing environments for the test further comprises launching the web application from the testing environments.

7. The method of claim 1, wherein the slave applications receive commands to open and close the browser from the prepared testing environments to load the web application before executing the test.

8. The method of claim 1, wherein the testing framework cleans the prepared testing environments after executing the test.

9. A computer system, comprising:

one or more processors;

appliances to provide testing environments comprising a browser for displaying a web application for testing;

a testing framework to;

define the testing environments to be configured on the appliances;

establish a communication between the testing framework and the appliances;

define a test for the web application for a parallel automatic execution on

prepare the testing environments for the parallel automatic execution of the test, wherein the web application is launched from the testing environments, and wherein the preparation includes automatic unification of configuration files of the web application with configuration files associated with the test by resolving duplications and dependencies existing in the configuration files of the web application and the configuration files associated with the test;

execute the test in parallel on the prepared testing environments by the testing framework, wherein the testing framework controls the testing environments through slave applications installed on appliances that provide the testing environments; and

generate a unified test report with test results from the parallel automatic execution of the test.

10. The system of claim 9, wherein the testing environments are specified at least with a software platform, a browser type, and a browser version, and wherein an appliance from the appliances includes a set of testing environments from the testing environments.

11. The system of claim 9, the testing framework when preparing the testing environments is further operable to:

based on the automatic unification mechanism, define consolidated configuration details of the web application to execute the test in parallel on the testing environments;

define and provide resources required by the testing environments for testing the web application;

launch a local server part of the testing framework to publish the web application; and

publish the web application on the local server.

12. The system of claim 9, wherein the slave applications receive commands to open and close the browser from the prepared testing environments to load the web application before executing the test.

13. A non-transitory computer readable storage medium including executable instructions, which when executed by a computer, cause the computer to:

define testing environments in a testing framework, wherein definition of the testing environments comprise at least a definition of a software platform, a browser type, and a browser version;

establish a communication between the testing environments and the testing framework;

define a test for the web application for a parallel automatic execution on the defined testing environments;

prepare the testing environments for launching the web application and executing the test in parallel, wherein the preparation includes automatic unification of configuration files of the web application with configuration files associated with the test by resolving duplications and dependencies existing in the configuration files of the web application and the configuration files associated with the test;

execute the test in parallel on the one or more prepared testing environments by the testing framework, wherein the testing framework controls the testing environments through slave applications installed on appliances that provide the testing environments; and

generate a unified test report with test results from the parallel automatic execution of the test.

14. The computer-readable medium of claim 13, wherein the testing environments are defined in a configuration file in the testing framework.

15. The computer-readable medium of claim 13, wherein the instructions to prepare the testing environments for launching the web application and executing the test in parallel further comprise instructions, which when executed by a computer, cause the computer to:

based on the automatic unification mechanism, define consolidated configuration details of the web application by the testing framework to execute the test in parallel on the testing environments;

define and providing resources required by the testing environments for testing the web application;

launch a local server part of the testing framework to publish the web application;

publish the web application on the local server; and

launch the web application from the testing environments.

16. The computer-readable medium of claim 13, wherein the slave applications receive commands to open and close a browser from the prepared testing environments on the appliances to load the web application before executing the test.

17. The computer-readable medium of claim 13, wherein the testing framework cleans the prepared testing environments after executing the test.