Distributed software testing using cloud computing resources

• US 8,949,791 B2
• Filed: 07/08/2009
• Issued: 02/03/2015
• Est. Priority Date: 07/08/2009
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Lu, Zihong, Li, Wei, Murthy, Karthik Sreenivasa, Raghuram, Sirish
• Primary Examiner(s): Do, Chat
• Assistant Examiner(s): JEON, JAE UK
• Application Number:
  US12/499,285
• Publication Number:
  US 20110010691A1
• Time in Patent Office: 2,036 Days
• Field of Search: 717124-135
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A method of creating computing environment in a cloud computing environment for execution of a test is disclosed. The method includes loading a setup script from a script store. The loading is performed by a test manager that is in communication with the script store. The test manager checks if there are more setup scripts to be loaded. If yes, the remaining setup scripts are loaded by the test manager. The test manager then calculates computing resources needed to run all tests as coded in all loaded scripts. The test manager then attempts to reserve needed computing resources in a virtual data center using a data center infrastructure manager.

Claims

1. A method of creating computing environment for execution of a test, the method comprising:

(a) loading a setup script from a script store, the loading being performed by a test manager that is in communication with the script store, wherein the loading includes identifying computing resource requirements to run the test as coded in the setup script, wherein in response to the computing resource requirements to run a test in a first setup script being identical to computing resource requirements to run a second test in a second setup script, dynamically merging the first setup script with the second setup script during run time, and wherein responsive to a notification of a clean state requirement being provided to said test manager from said second setup script said dynamically merging comprises said test manager rolling back a computing resource to a clean state prior to execution of said second test on said computing resource;

(b) performing step (a) again until all setup scripts that are to be loaded are loaded;

(c) calculating computing resources needed to run all tests as coded in all loaded scripts; and

(d) provided needed computing resources in a virtual data center are available for reservation, reserving said needed computing resources in a virtual data center through a virtual data center infrastructure manager.

2. The method as recited in claim 1, wherein the calculating includes determining computing resources to run all tests in parallel.

3. The method as recited in claim 2, wherein if a particular test in all tests is dependent on another test, the calculating includes determining computing resources to run all tests, except the particular test, in parallel.

4. The method as recited in claim 1, wherein if the needed computing resources in the virtual data center may not be reserved, the calculating includes reducing a number of tests to be run in parallel and performing step (d) again.

5. The method as recited in claim 4, wherein if not enough computing resources available to run tests as coded in any one of the setup scripts, notifying the test manager that no resources are available.

6. The method as recited in claim 4, wherein if the needed computing resources are available to run a group of tests in parallel, then reserving the needed computing resources in the virtual data center to run the group of tests in parallel, then dismantling the computing environment after recording results of the group of tests.

7. The method as recited in claim 4, wherein if the needed computing resources are available to run a group of tests in parallel, then reserving the needed computing resources in the virtual data center to run the group of tests in parallel, wherein if a test in the group of tests fails, then preserving the needed computing resources in same setup for a post test debugging.

8. The method as recited in claim 1, wherein the computing environment is isolated and accessible only for the execution of the test.

9. A non-transitory computer readable storage medium having instructions embodied therein that when executed cause a computing system to perform a method for creating a computing environment for execution of a test, the computer readable medium comprising:

programming instructions for loading a setup script from a script store, the loading being performed by a test manager that is in communication with the script store, and the loading continuing until all setup scripts that are to be loaded are loaded;

programming instructions for checking for more setup scripts to be loaded;

programming instructions for dynamically merging a first test script associated with said setup script and a second test script associated with a second setup script during runtime such that said first test script and said second test script run one after another on the same computing resource when computing resource requirements specified by said setup script are identical to computing resource requirements specified by said second setup script, wherein responsive to a notification of a clean state requirement being provided to said test manager from said second setup script said dynamically merging comprises said test manager rolling back said same computing resource to a clean state prior to execution of said second test;

programming instructions for calculating computing resources needed to run all tests as coded in all loaded scripts; and

programming instructions for reserving needed computing resources in a virtual data center.

10. The non-transitory computer readable storage medium as recited in claim 9, further including programming instructions for notifying the test manager when no resources are available.

11. The non-transitory computer readable storage medium as recited in claim 9, wherein the programming instructions for loading includes programming instructions for identifying computing resource requirements to run the test as coded in the setup script.

12. A non-transitory computer usable storage medium having computer readable program code embedded therein that when executed causes a computing system to manage tests, said program code comprising:

a test manager comprising;

a script loader to load one or more setup scripts from a testsuite store until all setup scripts that are to be loaded are loaded;

a testsuite merge module to dynamically merge a first setup script and a second setup script during runtime when computing resource requirements to run a first test associated with said first setup script are identical to computing resource requirements to run a second test associated with said second setup script, wherein responsive to a notification of a clean state requirement being provided to said test manager from said second setup script said dynamically merging comprises rolling back a computing resource used by said first test to a clean state prior to execution of said second test on said computing resource;

an interfacing module to communicate with a virtual data center; and

a computing environment setup module to calculate computing resource requirements and reserve computing resources in the virtual data center.

13. The non-transitory computer usable storage medium of claim 12 wherein the test manager further includes a logging and reporting module to capture results of test executions.

14. The non-transitory computer usable storage medium of claim 12 wherein the test manager further comprises an execution module to coordinate test executions.