Test environment managed within tests

• US 8,839,202 B2
• Filed: 10/12/2012
• Issued: 09/16/2014
• Est. Priority Date: 10/12/2012
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Tempel, Mark, Gibbens, David, Schissel, Callistus C
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Wang, Ben C
• Application Number:
  US13/650,969
• Publication Number:
  US 20140109052A1
• Time in Patent Office: 704 Days
• Field of Search: None
• US Class Current: 717/127
• CPC Class Codes: G06F 11/0712 in a virtual computing platform, e.g. logically partitioned systems
• CPC Class Codes: G06F 11/0769 Readable error formats, e.g. cross-platform generic formats, human understandable formats
• CPC Class Codes: G06F 11/0772 Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

In a method of managing a test environment, a test of a software item is initiated, wherein the test manages a test environment that the test executes test cases against during run time. At least one global variable file is accessed. The global variable file describes the test environment and defines references to machine names.

Claims

1. A processor-implemented method of managing a test environment, said method comprising:

initiating a test of a software item on a computing environment comprising a plurality of virtual machines, wherein said test manages a test environment that said test executes test cases against during run time;

modifying said test environment according to said test, such that said plurality of virtual machines begins in a predetermined operational state;

accessing at least one global variable file, wherein said global variable file describes said test environment and is operable to modify said test environment, and wherein said global variable file defines references to machine names such that said global variable file assists in translating said references to machine names to specific virtual machines available in said test environment;

communicating with a custom action layer to execute a custom action of said test, wherein said custom action layer is dynamic; and

invoking said custom action from said custom action layer.

2. The processor-implemented method as recited in claim 1, further comprising:

reverting virtual machine snapshots.

3. The processor-implemented method as recited in claim 1, further comprising:

starting at least one virtual machine.

4. The processor-implemented method as recited in claim 1, further comprising:

stopping at least one virtual machine.

5. The processor-implemented method as recited in claim 1, wherein said test is performed in a cloud-based computing environment.

6. The processor-implemented method as recited in claim 1, wherein said test is operable to modify said test environment such that said test begins in a predetermined test environment.

7. The processor-implemented method as recited in claim 1, wherein said test is written in the same commonly used language as test cases that do not manage testing environments.

8. A non-transitory computer readable storage medium comprising instructions stored thereon which, when executed, cause a computing system to perform a method of managing a test environment, said method comprising:

initiating a test of a software item on a computing environment comprising a plurality of virtual machines, wherein said test manages a test environment that said test executes test cases against during run time;

modifying said test environment according to said test, such that said plurality of virtual machines begins in a predetermined operational state;

accessing at least one global variable file, wherein said global variable file describes said test environment and is operable to modify said test environment, and wherein said global variable file defines references to machine names such that said global variable file assists in translating said references to machine names to specific virtual machines available in said test environment;

communicating with a custom action layer to execute a custom action of said test, wherein said custom action layer is dynamic; and

invoking said custom action from said custom action layer.

9. The non-transitory computer readable storage medium of claim 8, further comprising instructions for:

reverting virtual machine snapshots.

10. The non-transitory computer readable storage medium of claim 8, further comprising instructions for:

starting at least one virtual machine.

11. The non-transitory computer readable storage medium of claim 8, further comprising instructions for;

stopping at least one virtual machine.

12. The non-transitory computer readable storage medium of claim 8, wherein said instructions cause said test to be performed in a cloud-based computing environment.

13. The non-transitory computer readable storage medium of claim 8, wherein said instructions cause said test to modify said test environment such that said test begins in a predetermined test environment.

14. The non-transitory computer readable storage medium of claim 8, wherein said instructions permit said test to be written in the same commonly used language as test cases that do not manage testing environments.

15. At least one non-transitory computer readable storage medium containing a computer program product for a testing framework comprising:

a framework layer which is compiled prior to running a custom action;

a test environment management add-on providing actions to all layers, wherein said test environment management add-on is operable to modify a test environment upon which a software item is being tested, and wherein said test environment management add-on is operable to access at least one global variable file that describes said test environment and is operable to modify said test environment, and wherein said global variable file defines references to machine names such that said global variable file assists in translating said references to machine names to specific virtual machines available in said test environment;

a custom action layer for running custom actions, wherein said custom action layer is dynamic;

at least one fixture layer to communicate with said framework layer and said custom action layer, wherein said fixture layer is compiled prior to running said custom action; and

a test layer to communicate with said custom action layer, wherein said test layer is configured to receive and execute a test, wherein said test manages said test environment that said test executes test cases against during run time using said test environment management add-on. and wherein said test layer is compiled prior to running said custom action and can invoke said custom action from said custom action layer.

16. The computer program product of claim 15, wherein actions in said test environment management add-on is operable to start at least one virtual machine, revert at least one virtual machine to a snapshot, and wherein said test environment management layer is operable to stop at least one virtual machine.

17. The computer program product of claim 15, wherein a test alters said testing environment, and wherein said testing environment is a predetermined testing environment.