Test framework for testing an application

• US 7,823,023 B2
• Filed: 02/26/2007
• Issued: 10/26/2010
• Est. Priority Date: 02/26/2007
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Kwan, Nang Kon, Hegarty, Orla
• Primary Examiner(s): Bonzo; Bryce P
• Application Number:
  US11/678,982
• Publication Number:
  US 20080209275A1
• Time in Patent Office: 1,338 Days
• Field of Search: 714/38
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A device, method and/or computer-readable medium for testing an application within a test framework includes a framework controller associated with the test framework installed on a master device and a test driver associated with the test framework installed on one or more client devices. The master device is connected to the one or more client devices and a virtual machine (VM) module is installed on each of the one or more client devices. VMs can be created on the client devices and the application is installed on at least one of the VMs. The application is executed on the VMs according to a test scenario file. The framework controller collects data to generate an output result.

Claims

1. A method of testing an application within a test framework, the method comprising:

receiving a test scenario file specifying a configuration of one or more virtual machines (VMs) for testing the application;

searching for one or more client devices having a hardware specification necessary to support operation of the one or more VMs according to the test scenario file;

creating the one or more VMs on the one or more client devices according to the test scenario file;

installing the application on at least one of the one or more VMs;

executing the application on the at least one of the one or more VMs according to the test scenario file to generate an output result; and

collecting data associated with the output result.

2. The method of claim 1, wherein the creating of the one or more VMs comprises setting a hardware configuration of each of the one or more VMs.

3. The method of claim 1, wherein the hardware configuration necessary to support operation is specified by a VM_HARDWARE_SPECIFICATION primitive.

4. The method of claim 1, wherein the test scenario file comprises a non-coding format text file.

5. The method of claim 1, further comprising installing a different operating system on at least one of the one or more VMs as specified in the test scenario file.

6. The method of claim 1, further comprising saving a state of one of the one or more VMs.

7. The method of claim 1, further comprising:

saving a state of one of the one or more VMs; and

restoring the one of the one or more VMs on one of the one or more client devices based upon the saved state.

8. The method of claim 1, wherein the creating of the one or more VMs on the one or more client devices comprises activating at least one of the one or more VMs on at least one of the one or more client devices.

9. The method of claim 1, further comprising destroying one or more of the one or more VMs.

10. The method of claim 1, further comprising:

installing a client application on one of the one or more VMs; and

executing the client application on the one of the one or more VMs according to the test scenario file to generate a output client result; and

collecting data associated with the output client result.

11. A test framework for testing an application, the test framework comprising:

one or more client devices with a test driver installed thereon and connected to a master device;

a framework controller installed on the master device and configured to search for one of the one or more client devices having a hardware specification necessary to support operation according to a test scenario file, and to send control signals to the test driver to execute operations at the one of the one or more client devices according to a configuration specified in the test scenario file, wherein the configuration specified in the test scenario file comprises;

a set of primitives for creating a virtual machine (VM) for testing the application on the one of the one or more client devices and controlling operation of the VM; and

an application primitive for specifying the application to be installed on the VM.

12. The test framework of claim 11, wherein the set of primitives for creating the VM includes one or more of:

a CREATE_VM primitive for creating the VM on the one of the one or more client devices, and a VM_HARDWARE_SPECIFICATION primitive for setting a hardware specification of the VM, a SAVE_VM_STATE primitive for saving a state of the VM.

13. The test framework of claim 11, wherein the set of primitives for creating the VM includes one or more of:

a CREATE_VM primitive for creating the VM on the one of the one or more client devices, a VM_HARDWARE SPECIFICATION primitive for defining a hardware specification of the VM, a SAVE_VM_STATE primitive for saving a state of the VM, and a RESTORE_VM_STATE primitive for restoring the VM based upon the saved state.

14. The test framework of claim 11, wherein the test scenario file comprises a non-coding format text file.

15. The test framework of claim 11, wherein the test driver is configured to execute the application installed on the VM to generate an output result, and wherein the test framework further comprises a data collection module for collecting data associated with the output result from the VM.

16. A master device for testing an application within a test framework, the master device comprising:

an interface for connecting with a test driver at one or more client devices; and

a processor coupled to the interface, the processor configured to;

receive a test scenario file specifying a configuration of a virtual machine (VM) for testing the application;

search for one of the one or more client devices having a hardware specification necessary to support operation of the VM according to the test scenario file;

create the VM on the one of the one or more client devices according to the test scenario file;

install the application on the VM;

execute the application on the VM according to the test scenario file to collect execution data; and

generate an output result based upon the collected execution data.

17. The master device of claim 16, wherein the processor is further configured to save a state of the VM.

18. The master device of claim 16, wherein the processor is further configured to:

save a state of the VM; and

restore the VM based upon the saved state.

19. The master device of claim 16, wherein:

the test scenario file comprises a non-coding format text file; and

the processor is further configured to read the non-coding format text file to execute the application.