System and method for providing a standardized test framework

• US 20050086022A1
• Filed: 10/15/2003
• Published: 04/21/2005
• Est. Priority Date: 10/15/2003
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ibrahim, Mohamed A., Santa Maria Filho, Ivan, Ren, Liming, Lindberg, Lance E., Putrevu, Suryanarayana V., Sunkammurali, Krishna Kumar
• Application Number:
  US10/685,667
• Publication Number:
  US 20050086022A1
• Time in Patent Office: Days
• US Class Current: 702/123
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 8/41 Compilation

Abstract

A system for testing software may include a driver, dispatcher and one or more executors. One or group of test cases may be provided to the testing system. Each test case includes one or more actions and may be in the form of an XML document. Each action may be dependent on or independent of previous or following actions. In preparation for executing the test case one or more times, system initialization is performed. One or more iterations of the test case may be executed and housekeeping tasks may be performed in preparation for executing the next test case. Executing an iteration of a test case includes initialization in preparation for executing the iteration, performing the actions that test the software and validating the results (including comparing the actual result with an expected result and making entries to a log) and performing local cleanup (i.e., cleanup relevant to the iteration).

Claims

1. A system for testing software comprising:

an executor for executing at least one action, the at least one action specified in an XML document,

a dispatcher for instantiating the executor to execute the at least one action; and

a driver for receiving information associated with the execution of the at least one action, and for sending instructions to the dispatcher.

2. The system of claim 1, further comprising a logger for logging information associated with the execution of the at least one action.

3. The system of claim 2, wherein the logger logs trace statements.

4. The system of claim 2, wherein the logger logs exceptions.

5. The system of claim 2, wherein the logger logs warnings.

6. The system of claim 2, wherein the logger logs errors.

7. The system of claim 1, wherein the driver receives input comprising a level of logging to be performed.

8. The system of claim 1, wherein the XML document comprises at least one action to be performed to test a software system and identifies an executor to execute the at least one action.

9. The system of claim 1, wherein the XML document specifies at least one action to be performed to initialize the software system.

10. The system of claim 1, wherein the XML document specifies at least one action to be performed to test the software system.

11. The system of claim 10, wherein the XML document specifies at least one expected result of performing the at least one action.

12. The system of claim 1, wherein the XML document specifies at least one action to restore the software to a testable state.

13. A method of testing software comprising:

determining at least one option associated with executing at least one action in a process, the action specifiable in an XML test case,

associating the at least one action with an executor capable of executing the at least one action; and

executing the action.

14. The method of claim 13 wherein the action comprises initializing a global testing environment.

15. The method of claim 13 wherein the action comprises initializing a testing environment for a single iteration of the test case.

16. The method of claim 13 wherein the action comprises a test operation.

17. The method of claim 13 wherein the action comprises validating the result of the test operation.

18. The method of claim 13 wherein the action comprises restoring a testing environment to a testable state.

19. A method of generating a test case comprising identifying at least one action to be taken to test software and identifying an executor capable of executing the at least one action.

20. The method of claim 19, wherein the test case is a first test case and the first test case is copied and modified to generate a second testcase.

21. The method of claim 20 wherein a test group is generated by combining the first and second test cases into a test group.

22. The method of claim 21 wherein a second test group is generated by combining the test group with a third test case to generating a second test group.

23. A computer-readable medium including computer-executable instructions for:

determining at least one option associated with executing at least one action in a process, the action specifiable in an XML test case,

associating the at least one action with an executor capable of executing the at least one action; and

executing the action.