AUTOMATED TESTING SYSTEM, METHOD AND PROGRAM PRODUCT USING TESTING MAP

• US 20050203717A1
• Filed: 03/11/2004
• Published: 09/15/2005
• Est. Priority Date: 03/11/2004
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Parimi, Rakesh K.
• Application Number:
  US10/708,562
• Publication Number:
  US 20050203717A1
• Time in Patent Office: Days
• US Class Current: 702/188
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers

Abstract

A method, system and program product are disclosed for performing automatic testing of a system including a plurality of modules in which at least two modules lack a predetermined communication mechanism. In particular, the invention performs automated testing of such systems by finding and applying a logical correlation on test results for automated generation of a test map. Each test map includes a sequence of test scripts to be run by the modules and/or interface points. The test map generation can be based on test results from previous tests such that the invention learns, improves and obtains more functionality.

Claims

1. A method for performing automatic testing of a system including a plurality of modules in which at least two modules lack a predetermined communication mechanism, the method comprising the steps of:

establishing at least one test goal for testing regarding at least one of a module and an interface point between modules;

providing at least one test script configured to conduct a test at each module and each interface point;

generating a test map for each test goal, each test map configured to run at least one test script for each module and each interface point in accordance with the test goal; and

automatically testing the system using each test map.

2. The method of claim 1, further comprising the step of scoring a test result for at least one of the test goal and each test script.

3. The method of claim 2, wherein a test script is included in a test map only if the test script has a score that is greater than a threshold score.

4. The method of claim 2, wherein the generating step includes generating a test map for a given test goal only if the given test goal has a score that is greater than a threshold score.

5. The method of claim 1, further comprising the step of recording a test result for each test script.

6. The method of claim 1, further comprising the step of recording each test map.

7. The method of claim 1, further comprising the step of repeating the steps of generating and automatically testing after correction of a failure.

8. The method of claim 1, further comprising the step of modifying the test map based on a modeling rule.

9. A computer program product comprising a computer useable medium having computer readable program code embodied therein for performing automatic testing of a system including a plurality of modules in which at least two modules lack a predetermined communication mechanism, the program product comprising:

program code configured to establish at least one test goal for testing regarding at least one of a module and an interface point between modules, wherein at least one test script configured to conduct a test is provided at each module and each interface point;

program code configured to generate a test map for each test goal, each test map configured to run at least one test script for each module and each interface point in accordance with the test goal; and

program code configured to automatically test the system using each test map.

10. The program product of claim 9, further comprising the program code configured to score a test result for at least one of the test goal and each test script.

11. The program product of claim 10, wherein a test script is included in a test map only if the test script has a score that is greater than a threshold score.

12. The program product of claim 10, wherein the generating program code generates a test map for a given test goal only if the given test goal has a score that is greater than a threshold score.

13. The program product of claim 9, further comprising program code configured to modify the test map based on a modeling rule.

14. A system for performing automatic testing of a system including a plurality of modules in which at least two modules lack a predetermined communication mechanism, the system comprising:

means for establishing at least one test goal for testing regarding at least one of a module and an interface point between modules, wherein at least one test script configured to conduct a test is provided at each module and each interface point;

means for generating a test map for each test goal, each test map configured to run at least one test script for each module and each interface point in accordance with the test goal; and

means for automatically testing the system using each test map.

15. The system of claim 14, further comprising means for scoring a test result for at least one of the test goal and each test script.

16. The system of claim 15, wherein a test script is included in a test map only if the test script has a score that is greater than a threshold score.

17. The system of claim 15, wherein the generating means generates a test map for a given test goal only if the given test goal has a score that is greater than a threshold score.

18. The system of claim 14, further comprising means for recording a test result for each test script and each test map.

19. The system of claim 14, further comprising means for repeating the steps of generating and automatically testing after correction of a failure.

20. The system of claim 14, wherein the generating means includes means for modifying the test map based on a modeling rule.