Remotely driven system for multi-product and multi-platform testing

• US 20030140138A1
• Filed: 01/24/2002
• Published: 07/24/2003
• Est. Priority Date: 01/24/2002
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wood, Jeremie, Mi, Hongcheng, Wrayno, Gary M., Dygon, John G.
• Granted Patent: US 7,299,451 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A system and method for automated testing of software products for use in a multi-platform and multi-product environment. The system comprises a series of databases in combination with a kernel of executable code for automatically running the testing process and displaying the test results. The system can be accessed via a web browser user interface.

Claims

1. A method for automated testing of software products in a multi-platform and multi-product environment comprising the steps of:

selecting a list of at least one test case by a user via a user interface;

storing said list in a queue;

executing said test cases contained on said list automatically at specified times; and

storing output information generated by said software products.

2. The method as set forth in claim 1, wherein the step of executing said test cases contained on said list automatically at a specified time further comprises the steps of:

retrieving location and attribute information about said test case from a database;

using said location and attribute information to extract said test case,

applying input information associated with said test case to said software product.

3. The method as set forth in claim 1, wherein the step of selecting a list of at least one test case by a user via a user interface further comprises the steps of:

selecting a product to be tested by said test case; and

selecting the platform for said software product to operate

4. A method as set forth in claim 1, further comprising the step of:

evaluating said output information generated by said software product to determine whether said product is operating as properly.

5. A method as set forth in claim 1, further comprising the step of:

displaying said output information on a web page accessible through an internet user interface.

6. The method as set forth in claim 1, wherein the step of applying input information associated with said test case to said software product further comprises the steps of:

retrieving a batch file containing execution commands;

running said execution commands;

providing said input information as specified in said execution commands to said application; and

receiving source code output from said product.

7. A system for automated remote testing of software products in a multi-product and multi-platform environment, comprising:

a series of databases;

a kernel containing executable code for automatically running the testing process, and

a user interface.

8. A system as set forth in claim 7, wherein the series of databases further comprises:

a platform preference database for maintaining data on various platforms the system can operate on;

a product description containing data on the various software products that can be tested;

an test definition database containing information on the test cases that can be executed; and

a test result database containing information on the results of the testing procedure.

9. A system as set forth in claim 7, wherein the said kernel further comprises:

a remote execution engine for executing batch files to run test cases;

a test execution queue containing user instructions to the remote execution engine on which batch files to execute to run user selected test cases.

10. A system as set forth in claim 9, wherein the kernel further comprises:

a code preparation module for evaluating the results of said test cases.

11. A system as set forth in claim 7, further comprising a web page for displaying the results in a format accessible by a user using an internet browser.

12. A system as set forth in claim 7, wherein said test cases are “

self-checking.”

13. A computer program product for automated remote testing of a software product in a multi-product and multi-platform environment, comprising computer executable instructions for:

storing identifying information for a list of user selected test cases in a queue;

extracting said test case from a specified location using said information;

executing said test case;

storing the output generated from the execution of said test case.

14. A computer program product as set forth in claim 13, wherein the computer executable instructions for executing said test case further comprise instructions for:

using identifying information in said queue to retrieve a batch file containing execution commands;

running said execution commands;

providing said input information as specified in said execution commands to the said software product; and

accepting source code output from said software product.

15. A computer program product as set forth in claim 13, wherein the computer executable instructions for storing the output generated from the execution of said test case further comprises instructions for:

compiling said source code output for processing; and

processing said compiled source code.

16. A computer program product as set forth in claim 13, wherein the computer executable instructions for processing said compiled source code further comprises instructions for:

comparing said output with pre-established expected output;

determining results based upon whether said software product passed, partially passed or failed the testing process; and

providing said results to the user.

17. A computer program product as set forth in claim 15, further comprising instructions for displaying said results on a web page.