Determination of software functionality

• US 5,905,856 A
• Filed: 10/18/1996
• Issued: 05/18/1999
• Est. Priority Date: 02/29/1996
• Status: Expired due to Fees

• Current Assignee: BT Financial Group Pty Limited (Westpac Banking Corporation)
• Original Assignee: Bankers Trust Australia Limited
• Inventors: Ottensooser, Avner Benjamin
• Primary Examiner(s): Palys, Joseph E.
• Application Number:
  US08/733,441
• Time in Patent Office: 942 Days
• Field of Search: 395/183.14, 395/183.21, 395/183.22, 395/185.1, 395/183.13, 395/704, 395/183.08, 395/183.09, 395/185.02
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A method of determining the functionality of a software system includes inputting a test plan to the software system via a software testing interface program, and logging an indication of one or more resulting outputs of the software system compared to expected output(s). The test plan invokes a sequence of test scripts and includes associated parameter inputs for the test scripts, and an expected output of the function or transaction of each test script. The test scripts are selected from a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed.

Claims

1. A method of determining the functionality of a software system, including:

inputting a test plan to the software system via a software testing interface program and writing the test plan; and

logging an indication of one or more resulting outputs of the software system compared to expected output(s);

wherein said test plan invokes a sequence of test scripts and includes associated parameter inputs for the test scripts, and an expected output of a function or transaction of each test script, which test scripts are selected from a set of test scripts each able, when input to the software system via the software testing interface program, to prompt performance of a transaction or function for which the software system is designed; and

wherein said inputting of the test plan to the software system utilises user interface software which communicates with the software testing interface program as if it were a recording made earlier by the software testing interface program.

2. A method according to claim 1 further including preparing said test plan.

3. A method according to claim 2 further including preparing said set of test scripts.

4. A method according to claim 1 wherein the user interface software invokes each test script of said sequence of test scripts in the test plan and presents each script to the software testing interface program so that the latter also reads the script as a recording made earlier by the software testing interface program.

5. A method according to claim 1 wherein the user interface software includes at least a graphical user interface, a test script definition language parser, a test plan parser which generates a set of action codes for each test plan, and an interpreter which responds to the action codes and interacts with the software system under test.

6. A method according to claim 1 wherein the user interface software checks the test plans for syntax errors prior to running.

7. A method according to claim 1 wherein the parameter inputs for test scripts after the first include parameter inputs derived from recorded outputs of earlier test scripts.

8. A method according to claim 1 wherein running of each of the test plans includes recordal of an inheritance file containing the values returned by test scripts while the test plan was running.

9. A method according to claim 1 wherein said test scripts are written in a simple programming language, and include a mix of general routines selected from the language, and routines specific to said software system.

10. A method according to claim 1 wherein the inputting and logging steps are carried out in computer apparatus in which the software testing interface program is installed and which includes memory means in which the test scripts and test plans are stored.

11. A method according to claim 1 further including generating a response indicative of functionality of the software system.

12. A method of determining the functionality of a software system, including:

inputting a test plan to the software system via a software testing interface program and writing the test plan; and

logging an indication of one or more resulting outputs of the software system compared to expected output(s);

wherein said test plan invokes a sequence of test scripts and includes associated parameter inputs for the test scripts, and an expected output of a function or transaction of each test script, which test scripts are selected from a set of test scripts each able, when input to the software system via the software testing interface program, to prompt performance of a transaction or function for which the software system is designed; and

wherein the test plan is written in a characteristic language utilizing names for the respective test scripts, an established sequence for parameter inputs, identifiers for the respective parameters, parameter generator notation, and parameter broker notation instructing derivation of parameter inputs from recorded outputs of other test scripts.

13. A method according to claim 12 wherein the parameter inputs for test scripts after the first include parameter inputs derived from recorded outputs of earlier test scripts.

14. A method according to claim 12 wherein running of each of the test plans includes recordal of an inheritance file containing the values returning by test scripts while the test plan was running.

15. A method according to claim 12 wherein said test scripts are written in a simple programming language, such as visual basic, and include a mix of general routines selected from the language, and routines specific to said software system.

16. A method according to claim 12 further including preparing said test plan.

17. A method according to claim 16 further including preparing said set of test scripts.

18. A method according to claim 12 wherein the inputting and logging steps are carried out in computer apparatus in which the software testing interface program is installed and which includes memory means in which the test scripts and test plans are stored.

19. A method according to claim 12 further including generating a response indicative of functionality of the software system.

20. A method of determining the functionality of a software system, including:

inputting a test plan to the software system via a software testing interface program and writing the test plan; and

logging an indication of one or more resulting outputs of the software system compared to expected output(s);

wherein said test plan invokes a sequence of test scripts and includes associated parameter inputs for the test scripts, and an expected output of a function or transaction of each test script, which test scripts are selected from a set of test scripts each able, when input to the software system via the software testing interface program, to prompt performance of a transaction or function for which the software system is designed; and

wherein the test scripts are characterised if their operation for a first user affects other users of said software system.

21. A method according to claim 20 further including preparing said test plan.

22. A method according to claim 21 further including preparing said set of test scripts.

23. A method according to claim 20 wherein the parameter inputs for test scripts after the first include parameter inputs derived from recorded outputs of earlier test scripts.

24. A method according to claim 20 wherein running of each of the test plans includes recordal of an inheritance file containing the values returned by test scripts while the test plan was running.

25. A method according to claim 20 wherein said test scripts are written in a simple programming language, such as visual basic, and include a mix of general routines selected from the language, and routines specific to said software system.

26. A method according to claim 20 wherein the inputting and logging steps are carried out in computer apparatus in which the software testing interface program is installed and which includes memory means in which the test scripts and test plans are stored.

27. A method according to claim 20 further including generating a response indicative of functionality of the software system.

28. Computer apparatus for determining the functionality of a software system, including:

first memory means to store a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed;

second memory means to store one or more test plans each invoking a sequence of said test scripts and including associated parameter inputs for the test scripts and an expected output of the transaction or function of each test script;

computing means, including installed user interface software and an installed software testing interface program, and operatively connectable to said first and second memory means, for selectively inputting and running the test plan(s) to the software system via the software testing interface program, said user interface software communicating with the software testing interface program as if it were a recording made earlier by the software testing interface program; and

logging means for logging an indication of one or more resulting outputs of the software system compared to expected output(s).

29. Apparatus according to claim 28 wherein, in use of the apparatus, the user interface software invokes the test script identified in the test plan and presents each script to the software testing interface program so that the latter also reads the script as a recording made earlier by the software testing interface program.

30. Apparatus according to claim 28 wherein the parameter inputs for test scripts after the first include parameter inputs derived from recorded outputs of earlier test scripts.

31. Apparatus according to claim 28 wherein the test plans include generator utility functions to uniquely generate and/or identify parameter values.

32. Apparatus according to claim 28 wherein the test plan(s) are written in a characteristic language utilising names for the respective test scripts, an established sequence for parameter inputs, identifiers for the respective parameters, parameter generator notation, and parameter broker notation instructing derivation of parameter inputs from recorded outputs of other test scripts.

33. Apparatus according to claim 28, further including third memory means to store an inheritance file containing the values returned by test scripts while the test plan was running.

34. Apparatus according to claim 28 wherein the user interface software includes at least a graphical user interface, a test script definition language parser, a test plan parser which generates a set of action codes for each test plan, and an interpreter which responds to the action codes and interacts with the software system.

35. Apparatus according to claim 28 wherein the test scripts are characterised if their operation for a first user affects other users of said software system.

36. Apparatus according to claim 28 wherein the user interface software includes provision to check the test plan(s) for syntax errors prior to running.

37. A method of determining the functionality of a software system, including:

inputting a test plan to the software system via a software testing interface program; and

logging an indication of one or more resulting outputs of the software system compared to expected output(s);

wherein said test plan invokes a sequence of test scripts selected from a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed; and

wherein said inputting of the test plan to the software system utilises user interface software which presents each test script to the software testing interface program so that the latter reads the script as if it were a recording made earlier by the software testing interface program.

38. A method according to claim 37 wherein the parameter inputs for test scripts after the first include parameter inputs derived from recorded outputs of earlier test scripts.

39. A method according to claim 37 wherein generator utility functions are employed in test plans to uniquely generate and/or identify parameter values.

40. A method according to claim 37 wherein the test plans are written in a characteristic language utilising names for the respective test scripts, an established sequence for parameter inputs, identifiers for the respective parameters, parameter generator notation, and parameter broker notation instructing derivation of parameter inputs from recorded outputs of other test scripts.

41. A method according to claim 37 wherein running of each of the test plans includes recordal of an inheritance file containing the values returned by test scripts while the test plan was running.

42. A method according to claim 37 wherein said test scripts are written in the language of the software system under test, and include a mix of general routines selected from the language, and routines specific to said software system.

43. A method according to claim 37 wherein the user interface software includes at least a graphical user interface, a test script definition language parser, a test plan parser which generates a set of action codes for each test plan, and an interpreter which responds to the action codes and interacts with said software system.

44. A method according to claim 37 wherein the test scripts are characterised if their operation for a first user affects other users of said software system.

45. A method according to claim 37 wherein the user interface software checks the test plans for syntax errors prior to running.

46. A method according to claim 37 wherein the inputting and logging steps are carried out in computer apparatus in which the test scripts and test plans are stored in memory means and in which the software testing program is installed and logging steps are carried out in computer apparatus in which the software testing interface program is installed and which includes memory means in which the test scripts and test plans are stored.

47. A method according to claim 37 further including generating a response indicative of functionality of the software system.

48. Computer apparatus for determining the functionality of a software system, including:

first memory means to store a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed;

second memory means to store one or more test plans each invoking a sequence of said test scripts;

computing means, including installed user interface software and an installed software testing interface program, and operatively connectable to said first and second memory means, for selectively inputting the test plan(s) to the software system via the software testing interface program and running the test plan; and

logging means for logging an indication of one or more resulting outputs of the software system compared to expected output(s);

wherein the user interface software is arranged for presenting each test script to the software testing interface program so that the latter if it were a recording made earlier by the software testing interface program.

49. Apparatus according to claim 48 wherein the parameter inputs for test scripts after the first include parameter inputs derived from recorded outputs of earlier test scripts.

50. Apparatus according to claim 48 wherein the test plans include generator utility functions to uniquely generate and/or identify parameter values.

51. Apparatus according to claim 48 wherein the test plan(s) are written in a characteristic language utilising names for the respective test scripts, an established sequence for parameter inputs, identifiers for the respective parameters, parameter generator notation, and parameter broker notation instructing derivation of parameter inputs from recorded outputs of other test scripts.

52. Apparatus according to claim 48, further including third memory means to store an inheritance file containing the values returned by test scripts while the test plan was running.

53. Apparatus according to claim 48 wherein the user interface software includes at least a graphical user interface, a test script definition language parser, a test plan parser which generates a set of action codes for each test plan, and an interpreter which responds to the action codes and interacts with said software system.

54. Apparatus according to claim 48 wherein the test scripts are characterised if their operation for a first user affects other users of said software system.

55. Apparatus according to claim 48 wherein the user interface software includes provision to check the test plan(s) for syntax errors prior to running.

56. Computer apparatus for determining the functionality of a software system, including;

first memory means to store a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed;

second memory means to store one or more test plans each invoking a sequence of said test scripts and including associated parameter inputs for the test scripts and an expected output of the transaction or function of each test script, wherein the test plan(s) are written in a characteristic language utilizing names for the respective test scripts, an established sequence for parameter inputs, identifiers for the respective parameters, parameter generator notation, and parameter broker notation instructing derivation of parameter inputs from recorded outputs of other test scripts;

computing means, including installed user interface software and an installed software testing interface program, and operatively connectable to said first and second memory means, for selectively inputting and running the test plan(s) to the software system via the software testing interface program; and

logging means for logging an indication of one or more resulting outputs of the software system compared to expected output(s).

57. Computer apparatus for determining the functionality of a software system, including:

first memory means to store a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed;

second memory means to store one or more test plans each invoking a sequence of said test scripts and including associated parameter inputs for the test scripts and an expected output of the transaction or function of each test script;

computing means, including installed user interface software and an installed software testing interface program, and operatively connectable to said first and second memory means, for selectively inputting and running the test plan(s) to the software system via the software testing interface program; and

logging means for logging an indication of one or more resulting outputs of the software system compared to expected output(s);

wherein the user interface software includes at least a graphical user interface, a test script definition language parser, a test plan parser which generates a set of action codes for each test plan, and an interpreter which responds to the action codes and interacts with said software system.

58. Computer apparatus for determining the functionality of a software system, including;

first memory means to store a set of test scripts each able, when input to the software system via a software testing interface program, to prompt performance of a transaction or function for which the software system is designed, which test scripts are characterised if their operation for a first user affects other users of said software system;

second memory means to store one or more test plans each invoking a sequence of said test scripts and including associated parameter inputs for the test scripts and an expected output of the transaction or function of each test script;

computing means, including installed user interface software and an installed software testing interface program, and operatively connectable to said first and second memory means, for selectively inputting and running the test plan(s) to the software system via the software testing interface program; and

logging means for logging an indication of one or more resulting outputs of the software system compared to expected output(s).