Auto-recording tool for developing test harness files

• US 7,702,958 B2
• Filed: 05/24/2005
• Issued: 04/20/2010
• Est. Priority Date: 05/24/2005
• Status: Expired due to Fees

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Alcatel-Lucent USA, Inc. (Nokia Corporation)
• Inventors: Suen, Lai-Cherng, Kwong, Man K., Kwong, Roberta C., Wang, Chen-Wan
• Primary Examiner(s): Lohn, Joshua A
• Assistant Examiner(s): KO, CHAE M
• Application Number:
  US11/135,707
• Publication Number:
  US 20060271824A1
• Time in Patent Office: 1,792 Days
• Field of Search: 714/38, 714/46, 715700-866
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A test harness development component streamlines the design of regression test harnesses for testing text-based software. An auto-recording tool to automatically record the input and output data in an actual run of the testing session and to automatically generate a test harness. The test harness development component provides an auto-executing tool to automatically run the test harness in subsequent regression tests. The test harness language is used to specify the tests, validation rules of the results, and any other rules for running the test of a test harness. The test harness language is human-readable and emulates the manual test procedures with very little overhead.

Claims

1. A method, comprising the steps of:

a.) recording a number of statements from a user, wherein the statements comprise automated regression test harness commands;

b.) passing the statements to an external auto-executing tool for testing a program with the statements;

c.) executing the statement under control of the auto-executing tool so as to perform a test of the statement;

d.) capturing and displaying results of the test;

e.) filtering unwanted portions of the results of the test to create a filtered output wherein filtering unwanted portions of the results comprises removing portions of the results of the test before the filtered results are stored to a file wherein filtering unwanted portions of the results further comprises a default filter configured to filter results before the filtered output is stored to a file wherein filtering results comprises performing at least one of suppressing, altering and converting results wherein the default filter filters a first set of characters as applied to the results, and further comprising an override filter that filters a second set of characters, wherein the override filter is used to filter the results for one command, and subsequent results are filtered using the default filter;

f.) selecting, from the statements, a statement to be saved in a test harness file as an automated regression test harness command;

g.) saving the selected statement in a test harness file

h.) saving the filtered output as a benchmark file.

2. The method of claim 1, wherein the unwanted portions of the results of the test comprise one or more of a date, computer name, software name, or software version.

3. The method of claim 1, wherein the filtered output comprises a benchmark for a regression test of the program.

4. The method of claim 1 wherein filtering unwanted portions of the results further comprises performing at least one of suppressing and altering test results.

5. The method of claim 1 wherein the step of passing the statements comprising automated regression test harness commands to the auto-executing tool is automatically carried out upon recording the statement in step a.) and upon receipt of the command the auto-executing tool translates the commands into specific operating instructions.

6. The method of claim 1 further comprising the step of recording a statement in step a.) which includes the test results.

7. The method of claim 1 further comprising the step of testing a statement recorded in step a.) prior to selecting the statement in step b.).

8. The method of claim 1 further comprising the step of testing the statement selected in step b.) prior to performing step c.).

9. The method of claim 1 further comprising the step of closing the file so as to generate an automatic regression test harness file.

10. The method of claim 1 further comprising the step of repeating steps f.) and g.) to save a series of tests in the test harness file.

11. The method of claim 10 further comprising the step of saving to the test harness file a test name.

12. The method of claim 1 wherein filtering unwanted portions further comprises specifying output that is to be filtered.

13. The method of claim 12 wherein filtering unwanted portions further comprises converting identified output to selected character strings.

14. The method of claim 1 wherein passing the statements to an external auto-executing tool comprises passing an input data stream that has not been saved to a file and where the input data stream is parsed into commands from an auto-recording tool to the external auto-executing tool to be executed by the external auto-executing tool.

15. An apparatus, comprising:

one or more processors, one or more interface components, and one or more storage devices for displaying a graphical user interface including a record panel, a playback panel, an output panel, and at least one program button;

wherein the one or more interface components comprise an input device for inputting a series of commands for a test harness file, specified by a user;

wherein the record panel is configured to display the series of commands;

wherein the output panel is configured to display a filtered output based on an execution of the series of commands wherein the filtered output comprises output comprised of test results with unwanted portions removed from the output before the output is stored in a file;

wherein the one or more interface components display indicators adjacent to each of the series of commands in the record panel which, when activated, copy the indicated command to the playback panel;

wherein the one or more interface components display at least one program button comprising a “

Save”

button which, when activated, saves the commands in the playback panel to a test harness file;

wherein the apparatus further comprises a default filter configured to filter output before the output is stored to a file wherein filtering the output comprises performing at least one of suppressing, altering and converting the output wherein the default filter filters a first set of characters as applied to the output; and

the apparatus further comprises an override filter that filters a second set of characters, wherein the override filter is used to filter the output for one command, and subsequent command output filtered using the default filter.

16. The apparatus of claim 15 further comprising:

a title window for entering a title of the test harness file; and

wherein the playback panel initially comprises all the commands in the test harness file specified to be read via a load button, and wherein left-clicking a button displayed next to a command displayed in the playback panel re-executes the command, and wherein right-clicking the button next to the command recalls the command in a command entry window.

17. The apparatus of claim 16 further comprising the command entry window for entering a command to be executed and a command copy selector for copying a selected command into the command entry window.

18. The apparatus of claim 15 wherein:

the apparatus further comprises an external auto-executing tool, and

the indicators adjacent to each of the series of commands, when activated, pass the command to the auto-executing tool for execution under control of the auto-executing tool.

19. The apparatus of claim 18, further comprising:

a filter tool;

wherein the auto-executing tool executes the series of commands to generate a series of results;

wherein the filter tool filters unwanted portions of the series of results to generate the filtered output.

20. The apparatus of claim 19, wherein the filtered output comprises a benchmark for a regression test of the program.

21. The apparatus of claim 19, wherein the unwanted portions of the series of results comprise one or more of a date, computer, name, software name, or software version.

22. The apparatus of claim 15 wherein the apparatus is configured to filter output by performing at least one of suppressing, altering and converting test results where the output is filtered before the output is stored to a file.

23. The apparatus of claim 15 wherein the apparatus is configured to filter output by converting identified output to selected character strings where the output is converted before the output is stored in a file.