Testing measurements

• US 20030135843A1
• Filed: 11/14/2002
• Published: 07/17/2003
• Est. Priority Date: 12/20/2001
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Sluiman, Harm, Paternostro, Marcelo
• Granted Patent: US 7,299,453 B2
• Time in Patent Office: Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

Embodiments of the invention include a testing measurement which output a non-binary test result for one or more steps or processes performed during execution of a test of a subject. The non-binary test result, which may be output by a verification point or a test script, provides a developer with an improved gauge of the subject under test. In embodiments of the present invention, a test script or verification point will, rather than simply generate a “pass” or “fail” (i.e., “successful” or “unsuccessful”) output, generate a non-boolean value providing data with improved correlation between the test output and the relative success of a test script. In some embodiments, each verification point or test script can be associated with a rule for determining the test output which can be easily modified. This aspect provides users with an ability to carefully develop and implement a test result rule which provides output which enhances test output data analysis.

Claims

1. A verification point for use in a test script, said verification point adapted to output a non-binary value.

2. The verification point of claim 1 comprising a verification rule, said verification rule generating said non-binary value from calculations performed on input received from at least one process.

3. The verification point of claim 2 further comprising a data type, wherein said non-binary value output by said verification point is defined by said data type.

4. The verification point of claim I wherein said verification point is adapted to output a plurality of non-binary values.

5. The verification point of claim 4 wherein said plurality of non-binary values output by said verification point may be of differing data types.

6. A test script for testing a computer application in whole or in part, said test script comprising a verification point, said verification point outputting a non-binary value.

7. The test script of claim 6 wherein said verification point comprises a verification rule generating said non-binary value from calculations performed on input received from at least one process.

8. The test script for testing a computer application, said test script adapted to output at least one non-binary value.

9. A test tool for generating a test script for testing a computer application in whole or in part, said test tool adapted to generate a test script which outputs a non-binary value.

10. The test tool of claim 9 wherein said test script comprises one or more verification points, wherein at least one of said one more or verification point is adapted to output a non-binary value.

11. The test tool of claim 9 further adapted to generate a test script outputting a plurality of non-binary values.

12. A method for generating a test script said method comprising:

creating a verification point for receiving data responsive to execution of an instruction, wherein said verification point is adapted to output a non-binary value representative of execution of said instruction.

13. The method of claim 12 wherein said verification point is further adapted to output a plurality of non-binary values.

14. The method of claim 12 wherein said test script is adapted to output a non-binary value representative of execution of said test script.

15. A computer readable media containing data and instructions, said data and instructions when executed by a computer system adapt said computer system to:

generate a test script for testing a computer application in whole or in part, which outputs a non-boolean value.

16. The computer readable media of claim 15 wherein said test script comprises one or more verification points, wherein at least one of said one more or verification point is adapted to output a non-boolean value.

17. The computer readable media of claim 16 wherein said test script outputs a plurality of non-boolean values.

18. A computer readable media containing data and instructions, said data and instructions when executed by a computer system adapt said computer system to:

create a verification point for receiving data responsive to execution of an instruction, wherein said verification point is adapted to output a non-binary value representative of execution of said instruction.

19. The computer readable media of claim 18 wherein said verification point is further adapted to output a plurality of non-binary values.

20. The computer readable media of claim 19 wherein said test script is adapted to output a non-binary value representative of execution of said test script.

21. A verification point for use in a test script, said verification point comprising a means for outputting a non-binary value.

22. The verification point of claim 21 further comprising a verification rule, said verification rule generating said non-binary value from calculations performed on input received from at least one process.

23. The verification point of claim 22 further comprising a data type, wherein means for outputting said non-binary value outputs data conforming to said data type.

24. A test tool for generating a test script for testing a computer application in whole or in part, said test tool adapted to generate a test script comprising means for outputting a non-binary value.

25. The test tool of claim 24 wherein said test script comprises one or more verification points, wherein at least one of said one more or verification point comprises means for outputting a non-binary value.

26. The test tool of claim 24 further adapted to generate a test script comprising means for outputting a plurality of non-binary values.