Testing flow control at test assertion level

• US 7,284,237 B2
• Filed: 11/26/2003
• Issued: 10/16/2007
• Est. Priority Date: 11/26/2003
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Schmitt, Andreas Simon, Blumenthal, Andreas, Staader, Juergen, Ziegler, Klaus
• Primary Examiner(s): STEELMAN, MARY J
• Application Number:
  US10/723,769
• Publication Number:
  US 20050114839A1
• Time in Patent Office: 1,420 Days
• Field of Search: 717/141, 717/144, 717/157
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3672 Test management

Abstract

Techniques for test flow control include providing a test hierarchy, the test hierarchy includes a collection of test methods, each test method calling test assertion methods for checking the correctness of production code, and each test assertion call defines the test execution flow within the test hierarchy in an event of a failure. The flow inside the test hierarchy is controlled according to a parameter of the test assertion method call, in response to the event.

Claims

1. A method comprising:

providing a test hierarchy implemented in a common source unit including production source code and test source code, the test hierarchy including a collection of test methods, a test method in the collection of test methods including test source code specifying a call to a test assertion method for testing the production source code, the test assertion call defining a test execution flow within the test hierarchy in an event of a failure; and

controlling the test execution flow inside the test hierarchy in the event of failure according to a parameter value of the call to the test assertion method, the parameter values available for controlling the test execution flow including values specifying;

continuing the test execution flow with a next statement in the test method;

interrupting the test execution flow of the test method and continuing the test execution flow with any remaining test methods in the test hierarchy; and

interrupting the test execution flow of a test class containing the test method and continuing the test execution flow with any remaining test classes in the test hierarchy.

2. The method of claim 1 wherein the parameter causes instructions to continue or to abort at any level of the test hierarchy after the event.

3. The method of claim 1 wherein a test assertion method includes instructions for verifying an expected state of the production source code.

4. The method of claim 1 wherein the test hierarchy is implemented using an object oriented programming language.

5. The method of claim 1 wherein the test hierarchy is implemented using a procedural programming language including at least one of C programming language, Fortran programming language and Pascal programming language.

6. The method of claim 1 wherein the test hierarchy is implemented in a unit test environment.

7. The method of claim 1, wherein the parameter values available for controlling the test execution flow include a value specifying:

interrupting the test execution flow of a program frame containing the test method and continuing the test execution flow with any remaining program frames in the test hierarchy.

8. A computer program product, tangibly embodied in a machine-readable storage device, the computer program product comprising instructions operable to:

provide a test hierarchy implemented in a common source unit including production source code and test source code, the test hierarchy including a collection of test methods, a test method in the collection of test methods including test source code specifying a call to a test assertion method for testing the production source code, the test assertion call defining a test execution flow inside the test hierarchy in an event of failure detection; and

control the test execution flow within the test hierarchy in the event of failure according to a parameter value of the call to the test assertion method, the parameter values available for controlling the test execution flow including values specifying;

continuing the test execution flow with a next statement in the test method;

interrupting the test execution flow of the test method and continuing the test execution flow with any remaining test methods in the test hierarchy; and

interrupting the test execution flow of a test class containing the test method and continuing the test execution flow with any remaining test classes in the test hierarchy.

9. The product of claim 8 wherein the parameter causes the test execution flow to continue or to abort at any level of the test hierarchy after the occurrence of the event.

10. The product of claim 8 wherein a test assertion method includes instructions for verifying an expected state of the production source code.

11. The product of claim 8 wherein the test hierarchy is implemented using an object oriented programming language.

12. The product of claim 8 wherein the test hierarchy is implemented using a procedural programming language including at least one of C programming language, Fortran programming language and Pascal programming language.

13. The product of claim 8 wherein the test hierarchy is implemented in a unit test environment.

14. The product of claim 8, wherein the parameter values available for controlling the test execution flow include a value specifying:

interrupting the test execution flow of a program frame containing the test method and continuing the test execution flow with any remaining program frames in the test hierarchy.

15. A computer system comprising:

a processor for executing program instructions; and

one or more memory devices storing program instructions implementing a test hierarchy implemented in a common source unit including production source code and test code, the test hierarchy including a collection of test methods, a test method in the collection of test methods including test source code specifying a call to a test assertion method for testing the production source code, the test assertion call defining the test execution flow within the test hierarchy in an event of a failure,

the one or more memory devices further storing program instructions operable to control a flow inside the test hierarchy in the event of failure according to a parameter value of the call to the test assertion method, the parameter values available for controlling the test execution flow including values specifying;

continuing the test execution flow with a next statement in the test method;

interrupting the test execution flow of the test method and continuing the test execution flow with any remaining test methods in the test hierarchy; and

interrupting the test execution flow of a test class containing the test method and continuing the test execution flow with any remaining test classes in the test hierarchy.

16. The system of claim 15 wherein the parameter causes the test execution to continue or to abort at any level of the test hierarchy after the event.

17. The system of claim 15 wherein a test assertion method includes instructions for verifying an expected state of the production source code.

18. The system of claim 15 wherein the test hierarchy is implemented using an object oriented programming language.

19. The system of claim 15 wherein the test hierarchy is implemented using a procedural programming language including at least one of C programming language, Fortran programming language and Pascal programming language.

20. The system of claim 15 wherein the test hierarchy is implemented in a unit test environment.

21. The system of claim 15, wherein the parameter values available for controlling the test execution flow include a value specifying:

interrupting the test execution flow of a program frame containing the test method and continuing the test execution flow with any remaining program frames in the test hierarchy.