Low-level checking of context-dependent expected results

• US 9,274,922 B2
• Filed: 04/10/2013
• Issued: 03/01/2016
• Est. Priority Date: 04/10/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Masser, Joel L.
• Primary Examiner(s): Riad, Amine
• Application Number:
  US13/860,104
• Publication Number:
  US 20140310558A1
• Time in Patent Office: 1,056 Days
• Field of Search: 714/33
• US Class Current: 1/1
• CPC Class Codes: G06F 11/261 by simulating additional hardware, e.g. fault simulation
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3692 for test results analysis

Abstract

A processor-implemented method for diagnostic testing using an expected result parameter is provided. The processor-implemented method may include establishing a known system environment associated with a function under test and setting the expected result parameter corresponding to the function under test and the known system environment. A call is issued by the processor to execute the function under test. Before returning to the caller, the function under test compares an expected result value to an actual result value. The function under test determines an error based on the actual result value being different from the expected result value and performs a low-level diagnostic based on the determined error. Then the processor receives a return value from the function under test based on the issued call.

Claims

1. A processor-implemented method for diagnostic testing using an expected result parameter, the method comprising:

establishing, by a processor, a known system environment associated with a specific function under test;

setting, by the processor, an expected result parameter corresponding to the specific function under test and the known system environment;

issuing, by the processor, a call to execute the specific function under test, wherein the specific function under test is called by a higher-level module and the specific function under test is a lower-level module than the higher level module that called the specific function under test and the expected result parameter is passed through multiple levels of nesting modules and assigned to the specific function under test when the specific function under test is called, wherein the expected result parameter is an added parameter to an invocation statement of a function in a call stack;

comparing, by the specific function under test, the assigned expected result value to an actual result value;

determining, by the specific function under test, an error based on the actual result value being different from the assigned expected result value;

performing, by the specific function under test, a low-level diagnostic based on the determined error, wherein the performing of the low-level diagnostic comprises a capturing of a current system environment immediately following the error which includes performing a storage dump, recording a plurality of trace data, and collecting a plurality of problem documentation in retained memory; and

receiving, by the processor, a return value from the specific function under test based on the issued call.

2. The method of claim 1, wherein the expected result parameter is added to the call to execute the function under test.

3. The method of claim 1, wherein the expected result parameter includes at least one of a name of the function under test, the expected result value to be checked against the actual result value, a type of comparison, a set of conditions that are to be considered the error, a set of conditions wherein anything not in the set is to be considered the error, and an action to be taken when the error occurs.

4. The method of claim 3, wherein the actual result value comprises at least one of the return value, an error code, a message code, a message text, and a reason code.

5. The method of claim 3, wherein the comparison includes “

equal to”

or “

not equal to”

.

6. The method of claim 3, wherein the action to be taken includes capturing one of more storage areas associated with a current system environment.

7. A computer system for diagnostic testing using an expected result parameter, the computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the program instructions comprising;

program instructions to establish a known system environment associated with a specific function under test;

program instructions to set an expected result parameter corresponding to the specific function under test and the known system environment;

program instructions to issue a call to execute the specific function under test, wherein the specific function under test is called by a higher-level module and the specific function under test is a lower-level module than the higher level module that called the specific function under test and the expected result parameter is passed through multiple levels of nesting modules and assigned to the specific function under test when the specific function under test is called, wherein the expected result parameter is an added parameter to an invocation statement of a function in a call stack;

program instructions to compare an expected result value to the assigned actual result value;

program instructions to determine an error based on the assigned actual result value being different from the expected result value;

program instructions to perform a low-level diagnostic based on the determined error wherein the performing of the low-level diagnostic comprises a capturing of a current system environment immediately following the error which includes performing a storage dump, recording a plurality of trace data, and collecting a plurality of problem documentation in retained memory; and

program instructions to receive a return value from the specific function under test based on the issued call.

8. The computer system of claim 7, wherein the expected result parameter is added to the call to execute the function under test.

9. The computer system of claim 7, wherein the expected result parameter includes a name of the function under test, the expected result value to be checked against the actual result value, a type of comparison, a set of conditions that are to be considered the error, a set of conditions wherein anything not in the set is to be considered the error, and an action to be taken when the error occurs.

10. The computer system of claim 9, wherein the actual result value comprises at least one of the return value, an error code, a message code, a message text, and a reason code.

11. A computer program product for diagnostic testing using an expected result parameter, the computer program product comprising:

one or more computer-readable storage devices and program instructions stored on at least one of the one or more non-transitory tangible storage devices, the program instructions comprising;

program instructions to establish a known system environment associated with a specific function under test;

program instructions to set an expected result parameter corresponding to the specific function under test and the known system environment;

program instructions to issue a call to execute the specific function under test, wherein the specific function under test is called by a higher-level module and the specific function under test is a lower-level module than the higher level module that called the specific function under test and the expected result parameter is passed through multiple levels of nesting modules and assigned to the specific function under test when the specific function under test is called, wherein the expected result parameter is an added parameter to an invocation statement of a function in a call stack;

program instructions to compare an expected result value to the assigned actual result value;

program instructions to determine an error based on the assigned actual result value being different from the expected result value;

program instructions to perform a low-level diagnostic based on the determined error wherein the performing of the low-level diagnostic comprises a capturing of a current system environment immediately following the error which includes performing a storage dump, recording a plurality of trace data, and collecting a plurality of problem documentation in retained memory; and

program instructions to receive a return value from the function under test based on the issued call.

12. The computer program product of claim 11, wherein the expected result parameter is added to the call to execute the function under test.

13. The computer program product of claim 11, wherein the expected result value includes a name of the function under test, the expected result value to be checked against the actual result value, a type of comparison, a set of conditions that are to be considered the error, a set of conditions wherein anything not in the set is to be considered the error, and an action to be taken when the error occurs.

14. The computer program product of claim 13, wherein the actual result value comprises at least one of the return value, an error code, a message code, a message text, and a reason code.