Automatic regression testing based on cyclomatic complexity

• US 8,959,486 B2
• Filed: 01/09/2013
• Issued: 02/17/2015
• Est. Priority Date: 01/09/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, John M. Jr., Kaemmerer, John P., Trim, Craig M.
• Primary Examiner(s): Wong, Don
• Assistant Examiner(s): Talukdar, Devayani R
• Application Number:
  US13/737,425
• Publication Number:
  US 20140196011A1
• Time in Patent Office: 769 Days
• Field of Search: None
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A processor-implemented method, system, and/or computer program product automates regression testing based on cyclomatic complexity of changed code. A base code change to a software program is identified as having a particular cyclomatic complexity. Multiple different software test routines are mapped to the base code change. A specific quantity of the different software test routines are then run to test the base code change, where the quantity of test routines that is run is based on the cyclomatic complexity of the base code change.

Claims

1. A processor-implemented method of automating regression testing, the processor-implemented method comprising:

identifying, by a processor, a base code change in a software program;

receiving, by the processor, a string of binary data that represents a cyclomatic complexity of the base code change, wherein the cyclomatic complexity of the base code change is defined by a formula;

M=E−

N+P

where E=a quantity number of edges in a graph of the base code change,

N=a quantity of nodes in the graph of the base code change, and

P=a quantity of exit nodes depicted in the graph of the base code change;

mapping, by the processor, the base code change to different software test routines, wherein the different software test routines have been predetermined to test changes to the software program; and

executing, by the processor, a quantity of the different software test routines on the base code change to automatically perform regression testing on the software program, wherein the quantity of the different software test routines that are executed on the base code change is determined by the cyclomatic complexity of the base code change.

2. The processor-implemented method of claim 1, further comprising:

the processor further determining the quantity of different software test routines that are executed on the base code change based on a number of lines of changed code found in the base code change.

3. The processor-implemented method of claim 1, further comprising:

the processor further determining the quantity of different software test routines that are executed on the base code change based on whether the base code change has been predetermined to execute a new business requirement, wherein the new business requirement is from a contractual agreement to provide a new service to a customer, wherein base code changes that execute the new business requirement are tested by more of the different software test routines than base code changes that do not execute the new business requirement.

4. The processor-implemented method of claim 1, further comprising:

the processor further determining the quantity of different software test routines that are executed on the base code change based on a quantity of software routines that call the base code change.

5. The processor-implemented method of claim 1, further comprising:

the processor further determining the quantity of different software test routines that are executed on the base code change based on a quantity of downstream routines that utilize an output of the base code change, wherein a first base code change that causes an output that is used by more downstream routines than a second base code change is tested by more of the different software test routines than the second base code change whose output is used by relatively fewer downstream routines than the first base code change.

6. The processor-implemented method of claim 1, further comprising:

the processor, in response to determining that the cyclomatic complexity of the base code change exceeds a predetermined value, issuing an alert indicating that a regression test is needed on the software program.

7. The processor-implemented method of claim 1, further comprising:

the processor identifying any software routines that are called by the base code change; and

the processor automatically executing pre-identified test code on the software routines that are called by the base code change.

18. The processor-implemented method of claim 1, further comprising:

displaying, by the processor, the graph of the base code change on a display.

19. The processor-implemented method of claim 1, wherein the base code change adds new code to the software program.

20. The processor-implemented method of claim 1, wherein the base code change alters existing code from the software program.

8. A computer program product for automating regression testing, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code readable and executable by a processor to perform a method comprising:

identifying, by a processor, a base code change in a software program;

receiving, by the processor, a string of binary data that represents a cyclomatic complexity of the base code change, wherein the cyclomatic complexity of the base code change is defined by a formula;

M=E−

N+P

where E=a quantity number of edges in a graph of the base code change,

N=a quantity of nodes in the graph of the base code change, and

P=a quantity of exit nodes depicted in the graph of the base code change;

mapping, by the processor, the base code change to different software test routines, wherein the different software test routines have been predetermined to test changes to the software program; and

executing, by the processor, a quantity of the different software test routines on the base code change to automatically perform regression testing on the software program, wherein the quantity of the different software test routines that are executed on the base code change is determined by the cyclomatic complexity of the base code change.

9. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

further determine the quantity of different software test routines that are executed on the base code change based on a number of lines of changed code found in the base code change.

10. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

further determine the quantity of different software test routines that are executed on the base code change based on whether the base code change has been predetermined to execute a new business requirement, wherein base code changes that execute the new business requirement are tested by more of the different software test routines than base code changes that do not execute the new business requirement.

11. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

further determine the quantity of different software test routines that are executed on the base code change based on a quantity of software routines that call the base code change.

12. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

further determine the quantity of different software test routines that are executed on the base code change based on a quantity of downstream routines from the base code change, wherein base code changes that result in more downstream routines are tested by more of the different software test routines than base code changes that result in relatively fewer downstream routines.

13. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

in response to determining that the cyclomatic complexity of the base code change exceeds a predetermined value, issue an alert indicating that a regression test is needed on the software program.

14. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

identify any software routines that are called by the base code change; and

automatically execute pre-identified test code on the software routines that are called by the base code change.

15. A computer system comprising:

a processor, a computer readable memory, and a non-transitory computer readable storage medium;

first program instructions to identify a base code change in a software program;

second program instructions to receive a string of binary data that represents a cyclomatic complexity of the base code change, wherein the cyclomatic complexity of the base code change is defined by a formula;

M=E−

N+P

where E=a quantity number of edges in a graph of the base code change,

N=a quantity of nodes in the graph of the base code change, and

P=a quantity of exit nodes depicted in the graph of the base code change;

third program instructions to map the base code change to different software test routines, wherein the different software test routines have been predetermined to test changes to the software program; and

fourth program instructions to execute a quantity of the different software test routines on the base code change to automatically perform regression testing on the software program, wherein the quantity of the different software test routines that are executed on the base code change is determined by the cyclomatic complexity of the base code change; and

wherein the first, second, third, and fourth program instructions are stored on the non-transitory computer readable storage medium for execution by the processor via the computer readable memory.

16. The computer system of claim 15, further comprising:

fifth program instructions to further determine the quantity of different software test routines that are executed on the base code change based on a number of lines of changed code found in the base code change;

and wherein the fifth program instructions are stored on the non-transitory computer readable storage medium for execution by the processor via the computer readable memory.

17. The computer system of claim 15, further comprising:

fifth program instructions to further determine the quantity of different software test routines that are executed on the base code change based on whether the base code change has been predetermined to execute a new business requirement, wherein base code changes that execute the new business requirement are tested by more of the different software test routines than base code changes that do not execute the new business requirement;

and wherein the fifth program instructions are stored on the non-transitory computer readable storage medium for execution by the processor via the computer readable memory.