SYSTEMS AND METHODS FOR MONITORING SOFTWARE APPLICATION QUALITY

• US 20090070734A1
• Filed: 09/29/2006
• Published: 03/12/2009
• Est. Priority Date: 10/03/2005
• Status: Abandoned Application

• Current Assignee: Mark Dixon, Michael Hamilton
• Original Assignee: Mark Dixon, Michael Hamilton
• Inventors: Hamilton, Michael, Dixon, Mark
• Application Number:
  US12/088,116
• Publication Number:
  US 20090070734A1
• Time in Patent Office: Days
• US Class Current: 717/102
• CPC Class Codes: G06F 11/3616 using software metrics
• CPC Class Codes: G06F 11/3676 for coverage analysis
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management

Abstract

Computer-based systems, methods and software products for monitoring software application quality comprise enabling a computer to generate a developer-identifying output identifying which software application developer (301) among a plurality of software application developers is responsible for a given software application modification in a corpus of software application code; analyzing the corpus of software application code to generate a software code quality output comprising values (303-305) for metrics of software code quality; and correlating the developer-identifying output and the software code quality output (306) to produce human-perceptible software application quality reports (309) on a per-developer basis, thereby to provide attribution of quality metric values on a per-developer basis.

Claims

1. A computer-executable system for monitoring software application quality, the system comprising:

a version control subsystem operable to generate an output identifying which software application developer among a plurality of software application developers is responsible for a given software application modification in a corpus application software;

a software code quality monitoring subsystem to generate an output comprising values for metrics of software code quality; and

an analysis module operable to correlate the version control system output and the software code quality monitoring system output to produce software application quality reports on a per-developer basis, thereby to provide attribution of quality metric values on a per-developer basis.

2. The system of claim 1 wherein the software code quality monitoring subsystem comprises a static code analyzer module operable to examine source code for errors or deviations from defined best practices.

3. The system of claim 1 wherein the software code quality monitoring subsystem comprises a unit test suite module operable to execute code under test.

4. The system of claim 3 wherein the software code quality monitoring subsystem comprises a code coverage module operable to monitor test runs, ensuring that code to be tested is actually executed during test runs.

5. The system of claim 1 wherein the version control subsystem comprises an information repository operable to store a master copy of the code and a history of source code associated with a given software application, identifying which developer is responsible for each modification.

6. The system of claim 5 wherein the version control subsystem is further operable to generate a report of which developer last modified each line of source code along with a date and time of each modification.

7. The system of claim 5 wherein the software code quality monitoring subsystem is operable to generate outputs comprising values for a plurality of metrics of software code quality.

8. The system of claim 7 wherein the metrics of software code quality comprise any of compliance violations per thousand lines of source code, percentage of code covered by unit tests, and number of failing unit tests.

9. The system of claim 8 further wherein processing of violations per thousand lines of source code comprises assigning violations to a developer by attributing all of the violations in a source file to the developer who most recently modified that source file.

10. The system of claim 9 further wherein the number of lines of source code per developer is calculated by summing the size, measured in lines, of each of the source files that were last modified by that developer.

11. The system of claim 9 further wherein processing of the percentage of code covered by unit tests metric includes reporting, for each line of source code, whether it is executable and covered, executable but not covered, or not executable.

12. The system of claim 11 further wherein the percentage of code covered by unit tests metric is defined for a software code development project as the number of covered lines divided by the number of executable lines.

13. The system of claim 12 wherein line ownership information obtained from the version control subsystem is utilized to assign every executable line to a given developer, so that the percentage of code covered by unit tests metric can be calculated on a per-developer basis.

14. The system of claim 8 wherein the analysis module is operable to assign a failing unit test to a developer, the assigning comprising:

automatically attempting to determine, utilizing the name of the unit test, the class under test which is associated with the unit test;

if the class under test can be determined, attributing the failing unit test to the developer who most recently modified the class; and

if the class under test cannot be determined, attributing the failing with test to the developer who most recently modified the unit test class itself.

15. The system of claim 14 wherein the analysis module is operable to cause re-computing of metrics after each individual check-in to the source code control system, wherein each check-in is associated with a single developer, such that that a given failure can be attributed to the developer who executed the last check-in.

16. The system of claim 14 further comprising a GUI operable to display a user-perceptible output graphically depicting values calculated for the quality metrics.

17. The system of claim 16 wherein the displaying comprises displaying metrics for an entire development team and alerts for individual developers who have exceeded a prescribed threshold for a metric, the alerts including the name of the developer, the value of the relevant metric, the number of days the alert has been firing and the value of the metric when the alert first fired.

18. The system of claim 17 wherein the GUI is further operable to display progress over time for given developers with respect to selected software code quality metrics.

19. The system of claim 1 further wherein the analysis module is operable to periodically communicate with the version control subsystem for updates to application source code, and, when changes are detected, to download revised code, re-calculate quality metrics, and store the results in a relational database.

20. The system of claim 19 further wherein the GUI comprises a network-based application operable to read data from the relational database.

21. A computer-executable method for monitoring software application quality, the method comprising:

generating a developer-identifying output identifying which software application developer among a plurality of software application developers is responsible for a given software application modification in a corpus of software application code;

analyzing the corpus of software application code to generate a software code quality output comprising values for metrics of software code quality; and

correlating the developer-identifying output and the software code quality output to produce human-perceptible software application quality reports on a per-developer basis, thereby to provide attribution of quality metric values on a per-developer basis.

22. A computer-readable software product executable on a computer to enable monitoring of software application quality, the software product comprising:

first computer-readable instructions encoded on a computer-readable medium and executable to enable the computer to generate a developer-identifying output identifying which software application developer among a plurality of software application developers is responsible for a given software application modification in a corpus of software application code;

second computer-readable instructions encoded on the computer-readable medium and executable to enable the computer to analyze the corpus of software application code to generate a software code quality output comprising values for metrics of software code quality; and

third computer-readable instructions encoded on the computer-readable medium and executable to enable the computer to correlate the developer-identifying output and the software code quality output to produce human-perceptible software application quality reports on a per-developer basis, thereby to provide attribution of quality metric values on a per-developer basis.