System and method to produce business case metrics based on defect analysis starter (DAS) results
First Claim
1. A method implemented in a computer infrastructure for determining when to remove defects in a production lifecycle of a software product, the method comprising:
- receiving data including defect analysis starter (DAS)/defect reduction method (DRM) defect analysis data of a software development project to develop the software product, the DAS/DRM defect analysis data comprises a quantity of defects in the software product discovered by each of a plurality of defect triggers, each comprised of conditions under which a defect is uncovered during testing of the software product, and an estimated percentage of defect reduction in the software product after preventative actions are taken by each defect trigger;
processing the data to identify improvements which have an impact to reduce defects in the software product, and which of the improvements have a highest impact among the identified improvements to reduce defects in the software product to determine which defects to remove and when to remove them to control the number of defects in the completed software product, the processing comprising;
determining cost versus benefit received for making the improvements to provide an improved software product with a reduced number of defects,resolving defects in the software product during development of the software product before marketing the software product;
performing a calibration comprising adjusting a defect volume and a distribution by defect trigger in accordance with the received quantity of defects discovered by each defect trigger;
applying the preventative actions, after the calibration has been performed, to determine a reduction in the defect volume and the distribution by each defect trigger; and
calculating a benefit for preventing an injection of defects comprising calculating costs associated with avoidance of discovered defects and costs associated with avoidance of escaped defects according to the determined reduction in the defect volume and the distribution by each defect trigger;
determining one or more business metrics based on the data, wherein the one or more business metrics comprises the benefit for preventing the injection of defects; and
generating at least one report regarding proceeding with the development of the software product based on the one or more business metrics,wherein;
at least the step of processing the data is implemented using a processor of the computer infrastructure;
the determining the reduction in the defect volume comprises calculating a product of the percentage of defect reduction and a total defect volume of the software development project;
the one or more business metrics further comprise a benefit for shifting defect removal earlier in a life cycle of developing the software product;
for determining the benefit for shifting defect removal earlier;
the receiving the data comprises receiving a potential defect and defect distribution by triggers and the quantity of defects discovered by each trigger; and
the processing the data comprises;
shifting defects by type from a source activity to an optimally-timed discovery, wherein a defect is one of directly shifted and shifted with a defect probability table; and
calculating a shifting benefit as a defect fix cost difference between discovering one or more defects at the source activity and discovering the one or more defects at the optimally-timed discovery;
for the discovered defects, the benefit for preventing the injection of defects is the sum of a testing cost and a fix cost; and
for the escaped defects, the benefit for preventing the injection of defects is determined based on a business case,the method further comprising;
applying prevention actions to prevent an injection of defects into the software product and to shift defect removal earlier in the lifecycle of developing the software product based upon the benefit calculated for preventing the injection of defects into the software product and the benefit determined for shifting the defect removal earlier in the lifecycle of developing the software product; and
applying prevention actions to remove production defects at a time, in the production lifecycle of the software product, determined by a comparison of a first maximum potential decrease in the number of production defects if production defect removal is made in a first test phase of the production lifecycle of the software product and a second maximum potential decrease in the number of production defects if production defect removal is made in a second test phase of the production lifecycle of the software product which is subsequent to the first test phase.
1 Assignment
0 Petitions
Accused Products
Abstract
A method is implemented in a computer infrastructure having computer executable code tangibly embodied on a computer readable storage medium having programming instructions. The programming instructions are operable to receive data including defect analysis defect analysis starter (DAS)/defect reduction method (DRM) defect analysis data of a software development project and process the data. Additionally, the programming instructions are operable to determine one or more business metrics based on the data and generate at least one report based on the one or more business metrics. The one or more business metrics comprises at least one of a benefit for shifting defect removal earlier, a benefit for preventing an injection of defects, a benefit for reducing a cycle time, a benefit of reducing invalid defects and a benefit for reducing production defects.
-
Citations
22 Claims
-
1. A method implemented in a computer infrastructure for determining when to remove defects in a production lifecycle of a software product, the method comprising:
-
receiving data including defect analysis starter (DAS)/defect reduction method (DRM) defect analysis data of a software development project to develop the software product, the DAS/DRM defect analysis data comprises a quantity of defects in the software product discovered by each of a plurality of defect triggers, each comprised of conditions under which a defect is uncovered during testing of the software product, and an estimated percentage of defect reduction in the software product after preventative actions are taken by each defect trigger; processing the data to identify improvements which have an impact to reduce defects in the software product, and which of the improvements have a highest impact among the identified improvements to reduce defects in the software product to determine which defects to remove and when to remove them to control the number of defects in the completed software product, the processing comprising; determining cost versus benefit received for making the improvements to provide an improved software product with a reduced number of defects, resolving defects in the software product during development of the software product before marketing the software product; performing a calibration comprising adjusting a defect volume and a distribution by defect trigger in accordance with the received quantity of defects discovered by each defect trigger; applying the preventative actions, after the calibration has been performed, to determine a reduction in the defect volume and the distribution by each defect trigger; and calculating a benefit for preventing an injection of defects comprising calculating costs associated with avoidance of discovered defects and costs associated with avoidance of escaped defects according to the determined reduction in the defect volume and the distribution by each defect trigger; determining one or more business metrics based on the data, wherein the one or more business metrics comprises the benefit for preventing the injection of defects; and generating at least one report regarding proceeding with the development of the software product based on the one or more business metrics, wherein; at least the step of processing the data is implemented using a processor of the computer infrastructure; the determining the reduction in the defect volume comprises calculating a product of the percentage of defect reduction and a total defect volume of the software development project; the one or more business metrics further comprise a benefit for shifting defect removal earlier in a life cycle of developing the software product; for determining the benefit for shifting defect removal earlier; the receiving the data comprises receiving a potential defect and defect distribution by triggers and the quantity of defects discovered by each trigger; and the processing the data comprises; shifting defects by type from a source activity to an optimally-timed discovery, wherein a defect is one of directly shifted and shifted with a defect probability table; and calculating a shifting benefit as a defect fix cost difference between discovering one or more defects at the source activity and discovering the one or more defects at the optimally-timed discovery; for the discovered defects, the benefit for preventing the injection of defects is the sum of a testing cost and a fix cost; and for the escaped defects, the benefit for preventing the injection of defects is determined based on a business case, the method further comprising; applying prevention actions to prevent an injection of defects into the software product and to shift defect removal earlier in the lifecycle of developing the software product based upon the benefit calculated for preventing the injection of defects into the software product and the benefit determined for shifting the defect removal earlier in the lifecycle of developing the software product; and applying prevention actions to remove production defects at a time, in the production lifecycle of the software product, determined by a comparison of a first maximum potential decrease in the number of production defects if production defect removal is made in a first test phase of the production lifecycle of the software product and a second maximum potential decrease in the number of production defects if production defect removal is made in a second test phase of the production lifecycle of the software product which is subsequent to the first test phase. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system implemented in hardware comprising a processor for determining when to remove defects in a lifecycle of developing a software product, comprising:
-
a data receiving tool operable to receive data including at least one of defect analysis starter (DAS)/defect reduction method (DRM) defect analysis data, organization data and other data of a software development project to develop the software product, the DAS/DRM defect analysis data comprises a quantity of defects in the software product discovered by each of a plurality of defect triggers, each comprised of conditions under which a defect is uncovered during testing of the software product, and an estimated percentage of defects reduction in the software product after preventative actions are taken by each defect trigger; a data processing tool operable to; identify improvements which have an impact to reduce defects in the software product, and which of the improvements have a highest impact among the identified improvements to reduce defects in the software product to determine which defects to remove and when to remove them to control the number of defects in the completed software product; determine cost versus benefit received for making the improvements to provide an improved software product with a reduced number of defects, resolve defects in the software product during development of the software product before marketing the software product; perform a calibration comprising adjusting a defect volume and a distribution by trigger in accordance with the received quantity of defects discovered by each defect trigger; apply the preventative actions, after the calibration has been performed, to determine a reduction in the defect volume and the distribution by each defect trigger; calculate a benefit for preventing an injection of defects comprising calculating costs associated with avoidance of discovered defects and costs associated with avoidance of escaped defects according to the determined reduction in the defect volume and the distribution by each defect trigger; shift defects by type from a source activity to an optimally-timed discovery, wherein a defect is one of directly shifted and shifted with a defect probability table; and calculate a shifting benefit as a defect fix cost difference between discovering one or more defects at the source activity and discovering the one or more defects at the optimally-timed discovery; determine one or more business metrics based on the data, wherein the one or more business metrics comprises the benefit for preventing the injection of defects and a benefit for shifting defect removal earlier; and a report generation tool operable to generate at least one report regarding proceeding with the development of the software product based on the one or more business metrics, the system further being operable to apply prevention actions to prevent an injection of defects into the software product, based upon the benefit calculated for preventing the injection of defects into the software product, and to shift defect removal from a first time in the lifecycle of developing the software product, which is a time used to determine an initial estimate for removing defects, to a second time in the lifecycle of developing the software product, wherein the second time in the lifecycle of developing the software product is earlier in the lifecycle of developing the software product than the first time, based upon the benefit determined for shifting the defect removal earlier in the lifecycle of developing the software product. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A computer program product comprising a computer usable storage device having readable program code embodied in the storage device for determining when to remove defects in a production lifecycle of a software product, the computer program product includes at least one component operable to perform steps of:
-
receiving data including defect analysis defect analysis starter (DAS)/defect reduction method (DRM) defect analysis data of a software development project of an organization to develop the software product, the DAS/DRM defect analysis data comprises a quantity of defects in the software product discovered by each of a plurality of defect triggers, each comprised of conditions under which a defect is uncovered during testing of the software product, and an estimated percentage of defects reduction in the software product after preventative actions are taken by each defect trigger; processing the data to identify improvements which have an impact to reduce defects in the software product, and which of the improvements have a highest impact among the identified improvements to reduce defects in the software product to determine which defects to remove and when to remove them to control the number of defects in the completed software product, the processing comprising; determining cost versus benefit received for making the improvements to provide an improved software product with a reduced number of defects, resolving defects in the software product during development of the software product before marketing the software product; performing a calibration comprising adjusting a defect volume and a distribution by each defect trigger in accordance with the received quantity of defects discovered by each defect trigger; applying the preventative actions, after the calibration has been performed, to determine a reduction in the defect volume and the distribution by each defect trigger, wherein the determining the reduction in the defect volume comprises calculating a product of the percentage of defect reduction and a total defect volume of the software development project; calculating a benefit for preventing an injection of defects comprising calculating costs associated with avoidance of discovered defects and costs associated with avoidance of escaped defects according to the determined reduction in the defect volume and the distribution by each defect trigger; shifting defects by type from a source activity to an optimally-timed discovery, wherein a defect is one of directly shifted and shifted with a defect probability table; and calculating a shifting benefit as a defect fix cost difference between discovering one or more defects at the source activity and discovering the one or more defects at the optimally-timed discovery; determining one or more business metrics for the organization based on the data, wherein the one or more business metrics comprises the benefit for preventing the injection of defects and a benefit for shifting defect removal earlier; generating at least one report regarding proceeding with the development of the software product based on the one or more business metrics, applying prevention actions to prevent an injection of defects into the software product and to shift defect removal earlier in the lifecycle of developing the software product based upon the benefit calculated for preventing the injection of defects into the software product and the benefit determined for shifting the defect removal earlier in the lifecycle of developing the software product; and applying prevention actions to remove production defects at a time, in the production lifecycle of the software product, determined by a comparison of a first maximum potential decrease in the number of production defects if production defect removal is made in a first test phase of the production lifecycle of the software product and a second maximum potential decrease in the number of production defects if production defect removal is made in a second test phase of the production lifecycle of the software product which is subsequent to the first test phase. - View Dependent Claims (20, 21)
-
-
22. A computer system for classifying automated code inspection services defect output for determining when to remove defects in a lifecycle of developing a software product, the system comprising:
-
a CPU, a computer readable memory and a computer readable storage media; first program instructions to receive data including defect analysis starter (DAS)/defect reduction method (DRM) defect analysis data of a software development project of an organization to develop the software product, the DAS/DRM defect analysis data comprises a quantity of defects in the software product discovered by each of a plurality of defect triggers, each comprised of conditions under which a defect is uncovered during testing of the software product, and an estimated percentage of defects reduction in the software product after preventative actions are taken by each defect trigger, wherein the receiving the data comprises receiving a potential defect and defect distribution by triggers and the quantity of defects discovered by each trigger; second program instructions to process the data to identify improvements which have an impact to reduce defects in the software product, and which of the improvements have a highest impact among the identified improvements to reduce defects in the software product to determine which defects to remove and when to remove them to control the number of defects in the completed software product, to determine cost versus benefit received for making the improvements to provide an improved software product with a reduced number of defects, to resolve defects in the software product during development of the software product before marketing the software product, and to determine one or more business metrics of the organization based on the data, the one or more business metrics comprises a benefit for preventing an injection of defects and a benefit for shifting defect removal earlier, wherein the processing the data comprises; performing a calibration comprising adjusting a defect volume and a distribution by each defect trigger in accordance with the received quantity of defects discovered by each defect trigger; applying the preventative actions, after the calibration has been performed, to determine a reduction in the defect volume and the distribution by each defect trigger, wherein the determining the reduction in the defect volume comprises calculating a product of the percentage of defect reduction and a total defect volume of the software development project; calculating the benefit for preventing the injection of defects comprising calculating costs associated with avoidance of discovered defects and costs associated with avoidance of escaped defects according to the determined reduction in the defect volume and the distribution by each defect trigger; for discovered defects, the benefit for preventing the injection of defects is the sum of a testing cost and a fix cost; for escaped defects, the benefit for preventing the injection of defects is determined based on a business case; shifting defects by type from a source activity to an optimally-timed discovery, wherein a defect is one of directly shifted and shifted with a defect probability table; and calculating a shifting benefit as a defect fix cost difference between discovering one or more defects at the source activity and discovering the one or more defects at the optimally-timed discovery; third program instructions to generate at least one report regarding proceeding with the development of the software product based on the one or more business metrics, and fourth program instructions to apply prevention actions to prevent an injection of defects into the software product, based upon the benefit calculated for preventing the injection of defects into the software product, and to shift defect removal from a first time in the lifecycle of developing the software product, which is a time used to determine an initial estimate for removing defects, to a second time in the lifecycle of developing the software product, wherein the second time in the lifecycle of developing the software product is earlier in the lifecycle of developing the software product than the first time, based upon the benefit determined for shifting the defect removal earlier in the lifecycle of developing the software product, wherein the first, second, third and fourth program instructions are stored on the computer readable storage media for execution by the CPU via the computer readable memory.
-
Specification