Probationary software tests
First Claim
Patent Images
1. A computer program product residing on a non-transitory computer-readable storage medium having a plurality of instructions stored thereon, which, when executed by a processor, cause the processor to perform operations comprising:
- identifying a continuous integration environment;
identifying a first software test associated with the continuous integration environment;
determining a probationary status for the first software test based upon, at least in part, a recency with which the first software test was associated with the continuous integration environment relative to a recency with which another software test was associated with the continuous integration environment, wherein the recency with which the first software test was associated with the continuous integration environment includes one or more of a recency with which the first software test was added to the continuous integration environment and a recency with which the first software test was updated, the probationary status indicating, at least in part, a potential lack of reliability for the first software test; and
determining a promoted status for the first software test based upon, at least in part, identifying a code consistency over a sequence of a plurality of successful runs for the first software test over a plurality of code builds, the code consistency including a lack of changes to the first software test over the sequence of runs for the first software test, the promoted status indicating a greater degree of reliability for the first software test.
1 Assignment
0 Petitions
Accused Products
Abstract
A method, computer program product, and system is described. A continuous integration environment is identified. A first software test associated with the continuous integration environment is identified. A probationary status for the first software test is determined, the probationary status indicating, at least in part, a potential lack of reliability for the first software test.
56 Citations
14 Claims
-
1. A computer program product residing on a non-transitory computer-readable storage medium having a plurality of instructions stored thereon, which, when executed by a processor, cause the processor to perform operations comprising:
-
identifying a continuous integration environment; identifying a first software test associated with the continuous integration environment; determining a probationary status for the first software test based upon, at least in part, a recency with which the first software test was associated with the continuous integration environment relative to a recency with which another software test was associated with the continuous integration environment, wherein the recency with which the first software test was associated with the continuous integration environment includes one or more of a recency with which the first software test was added to the continuous integration environment and a recency with which the first software test was updated, the probationary status indicating, at least in part, a potential lack of reliability for the first software test; and determining a promoted status for the first software test based upon, at least in part, identifying a code consistency over a sequence of a plurality of successful runs for the first software test over a plurality of code builds, the code consistency including a lack of changes to the first software test over the sequence of runs for the first software test, the promoted status indicating a greater degree of reliability for the first software test. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer system comprising:
-
one or more processor devices; and one or more memory architectures coupled with the one or more processor devices; wherein the one or more processor devices are configured to; identify a continuous integration environment; identify a first software test associated with the continuous integration environment; determine a probationary status for the first software test based upon, at least in part, a recency with which the first software test was associated with the continuous integration environment relative to a recency with which another software test was associated with the continuous integration environment, wherein the recency with which the first software test was associated with the continuous integration environment includes one or more of a recency with which the first software test was added to the continuous integration environment and a recency with which the first software test was updated, the probationary status indicating, at least in part, a potential lack of reliability for the first software test; and determine a promoted status for the first software test based upon, at least in part, identifying a code consistency over a sequence of a plurality of successful runs for the first software test over a plurality of code builds, the code consistency including a lack of changes to the first software test over the sequence of runs for the first software test, the promoted status indicating a greater degree of reliability for the first software test. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
Specification