Generating a test script execution order

• US 10,592,398 B1
• Filed: 09/27/2018
• Issued: 03/17/2020
• Est. Priority Date: 09/27/2018
• Status: Active Grant

• Current Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Original Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Inventors: Dwarakanath, Anurag, Dubash, Neville, Podder, Sanjay, Durg, Kishore P, N C, Shrikanth
• Primary Examiner(s): Vu, Tuan A
• Application Number:
  US16/144,817
• Publication Number:
  US 20200104245A1
• Time in Patent Office: 537 Days
• CPC Class Codes: G06F 11/008 Reliability or availability analysis
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3608 using formal methods, e.g. model checking, abstract interpretation theorem proving G06N5/013
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups

Abstract

A device may determine probabilities for test scripts associated with a test to be executed on a software element, where a respective probability is associated with a respective test script, indicates a likelihood that the respective test script will be unsuccessful in a test cycle, and is determined based on historical test results, associated with the software element, for the respective test script. The device may generate, based on the probabilities, a test script execution order, of the test scripts, for the test cycle, and may execute, based on the test script execution order, the test on the software element in the test cycle. The device may dynamically generate, based on results for the test in the test cycle, an updated test script execution order, and may execute, based on the updated test script execution order, the test on the software element in the test cycle.

Claims

1. A device, comprising:

one or more memories; and

one or more processors, communicatively coupled to the one or more memories, to;

determine a plurality of first probabilities for a plurality of test scripts that is associated with a test to be executed on a software element,

wherein a respective first probability, of the plurality of first probabilities, is associated with a respective test script of the plurality of test scripts,

wherein the respective first probability indicates a likelihood that the respective test script will be unsuccessful in a test cycle, and

wherein the respective first probability is determined based on historical test results, associated with the software element, for the respective test script;

generate, based on the plurality of first probabilities, a test script execution order, of the plurality of test scripts, for the test cycle,

wherein the plurality of test scripts are ordered from greatest respective probability to least respective probability;

execute, based on the test script execution order, the test on the software element in the test cycle,

wherein a first test script, of the plurality of test scripts, is executed based on the test script execution order;

determine, based on a result of executing the first test script, a plurality of second probabilities for a plurality of second test scripts,

wherein the plurality of second test scripts do not include the first test script,

wherein the plurality of second probabilities are used to generate an updated test script execution order, and

wherein the plurality of first probabilities are not used to generate the updated test script execution order;

generate, based on the plurality of second probabilities, the updated test script execution order; and

execute, based on the updated test script execution order, a second test script, of the plurality of second test scripts, on the software element in the test cycle.

2. The device of claim 1, wherein the one or more processors, when determining the plurality of first probabilities for the plurality of test scripts, are to:

determine, for the respective test script, a first results pattern for a quantity of historical test cycles of the respective test script;

determine a first quantity of occurrences that the first results pattern occurred in the historical test results for the respective test script;

determine a second results pattern for the respective test script,

wherein the second results pattern comprises;

the first results pattern, and

an assumed result for the test cycle;

determine a second quantity of occurrences that the second results pattern occurred in the historical test results for the respective test script; and

determine the respective first probability, associated with the respective test script, based on the first quantity of occurrences and the second quantity of occurrences.

3. The device of claim 2, wherein the one or more processors, when determining the respective first probability associated with the respective test script, are to:

determine the respective first probability based on a ratio of the first quantity of occurrences and the second quantity of occurrences.

4. The device of claim 3, wherein the one or more processors, when determining the respective first probability associated with the respective test script, are to:

determine whether the second quantity of occurrences satisfies a threshold quantity of occurrences;

reduce, based on determining that the second quantity of occurrences does not satisfy the threshold quantity of occurrences, the quantity of historical test cycles of the respective test script; and

determine the first results pattern and the second results pattern based on reducing the quantity of historical test cycles of the respective test script.

5. The device of claim 2, wherein the assumed result for the test cycle is that the respective test script will be unsuccessful in the test cycle.

6. The device of claim 1, wherein the one or more processors are further to:

determine that the execution of the second test script was unsuccessful; and

terminate, based on determining that the execution of the second test script was unsuccessful, the test so that a third test script is not executed.

7. The device of claim 1, wherein the one or more processors are further to:

determine that the execution of the second test script was unsuccessful; and

troubleshoot, based on determining that the execution of the second test script was unsuccessful, the software element to determine a cause of the execution of the second test script being unsuccessful.

8. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors, cause the one or more processors to;

determine a plurality of first probabilities for a plurality of first test scripts that is associated with a test to be executed on a software element,

wherein the plurality of first probabilities indicate a likelihood that the plurality of first test scripts will be unsuccessful in a test cycle;

generate, based on the plurality of first probabilities, a test script execution order, of the plurality of first test scripts, for the test cycle,

wherein the plurality of first test scripts are ordered from greatest respective probability to least respective probability;

execute, based on the test script execution order, a first test script, of the plurality of first test scripts, on the software element in the test cycle,

wherein the first test script, of the plurality of first test scripts, is executed based on the test script execution order;

determine, based on a result of executing the first test script, a plurality of second probabilities for a plurality of second test scripts,

wherein the plurality of second test scripts do not include the first test script,

wherein the plurality of second probabilities are used to generate an updated test script execution order, and

wherein the plurality of first probabilities are not used to generate the updated test script execution order;

generate, based on the plurality of second probabilities, the updated test script execution order; and

execute, based on the updated test script execution order, a second test script, of the plurality of second test scripts, on the software element.

9. The non-transitory computer-readable medium of claim 8, wherein the one or more instructions, that cause the one or more processors to determine the plurality of second probabilities, cause the one or more processors to:

determine a results pattern for the first test script and the second test script,

wherein the results pattern comprises;

the result of executing the first test script, and

an assumed result of executing the second test script in the test cycle;

determine a first quantity of historical test cycles in which the results pattern occurred;

determine a second quantity of historical test cycles in which the result of executing the first test script occurred; and

determine a respective probability, of the plurality of second probabilities, for the second test script based on the first quantity of historical test cycles and the second quantity of historical test cycles.

10. The non-transitory computer-readable medium of claim 9, wherein the one or more instructions, that cause the one or more processors to determine the plurality of second probabilities, cause the one or more processors to:

determine the respective probability for the second test script based on a ratio of the first quantity of historical test cycles and the second quantity of historical test cycles.

11. The non-transitory computer-readable medium of claim 10, wherein the one or more instructions, that cause the one or more processors to determine the plurality of second probabilities, cause the one or more processors to:

determine whether the first quantity of historical test cycles satisfies a threshold quantity of historical test cycles;

determine a third quantity of historical test cycles in which the second test script was executed; and

determine the respective probability for the second test script based on another ratio of the second quantity of historical test cycles and the third quantity of historical test cycles.

12. The non-transitory computer-readable medium of claim 9, wherein the assumed result of executing the second test script is that the second test script will be unsuccessful in the test cycle.

13. The non-transitory computer-readable medium of claim 8, wherein a third probability, of the plurality of first probabilities, for the second test script is different from a fourth probability, of the plurality of second probabilities, for the second test script.

14. The non-transitory computer-readable medium of claim 8, wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

determine that the execution of the second test script was unsuccessful; and

terminate, based on determining that the execution of the second test script was unsuccessful, the test so that a third test script is not executed.

15. A method, comprising:

determining, by a device, a plurality of first probabilities for a plurality of first test scripts that is associated with a test to be executed on a software element,

wherein the plurality of first probabilities indicate a likelihood that the plurality of first test scripts will be unsuccessful in a test cycle;

generating, by the device and based on the plurality of first probabilities, a test script execution order, of the plurality of first test scripts, for the test cycle,

wherein the plurality of first test scripts are ordered from greatest respective probability to least respective probability;

executing, by the device and based on the test script execution order, a first test script, of the plurality of first test scripts, on the software element in the test cycle,

wherein the first test script, of the plurality of test scripts, is executed based on the test script execution order;

determining, by the device, a plurality of second probabilities for a plurality of second test scripts,

wherein the plurality of second probabilities is determined based on;

a first result of executing the first test script, and

one or more second results, from one or more historical test cycles, for one or more second test scripts of the plurality of second test scripts,

wherein the plurality of second probabilities are used to generate an updated test script execution order,

wherein the plurality of first probabilities are not used to generate the updated test script execution order, and

wherein the one or more second test scripts do not include the first test script;

generating, by the device and based on the plurality of second probabilities, the updated test script execution order; and

executing, by the device and based on the updated test script execution order, a third test script, of the plurality of second test scripts, on the software element.

16. The method of claim 15, wherein the test script execution order is different from the updated test script execution order.

17. The method of claim 15, wherein a third probability, of the plurality of first probabilities, for the third test script is different from a fourth probability, of the plurality of second probabilities, for the third test script.

18. The method of claim 15, wherein the test script execution order and the updated test script execution order are ordered from greatest respective probability, for the plurality of second test scripts, to least respective probability, for the plurality of second test scripts.

19. The method of claim 15, wherein generating the test script execution order, of the plurality of first test scripts, for the test cycle, comprises:

generating the test script execution order prior to initiating the test cycle.

20. The method of claim 15, wherein determining the plurality of first probabilities for the plurality of first test scripts comprises:

determining the plurality of first probabilities based on third results, in one or more other historical test cycles, for the plurality of first test scripts.