MANAGING A SET OF TESTS BASED ON OTHER TEST FAILURES

• US 20160364310A1
• Filed: 06/15/2015
• Published: 12/15/2016
• Est. Priority Date: 06/15/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Pringle, Alexander R., Smith, Kevin B., Maple, Elizabeth J., Waddling, David R.
• Granted Patent: US 10,452,508 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

In an approach for managing a set of tests to run on a set of platforms, a processor identifies a set of tests to run on a set of platforms and one or more priorities associated with the set of tests. A processor sends the set of tests and the one or more priorities associated with the set of tests to the set of platforms. A processor receives information about a first test run of a first test on a first platform of the set of platforms. A processor determines that the first test failed on the first platform. A processor updates the one or more priorities associated with the set of tests. A processor sends the updated one or more priorities associated with the set of tests to at least the second platform.

Claims

1. A method for managing a set of tests to run on a set of platforms, the method comprising:

identifying, by one or more processors, a set of tests to run on a set of platforms and one or more priorities associated with the set of tests;

sending, by one or more processors, the set of tests and the one or more priorities associated with the set of tests to the set of platforms;

receiving, by one or more processors, information about a first test run of a first test on a first platform of the set of platforms;

determining, by one or more processors, that the first test failed on the first platform;

updating, by one or more processors, the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms; and

sending, by one or more processors, the updated one or more priorities associated with the set of tests to at least the second platform.

2. The method of claim 1, further comprising:

responsive to sending the set of tests and the one or more priorities associated with the set of tests to the set of platforms, causing, by one or more processors, the first test to run on the first platform; and

responsive to sending the updated one or more priorities associated with the set of tests to at least the second platform, causing, by one or more processors, the first test to run on the second platform.

3. The method of claim 1, wherein the information about the first test run indicates the test failed.

4. The method of claim 1, further comprising:

associating, by one or more processors, diagnostic information with the first test on the second platform, wherein the diagnostic information is based on, at least the information about the first test run of the first test on the first platform.

5. The method of claim 1, wherein the set of platforms are operating system platforms.

6. The method of claim 1, wherein updating the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms comprises:

updating, by one or more processors, the one or more priorities associated with the set of tests, such that the first test will run sooner than scheduled per the sent one or more priorities.

7. The method of claim 1, wherein updating the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms comprises:

updating, by one or more processors, the one or more priorities associated with the set of tests, such that the first test will run later than scheduled per the sent one or more priorities.

8. A computer program product for managing a set of tests to run on a set of platforms, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising;

program instructions to identify a set of tests to run on a set of platforms and one or more priorities associated with the set of tests;

program instructions to send the set of tests and the one or more priorities associated with the set of tests to the set of platforms;

program instructions to receive information about a first test run of a first test on a first platform of the set of platforms;

program instructions to determine that the first test failed on the first platform;

program instructions to update the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms; and

program instructions to send the updated one or more priorities associated with the set of tests to at least the second platform.

9. The computer program product of claim 8, further comprising:

responsive to sending the set of tests and the one or more priorities associated with the set of tests to the set of platforms, program instructions, stored on the one or more computer readable storage media, to cause the first test to run on the first platform; and

responsive to sending the updated one or more priorities associated with the set of tests to at least the second platform, program instructions, stored on the one or more computer readable storage media, to cause the first test to run on the second platform.

10. The computer program product of claim 8, wherein the information about the first test run indicates the test failed.

11. The computer program product of claim 8, further comprising:

program instructions, stored on the one or more computer readable storage media, to associate diagnostic information with the first test on the second platform, wherein the diagnostic information is based on, at least the information about the first test run of the first test on the first platform.

12. The computer program product of claim 8, wherein the set of platforms are operating system platforms.

13. The computer program product of claim 8, wherein program instructions to update the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms comprise:

program instructions to update the one or more priorities associated with the set of tests, such that the first test will run sooner than scheduled per the sent one or more priorities.

14. The computer program product of claim 8, wherein program instructions to update the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms comprises:

program instructions to update the one or more priorities associated with the set of tests, such that the first test will run later than scheduled per the sent one or more priorities.

15. A computer system for managing a set of tests to run on a set of platforms, the computer system comprising:

one or more computer processors, one or more computer readable storage media, and program instructions stored on the computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to identify a set of tests to run on a set of platforms and one or more priorities associated with the set of tests;

program instructions to send the set of tests and the one or more priorities associated with the set of tests to the set of platforms;

program instructions to receive information about a first test run of a first test on a first platform of the set of platforms;

program instructions to determine that the first test failed on the first platform;

program instructions to update the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms; and

program instructions to send the updated one or more priorities associated with the set of tests to at least the second platform.

16. The computer system of claim 15, further comprising:

responsive to sending the set of tests and the one or more priorities associated with the set of tests to the set of platforms, program instructions, stored on the computer readable storage media for execution by at least one of the one or more processors, to cause the first test to run on the first platform; and

responsive to sending the updated one or more priorities associated with the set of tests to at least the second platform, program instructions, stored on the computer readable storage media for execution by at least one of the one or more processors, to cause the first test to run on the second platform.

17. The computer system of claim 15, wherein the information about the first test run indicates the test failed.

18. The computer system of claim 15, further comprising:

program instructions, stored on the computer readable storage media for execution by at least one of the one or more processors, to associate diagnostic information with the first test on the second platform, wherein the diagnostic information is based on, at least the information about the first test run of the first test on the first platform.

19. The computer system of claim 15, wherein program instructions to update the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms comprise:

program instructions to update the one or more priorities associated with the set of tests, such that the first test will run sooner than scheduled per the sent one or more priorities.

20. The computer system of claim 15, wherein program instructions to update the one or more priorities associated with the set of tests, such that the first test is associated with an increased priority on at least a second platform of the set of platforms comprise:

program instructions to update the one or more priorities associated with the set of tests, such that the first test will run later than scheduled per the sent one or more priorities.