Method and system for analyzing software test results

• US 7,836,346 B1
• Filed: 06/11/2007
• Issued: 11/16/2010
• Est. Priority Date: 06/11/2007
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Oracle America, Inc. (Oracle Corporation)
• Inventors: Kuchkova, Irina N., Pastsyak, Alexander R., Davidov, Mikhail B., Barilov, Alexey Alexeevich
• Primary Examiner(s): McCarthy; Christopher S
• Application Number:
  US11/761,300
• Time in Patent Office: 1,254 Days
• Field of Search: None
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3692 for test results analysis

Abstract

A method for analyzing software test results that includes identifying a test result of a failed test case in a test log, determining whether the failed test case has a related defect report, and storing a selectable link to the related defect report in the test result when the failed test case has the related defect report.

Claims

1. A method for analyzing software test results comprising:

identifying a failed test result in a test log, wherein the failed test result indicates a first defect, and wherein the failed test result is associated with a first test result identifier;

identifying, using the first test result identifier, a first defect report corresponding to the first defect, wherein the failed test result was not previously associated with a first defect report corresponding to the first defect, wherein the first defect report comprises a first defect description and the first test result identifier, and wherein the first defect report is stored in a defect report repository;

associating the failed test result with the first defect report by storing a first selectable link to the first defect report in the failed test result when the failed test result was not previously associated with the first defect report.

2. The method of claim 1, wherein determining whether the failed test result was previously associated with the first defect report further comprises:

retrieving identifying information for the failed test result; and

using the identifying information to search the defect report repository to locate the first defect report.

3. The method of claim 2, wherein associating the failed test result with the first defect report further comprises associating the first defect report with a unique identifier of the failed test result.

4. The method of claim 3, wherein using the identifying information further comprises using the identifying information to determine the unique identifier.

5. The method of claim 1, further comprising:

displaying the first defect report responsive to user selection of the selectable link.

6. The method of claim 1, further comprising:

identifying that the failed test result indicates a second defect;

determining that the failed test result was not previously associated with a second defect report corresponding to the second defect;

in response to the determination that the failed test result was not previously associated with a second defect report corresponding to the second defect;

storing the second defect report in the defect report repository;

associating the failed test result with the second defect report by storing a second selectable link to the second defect report in the failed test result; and

storing a unique identifier for the failed test result in the second defect report.

7. The method of claim 1, wherein the test log is generated by a Java test harness.

8. The method of claim 1, wherein the failed test result is comprised in a test suite of a technology compatibility kit (TCK).

9. A system for analyzing software test results comprising:

a test harness configured to execute a plurality of test cases and generate a test log, wherein the test log comprises test results for a portion of the plurality of test cases; and

a test log analysis component configured to;

identify a failed test result in a test log, wherein the failed test result indicates a first defect, and wherein the first failed test result is associated with a first test result identifier;

identify, using the first test result identifier, a first defect report corresponding to the first defect, wherein the failed test result was not previously associated with a first defect report corresponding to the first defect, wherein the first defect report comprises a first defect description and the first test result identifier, and wherein the first defect report is stored in a defect report repository;

associate the failed test result with the first defect report by storing a first selectable link to the first defect report in the failed test result when the failed test result was not previously associated with the first defect report.

10. The system of claim 9, further comprising:

the defect report repository configured to store the related defect report,

wherein the test log analysis component is further configured to determine whether the failed test result has a related defect report by;

retrieving identifying information for the failed test result; and

using the identifying information to search the defect report repository to locate the first defect report.

11. The system of claim 10, wherein the test log analysis component is further configured to associate the failed test result with the first defect report by associating the first defect report with a unique identifier of the failed test result.

12. The system of claim 11, wherein using the identifying information further comprises using the identifying information to determine the unique identifier.

13. The system of claim 9, further comprising:

a defect tracking system configured to receive a second defect report and store the second defect report in the defect report repository,

wherein the defect tracking system;

receives the second defect report for the failed test result when the failed test result was not previously associated with a second defect report corresponding to the second defect; and

stores a unique identifier for the failed test result in the second defect report.

14. The system of claim 9, wherein the test harness is a Java test harness.

15. The system of claim 9, wherein the failed test result is comprised in a test suite of a TCK.

16. A computer readable medium comprising computer program code embodied therein for analyzing software test results, the computer program code comprising instructions to:

identify a failed test result in a test log, wherein the failed test result indicates a first defect, and wherein the failed test result is associated with a first test result identifier;

identify, using the first test result identifier, a first defect report corresponding to the first defect, wherein the failed test was not previously associated with a first defect report corresponding to the first defect, wherein the first defect report comprises a first defect description and the first test result identifier, and wherein the first defect report is stored in a defect report repository;

associate the first failed test result with the first defect report by storing a first selectable link to the first defect report in the failed test result when the first failed test result was not previously associated with the first defect report.

17. The computer readable medium of claim 16, wherein the instruction to determine whether the failed test result has a related defect report further comprise instructions to:

retrieve identifying information for the failed test result; and

use the identifying information to search the defect report repository to locate the first defect report.

18. The computer readable medium of claim 16, wherein the computer program code further comprises instructions to:

display the first defect report responsive to user selection of the selectable link.

19. The computer readable medium of claim 16, wherein the computer program code further comprises instructions to:

identify that the failed test result indicates a second defect;

determine that the failed test result was not previously associated with a second defect report corresponding to the second defect;

store the second defect report in the defect report repository;

associate the failed test result with the second defect report by storing a second selectable link to the second defect report in the failed test result; and

store a unique identifier for the failed test result in the second defect report.

20. The computer readable medium of claim 16, wherein the failed test result is comprised in a test suite of a technology compatibility kit (TCK).