Integrated bug tracking and testing

• US 8,713,531 B1
• Filed: 06/28/2011
• Issued: 04/29/2014
• Est. Priority Date: 06/28/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Heath, Taliver, Pettis, Eddie
• Primary Examiner(s): DAO, THUY CHAN
• Application Number:
  US13/170,841
• Time in Patent Office: 1,036 Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A computer implemented software testing method includes receiving a bug report regarding software under test; storing the bug report in a computer readable data store upon receiving the bug report; setting an a status indicator for the bug report to an open condition upon storing the bug report; requesting execution of a test procedure corresponding to the bug report; executing the test procedure using a processor; receiving a test result from the processor indicating a pass state or a fail state for the test procedure; and setting the status indicator for the bug report to a closed condition if the pass state is determined for the test procedure.

Claims

1. A computer implemented software testing method, comprising:

outputting information that, when interpreted by a user system, causes a bug report submission interface to be output for display at the user system;

receiving, by transmission from the user system and in response to a user input at the bug report submission interface, a bug report regarding software under test, wherein the bug report includes information describing an issue identified with respect to the software under test, a test procedure that is related to the issue identified with respect to the software under test, and an assessment procedure;

storing the bug report in a computer readable data store upon receiving the bug report;

setting an a status indicator for the bug report to an open condition upon storing the bug report;

requesting execution of the test procedure and the assessment procedure;

executing the test procedure and the assessment procedure using a processor;

receiving a test result from the processor indicating a pass state or a fail state for the test procedure, wherein the test output includes an elapsed time for performing at least part of the test procedure, and the assessment procedure produces the test result by comparing the elapsed time to a threshold value; and

setting the status indicator for the bug report to a closed condition if the pass state is determined for the test procedure.

2. The computer implemented software testing method of claim 1, wherein the test result includes the elapsed time, and the elapsed time is stored as part of the bug report.

3. The computer implemented software testing method of claim 1, wherein the test result includes an identifier that is unique to the bug report.

4. The computer implemented software testing method of claim 1, wherein the steps of requesting execution of the test procedure and receiving a test result are selectively performed in response to the open condition of the status indicator of the bug report.

5. The computer implemented software testing method of claim 1, further comprising:

storing at least part of the test result in the bug report.

6. The computer implemented software testing method of claim 1, further comprising:

sending an update to a user after setting the status indicator for the bug report to the closed condition.

7. The computer implemented software testing method of claim 1, wherein the step of requesting execution of the test procedure is performed by a bug tracking system and the processor is part of a software testing system.

8. The computer implemented software testing method of claim 1, further comprising:

generating a web application having a bug submission interface and sending the web application to a user system for submission of the bug report.

9. A computer implemented software testing method, comprising:

receiving a plurality of user-submitted bug reports regarding software under test, each bug report including a user submitted test procedure and a user submitted assessment procedure;

storing the bug reports in a computer readable data store upon receiving the bug report;

setting an a status indicator for each bug report to an open condition upon storing each bug report;

requesting execution of the test procedure corresponding to each bug reports on a selective basis in response to the open condition of the status indicator of the bug report;

executing the test procedure of each selected bug report using a processor to produce a test output;

executing the assessment procedure of each selected bug report using the processor of the software testing system to produce a test result by comparing a test output of the test procedure to a predetermined criteria, the test result indicating a pass state or a fail state for the test procedure, wherein the test output includes an elapsed time for performing at least part of the test procedure, the predetermined criteria is a threshold value, and the assessment procedure compares the elapsed time to the threshold value to produce the test result;

sending the test result to the bug tracking system; and

setting the status indicator for each selected bug report to a closed condition if the pass state is determined for the test procedure.

10. The computer implemented software testing method of claim 9, further comprising:

sending an update to a user after setting the status indicator for the bug report to the closed condition.

11. A bug tracking and testing system, comprising:

one or more processors;

a bug tracking system that is implemented using the one or more processors and is configured to receive a plurality of user-submitted bug reports regarding software under test, store the bug reports in a computer readable data store, and set an a status indicator for each bug report to an open condition upon storing each bug report, each bug report including a user-submitted test procedure and a user-submitted assessment procedure; and

a software testing system that is implemented using the one or more processors and is configured to receive test requests for selected bug reports of the plurality of bug reports, where the selected bug reports have the open condition, execute the test procedure of each selected bug report using a processor of the software testing system to produce a test output, and execute the assessment procedure of each selected bug report using the processor of the software testing system to produce a test result indicating a pass state or a fail state for the test procedure based on the test output, where the assessment procedure produces the test result by comparing the test output of the test procedure to a predetermined criteria, the predetermined criteria is a threshold value, the pass state is indicated if the test output satisfies the threshold value and the fail state is indicated of the test output does not satisfy the threshold value, the test output includes an elapsed time for performing at least part of the test procedure, the assessment procedure compares the elapsed time to a threshold value to produce the test result, the test result is sent to the bug tracking system, and the status indicator for each selected bug report is set to a closed condition by the bug tracking system if the pass state is determined.