Interactive software program repair

• US 10,268,572 B2
• Filed: 08/03/2017
• Issued: 04/23/2019
• Est. Priority Date: 08/03/2017
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Prasad, Mukul R., Yoshida, Hiroaki, Saha, Ripon K., Ghosh, Indradeep
• Primary Examiner(s): Das, Chameli
• Application Number:
  US15/668,065
• Publication Number:
  US 20190042398A1
• Time in Patent Office: 628 Days
• Field of Search: 717124
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis

Abstract

In some examples, a method to interactively repair a software program using one or more automatically generated tests with human-provided test oracles may include identifying a fault location in a software program, generating a potential repair at the fault location based on a repair candidate, automatically generating a first test to test the potential repair, and generating a first query for a first test oracle based on the first test. The method may also include obtaining a response to the first query from a human, generating a first human-provided test oracle based on the first query and the obtained response to the first query, augmenting a test suite to include the first automatically generated test with the first human-provided test oracle, and testing the potential repair using the augmented test suite including the first automatically generated test with the first human-provided test oracle.

Claims

1. A method to interactively repair a software program, the method comprising:

identifying a fault location in a software program in which the fault location includes a fault of the software program;

generating a potential repair at the fault location based on a repair candidate that modifies the software program at the fault location;

automatically generating a first test to test efficacy of the potential repair with respect to correction of the fault;

generating a first query that relates to an expected result of the first test in which obtaining the expected result of the first test in response to executing the first test indicates that the fault has been corrected;

obtaining a response to the first query from a human, the response including an indication of the expected result of the first test;

generating an augmented first test by adding, as indicated by the response to the first query, the expected result of the first test with the first test as a test oracle to the first test;

augmenting a test suite to include the augmented first test;

testing the efficacy of the potential repair with respect to correction of the fault using the augmented test suite by determining whether the expected result of the augmented first test is obtained from execution of the potential repair; and

in response to a passing result of the augmented test suite accepting the potential repair as a proper repair of the fault.

2. The method of claim 1, further comprising:

automatically generating a second test to test the efficacy of the potential repair with respect to correction of the fault;

generating a second query that relates to an expected result of the second test in which obtaining the expected result of the second test in response to executing the second test indicates that the fault has been corrected;

obtaining a response to the second query from a human, the response including an indication of the expected result of the second test;

generating an augmented second test by adding, as indicated by the response to the second query, the expected result of the second test with the second test as a second test oracle to the second test; and

augmenting the augmented test suite to include the second augmented test.

3. The method of claim 2, further comprising testing the efficacy of the potential repair with respect to correction of the fault using the augmented test suite including the second augmented test by determining whether the expected result of the augmented second test is obtained from execution of the potential repair.

4. The method of claim 3, further comprising accepting the potential repair as a proper repair in response to the potential repair passing the augmented test suite including the augmented second test.

5. The method of claim 3, further comprising rejecting the potential repair as an improper repair in response to the potential repair not passing the augmented test suite including the augmented second test.

6. A method to interactively generate repairs to a software program, the method comprising:

automatically generating a test to test efficacy of a first potential repair with respect to correction of a fault of a software program, wherein the potential repair modifies a software program at a fault location, the fault location including the fault in the software program, the first potential repair being based on a first repair candidate;

generating a query that relates to an expected result of the test in which obtaining the expected result in response to executing the test indicates that the fault has been corrected;

obtaining a response to the query from a human, the response including an indication of the expected result of the test;

generating an augmented test by adding, as indicated by the response to the query, the expected result with the test as a test oracle to the test;

augmenting a test suite to include the augmented test; and

testing the efficacy of the first potential repair with respect to correction of the fault using the augmented test suite including the augmented test by determining whether the expected result of the augmented test is obtained from execution of the potential repair.

7. The method of claim 6, further comprising, responsive to the first potential repair passing the augmented test suite including the augmented test, accepting the first potential repair as a first proper repair.

8. The method of claim 7, further comprising:

generating a second potential repair at the fault location in the software program, the second potential repair being based on a second repair candidate that modifies the software program at the fault location;

testing efficacy of the second potential repair with respect to correction of the fault using the augmented test suite including the augmented test by determining whether the expected result of the augmented test is obtained from execution of the second potential repair; and

accepting the second potential repair as a second proper repair responsive to the second potential repair passing the augmented test suite including the augmented test.

9. The method of claim 6, further comprising testing a previously accepted potential repair using the augmented test suite including the augmented test.

10. A system configured to interactively repair a software program, the system comprising:

one or more non-transitory computer-readable storage media configured to store instructions; and

one or more processors configured to execute the instructions, wherein execution of the instructions causes the system to perform operations comprising;

identify a fault location in a software program in which the fault location includes a fault of the software program;

generate a first potential repair at the fault location based on a first repair candidate that modifies the software program at the fault location;

generate a first test to test efficacy of the first potential repair with respect to correction of the fault;

generate a first query that relates to an expected result of the first test in which obtaining the expected result of the first test in response to executing the first test indicates that the fault has been corrected;

obtain a response to the first query from a human, the response including an indication of the expected result of the first test;

generate an augmented first test by adding, as indicated by the response to the first query, the expected result of the first test with the first test as a test oracle to the first test;

augment a test suite to include the augmented first test; and

test the efficacy of the first potential repair with respect to correction of the fault using the augmented test suite including the augmented first test by determining whether the expected result of the augmented first test is obtained from execution of the first potential repair.

11. The system of claim 10, wherein the operations further comprise accept the first potential repair as a first proper repair in response to the first potential repair passing the augmented test suite including the augmented first test.

12. The system of claim 10, wherein the operations further comprise reject the first potential repair as an improper repair in response to the first potential repair not passing the augmented test suite including the augmented first test.

13. The system of claim 10, wherein the operations further comprise, responsive to the first potential repair passing the augmented test suite including the augmented first test:

generate a second test to test the efficacy of the first potential repair with respect to correction of the fault;

generate a second query that relates to an expected result of the second test in which obtaining the expected result of the second test in response to executing the first test indicates that the fault has been corrected;

obtain a response to the second query from a human, the response including an indication of the expected result of the second test;

generating an augmented second test by adding, as indicated by the response to the first query, the expected result of the second test with the second test as a test oracle to the second test; and

augment the augmented test suite to include the augmented second test.

14. The system of claim 13, wherein the operations further comprise test the efficacy of the first potential repair with respect to correction of the fault using the augmented test suite including the augmented second test by determining whether the expected result of the augmented second test is obtained from execution of the first potential repair.

15. The system of claim 10, wherein the operations further comprise:

generate a second potential repair at the fault location based on a second repair candidate that modifies the software program at the fault location;

test efficacy of the second potential repair with respect to correction of the fault using the augmented test suite including the augmented first test by determining whether the expected result of the augmented first test is obtained from execution of the potential repair; and

accepting the second potential repair as a second proper repair responsive to the second potential repair passing the augmented test suite including the augmented first test.

16. The system of claim 15, wherein the operations further comprise accept the second potential repair as a second proper repair responsive to the second potential repair passing the augmented test suite including the augmented first test.

17. The system of claim 10, wherein the operations further comprise test a previously accepted potential repair using the augmented test suite including the augmented first test.