METHOD AND APPARATUS FOR MINING TEST COVERAGE DATA

• US 20150169435A1
• Filed: 08/12/2014
• Published: 06/18/2015
• Est. Priority Date: 12/12/2013
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: WU, Yunjia
• Granted Patent: US 9,454,467 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3676 for coverage analysis
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

A method of mining test coverage data includes: at a device having one or more processors and memory: sequentially processing each of a plurality of coverage data files that is generated by executing the program using a respective test input of a plurality of test inputs, where the processing of each current coverage data file extracts respective execution counter data from the current coverage data file; after processing each current coverage data file, determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files; and in response to detecting the predetermined change for the current coverage data file, including the respective test input used to generate the current coverage data file in a test input collection for testing the program.

Claims

1. A method of mining test coverage data, comprising:

at a device having one or more processors and memory;

sequentially processing each of a plurality of coverage data files that is generated by executing a program using a respective test input of a plurality of test inputs, wherein the processing of each current coverage data file extracts respective execution counter data from the current coverage data file;

after processing each current coverage data file, determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files; and

in response to detecting the predetermined change for the current coverage data file, including the respective test input used to generate the current coverage data file in a test input collection for testing the program.

2. The method of claim 1, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change.

3. The method of claim 1, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change from zero to a non-zero value.

4. The method of claim 1, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused respective execution counters for at least a predetermined number of code blocks in the program to change from zero to a non-zero value.

5. The method of claim 1, further comprising:

sequentially executing the program using each of the plurality of test inputs to obtain a respective one of the plurality of coverage data files, wherein the execution of the program using each next test input in the plurality of test inputs follows the processing of the respective coverage data file obtained from executing the program using a current test input in the plurality of test inputs.

6. The method of claim 1, further comprising:

generating a execution counter table for the program, the execution counter table including a respective execution counter for each code block of a plurality of code blocks in the program.

7. The method of claim 6, further comprising:

in response to detecting the predetermined change for the current coverage data file, updating the execution counter table to reflect the predetermined change.

8. A system for mining test coverage data, comprising:

one or more processors; and

memory having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to perform operations comprising;

sequentially processing each of a plurality of coverage data files that is generated by executing the program using a respective test input of a plurality of test inputs, wherein the processing of each current coverage data file extracts respective execution counter data from the current coverage data file;

after processing each current coverage data file, determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files; and

in response to detecting the predetermined change for the current coverage data file, including the respective test input used to generate the current coverage data file in a test input collection for testing the program.

9. The system of claim 8, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change.

10. The system of claim 8, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change from zero to a non-zero value.

11. The system of claim 8, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused respective execution counters for at least a predetermined number of code blocks in the program to change from zero to a non-zero value.

12. The system of claim 8, wherein the operations further comprise:

sequentially executing the program using each of the plurality of test inputs to obtain a respective one of the plurality of coverage data files, wherein the execution of the program using each next test input in the plurality of test inputs follows the processing of the respective coverage data file obtained from executing the program using a current test input in the plurality of test inputs.

13. The system of claim 8, wherein the operations further comprise:

generating a execution counter table for the program, the execution counter table including a respective execution counter for each code block of a plurality of code blocks in the program.

14. The system of claim 13, wherein the operations further comprise:

in response to detecting the predetermined change for the current coverage data file, updating the execution counter table to reflect the predetermined change.

15. A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by one or more processors, cause the processors to perform operations comprising:

sequentially processing each of a plurality of coverage data files that is generated by executing the program using a respective test input of a plurality of test inputs, wherein the processing of each current coverage data file extracts respective execution counter data from the current coverage data file;

after processing each current coverage data file, determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files; and

in response to detecting the predetermined change for the current coverage data file, including the respective test input used to generate the current coverage data file in a test input collection for testing the program.

16. The computer-readable medium of claim 15, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change.

17. The computer-readable medium of claim 15, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change from zero to a non-zero value.

18. The computer-readable medium of claim 15, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused respective execution counters for at least a predetermined number of code blocks in the program to change from zero to a non-zero value.

19. The computer-readable medium of claim 15, wherein the operations further comprise:

sequentially executing the program using each of the plurality of test inputs to obtain a respective one of the plurality of coverage data files, wherein the execution of the program using each next test input in the plurality of test inputs follows the processing of the respective coverage data file obtained from executing the program using a current test input in the plurality of test inputs.

20. The computer-readable medium of claim 15, wherein the operations further comprise:

generating a execution counter table for the program, the execution counter table including a respective execution counter for each code block of a plurality of code blocks in the program.