Method and apparatus for mining test coverage data

• US 9,454,467 B2
• Filed: 08/12/2014
• Issued: 09/27/2016
• Est. Priority Date: 12/12/2013
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Wu, Yunjia
• Primary Examiner(s): Chen, Xi D
• Application Number:
  US14/458,127
• Publication Number:
  US 20150169435A1
• Time in Patent Office: 777 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3676 for coverage analysis
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

A method of mining test coverage data includes: at a device having one or more processors and memory: sequentially processing each of a plurality of coverage data files that is generated by executing the program using a respective test input of a plurality of test inputs, where the processing of each current coverage data file extracts respective execution counter data from the current coverage data file; after processing each current coverage data file, determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files; and in response to detecting the predetermined change for the current coverage data file, including the respective test input used to generate the current coverage data file in a test input collection for testing the program.

Claims

1. A computer-implemented method of mining test coverage data, comprising:

at a device having one or more processors and memory;

sequentially generating a plurality of coverage data files by executing a program using a respective test input of a plurality of test inputs, wherein the program includes a plurality of code blocks, each code block being either executed as a whole or not executed at all during the execution of the program;

after generating the plurality of coverage data files, processing a current coverage data file by extracting respective execution counter data from the current coverage data file, wherein each code block has a counter for recording execution counter value associated with the code block and the execution counter values associated with the plurality of code blocks collectively form a counter value list;

after processing the current coverage data file, determining whether the respective execution counter data from a current counter value list extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data from a previous counter value list extracted from previously processed coverage data files, further comprising;

determining whether the respective test input used to generate the current coverage data file has caused a respective counter for at least one code block in the program to change; and

in response to detecting the predetermined change for the current coverage data file;

including the respective test input used to generate the current coverage data file in a test input collection for testing the program; and

updating the counter value list with the respective execution counter data extracted from the current coverage data file.

2. The method of claim 1, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change from zero to a non-zero value.

3. The method of claim 1, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused respective execution counters for at least a predetermined number of code blocks in the program to change from zero to a non-zero value.

4. The method of claim 1, wherein the execution of the program using each next test input in the plurality of test inputs follows the processing of the respective coverage data file obtained from executing the program using a current test input in the plurality of test inputs.

5. The method of claim 1, further comprising:

generating a execution counter table for the program, the execution counter table including a respective execution counter for each code block of a plurality of code blocks in the program.

6. The method of claim 5, further comprising:

in response to detecting the predetermined change for the current coverage data file, updating the execution counter table to reflect the predetermined change.

7. A system for mining test coverage data, comprising:

one or more processors; and

memory having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to perform operations comprising;

sequentially generating a plurality of coverage data files by executing a program using a respective test input of a plurality of test inputs, wherein the program includes a plurality of code blocks, each code block being either executed as a whole or not executed at all during the execution of the program;

after generating the plurality of coverage data files, processing a current coverage data file by extracting respective execution counter data from the current coverage data file, wherein each code block has a counter for recording execution counter value associated with the code block and the execution counter values associated with the plurality of code blocks collectively form a counter value list;

after processing the current coverage data file, determining whether the respective execution counter data from a current counter value list extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data from a previous counter value list extracted from previously processed coverage data files, further comprising;

determining whether the respective test input used to generate the current coverage data file has caused a respective counter for at least one code block in the program to change; and

in response to detecting the predetermined change for the current coverage data file;

including the respective test input used to generate the current coverage data file in a test input collection for testing the program; and

updating the counter value list with the respective execution counter data extracted from the current coverage data file.

8. The system of claim 7, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change from zero to a non-zero value.

9. The system of claim 7, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused respective execution counters for at least a predetermined number of code blocks in the program to change from zero to a non-zero value.

10. The system of claim 7, wherein the execution of the program using each next test input in the plurality of test inputs follows the processing of the respective coverage data file obtained from executing the program using a current test input in the plurality of test inputs.

11. The system of claim 7, wherein the operations further comprise:

generating a execution counter table for the program, the execution counter table including a respective execution counter for each code block of a plurality of code blocks in the program.

12. The system of claim 11, wherein the operations further comprise:

in response to detecting the predetermined change for the current coverage data file, updating the execution counter table to reflect the predetermined change.

13. A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by one or more processors, cause the processors to perform operations comprising:

sequentially generating a plurality of coverage data files by executing a program using a respective test input of a plurality of test inputs, wherein the program includes a plurality of code blocks, each code block being either executed as a whole or not executed at all during the execution of the program;

after generating the plurality of coverage data files, processing a current coverage data file by extracting respective execution counter data from the current coverage data file, wherein each code block has a counter for recording execution counter value associated with the code block and the execution counter values associated with the plurality of code blocks collectively form a counter value list;

after processing the current coverage data file, determining whether the respective execution counter data from a current counter value list extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data from a previous counter value list extracted from previously processed coverage data files, further comprising;

determining whether the respective test input used to generate the current coverage data file has caused a respective counter for at least one code block in the program to change; and

in response to detecting the predetermined change for the current coverage data file;

including the respective test input used to generate the current coverage data file in a test input collection for testing the program; and

updating the counter value list with the respective execution counter data extracted from the current coverage data file.

14. The computer-readable medium of claim 13, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused a respective execution counter for at least one code block in the program to change from zero to a non-zero value.

15. The computer-readable medium of claim 13, wherein determining whether the respective execution counter data extracted from the current coverage data file includes a predetermined change relative to the respective execution counter data extracted from previously processed coverage data files further comprises:

determining whether the respective test input used to generate the current coverage data file has caused respective execution counters for at least a predetermined number of code blocks in the program to change from zero to a non-zero value.

16. The computer-readable medium of claim 13, wherein the execution of the program using each next test input in the plurality of test inputs follows the processing of the respective coverage data file obtained from executing the program using a current test input in the plurality of test inputs.

17. The computer-readable medium of claim 13, wherein the operations further comprise:

generating a execution counter table for the program, the execution counter table including a respective execution counter for each code block of a plurality of code blocks in the program.