Viewing multi-dimensional metric data from multiple test cases

• US 8,402,317 B1
• Filed: 05/21/2008
• Issued: 03/19/2013
• Est. Priority Date: 12/22/2005
• Status: Active Grant

• Current Assignee: The MathWorks, Inc.
• Original Assignee: The MathWorks, Inc.
• Inventors: Portal, Christian, Owen, James G., Thomas, Michael J.
• Primary Examiner(s): PATEL, KAMINI B
• Application Number:
  US12/124,854
• Time in Patent Office: 1,763 Days
• Field of Search: 714/37
• US Class Current: 714/37
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957

Abstract

A viewer is disclosed for viewing a multi-dimensional data set. The viewer may be coupled to or included in a test environment and receive data generated in the test environment. The test environment may generate metric data from the multiple test cases of a UUT. The viewer may display the cumulative metric data generated from multiple test cases. The viewer may display the cumulative metric data in a fashion that the user can gain insight into the UUT'"'"'s characteristics.

Claims

1. A computer-implemented method for displaying multi-dimensional data on a display, the method comprising:

receiving multi-dimensional metric data from a plurality of test cases, where;

the plurality of test cases test a unit under test in a test environment that executes the test cases,

the metric data is generated by the test environment from the plurality of test cases, and

the metric data comprises coverage information indicating a thoroughness of the test cases for evaluating the unit under test;

receiving an input to select a first group of test cases, the first group of test cases comprising two or more test cases from the plurality of test cases;

determining information on a structure of the unit under test, the structure of the unit under test transformed for displaying the metric data; and

displaying the structure of the unit under test and cumulative metric data for the selected first group of test cases on a display in response to the input.

2. The method of claim 1, wherein the unit under test comprises software or hardware.

3. The method of claim 2, wherein the software comprises a graphical software program or model.

4. The method of claim 1, wherein the plurality of test cases include a first test that tests the unit under test with a first test condition and a second test that tests the unit under test with a second test condition.

5. The method of claim 1, wherein the metric data comprises at least one of cyclomatic complexity, model coverage data, code coverage data, memory usage data, profiling data, performance data and statistics data.

6. The method of claim 1, further comprising:

displaying a graphical object for providing information for a portion of the selected test cases relative to the plurality of test cases.

7. The method of claim 1, further comprising:

displaying statistics for the metric data for the plurality of test cases or the selected test cases.

8. The method of claim 1, further comprising:

receiving an input to select a second group of test cases; and

determining a union or an intersection of the metric data between the first group of test cases and the second group of test cases.

9. The method of claim 1, wherein the plurality of test cases are executed in parallel for testing a unit under test in the test environment.

10. The method of claim 1, wherein the method is performed by a multi-core processor.

11. A computer system for displaying multi-dimensional data on a display, the computer system comprising a processor for executing:

a test environment to;

test a unit under test by;

performing a plurality of test cases,

generating multi-dimensional metric data for the plurality of test cases, where the metric data comprises coverage information indicating a thoroughness of the test cases for evaluating the unit under test, where the metric data is generated by the test environment from the plurality of test cases, and

selecting a first group of test cases based on a received input, the first group of test cases comprising two or more test cases from the plurality of test cases; and

a viewer to;

determine a structure of the unit under test,

transform the structure of the unit under test for displaying the metric data, and

display the structure of the unit under test and cumulative metric data for the selected first group of test cases in response to the received input.

12. The system of claim 11, wherein the metric data comprises at least one of cyclomatic complexity, model coverage data, code coverage data, memory usage data, profiling data, performance data and statistics data.

13. The system of claim 11, the viewer receives an input to select a second group of test cases, and determines a union or an intersection of the metric data between the first group of test cases and the second group of test cases.

14. The system of claim 11, wherein the viewer profiles execution time of the unit under test to transform the structure of the unit under test.

15. The system of claim 11, wherein the unit under test comprises application specific types of logic.

16. The system of claim 11, wherein the test environment comprises a technical computing environment.

17. A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by a computing device cause the computing device to display information on a structure of a unit under test, said instructions including:

one or more instructions for performing a plurality of original test cases to test a unit under test in a test environment that executes the test cases,

one or more instructions for producing multi-dimensional metric data from the plurality of original test cases, where;

the metric data comprises coverage information indicating a thoroughness of the original test cases for evaluating the unit under test, and

the metric data is generated by the test environment from the plurality of test cases;

one or more instructions for selecting a first group of test cases, the first group of test cases comprising two or more test cases from the plurality of test cases;

one or more instructions for determining information on a structure of the unit under test,

one or more instructions for transforming the structure information of the unit under test for displaying with the metric data; and

one or more instructions for displaying the structure information of the unit under test and cumulative metric data for the first group of test cases on a display in response to the input.

18. The computer-readable medium of claim 17, further storing:

one or more instructions for displaying a graphical object for providing information for a portion of the selected test cases relative to the plurality of test cases.

19. The computer-readable medium of claim 17, further storing:

one or more instructions for receiving an input to select a single test case; and

one or more instructions for displaying the metric data for the single test case.

20. A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by a computing device cause the computing device to display information on a structure of a unit under test, said instructions including:

one or more instructions for running a plurality of test cases to generate multi-dimensional metric data from the plurality of test cases in a test environment that executes the test cases, where the metric data is generated by the test environment from the plurality of test cases;

one or more instructions for profiling execution time of functions in the test cases;

one or more instructions for determining information on a structure of the unit under test based on the profiled execution time of the functions in the test cases;

one or more instructions for displaying the structure information of the unit under test and cumulative metric data on a display, the displaying of the structure information comprising displaying the profiled execution time of the functions in the test cases.

21. The computer-readable medium of claim 20, further storing:

one or more instructions for profiling number of calls, parent functions, child functions, code line hit counts, or code line execution time of the functions in the test cases.

22. The computer-readable medium of claim 20, wherein the structure information is displayed in a report documenting the unit under test along with the metric data.