Viewing multi-dimensional metric data from multiple test cases

• US 8,762,784 B1
• Filed: 03/19/2013
• Issued: 06/24/2014
• Est. Priority Date: 12/22/2005
• Status: Active Grant

• Current Assignee: The MathWorks, Inc.
• Original Assignee: The MathWorks, Inc.
• Inventors: Portal, Christian, Thomas, Michael J., Owen, James G.
• Primary Examiner(s): PATEL, KAMINI B
• Application Number:
  US13/847,182
• Time in Patent Office: 462 Days
• Field of Search: 714/37
• US Class Current: 714/37
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957

Abstract

A viewer is disclosed for viewing a multi-dimensional data set. The viewer may be coupled to or included in a test environment and receive data generated in the test environment. The test environment may generate metric data from the multiple test cases of a UUT. The viewer may display the cumulative metric data generated from multiple test cases. The viewer may display the cumulative metric data in a fashion that the user can gain insight into the UUT'"'"'s characteristics.

Claims

1. A method comprising:

receiving multi-dimensional metric data from a plurality of test cases,

the plurality of test cases testing a unit under test in a test environment, and

receiving the multi-dimensional metric data being performed by a device;

receiving a user input to select a first group of test cases from the plurality of test cases,

receiving the user input being performed by the device;

determining a structure of the unit under test,

determining the structure being performed by the device;

transforming the structure of the unit under test,

the structure of the unit under test being transformed for displaying a portion of the multi-dimensional metric data associated with the first group of test cases;

correlating the transformed structure of the unit under test with the portion of the multi-dimensional metric data,

correlating the transformed structure being performed by the device; and

providing the transformed structure of the unit under test correlated with the portion of the multi-dimensional metric data for display,

providing the transformed structure of the unit under test correlated with the portion of the multi-dimensional metric data for display being performed by the device.

2. The method of claim 1, where the unit under test comprises software, the method further comprising:

receiving a set of criteria for selecting test cases for testing the unit under test in the test environment; and

filtering, based on the set of criteria, the test cases to identify the plurality of test cases for testing the unit under test.

3. The method of claim 2, where the software comprises a graphical software program.

4. The method of claim 1, where the plurality of test cases includes:

a first test that tests the unit under test with a first test condition, and

a second test that tests the unit under test with a second test condition.

5. The method of claim 1, where the multi-dimensional metric data comprises at least one of:

cyclomatic complexity,

model coverage data,

code coverage data,

memory usage data,

profiling data,

performance data, or

statistics data.

6. The method of claim 1, further comprising:

displaying a graphical object for providing information for a portion of the first group of test cases relative to the plurality of test cases.

7. The method of claim 1, further comprising:

receiving an input to select a single test case; and

displaying the multi-dimensional metric data for the single test case.

8. The method of claim 1, further comprising:

displaying statistics for the multi-dimensional metric data for the plurality of test cases or for the portion of the multi-dimensional data associated with the first group of test cases.

9. The method of claim 1, further comprising:

receiving an input to select a second group of test cases of the plurality of test cases; and

determining a union or an intersection of the multi-dimensional metric data between the first group of test cases and the second group of test cases.

10. The method of claim 1, where the plurality of test cases are executed in parallel for testing the unit under test in the test environment.

11. The method of claim 1, where the device includes a multi-core processor;

and

where correlating the transformed structure of the unit under test with the portion of the multi-dimensional metric data includes;

correlating, using the multi-core processor, the transformed structure of the unit under test with the portion of the multi-dimensional metric data.

12. A computer system comprising:

a processor to;

test a unit under test,

the processor, when testing the unit under test being to;

perform a plurality of test cases,

generate multi-dimensional metric data based on performing the plurality of test cases, and

determine a structure of the unit under test;

transform the structure of the unit under test,

the structure of the unit under test being transformed for displaying the multi-dimensional metric data;

correlate the transformed structure of the unit under test with the multi-dimensional metric data; and

display the structure of the unit under test correlated with the multi-dimensional metric data.

13. The system of claim 12, where the multi-dimensional metric data includes at least one of:

cyclomatic complexity,

model coverage data,

code coverage data,

memory usage data,

profiling data,

performance data, or

statistics data.

14. The system of claim 12, where the processor is further to:

receive an input to select a first group of test cases and a second group of test cases; and

determine a union or an intersection of the multi-dimensional metric data between the first group of test cases and the second group of test cases.

15. The system of claim 12, where, when transforming the structure of the unit under test, the processor is to:

profile an execution time of the unit under test, and

transform the structure of the unit under test based on profiling the execution time.

16. The system of claim 12, where the unit under test includes application specific types of logic.

17. The system of claim 12, where the test environment comprises a technical computing environment.

18. A non-transitory computer-readable storage medium storing instructions, the instructions comprising:

one or more instructions that, when executed by a computing device, cause the computing device to;

perform a plurality of test cases to test a unit under test in a test environment;

produce multi-dimensional metric data based on performing the plurality of test cases;

determine information relating to a structure of the unit under test;

transform the structure of the unit under test,

the structure of the unit under test being transformed for displaying the multi-dimensional metric data;

correlate the transformed structure of the unit under test with the multi-dimensional metric data; and

provide the transformed structure of the unit under test correlated with the multi-dimensional metric data for display.

19. The non-transitory computer-readable storage medium of claim 18, where the instructions further comprise:

one or more instructions that, when executed by the computing device, cause the computing device to display a graphical object for indicating a portion of the plurality of test cases included in the first group of test cases.

20. The non-transitory computer-readable storage medium of claim 18, where the instructions further comprise:

one or more instructions that, when executed by the computing device, cause the computing device to;

receive an input to select a single test case of the plurality of test cases; and

display the multi-dimensional metric data for the single test case.