TEST CASE GENERATOR BUILT INTO DATA-INTEGRATION WORKFLOW EDITOR

• US 20180074944A1
• Filed: 12/21/2016
• Published: 03/15/2018
• Est. Priority Date: 09/15/2016
• Status: Active Grant

• Current Assignee: Talend Incorporated (Talend SA)
• Original Assignee: Talend Incorporated (Talend SA)
• Inventors: HIRT, Michal, Guillaume, Maurice, DYNES, Ciaran
• Granted Patent: US 10,642,720 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 8/34 Graphical or visual programming

Abstract

Embodiments presented herein provide techniques for generating test cases for transformation modules that are part of a larger data-integration workflow for an extract, transfer, and load (ETL) project. A test case generated according to the present disclosure can be executed independently of the application that generated it and independently of data sources and destinations referenced in the data-integration workflow. To achieve this independence, the test case can include code that simulates data sources and destinations that interact with the transformation module in the data-integration workflow. Furthermore, the test case can be a unit test based on a unit testing framework and can be compatible with a selected software framework.

Claims

1. A method for generating a test case for a transformation module of a data-integration workflow, the method comprising:

receiving a request to create a test case for a transformation module of the data-integration workflow that is compatible with a software framework;

identifying an input path from a first data source to the transformation module in the data-integration workflow;

identifying an output path from the transformation module to a second data source in the data-integration workflow; and

generating code that defines the test case for the transformation module, wherein the test case can be executed in the software framework without accessing the first data source or the second data source.

2. The method of claim 1, further comprising:

displaying a graphical model of the data-integration workflow in a graphical user interface (GUI), wherein at least one icon of the graphical model represents the transformation module; and

receiving the request via the graphical user interface, wherein a user identifies the transformation module by selecting the at least one icon.

3. The method of claim 1, further comprising:

receiving test input data for the test case;

receiving target output data for the test case; and

executing the test case by;

executing the transformation module using the test input data,

receiving actual output data from the transformation module, and

comparing the actual output data to the target output data.

4. The method of claim 3, further comprising:

determining, based on the comparison of the actual output data to the target output data, whether the transformation module passed or failed a test defined by the test case, the test input data, and the target output data; and

storing an indication of the determination.

5. The method of claim 3, further comprising:

determining that the transformation module has been changed; and

executing the test case in response to the determination.

6. The method of claim 3, wherein executing the test case includes simulating the first data source to provide the test input data to the transformation module.

7. The method of claim 3, wherein executing the test case includes simulating the second data source to receive the actual output data from the transformation module.

8. The method of claim 1, wherein the test case is associated with a version of the data-integration workflow.

10. The non-transitory computer-readable storage medium of claim 8, wherein the operation further comprises:

displaying a graphical model of the data-integration workflow in a graphical user interface (GUI), wherein at least one icon of the graphical model represents the transformation module; and

receiving the request via the graphical user interface, wherein a user identifies the transformation module by selecting the at least one icon.

11. The non-transitory computer-readable storage medium of claim 8, wherein the operation further comprises:

receiving test input data for the test case;

receiving target output data for the test case; and

executing the test case by;

executing the transformation module using the test input data,

receiving actual output data from the transformation module, and

comparing the actual output data to the target output data.

12. The non-transitory computer-readable storage medium of claim 11, wherein the operation further comprises:

determining, based on the comparison of the actual output data to the target output data, whether the transformation module passed or failed a test defined by the test case, the test input data, and the target output data; and

storing an indication of the determination.

13. The non-transitory computer-readable storage medium of claim 11, wherein the operation further comprises:

determining that the transformation module has been changed; and

executing the test case in response to the determination.

14. The non-transitory computer-readable storage medium of claim 11, wherein executing the test case includes simulating the first data source to provide the test input data to the transformation module.

15. The non-transitory computer-readable storage medium of claim 11, wherein executing the test case includes simulating the second data source to receive the actual output data from the transformation module.

9. A non-transitory computer-readable storage medium containing instructions that, when executed by one or more processors, perform an operation for generating a test case for a transformation module of a data-integration workflow, the operation comprising:

receiving a request to create a test case for a transformation module of the data-integration workflow that is compatible with a software framework;

identifying an input path from a first data source to the transformation module in the data-integration workflow;

identifying an output path from the transformation module to a second data source in the data-integration workflow; and

generating code that defines the test case for the transformation module, wherein the test case can be executed in the software framework without accessing the first data source or the second data source.

16. The non-transitory computer-readable storage medium of claim 9, wherein the test case is associated with a version of the data-integration workflow.

17. A system for generating a test case for a transformation module of a data-integration workflow comprising:

one or more processors; and

a memory storing one or more applications that, when executed on the one or more processors, perform an operation, the operation comprising;

receiving a request to create a test case for a transformation module of the data-integration workflow that is compatible with a software framework,

identifying an input path from a first data source to the transformation module in the data-integration workflow,

identifying an output path from the transformation module to a second data source in the data-integration workflow, and

generating code that defines the test case for the transformation module, wherein the test case can be executed in the software framework without accessing the first data source or the second data source.

18. The system of claim 17, wherein the operation further comprises:

displaying a graphical model of the data-integration workflow in a graphical user interface (GUI), wherein at least one icon of the graphical model represents the transformation module; and

receiving the request via the graphical user interface, wherein a user identifies the transformation module by selecting the at least one icon.

19. The system of claim 17, wherein the operation further comprises:

receiving test input data for the test case;

receiving target output data for the test case; and

executing the test case by;

executing the transformation module using the test input data,

receiving actual output data from the transformation module, and

comparing the actual output data to the target output data.

20. The system of claim 19, wherein the operation further comprises:

determining, based on the comparison of the actual output data to the target output data, whether the transformation module passed or failed a test defined by the test case, the test input data, and the target output data; and

storing an indication of the determination.

21. The system of claim 19, wherein the operation further comprises:

determining that the transformation module has been changed; and

executing the test case in response to the determination.

22. The system of claim 19, wherein executing the test case includes simulating the first data source to provide the test input data to the transformation module.

23. The system of claim 19, wherein executing the test case includes simulating the second data source to receive the actual output data from the transformation module.