Regenerating data integration functions for transfer from a data integration platform

• US 20050256892A1
• Filed: 03/16/2005
• Published: 11/17/2005
• Est. Priority Date: 03/16/2004
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: Ascential Software Corporation (International Business Machines Corporation)
• Inventors: Harken, Richard Earl
• Granted Patent: US 7,761,406 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

Methods and systems are provided for migrating a data integration facility, such as an ETL job, from a source data integration platform to a target data integration platform. Certain embodiments involve automatically interpreting at least one operation of a first data integration function adapted to operate on a first data integration platform; translating the at least one interpreted operation into an intermediate format; and regenerating the at least one operation of the first data integration function from the intermediate format to form a regenerated data integration function operation.

Claims

1. A method, comprising:

interpreting at least one operation of a first data integration function adapted to operate on a first data integration platform;

translating the at least one interpreted operation into an intermediate format; and

regenerating the at least one operation of the first data integration function from the intermediate format to form a regenerated data integration function operation.

2. The method of claim 1 wherein the regenerated data integration function operation is adapted to be operational on a second data integration platform.

3. The method of claim 2 wherein the first data integration function was not operationally compatible with the second data integration platform.

4. The method of claim 1 wherein the step of regenerating the at least one operation into an intermediate format further comprises parsing code associate with the at least one operation.

5. The method of claim 4 wherein parsing code associated with the at least one operation comprises parsing metadata associated with the at least one operation.

6. The method of claim 5 wherein the metadata is in an XML format and the parsing is performed using an XML parser.

7. The method of claim 5 wherein the parsed metadata is transformed from a first format into a second format.

8. The method of claim 7 wherein the second format comprises at least one of a generic format, object format, and atomic format.

9. The method of claim 2 wherein the method further comprises the step of testing the regenerated data integration function operation on the second data integration platform.

10. The method of claim 9 wherein the step of testing further comprises determining the effectiveness of the regeneration.

11. The method of claim 1 wherein the first data integration function comprises an ETL function.

12. The method of claim 11 wherein the first data integration function comprises at least one of an extract, transform, and load function.

24. The system of claim 11 wherein the first data integration function comprises at least one of an extract, transform, and load function.

13. A system comprising a regeneration facility adapted to interpret at least one operation of a first data integration function adapted to operate on a first data integration platform, translate the at least one interpreted operation into an intermediate format, and regenerate the at least one operation of the first data integration function from the intermediate format to form a regenerated data integration function operation.

14. The system of claim 13 wherein the regenerated data integration function operation is adapted to be operational on a second data integration platform.

15. The system of claim 14 wherein the first data integration function was not operationally compatible with the second data integration platform.

16. The system of claim 13 wherein the regeneration facility is further adapted to associate code with the at least one operation during the regeneration.

17. The system of claim 16 wherein the code associated with the at least one operation comprises code for parsing metadata associated with the at least one operation.

18. The system of claim 17 wherein the metadata is in an XML format and the parsing is performed using an XML parser.

19. The system of claim 17 wherein the parsed metadata is transformed from a first format into a second format.

20. The system of claim 19 wherein the second format comprises at least one of a generic format, an object format, and an atomic format.

21. The system of claim 14 further comprising a testing facility adapted to test the regenerated data integration function operation.

22. The system of claim 21 further comprising a quality facility adapted to determine the effectiveness of the regeneration.

23. The system of claim 13 wherein the first data integration function comprises an ETL function.