AUTOMATED IDENTIFICATION OF COMPLEX TRANSFORMATIONS AND GENERATION OF SUBSCRIPTIONS FOR DATA

• US 20160275099A1
• Filed: 12/16/2015
• Published: 09/22/2016
• Est. Priority Date: 03/20/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Miller, Gregg W., Jarvie, Rachel L., Marcovecchio, Nick
• Granted Patent: US 10,210,233 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/1794 Details of file format conversion
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 8/51 Source to source
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 8/76 Adapting program code to run in a different environment; Porting
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

According to embodiments of the present invention, machines, systems, methods and computer program products as part of a data replication process are provided. One or more complex transformations are identified from source code files of installed software products on a target system. A subscription is created for each complex transformation, the subscription containing instructions for transforming data within the source system into a form compatible with the target system. The instructions are executed within the target system to transform source data of the source system into a form compatible with the target system.

Claims

1. A computer-implemented method for data replication comprising:

identifying one or more complex transformations from source code files of installed software products on a target system;

creating a subscription for each complex transformation, the subscription containing instructions for transforming data within a source system into a form compatible with the target system; and

executing the instructions within the target system to transform source data of the source system into a form compatible with the target system.

2. The computer-implemented method of claim 1, wherein the subscription may comprise one or more references to one or more executable files containing instructions for transforming data of the source system into a form compatible with the target system, the instructions comprising generated source code.

3. The computer-implemented method of claim 2, wherein the executable file further comprises instructions providing fine grain access control to individual items of data to be transformed, the fine grain access control specifying instructions for controlling access to one or more particular tables of data, rows of data, columns of data or variables to be transformed.

4. The computer-implemented method of claim 3, wherein the fine grain access control includes, for a plurality of tables identified to be impacted by the complex transformation:

determining a subset of the plurality of tables comprising data that is not to be transformed;

inactivating access to the subset of tables; and

performing the complex transformation only on the tables that have not been inactivated.

5. The computer-implemented method of claim 2, further comprising creating the generated source code by:

selecting a source code file of the target system containing a complex transformation;

updating source code of the source code file to transform data of the source system into a form compatible with the target system; and

saving the updated source code.

6. The computer-implemented method of claim 1, further comprising:

obtaining an order of installation of the source code files of installed software products on the target system;

parsing the source code files in the order of installation to identify a corresponding order of the complex transformations; and

generating a cache of the complex transformations, wherein each table in the cache lists the identified complex transformations in the corresponding order based on the respective source code file.

7. The computer-implemented method of claim 1, further comprising:

generating a report listing differences between the source system and the target system;

identifying from the report, items of data that are present within the target system; and

generating a subscription for each complex transformation having a corresponding item of data in the target system.