TECHNIQUES FOR DATA INTEGRATION

• US 20140280218A1
• Filed: 09/30/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Teradata US, Inc. (Teradata Corporation)
• Original Assignee: Teradata US, Inc. (Teradata Corporation)
• Inventors: Ryan, Thomas Kevin, Bansode, Neelesh, Kumar, Arvind, Louis, Anand, Patel, Achal
• Granted Patent: US 9,619,538 B2
• Time in Patent Office: Days
• US Class Current: 707/748
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database

Abstract

Techniques for data integration are provided. Source attributes for source data are interactively mapped to target attributes for target data. Rules define how records from the source data are merged, selected, and for duplication detection. The mappings and rules are recorded as a profile for the source data and processed against the source data to transform the source attributes to the target attributes.

Claims

1. A method implemented and programmed within a non-transitory computer-readable storage medium and processed by a processor, the processor configured to execute the method, comprising:

identifying, by the processor, source data;

mapping, by the processor, source data attributes present in the source data to target data attributes in target data; and

creating, by the processor, a profile for the source data that defines actions of the mapping.

2. The method of claim 1 further comprising, providing, via the processor, the method as an interactive user interface.

3. The method of claim 1 further comprising, evaluating, via the processor, selection rules when multiple records from the source data appear to be a single record.

4. The method of claim 3, wherein evaluating further includes applying custom user-defined selection rules.

5. The method of claim 3, wherein evaluating further includes applying predefined selection rules.

6. The method of claim 5, wherein applying further includes applying the predefined selection rule as one of:

selection based on a highest score for each of the multiple records, selection based on a most-recent record created from the multiple records, selection based on a particular record last modified from the multiple records, and selection based on prioritization of each of the multiple records.

7. The method of claim 1 further comprising, reusing, via the processor, the profile when a new instance of the source data is processed.

8. The method of claim 1 further comprising, processing, via the processor, the profile against the source and target data.

9. The method of claim 8 further comprising, merging, via the processor, records in the source data into the target data.

10. A method implemented and programmed within a non-transitory computer-readable storage medium and processed by a processor, the processor configured to execute the method, comprising:

presenting, via the processor, source attributes for source data and target attributes defined in target data to a user;

recording, via the processor, mappings between the source attributes and the target attributes;

receiving, via the processor, rules for resolving conflicts when transforming the source data to the target data; and

housing, via the processor, the mappings and the rules with an identifier for the source data and another identifier for the target data as a profile for the transforming.

11. The method of claim 10, wherein presenting further includes using a source schema for presenting the source attributes and target schema for presenting the target attributes.

12. The method of claim 10, wherein recording further includes tracking interface selections or associations made by the user between the source attributes and the target attributes as the mappings.

13. The method of claim 10, wherein receiving further includes permitting the user to custom define rules for merging, selection, and duplication of records associated with the source data.

14. The method of claim 10, wherein receiving further includes providing predefined rules for merging, selection, and duplication based on profile type associated with the profile.

15. The method of claim 10, wherein housing further includes augmenting the profile with metadata and control data associated with processing the profile.

16. The method of claim 10 further comprising, using, via the processor, a profile type based on the source data and the target data.

17. The method of claim 10 further comprising, providing, via the processor, the method as a graphical user interface to the user.

18. A system, comprising:

a non-transitory computer-readable storage medium having instructions for a data mapper that execute on one or more processors of a network; and

the non transitory computer-readable storage media having instructions for a data integration interface manager that executes on the one or more processors of the network;

wherein the data mapper is configured to create a mapping between source attributes for source data and target attributes for target data by monitoring actions of a user accessing an interface presented by the data integration interface manager, and the data integration interface manager further configured to create and to record a profile for mappings that when processed transforms the source attributes to the target attributes.

19. The system of claim 18, wherein the data integration interface manager is configured to associate merge rules, duplication rules, and selection rules for records when processing the profile.

20. The system of claim 19, wherein the data integration interface manager is configured to receive custom rules for some of the merge rules, some of the duplication rules, and/or for some of the selection rules.