Multiple source data management using a conflict rule

• US 8,918,377 B2
• Filed: 01/21/2013
• Issued: 12/23/2014
• Est. Priority Date: 06/29/2006
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Garrett, Andrew J., Martin, James A. Jr., Prince, Jeffrey E.
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US13/746,100
• Publication Number:
  US 20130132354A1
• Time in Patent Office: 701 Days
• Field of Search: 707/694, 707/802, 707/702, 705/7.11
• US Class Current: 707/694
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

A solution for managing data received from multiple sources is provided. In particular, when conflicting data values are received from multiple sources for a data element, a conflict rule is used to determine the main data value for the data element, which is subsequently stored for use. The conflict rule can define any automatic, semi-automatic, or manual procedure for resolving the conflict. The conflict rule, or an identifier thereof, can be stored with each data value and the main data value for the data element.

Claims

1. A system for managing data received from a plurality of sources, the system comprising:

a system for obtaining a multi-dimensional set of data from each of the plurality of sources, each multi-dimensional set of data including a common data element;

a system for generating a main multi-dimensional set of data based on a combination of the sets of data, the system for generating including;

a system for obtaining a data value for the data element from each of the sets of data obtained from the plurality of sources;

a system for determining whether a conflict exists between the obtained data values;

a system for using a conflict rule to determine a main data value for the data element in the main multi-dimensional set of data when the conflict exists;

a system for storing a derivation record for the main data value for the data element in the main multi-dimensional set of data, the derivation record including;

the main data value, the data value received from each of the plurality of sources, and the conflict rule;

a system for obtaining the stored derivation record;

a system for modifying the conflict rule, which is stored in the derivation record; and

a system for determining a new main data value using the modified conflict rule.

2. The system of claim 1, further comprising a system for obtaining one of a plurality of conflict rules for use as the conflict rule for the data element.

3. The system of claim 1, further comprising a system for using the data value as the main data value when the conflict does not exist.

4. The system of claim 1, wherein the system for using includes a system for automatically selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources.

5. The system of claim 1, wherein the system for using includes:

a system for selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources;

a system for presenting the selected data value for evaluation by at least one of the sources; and

a system for obtaining the main data value based on the evaluation.

6. The system of claim 1, wherein the system for using includes:

a system for providing the plurality of data values for evaluation by a third party; and

a system for obtaining the main data value based on the evaluation.

7. A computer program comprising program code stored on a non-transitory computer-readable medium, which when executed, enables a computer system to implement a process for managing data received from a plurality of sources, the process comprising:

obtaining a multi-dimensional set of data from each of the plurality of sources, each multi-dimensional set of data including a common data element;

generating a main multi-dimensional set of data based on a combination of the sets of data, the generating including;

obtaining a data value for the data element from each of the sets of data obtained from the plurality of sources;

determining whether a conflict exists between the obtained data values;

using a conflict rule to determine a main data value for the data element in the main multi-dimensional set of data when the conflict exists;

storing a derivation record for the main data value for the data element in the main multi-dimensional set of data, the derivation record including;

the main data value, the data value received from each of the plurality of sources, and the conflict rule;

obtaining the stored derivation record;

modifying the conflict rule, which is stored in the derivation record; and

determining a new main data value using the modified conflict rule.

8. The computer program of claim 7, the process further comprising obtaining one of a plurality of conflict rules for use as the conflict rule for the data element.

9. The computer program of claim 7, the process further comprising using the data value as the main data value when the conflict does not exist.

10. The computer program of claim 7, wherein the using includes automatically selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources.

11. The computer program of claim 7, wherein the using includes:

selecting the data value received from one of the plurality of sources based on a corresponding priority for each of the plurality of sources;

presenting the selected data value for evaluation by at least one of the sources; and

obtaining the main data value based on the evaluation.

12. The computer program of claim 7, wherein the using includes:

providing the plurality of data values for evaluation by a third party; and

obtaining the main data value based on the evaluation.

13. A method of generating a system for managing data received from a plurality of sources, the method comprising:

providing a computer system operable to;

obtain a multi-dimensional set of data from each of the plurality of sources, each multi-dimensional set of data including a common data element;

generate a main multi-dimensional set of data based on a combination of the sets of data, the generating including;

obtaining a data value for the data element from each of the sets of data obtained from the plurality of sources;

determining whether a conflict exists between the obtained data values;

using a conflict rule to determine a main data value for the data element in the main multi-dimensional set of data when the conflict exists;

storing a derivation record for the main data value for the data element in the main multi-dimensional set of data, the derivation record including;

the main data value, the data value received from each of the plurality of sources, and the conflict rule;

obtaining the stored derivation record;

modifying the conflict rule, which is stored in the derivation record; and

determining a new main data value using the modified conflict rule.