DETERMINATION OF AN UPDATED DATA SOURCE FROM DISPARATE DATA SOURCES

• US 20100036892A1
• Filed: 09/29/2008
• Published: 02/11/2010
• Est. Priority Date: 08/08/2008
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Pandya, Saurabh
• Granted Patent: US 8,352,442 B2
• Time in Patent Office: Days
• US Class Current: N/A
• CPC Class Codes: G06F 16/244 Grouping and aggregation
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database

Abstract

A method and system for determining an updated data source from first and second disparate data sources. A first and second data list is received from the first and second data sources, respectively. The data elements in the first data list matching data elements in the second data list are written to a first aggregation data list. The data elements in the first data list not matching data elements in the second data list are written to an additions data list. The data elements in the second data list not matching data elements in the first data list are written to a first deletions data list. All data elements in the first aggregation data list and the additions data list are written into a second aggregation data list. All data elements matching the data elements in the first deletions data list are written into a second deletions data list.

Claims

1. A method for determining an updated data source from a first disparate data source and a second disparate data source in a data processing system, said method comprising:

receiving into a volatile memory a first data list and a second data list associated with the first disparate data source and the second disparate data source, respectively;

determining all data elements in the first data list that match data elements in the second data list;

writing into a first aggregation data list in the volatile memory said determined all data elements in the first data list that match data elements in the second data list;

determining all data elements in the first data list that do not match data elements in the second data list;

writing into an additions data list in said volatile memory said determined all data elements in the first data list that do not match data elements in the second data list;

determining all data elements in the second data list that do not match data elements in the first data list;

writing into a first deletions data list in said volatile memory said determined all data elements in the second data list that do not match data elements in the first data list;

after said writing into the first aggregation data list, said writing into the additions data list, and said writing into the first deletions data list;

writing to a second aggregation data list in a non-volatile memory of a data store all data elements in the first aggregation data list and all data elements in the additions data list; and

after said writing into the first deletions data list, removing from a second deletions data list stored in the non-volatile memory of the data store. all data elements matching the data elements in the first deletions data list.

2. The method of claim 1, wherein a server comprises a social networlkng application, a third party application, and the data store, wherein the received first data list and second data list is a copy of a first contact list and a second contact list, respectively, of a user, and wherein the first contact list and the second contact list is respectively comprised by the social networking application and the third party application.

3. The method of claim 2, wherein said method further comprises for a given data element in first aggregation data list and its matching data element in the first and second data lists:

finding first supplementary data and second supplementary data associated with the matching data element in the first data list and the second data list, respectively, and wherein the and wherein the first supplementary data differs from the second supplementary data.

storing the first supplementary data and the second supplementary data along with the given data element in the first aggregation data list.

4. The method of claim 3, wherein the first supplementary data and the second supplementary data are each selected from the group consisting of a name of the user, an email address of the user, and a telephone number of the user.

5. The method of claim 1, wherein the data elements in the second aggregation data list consist of the data elements in the first aggregation data list.

6. The method of claim 5, wherein the data elements in the second aggregation data list are in a different sequential order than the data elements in the first aggregation list.

7. The method of claim 1, wherein said removing results in the second deletions data list being empty.

14. The computer system of claim 1, wherein said removing results in the second deletions data list being empty.

8. A computer system comprising a processor and a computer readable storage medium, said storage medium containing program code configured to be executed by the processor to implement a method for determining an updated data source from a first disparate data source and a second disparate data source in a data processing system, said method comprising:

receiving into a volatile memory a first data list and a second data list associated with the first disparate data source and the second disparate data source, respectively;

determining all data elements in the first data list that match data elements in the second data list;

writing into a first aggregation data list in the volatile memory said determined all data elements in the first data list that match data elements in the second data list;

determining all data elements in the first data list that do not match data elements in the second data list;

writing into an additions data list in said volatile memory said determined all data elements in the first data list that do not match data elements in the second data list;

determining all data elements in the second data list that do not match data elements in the first data list;

writing into a first deletions data list in said volatile memory said determined all data elements in the second data list that do not match data elements in the first data list;

after said writing into the first aggregation data list, said writing into the additions data list, and said writing into the first deletions data list;

writing to a second aggregation data list in a non-volatile memory of a data store all data elements in the first aggregation data list and all data elements in the additions data list; and

after said writing into the first deletions data list, removing from a second deletions data list stored in the non-volatile memory of the data store. all data elements matching the data elements in the first deletions data list.

9. The computer system of claim 8, wherein a server comprises a social networking application, a third party application, and the data store, wherein the received first data list and second data list is a copy of a first contact list and a second contact list, respectively, of a user, and wherein the first contact list and the second contact list is respectively comprised by the social networking application and the third party application.

10. The computer system of claim 9, wherein said method further comprises for a given data element in first aggregation data list and its matching data element in the first and second data lists:

finding first supplementary data and second supplementary data associated with the matching data element in the first data list and the second data list, respectively, and wherein the and wherein the first supplementary data differs from the second supplementary data.

storing the first supplementary data and the second supplementary data along with the given data element in the first aggregation data list.

11. The computer system of claim 10, wherein the first supplementary data and the second supplementary data are each selected from the group consisting of a name of the user, an email address of the user, and a telephone number of the user.

12. The computer system of claim 8, wherein the data elements in the second aggregation data list consist of the data elements in the first aggregation data list.

13. The computer system of claim 12, wherein the data elements in the second aggregation data list are in a different sequential order than the data elements in the first aggregation list.

15. A computer program product, comprising a computer readable storage medium having a computer readable program code therein, said computer readable program code comprising an algorithm configured to implement a method for determining an updated data source from a first disparate data source and a second disparate data source in a data processing system, said method comprising:

receiving into a volatile memory a first data list and a second data list associated with the first disparate data source and the second disparate data source, respectively;

determining all data elements in the first data list that match data elements in the second data list;

writing into a first aggregation data list in the volatile memory said determined all data elements in the first data list that match data elements in the second data list;

determining all data elements in the first data list that do not match data elements in the second data list;

writing into an additions data list in said volatile memory said determined all data elements in the first data list that do not match data elements in the second data list;

determining all data elements in the second data list that do not match data elements in the first data list;

writing into a first deletions data list in said volatile memory said determined all data elements in the second data list that do not match data elements in the first data list;

after said writing into the first aggregation data list, said writing into the additions data list, and said writing into the first deletions data list;

writing to a second aggregation data list in a non-volatile memory of a data store all data elements in the first aggregation data list and all data elements in the additions data list; and

after said writing into the first deletions data list, removing from a second deletions data list stored in the non-volatile memory of the data store. all data elements matching the data elements in the first deletions data list.

16. The computer program product of claim 15, wherein a server comprises a social networking application, a third party application, and the data store, wherein the received first data list and second data list is a copy of a first contact list and a second contact list, respectively, of a user, and wherein the first contact list and the second contact list is respectively comprised by the social networking application and the third party application.

17. The computer program product of claim 16, wherein said method further comprises for a given data element in first aggregation data list and its matching data element in the first and second data lists:

finding first supplementary data and second supplementary data associated with the matching data element in the first data list and the second data list, respectively, and wherein the and wherein the first supplementary data differs from the second supplementary data.

storing the first supplementary data and the second supplementary data along with the given data element in the first aggregation data list.

18. The computer program product of claim 17, wherein the first supplementary data and the second supplementary data are each selected from the group consisting of a name of the user, an email address of the user, and a telephone number of the user.

19. The computer program product of claim 15, wherein the data elements in the second aggregation data list consist of the data elements in the first aggregation data list.

20. The computer program product of claim 19, wherein the data elements in the second aggregation data list are in a different sequential order than the data elements in the first aggregation list.