DATABASE MANAGEMENT

• US 20090234869A1
• Filed: 03/22/2006
• Published: 09/17/2009
• Est. Priority Date: 03/29/2005
• Status: Active Grant

• Current Assignee: British Telecommunications PLC (BT Group PLC)
• Original Assignee: British Telecommunications PLC (BT Group PLC)
• Inventors: Martin, Trevor P., Azvine, Behnam
• Granted Patent: US 7,743,078 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/211 Schema design and management

Abstract

A method of operating a database management system for integrating data from a plurality of data sources comprising steps of:

• • (a) selecting initial attributes for first and second data sources;
  • (b) selecting a candidate matching function relating to a possible mapping between data in said first and second data sources;
  • (c) applying said candidate matching function to data in said first data source to create possible data for said second data source;
  • (d) deriving a disparity measure relating to an amount of disparity therebetween;
  • (e) selecting different candidate matching functions and repeating steps (c) and (d);
  • (f) designating a candidate matching function having a disparity measure indicative of the lowest amount of disparity as a probable candidate matching function;
  • (g) selecting further attributes and performing steps (b) to (f) in respect thereof; and
  • (h) determining a probable correspondence between data objects of said first and second data sources.

Claims

1. ) A method of operating a database management system for integrating data from a plurality of data sources, said data sources being at least partially structured and comprising data objects each comprising data relating to one or more attributes of an entity;

said method comprising steps of;

(a) selecting, for each of a first and a second data source, an initial attribute or combination of attributes;

(b) automatically selecting, in respect of said attributes or combinations of attributes of said first and second data sources, a candidate matching function from a set of possible matching functions, said matching functions relating to possible mappings between data relating to one or more attributes in said first data source and data relating to one or more attributes in said second data source;

(c) applying said candidate matching function to data relating to said selected attribute or combination of attributes in said first data source to create possible data relating to said selected attribute or combination of attributes in said second data source;

(d) deriving, from said possible data and from actual data in said second data source a disparity measure relating to an amount of disparity therebetween;

(e) automatically selecting one or more different candidate matching functions from said set of possible matching functions, and repeating steps (c) and (d) in respect thereof;

(f) establishing, from said candidate matching functions, a candidate matching function having a disparity measure indicative of the lowest amount of disparity, and designating said candidate matching function as a probable candidate matching function;

(g) selecting, for each of said first and second data sources, one or more further attributes or combinations of attributes, and performing steps (b) to (f) in respect thereof whereby to establish probable candidate matching functions in respect thereof; and

(h) determining, with reference to one or more of said established probable candidate matching functions, a probable correspondence between data objects of said first data source and data objects of said second data source.

2. ) A method of operating a database management system according to claim 1 wherein said matching functions are selected from a set of predetermined matching functions.

3. ) A method of operating a database management system according to claim 1 wherein said matching functions are selected from a set of matching functions derived by a machine-learning system.

4. ) A method of operating a database management system according to claim 1, further comprising a step of identifying, in dependence on disparity measures derived in relation to previously-selected matching functions, one or more more-specific matching functions.

5. ) A method of operating a database management system according to claim 1, wherein the step of selecting said initial attributes or combinations of attributes comprises selecting one or more key attributes, said key attributes being attributes having a high cardinality relative to other attributes.

6. ) A method of operating a database management system according to claim 1, wherein said set of possible matching functions includes matching functions which relate to possible mappings between data relating to one or more attributes or combinations of attributes in said first data source and fuzzy sets of elements relating to one or more attributes or combinations of attributes in said second data source.

7. ) A method of operating a database management system according to claim 1, wherein said step of determining a probable correspondence between data objects of said first data source and data objects of said second data source comprises comparing fuzzy sets of elements relating to data objects of said first data source and data objects of said second data source.

8. ) A method of operating a database management system according to any of the preceding claims, further comprising a step of including one or more data objects from one of said first and second data sources into the other of said first and second data sources.

9. ) A method of operating a database management system according to claim 1, further comprising a step of creating a combined data source including one or more data objects from said first data source and one or more data objects from said second data source.

10. ) A method of operating a database management system according to claim 1, wherein different candidate matching functions are selected in turn from said set of possible matching functions until such time as a determination is made that selection of further different candidate matching functions is unlikely to lead to the selection of a further candidate matching function having a disparity measure indicative of the lowest amount of disparity.

11. ) A database management system for integrating data from a plurality of data sources, said data sources being at least partially structured and comprising data objects each comprising data relating to one or more attributes of an entity;

said system comprising;

(a) means for selecting, for each of a first and a second data source, an initial attribute or combination of attributes;

(b) means for automatically selecting, in respect of selected attributes or combinations of attributes of said first and second data sources, a candidate matching function from a set of possible matching functions, said matching functions relating to possible mappings between data relating to one or more attributes in said first data source and data relating to one or more attributes in said second data source;

(c) means for applying a selected candidate matching function to data relating to said selected attribute or combination of attributes in said first data source to create possible data relating to said selected attribute or combination of attributes in said second data source;

(d) means for deriving, from said possible data and from actual data in said second data source a disparity measure relating to an amount of disparity therebetween;

(e) means for automatically selecting one or more different candidate matching functions from said set of possible matching functions, and arranging for the or each of said different candidate matching functions to be treated by means (c) and (d);

(f) means for establishing, from said candidate matching functions, a candidate matching function having a disparity measure indicative of the lowest amount of disparity, and designating said candidate matching function as a probable candidate matching function;

(g) means for selecting, for each of said first and second data sources, one or more further attributes or combinations of attributes, and arranging for the or each of said further attributes or combinations of attributes to be treated by means (b) to (f) whereby to establish probable candidate matching functions in respect thereof; and

(h) means for determining, with reference to one or more of said established probable candidate matching functions, a probable correspondence between data objects of said first data source and data objects of said second data source.

12. ) A database management system according to claim 11 wherein said means for selecting a candidate matching function is arranged to select from a set of predetermined matching functions.

13. ) A database management system according to claim 11 wherein said means for selecting a candidate matching function is arranged to select from a set of matching functions derived by a machine-learning system.

14. ) A database management system according to claim 11, further comprising means for identifying, in dependence on disparity measures derived in relation to previously-selected matching functions, one or more more-specific matching functions.

15. ) A database management system according to claim 11, wherein the means for selecting said initial attributes or combinations of attributes comprises means for selecting one or more key attributes, said key attributes being attributes having a high cardinality relative to other attributes.

16. ) A database management system according to claim 11, wherein said set of possible matching functions includes matching functions which relate to possible mappings between data relating to one or more attributes or combinations of attributes in said first data source and fuzzy sets of elements relating to one or more attributes or combinations of attributes in said second data source.

17. ) A database management system according to claim 11, wherein said means for determining a probable correspondence between data objects of said first data source and data objects of said second data source comprises means for comparing fuzzy sets of elements relating to data objects of said first data source and data objects of said second data source.

18. ) A database management system according to claim 11, further comprising means for including one or more data objects from one of said first and second data sources into the other of said first and second data sources.

19. ) A database management system according to claim 11, further comprising means for creating a combined data source including one or more data objects from said first data source and one or more data objects from said second data source.

20. ) A database management system according to claim 11, wherein said means for selecting one or more different candidate matching functions is arranged to select different candidate matching functions in turn from said set of possible matching functions until such time as a determination is made that selection of further different candidate matching functions is unlikely to lead to the selection of a further candidate matching function having a disparity measure indicative of the lowest amount of disparity.