System and method for optimizing federated and ETL'd databases having multidimensionally constrained data

• US 7,523,118 B2
• Filed: 05/02/2006
• Issued: 04/21/2009
• Est. Priority Date: 05/02/2006
• Status: Expired due to Fees

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Kraemer, James R., Friedlander, Robert R., Hennessy, Richard
• Primary Examiner(s): Pham; Khanh B.
• Assistant Examiner(s): LODHI, ANDALIB FT
• Application Number:
  US11/416,973
• Publication Number:
  US 20070276851A1
• Time in Patent Office: 1,085 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure

Abstract

Method, system, and program product for configuring and using a federated database management system. The design of the metadata and queries includes the steps of first determining schema and metadata configurations of the data source servers. The next step is enumerating available resources, and enumerating security and confidentiality requirements. These are used for calculating an optimal federated database management system design based on the schema and metadata, the enumerated available resources, and the enumerated security and confidentiality requirements; and designing an optimal federated database management system.

Claims

1. A method for optimizing a federated database management system having a federated database server and a plurality of data source servers comprising the steps of:

a) determining schema and metadata configurations of the data source servers;

b) enumerating available resources;

c) enumerating security and confidentiality requirements;

d) calculating an optimal federated database management system design based on the schema and metadata, the enumerated available resources, and the enumerated security and confidentiality requirements, wherein said calculating includes;

(i) modeling a cost in terms of available resources consumed by each strategy of a plurality of strategies while executing a query with said federated database management system;

(ii) determining whether operations associated with said query should be performed by said federated database server or one of said data source servers;

(iii) determining the optimal order of said operations associated with said query;

e) designing an optimal federated database management system, wherein said designing includes;

(i) selecting the strategy having the lowest cost for executing said query;

(ii) in response to determining that said operations associated with said query should be performed by said federated database server, selecting said federated database server to perform said operations according to said optimal order;

(ii) in response to determining that said operations associated with said query should be performed by one of said data source servers, selecting said data source server to perform said operations according to said optimal order; and

f) providing functionality for user input including user heuristics and data inputs.

2. The method of claim 1 wherein available resources include people, skill sets, network capability, computing equipment, budget, time constraints, software systems, database management system application program interfaces, and storage.

3. The method of claim 1 wherein the security and confidentiality requirements include medical records confidentiality.

4. The method of claim 1 comprising designing the optimal federated database management system using one or more of an entity unification scheme, conformal dimensions, an aggregation scheme, unified metadata, and a unified data model.

5. A program product comprising a storage medium containing computer readable program code for directing a computer system to carry out the steps of:

a) determining schema and metadata configurations of the data source servers;

b) enumerating available resources;

c) enumerating security and confidentiality requirements;

d) calculating an optimal federated database management system design based on the schema and metadata, the enumerated available resources, and the enumerated security and confidentiality requirements, wherein said calculating includes;

(i) modeling a cost in terms of available resources consumed by each strategy of a plurality of strategies while executing a query with said federated database management system;

(ii) determining whether operations associated with said query should be performed by said federated database server or one of said data source servers;

(iii) determining the optimal order of said operations associated with said query;

e) designing an optimal federated database management system, wherein said designing includes;

(i) selecting the strategy having the lowest cost for executing said query;

(ii) in response to determining that said operations associated with said query should be performed by said federated database server, selecting said federated database server to perform said operations according to said optimal order;

(ii) in response to determining that said operations associated with said query should be performed by one of said data source servers, selecting said data source server to perform said operations according to said optimal order; and

f) providing functionality for user input including user heuristics and data inputs.

6. The program product of claim 5 wherein available resources include people, skill sets, network capability, computing equipment, budget, time constraints, software systems, database management system application program interfaces, and storage.

7. The program product of claim 5 wherein the security and confidentiality requirements include medical records confidentiality.

8. The program product of claim 5 comprising designing the optimal federated database management system using one or more of an entity unification scheme, conformal dimensions, an aggregation scheme, unified metadata, and a unified data model.