System and method for automatically linking data sources for providing data related to a query

• US 8,176,042 B2
• Filed: 10/24/2008
• Issued: 05/08/2012
• Est. Priority Date: 07/22/2008
• Status: Active Grant

• Current Assignee: eLumindata, Inc.
• Original Assignee: eLumindata, Inc.
• Inventors: Baris, Russell, Pan, Ray, Kruk, Arthur
• Primary Examiner(s): Breene, John E
• Assistant Examiner(s): MYINT, DENNIS Y
• Application Number:
  US12/257,831
• Publication Number:
  US 20100023487A1
• Time in Patent Office: 1,292 Days
• Field of Search: 707/723, 707/748, 707/737
• US Class Current: 707/723
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

A computer-implemented method of linking a predefined set of electronic data sources comprises electronically identifying a query data item and one or more query dimensions based on a query statement, electronically determining first data sources in which at least one of one or more source fields is equivalent to the query data item, determining whether any one of the first data sources has the ability to provide the data related to the one or more query dimensions, and identifying one or more second data sources within the database corresponding to one or more of the first data sources if it is determined that the first data sources do not have the ability to provide data related to the one or more query dimensions. The one or more second data sources meet the following criteria: (1) one or more source fields of the one or more second data sources are equivalent to the one or more query dimensions not contained in the first data source; and (2) each source dimension of the one or more second data sources are either: (A) equivalent to a source field of the first source or (B) have values that are capable of being obtained from the query statement. One or more first data sources are linked with the corresponding one or more second data sources to generate one or more composite data sources to provide the necessary data in response to the query statement.

Claims

1. A computer-implemented method of linking a predefined set of electronic data sources, the method comprising the steps of:

(a) providing a database stored on a computer readable medium, wherein the database contains metadata related to the predefined set of electronic data sources, and the metadata comprises, for each electronic data source, one or more source fields, each of the source fields comprising a data item or a source dimension;

(b) electronically receiving first signals at a processor that is operatively connected to computer readable media, wherein the first signals relate to a query statement for a data value;

(c) electronically identifying a query data item and one or more query dimensions based on the query statement;

(d) electronically determining first data sources within the database in which at least one of the one or more source fields is equivalent to the query data item;

(e) determining whether any one of the first data sources has an ability to provide the data related to the one or more query dimensions;

(f) identifying one or more second data sources within the database corresponding to one or more of the first data sources if it is determined that the first data sources do not have the ability to provide data related to the one or more query dimensions, the one or more second data sources meeting the following criteria;

(1) one or more source fields of the one or more second data sources are equivalent to the one or more query dimensions not contained in the first data source; and

(2) each source dimension of the one or more second data sources are either;

(A) equivalent to a source field of the first source or (B) have values that are capable of being obtained from the query statement;

(g) linking the one or more first data sources with the corresponding one or more second data sources to generate one or more composite data sources.

2. The method of claim 1, wherein the metadata further comprises information regarding whether a relationship exists between source dimensions of the data sources.

3. The method of claim 2, further comprising the step of updating the database with information regarding whether the relationship between the source dimensions is a direct feed relationship or an indirect feed relationship if it is determined that a relationship exists between one or more source dimensions of the data sources.

4. The method of claim 3, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions.

5. The method of claim 2, wherein the relationship is a classification relationship.

6. The method of claim 2, wherein the relationship is an aggregation relationship.

7. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether one or more source dimensions of the data source are equivalent to the one or more query dimensions.

8. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

9. The method of claim 1, wherein the step of electronically determining first data sources comprises determining data sources in which at least one or more source fields are synonyms of the query data item.

10. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether one or more source dimensions of the data source are synonyms of the one or more query dimensions.

11. The method of claim 1, further comprising applying the one or more data sources sequentially to locate the data value.

12. The method of claim 1, further comprising applying the one or more data sources in parallel to locate the data value.

13. The method of claim 1, wherein the step of electronically determining first data sources comprises electronically determining first data sources in which at least one or more source fields are the same as the query data item.

14. The method of claim 1, wherein the step of identifying one or more second data sources comprises identifying one or more second data sources comprising one or more source fields that are the same as the one or more query dimensions not contained in the first data source.

15. The method of claim 1, further comprising the step of electronically and dynamically ranking each of the first data sources based on one or more criteria, wherein the one or more criteria comprise at least the ability to provide data related to the one or more query dimensions and an extent of aggregation necessary to provide the data.

16. The method of claim 15, further comprising the step of electronically and dynamically ranking the composite data sources based on the one or more criteria.

17. The method of claim 16, further comprising electronically identifying one or more of the composite data sources having the highest rank as preferred data sources for locating the data value.