System and method for automatically selecting a data source for providing data related to a query

• US 8,037,062 B2
• Filed: 10/23/2008
• Issued: 10/11/2011
• Est. Priority Date: 07/22/2008
• Status: Expired due to Fees

• Current Assignee: eLumindata, Inc.
• Original Assignee: eLumindata, Inc.
• Inventors: Pan, Ray, Baris, Russell, Kruk, Arthur
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): MYINT, DENNIS Y
• Application Number:
  US12/257,230
• Publication Number:
  US 20100023503A1
• Time in Patent Office: 1,083 Days
• Field of Search: 707/723, 707/748
• US Class Current: 707/723
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

A computer-implemented method of prioritizing a predefined set of electronic data sources includes a step of identifying one or more second data sources corresponding to one or more first data sources if it is determined that the first data sources do not have the ability to provide data related to one or more query dimensions of a query statement. The identified one or more second data sources meet the following criteria: (1) one or more source fields of the one or more second data sources are equivalent to the one or more query dimensions not contained in the first data source; and (2) each source dimension field of the one or more second data sources are either: (A) equivalent to a source field of the first source or (B) have values that are capable of being obtained from the query statement. The one or more first data sources are linked with the corresponding one or more second data sources to generate one or more composite data sources. Scores are electronically assigned to each of the composite data sources based on certain criteria, and the composite data sources are electronically and dynamically ranked based on the assigned scores. One or more of the composite data sources electronically identified as having the highest rank are selected as preferred data sources for locating the data value in response to the query statement.

Claims

1. A computer-implemented method of prioritizing a predefined set of electronic data sources, the method comprising the steps of:

(a) providing a database stored on a computer readable medium, wherein the database contains metadata related to the predefined set of electronic data sources, and the metadata comprises, for each electronic data source, one or more source fields, each of the source fields comprising a data item or a source dimension;

(b) electronically receiving first signals at a processor that is operatively connected to the computer readable medium, wherein the first signals relate to a query statement for a data value;

(c) electronically identifying a query data item and one or more query dimensions based on the query statement;

(d) electronically determining first data sources within the database in which at least one of the one or more source fields is equivalent to the query data item;

(e) electronically assigning a score to each of the first data sources based on one or more criteria, wherein the one or more criteria comprise an ability to provide data related to the one or more query dimensions and an extent of aggregation necessary to provide the data;

(f) determining whether any one of the first data sources has a score that indicates the first data source has the ability to provide the data related to the one or more query dimensions;

(g) identifying one or more second data sources within the database corresponding to one or more of the first data sources if it is determined that the first data sources have scores that indicate the first data sources do not have the ability to provide data related to the one or more query dimensions, the one or more second data sources meeting the following criteria;

(1) one or more source fields of the one or more second data sources are equivalent to the one or more query dimensions not contained in the first data source; and

(2) each source dimension of the one or more second data sources are either;

(A) equivalent to a source field of the first source or (B) have values that are capable of being obtained from the query statement;

(h) linking the one or more first data sources with the corresponding one or more second data sources to generate one or more composite data sources;

(i) electronically assigning a score to each of the composite data sources based on the one or more criteria;

(j) electronically and dynamically ranking the composite data sources based on the assigned scores; and

(k) electronically identifying one or more of the composite data sources having the highest rank as preferred data sources for locating the data value.

2. The method of claim 1, wherein the metadata further comprises information regarding whether a relationship exists between source dimensions of the data sources.

3. The method of claim 2, further comprising the step of updating the database with information regarding whether the relationship between the source dimensions is a direct feed relationship or an indirect feed relationship if it is determined that a relationship exists between one or more source dimensions of the data sources.

4. The method of claim 3, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions.

5. The method of claim 4, wherein, if the data source includes one or more source dimensions that are related to the one or more query dimensions, the data source is assigned a score that is higher than the scores assigned to the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

6. The method of claim 4, wherein, if the data source includes one or more source dimensions that are in a direct feed relationship to the one or more query dimensions, the data source is assigned a score that is higher than the scores assigned to the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

7. The method of claim 2, wherein the relationship is a classification relationship.

8. The method of claim 2, wherein the relationship is an aggregation relationship.

9. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether one or more source dimensions of the data source are equivalent to the one or more query dimensions.

10. The method of claim 9, wherein higher scores are assigned to data sources in which one or more source dimensions are the same as the one or more query dimensions as compared to scores assigned to data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

11. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

12. The method of claim 1, wherein the step of electronically determining first data sources comprises determining data sources in which at least one or more source fields are synonyms of the query data item.

13. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether one or more source dimensions of the data source are synonyms of the one or more query dimensions.

14. The method of claim 1, further comprising applying the one or more data sources sequentially to locate the data value.

15. The method of claim 1, further comprising applying the one or more data sources in parallel to locate the data value.

16. The method of claim 1, wherein the step of electronically determining first data sources comprises electronically determining first data sources in which at least one or more source fields are the same as the query data item.

17. The method of claim 1, wherein the step of identifying one or more second data sources comprises identifying one or more second data sources comprising one or more source fields that are the same as the one or more query dimensions not contained in the first data source.