System and method for automatically selecting a data source for providing data related to a query

• US 8,041,712 B2
• Filed: 10/28/2008
• Issued: 10/18/2011
• Est. Priority Date: 07/22/2008
• Status: Expired due to Fees

• Current Assignee: eLumindata, Inc.
• Original Assignee: eLumindata, Inc.
• Inventors: Pan, Ray, Baris, Russell, Kruk, Arthur
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): MYINT, DENNIS Y
• Application Number:
  US12/259,892
• Publication Number:
  US 20100023504A1
• Time in Patent Office: 1,085 Days
• Field of Search: 707/723, 707/748
• US Class Current: 707/723
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

A computer-implemented method of prioritizing a predefined set of electronic data sources includes the steps of electronically determining data sources in which at least one of one or more source fields is the same as a query data item of a query statement, electronically and dynamically ranking the data sources in which at least one of the one or more source fields is the same as the query data item based on at least the ability of the data sources to provide data at one or more query dimensions of the query statement and the extent of aggregation necessary to provide the data, and electronically identifying one or more of the data sources having the highest rank as preferred data sources for locating the data value.

Claims

1. A computer-implemented method of prioritizing a predefined set of electronic data sources, the method comprising the steps of:

providing a database containing metadata related to the predefined set of electronic data sources, the metadata comprising, for each electronic data source, one or more source fields, each source field comprising a source data item or a source dimension;

electronically receiving first signals at a processor, the first signals related to a query for a data value;

electronically identifying a query data item and one or more query dimensions based on the query;

electronically determining the data sources in which at least one of the one or more source fields is the same as the query data item;

electronically and dynamically ranking the data sources in which at least one of the one or more source fields is the same as the query data item based on at least an ability of the data sources to provide data at the one or more query dimensions and an extent of aggregation necessary to provide the data;

electronically identifying one or more of the data sources having the highest rank as preferred data sources for locating the data value;

wherein the metadata further comprises information regarding whether a relationship exists between one or more of the source dimensions of the data sources and the one or more query dimensions;

wherein, if it is determined that a relationship exists between the source dimensions and the one or more query dimensions, the metadata further comprises information regarding whether the relationship is a direct feed relationship or an indirect feed relationship;

wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions; and

wherein, if the data source includes one or more source dimensions that are in a direct feed relationship to the one or more query dimensions, the data source is ranked higher than the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

2. The method of claim 1, wherein the relationships comprise one or more of the following relationship types:

classification relationship and aggregation relationship.

3. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether one or more of the source dimensions of the data source are the same as the one or more query dimensions.

4. The method of claim 3, wherein, if one or more of the source dimensions of the data source are the same as the one or more query dimensions, the data source is ranked higher than the data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

5. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

6. The method of claim 1, wherein, if the data source includes one or more source dimensions that are related to the one or more query dimensions, the data source is ranked higher than the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

7. The method of claim 1, wherein the step of electronically determining the data sources in which at least one of the one or more source fields are the same as the query data item comprises determining whether the one or more source fields are synonyms of the one or more query data items.

8. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the one or more source dimensions of the data source are synonyms of the one or more query dimensions.

9. The method of claim 1, further comprising applying the one or more data sources, sequentially to locate the data value.

10. The method of claim 1, further comprising applying the one or more data sources in parallel to locate the data value.

11. The method of claim 1, wherein the step of ranking the data sources comprises assigning a score to each of the data sources based on at least the ability of the data source to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data.

12. A system for prioritizing a predefined set of electronic data sources, comprising:

a database containing metadata related to the predefined set of electronic data sources, the metadata comprising, for each electronic data source, one or more source fields, each source field comprising a source data item or a source dimension;

a query processor that receives a query for a data value and that electronically identifies a query data item and one or more query dimensions based on the query;

a data source analyzer that determines the data sources in which at least one of the one or more source fields is the same as the query data item;

a data source ranking engine that electronically and dynamically ranks the data sources in which at least one of the one or more source fields is the same as the query data item based on at least an ability of the data sources to provide data at the one or more query dimensions and an extent of aggregation necessary to provide the data;

a data source selection engine that electronically identifies one or more of the data sources having the highest rank as preferred data sources for locating the data value;

wherein the metadata further comprises information regarding whether a relationship exists between one or more source dimensions of the data sources and the one or more query dimensions;

wherein, if it is determined that a relationship exists between one or more source dimensions of the data sources and the query dimensions, the metadata further comprises information regarding whether the relationship is a direct feed relationship or an indirect feed relationship;

wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions; and

wherein the data source ranking engine ranks the data sources in which one or more source dimensions are in a direct feed relationship to the one or more query dimensions higher than the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

13. The system of claim 12, wherein the relationships comprise one or more of the following relationship types:

classification relationship and aggregation relationship.

14. The system of claim 12, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on whether the one or more source dimensions of the data source are the same as the one or more query dimensions.

15. The system of claim 14, wherein the data source ranking engine ranks the data sources in which one or more source dimensions are the same as the one or more query dimensions higher than the data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

16. The system of claim 12, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

17. The system of claim 12, wherein the data source ranking engine ranks the data sources in which one or more source dimensions are related to the one or more query dimensions higher than the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

18. The system of claim 12, wherein the data source analyzer determines the data sources in which at least one of the one or more source fields are the same as the query data item by determining whether the one or more source fields are synonyms of the one or more query data items.

19. The system of claim 12, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on whether the one or more source dimensions of the data source are synonyms of the one or more query dimensions.

20. The system of claim 12, wherein the data source ranking engine ranks the data sources based on scores electronically assigned to the data sources.

21. A computer system comprising a computer-executable program stored on a computer-readable medium having instructions executable on a computer processor for performing a method for prioritizing a predefined set of electronic data sources, the method comprising the steps of:

providing a database containing metadata related to the predefined set of electronic data sources, the metadata comprising, for each electronic data source, one or more source fields, each source field comprising a source data item or a source dimension;

electronically receiving first signals at a processor, the first signals related to a query for a data value;

electronically identifying a query data item and one or more query dimensions based on the query;

electronically determining the data sources in which at least one of the one or more source fields is the same as the query data item;

electronically and dynamically ranking the data sources in which at least one of the one or more source fields is the same as the query data item based on at least an ability of the data sources to provide data at the one or more query dimensions and an extent of aggregation necessary to provide the data;

electronically identifying one or more of the data sources having the highest rank as preferred data sources for locating the data value;

wherein the metadata further comprises information regarding whether a relationship exists between one or more source dimensions of the data sources and the one or more query dimensions;

wherein, if it is determined that a relationship exists between one or more source dimensions of the data sources and the one or more query dimensions, the metadata further comprises information regarding whether the relationship is a direct feed relationship or an indirect feed relationship;

wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions; and

wherein, if the data source includes one or more source dimensions that are in a direct feed relationship to the one or more query dimensions, the data source is ranked higher than the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

22. The computer system of claim 21, wherein the relationships comprise one or more of the following relationship types:

classification relationship and aggregation relationship.

23. The computer system of claim 21, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the one or more source dimensions of the data source are the same as the one or more query dimensions.

24. The computer system of claim 23, wherein, if the one or more source dimensions of the data source are the same as the one or more query dimensions, the data source is ranked higher than the data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

25. The computer system of claim 21, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

26. The computer system of claim 21, wherein, if the data source includes one or more source dimensions that are related to the one or more query dimensions, the data source is ranked higher than the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

27. The computer system of claim 21, wherein the step of electronically determining the data sources in which at least one of the one or more source fields is the same as the query data item comprises determining whether the one or more source fields are synonyms of the one or more query data items.

28. The computer system of claim 21, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the one or more source dimensions of the data source are synonyms of the one or more query dimensions.

29. The computer system of claim 21, further comprising applying the one or more data sources sequentially to locate the data value.

30. The computer system of claim 21, further comprising applying the one or more data sources in parallel to locate the data value.

31. The computer system of claim 21, wherein the step of ranking the data sources comprises assigning a score to each of the data sources based on at least the ability of the data source to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data.