SYSTEM AND METHOD FOR AUTOMATICALLY SELECTING A DATA SOURCE FOR PROVIDING DATA RELATED TO A QUERY

• US 20100023504A1
• Filed: 10/28/2008
• Published: 01/28/2010
• Est. Priority Date: 07/22/2008
• Status: Active Grant

• Current Assignee: eLumindata, Inc.
• Original Assignee: eLumindata, Inc.
• Inventors: Pan, Ray, Baris, Russell, Kruk, Arthur
• Granted Patent: US 8,041,712 B2
• Time in Patent Office: Days
• US Class Current: N/A
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

A computer-implemented method of prioritizing a predefined set of electronic data sources includes the steps of electronically determining data sources in which at least one of one or more source fields is the same as a query data item of a query statement, electronically and dynamically ranking the data sources in which at least one of the one or more source fields is the same as the query data item based on at least the ability of the data sources to provide data at one or more query dimensions of the query statement and the extent of aggregation necessary to provide the data, and electronically identifying one or more of the data sources having the highest rank as preferred data sources for locating the data value.

Claims

1. A computer-implemented method of prioritizing a predefined set of electronic data sources, the method comprising the steps of:

providing a database containing metadata related to the predefined set of electronic data sources, the metadata comprising, for each electronic data source, one or more source fields, each source field comprising a source data item or a source dimension;

electronically receiving first signals at a processor, the first signals related to a query for a data value;

electronically identifying a query data item and one or more query dimensions based on the query;

electronically determining the data sources in which at least one of the one or more source fields is the same as the query data item;

electronically and dynamically ranking the data sources in which at least one of the one or more source fields is the same as the query data item based on at least the ability of the data sources to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data; and

electronically identifying one or more of the data sources having the highest rank as preferred data sources for locating the data value.

2. The method of claim 1, wherein the metadata further comprises information regarding whether a relationship exists between one or more of the source dimensions of the data sources and the one or more query dimensions.

3. The method of claim 2, wherein, if it is determined that a relationship exists between the source dimensions and the one or more query dimensions, the metadata further comprises information regarding whether the relationship is a direct feed relationship or an indirect feed relationship.

4. The method of claim 2, wherein the relationships comprise one or more of the following relationship types:

classification relationship and aggregation relationship.

5. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether one or more of the source dimensions of the data source are the same as the one or more query dimensions.

6. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

7. The method of claim 5, wherein, if one or more of the source dimensions of the data source are the same as the one or more query dimensions, the data source is ranked higher than the data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

8. The method of claim 3, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions.

9. The method of claim 8, wherein, if the data source includes one or more source dimensions that are related to the one or more query dimensions, the data source is ranked higher than the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

10. The method of claim 8, wherein, if the data source includes one or more source dimensions that are in a direct feed relationship to the one or more query dimensions, the data source is ranked higher than the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

11. The method of claim 1, wherein the step of electronically determining the data sources in which at least one of the one or more source fields are the same as the query data item comprises determining whether the one or more source fields are synonyms of the one or more query data items.

12. The method of claim 1, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the one or more source dimensions of the data source are synonyms of the one or more query dimensions.

13. The method of claim 1, further comprising applying the one or more data sources sequentially to locate the data value.

14. The method of claim 1, further comprising applying the one or more data sources in parallel to locate the data value.

15. The method of claim 1, wherein the step of ranking the data sources comprises assigning a score to each of the data sources based on at least the ability of the data source to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data.

16. A system for prioritizing a predefined set of electronic data sources, comprising:

a database containing metadata related to the predefined set of electronic data sources, the metadata comprising, for each electronic data source, one or more source fields, each source field comprising a source data item or a source dimension;

a query processor that receives a query for a data value and that electronically identifies a query data item and one or more query dimensions based on the query;

a data source analyzer that determines the data sources in which at least one of the one or more source fields is the same as the query data item;

a data source ranking engine that electronically and dynamically ranks the data sources in which at least one of the one or more source fields is the same as the query data item based on at least the ability of the data sources to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data; and

a data source selection engine that electronically identifies one or more of the data sources having the highest rank as preferred data sources for locating the data value.

17. The system of claim 16, wherein the metadata further comprises information regarding whether a relationship exists between one or more source dimensions of the data sources and the one or more query dimensions.

18. The system of claim 17, wherein, if it is determined that a relationship exists between one or more source dimensions of the data sources and the query dimensions, the metadata further comprises information regarding whether the relationship is a direct feed relationship or an indirect feed relationship.

19. The system of claim 17, wherein the relationships comprise one or more of the following relationship types:

classification relationship and aggregation relationship.

20. The system of claim 16, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on whether the one or more source dimensions of the data source are the same as the one or more query dimensions.

21. The system of claim 16, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

22. The system of claim 20, wherein the data source ranking engine ranks the data sources in which one or more source dimensions are the same as the one or more query dimensions higher than the data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

23. The system of claim 18, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions.

24. The system of claim 23, wherein the data source ranking engine ranks the data sources in which one or more source dimensions are related to the one or more query dimensions higher than the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

25. The system of claim 23, wherein the data source ranking engine ranks the data sources in which one or more source dimensions are in a direct feed relationship to the one or more query dimensions higher than the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

26. The system of claim 16, wherein the data source analyzer determines the data sources in which at least one of the one or more source fields are the same as the query data item by determining whether the one or more source fields are synonyms of the one or more query data items.

27. The system of claim 16, wherein the data source ranking engine determines the ability of the data source to provide data corresponding to the one or more query dimensions based on whether the one or more source dimensions of the data source are synonyms of the one or more query dimensions.

28. The system of claim 16, wherein the data source ranking engine ranks the data sources based on scores electronically assigned to the data sources.

41. The computer system of claim 27, further comprising applying the one or more data sources sequentially to locate the data value.

29. A computer system comprising a computer-executable program stored on a computer-readable medium having instructions executable on a computer processor for performing a method for prioritizing a predefined set of electronic data sources, the method comprising the steps of:

providing a database containing metadata related to the predefined set of electronic data sources, the metadata comprising, for each electronic data source, one or more source fields, each source field comprising a source data item or a source dimension;

electronically receiving first signals at a processor, the first signals related to a query for a data value;

electronically identifying a query data item and one or more query dimensions based on the query;

electronically determining the data sources in which at least one of the one or more source fields is the same as the query data item;

electronically and dynamically ranking the data sources in which at least one of the one or more source fields is the same as the query data item based on at least the ability of the data sources to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data; and

electronically identifying one or more of the data sources having the highest rank as preferred data sources for locating the data value.

30. The computer system of claim 29, wherein the metadata further comprises information regarding whether a relationship exists between one or more source dimensions of the data sources and the one or more query dimensions.

31. The computer system of claim 30, wherein, if it is determined that a relationship exists between one or more source dimensions of the data sources and the one or more query dimensions, the metadata further comprises information regarding whether the relationship is a direct feed relationship or an indirect feed relationship.

32. The computer system of claim 30, wherein the relationships comprise one or more of the following relationship types:

classification relationship and aggregation relationship.

33. The computer system of claim 29, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the one or more source dimensions of the data source are the same as the one or more query dimensions.

34. The computer system of claim 29, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on one or more of the following:

quality of data in the data source, quantity of data in the data source, and user selection of one or more preferred data sources.

35. The computer system of claim 33, wherein, if the one or more source dimensions of the data source are the same as the one or more query dimensions, the data source is ranked higher than the data sources that do not have one or more source dimensions that are the same as the one or more query dimensions.

36. The computer system of claim 31, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the data source includes one or more source dimensions that are related to the one or more query dimensions.

37. The computer system of claim 36, wherein, if the data source includes one or more source dimensions that are related to the one or more query dimensions, the data source is ranked higher than the data sources that do not include one or more source dimensions that are related to the one or more query dimensions.

38. The computer system of claim 36, wherein, if the data source includes one or more source dimensions that are in a direct feed relationship to the one or more query dimensions, the data source is ranked higher than the data sources that include one or more source dimensions that are in an indirect feed relationship with the one or more query dimensions.

39. The computer system of claim 29, wherein the step of electronically determining the data sources in which at least one of the one or more source fields is the same as the query data item comprises determining whether the one or more source fields are synonyms of the one or more query data items.

40. The computer system of claim 29, wherein the ability of the data source to provide data corresponding to the one or more query dimensions is determined based on whether the one or more source dimensions of the data source are synonyms of the one or more query dimensions.

42. The computer system of claim 29, further comprising applying the one or more data sources in parallel to locate the data value.

43. The computer system of claim 29, wherein the step of ranking the data sources comprises assigning a score to each of the data sources based on at least the ability of the data source to provide data at the one or more query dimensions and the extent of aggregation necessary to provide the data.