SYSTEMS AND METHODS FOR GENERATING MULTI-POPULATION STATISTICAL MEASURES USING MIDDLEWARE

• US 20100057777A1
• Filed: 08/28/2008
• Published: 03/04/2010
• Est. Priority Date: 08/28/2008
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Williamson, Eric
• Granted Patent: US 8,463,739 B2
• Time in Patent Office: Days
• US Class Current: N/A
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases

Abstract

Embodiments relate to systems and methods for the generation of multi-population statistical measures on a set of data sources. A set of applications such as online analytical processing (OLAP) applications can access the combined data of a set of data sources via an aggregation engine. The set of data sources can be configured with diverse dimensions and associated data. In general the data sources may not be expected to reflect a strictly consistent structure. In embodiments, the aggregation engine can combine or aggregate the set of data sources using common dimensions or data points, and build an index into a transform table reflecting a combined mapping. An OLAP or other application can then perform statistical computations, searches, sorts, and/or other operations on the combined mapping, even when the original data sources do not contain identical dimensions or other formats.

Claims

1. A method of aggregating data, comprising:

receiving a data request from at least one application;

identifying a set of data sources containing data corresponding to the data request;

extracting data corresponding to the data request from the set of data sources; and

generating a set of quantitative measures based on the data extracted from the set of data sources.

2. The method of claim 1, wherein the set of data sources comprises a set of online analytical processing (OLAP) data sources.

3. The method of claim 1, wherein the at least one application comprises at least one online analytical processing (OLAP) application.

4. The method of claim 1, wherein the set of quantitative measures comprises a set of statistical measures computed based on the extracted data.

5. The method of claim 1, wherein the set of statistical measures comprises at least one of an average calculation, a mean calculation, a median calculation, a regression calculation, a sorting calculation, a modeling calculation, and a least-squares fit calculation.

6. The method of claim 1, wherein the generating a set of statistical measures is performed in a middleware module located between the at least one application and the set of data sources.

7. The method of claim 1, further comprising storing the set of quantitative measures to a data store.

8. A system for generating multi-population statistics, comprising:

an interface to receive a data request from at least one application; and

an aggregation engine, communicating with the interface, the aggregation engine being configured to—

receive a data request from at least one application,

identify a set of data sources containing data corresponding to the data request,

extract data corresponding to the data request from the set of data sources, and

generate a set of quantitative measures based on the data extracted from the set of data sources.

9. The system of claim 8, wherein the set of data sources comprises a set of online analytical processing (OLAP) data sources.

10. The system of claim 8, wherein the at least one application comprises at least one online analytical processing (OLAP) application.

11. The system of claim 8, wherein the set of quantitative measures comprises a set of statistical measures computed based on the extracted data.

12. The system of claim 8, wherein the set of statistical measures comprises at least one of an average calculation, a mean calculation, a median calculation, a regression calculation, a sorting calculation, a modeling calculation, and a least-squares fit calculation.

13. The system of claim 8, wherein the aggregation engine comprises a middleware module located between the at least one application and the set of data sources.

14. The system of claim 8, wherein the aggregation engine is further configured to store the set of quantitative measures to a data store.

15. A set of statistical measures generated from an aggregation of multi-population data, the set of statistical measures being generated by a method comprising:

receiving a data request from at least one application;

identifying a set of data sources containing data corresponding to the data request;

extracting data corresponding to the data request from the set of data sources; and

generating a set of quantitative measures based on the data extracted from the set of data sources.

16. The set of statistical measures of claim 15, wherein the set of data sources comprises a set of online analytical processing (OLAP) data sources.

17. The set of statistical measures of claim 15, wherein the at least one application comprises at least one online analytical processing (OLAP) application.

18. The set of statistical measures of claim 15, wherein the set of quantitative measures comprises a set of statistical measures computed based on the extracted data.

19. The set of statistical measures of claim 15, wherein the set of statistical measures comprises at least one of an average calculation, a mean calculation, a median calculation, a regression calculation, a sorting calculation, a modeling calculation, and a least-squares fit calculation.

20. The set of statistical measures of claim 15, wherein the generating a set of statistical measures is performed in a middleware module located between the at least one application and the set of data sources.

21. The set of statistical measures of claim 15, further comprising storing the set of quantitative measures to a data store.