System and method for aggregating raw data into a star schema

• US 8,401,990 B2
• Filed: 07/25/2008
• Issued: 03/19/2013
• Est. Priority Date: 07/25/2008
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Silsby, Joseph M.
• Primary Examiner(s): Kerzhner, Aleksandr
• Application Number:
  US12/180,372
• Publication Number:
  US 20100023546A1
• Time in Patent Office: 1,698 Days
• Field of Search: 707/601, 707/602, 707/999.102
• US Class Current: 707/601
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

A method for aggregating raw data into a star schema comprises receiving data from a data source. The data is aggregated into star schema objects, based on a user-defined metadata schema. The star schema objects are stored into a star schema database.

Claims

1. A method, comprising:

receiving data from a first data source;

converting the data into data packets having a common format using a user-defined metadata schema;

filtering the data packets using the user-defined metadata schema, wherein filtering the data packets includes;

replacing data in a first portion of the data packets with data from database tables of a second data source; and

storing a second portion of the data packets in a third data source;

aggregating the first portion of the data packets into star schema objects, based on the user-defined metadata schema;

storing the star schema objects into a star schema database; and

wherein the metadata schema defines how the data is converted into data packets, filtering criteria, and the star schema objects.

2. The method of claim 1, wherein the star schema database is generated in approximately real time using the user-defined metadata schema.

3. The method of claim 1, wherein the star schema objects comprise statistics relating to the data.

4. The method of claim 3, further comprising generating reports based on the statistics.

5. The method of claim 4, further comprising communicating the reports to a user.

6. The method of claim 1, wherein filtering the data packets further includes deleting data packets based on one or more thresholds defined in the user-defined metadata schema.

7. A system, comprising:

an interface being operable to receive data from a first data source;

a processor being operable to;

convert the data into data packets having a common format using a user-defined metadata schema;

filter the data packets using the user-defined metadata schema, wherein filtering the data packets includes;

replacing data in a first portion of the data packets with data from database tables of a second data source; and

storing a second portion of the data packets in a third data source;

aggregate the filtered first portion of the data packets into star schema objects, based on the user-defined metadata schema;

a star schema database operable to store the star schema objects; and

wherein the metadata schema defines how the data is converted into data packets, filtering criteria, and the star schema objects.

8. The system of claim 7, wherein the star schema database is generated in approximately real time using the user-defined metadata schema.

9. The system of claim 7, wherein the star schema objects comprise statistics relating to the data.

10. The system of claim 9, wherein the processor is further operable to generate reports based on the statistics.

11. The system of claim 10, wherein the interface is further operable to communicate the reports to a user.

12. The system of The method of claim 7, wherein the processor operable to filter the data packets is further operable to delete data packets based on one or more thresholds defined in the user-defined metadata schema.

13. A non-transitory, computer readable medium comprising logic operable, when executed on a processor, to:

receive data from a first data source;

convert the data into data packets having a common format using a user-defined metadata schema;

filter the data packets using the user-defined metadata schema, wherein filtering the data packets includes;

replacing data in a first portion of the data packets with data from database tables of a second data source; and

storing a second portion of the data packets in a third data source;

aggregate the first portion of the data packets into star schema objects, based on the user-defined metadata schema;

store the star schema objects into a star schema database; and

wherein the metadata schema defines how the data is converted into data packets, filtering criteria, and the star schema objects.

14. The computer readable medium of claim 13, wherein the star schema database is generated in approximately real time using the user-defined metadata schema.

15. The computer readable medium of claim 13, wherein the star schema objects comprise statistics relating to the data.

16. The computer readable medium of claim 15, wherein the logic is further operable to generate reports based on the statistics.

17. The computer readable medium of claim 16, wherein the logic is further operable to communicate the reports to a user.

18. The computer readable medium of claim 13, wherein the logic operable to filter the data packets is further operable to delete data packets based on one or more thresholds defined in the user-defined metadata schema.