UPDATING HISTORIC DATA AND REAL-TIME DATA IN REPORTS
First Claim
1. An article of manufacture including a computer readable storage medium to tangibly store instructions, which when executed by a computer, cause the computer to:
- receive a request to view a historic data and a real-time data in a report;
identify one or more data objects associated with the request;
identify one or more extract, transform and load (ETL) jobs associated with the identified one or more data objects, the one or more ETL jobs comprising transformations of a different one or more data objects;
determine a delta ETL job associated with the identified one or more ETL jobs and an upload timestamp of the delta ETL job, wherein the delta ETL job is a most recent batch of ETL jobs uploaded to a data warehouse;
based on the upload timestamp of the delta ETL job, generate a data warehouse query for the data warehouse;
based on the transformations in the one or more ETL jobs and the upload timestamp of the delta ETL job, generate a real-time query for a transaction database;
execute the data warehouse query and the real-time query to obtain the historic data and the real-time data; and
update the report with the historic data and the real-time data.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are methods and systems for updating a report with real-time data. The method and systems involve receiving a request to view both historic data and real-time data in the report, identifying one or more data objects associated with the request, identifying one or more ETL jobs associated with the identified one or more data objects, determining a delta ETL job associated with the identified one or more ETL jobs and a upload timestamp of a delta ETL job, generating a data warehouse query based on the upload timestamp of the delta ETL job, generating a real-time query based on the transformations in the one or more ETL jobs and the upload timestamp of the delta ETL job, executing queries of the data warehouse query and real-time query to obtain historic data and real-time data and updating the report with both real-time data and historic data.
57 Citations
20 Claims
-
1. An article of manufacture including a computer readable storage medium to tangibly store instructions, which when executed by a computer, cause the computer to:
-
receive a request to view a historic data and a real-time data in a report; identify one or more data objects associated with the request; identify one or more extract, transform and load (ETL) jobs associated with the identified one or more data objects, the one or more ETL jobs comprising transformations of a different one or more data objects; determine a delta ETL job associated with the identified one or more ETL jobs and an upload timestamp of the delta ETL job, wherein the delta ETL job is a most recent batch of ETL jobs uploaded to a data warehouse; based on the upload timestamp of the delta ETL job, generate a data warehouse query for the data warehouse; based on the transformations in the one or more ETL jobs and the upload timestamp of the delta ETL job, generate a real-time query for a transaction database; execute the data warehouse query and the real-time query to obtain the historic data and the real-time data; and update the report with the historic data and the real-time data. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A computer system for updating historic data and real-time data to a report, the system comprising:
-
a data warehouse to store the historic data; a transaction database to store the real-time data; a processor; a memory in communication with the processor, storing; a report module to receive a request to view both the historic data and the real-time data in the report; an extract, transform and load-enterprise information integration (ETL-EII) module to; identify one or more data objects associated with the request; identify one or more ETL jobs associated with the identified one or more data objects, the one or more ETL jobs comprising transformations of a different one or more data objects; determine a delta ETL job associated with the one or more ETL jobs and an upload timestamp of the delta ETL job, the delta ETL job is a most recent batch of ETL jobs uploaded to the data warehouse; based on the upload timestamp of the delta ETL job, generate a data warehouse query; based on the transformations in the identified one or more ETL jobs and the upload timestamp of the delta ETL job, generate a real-time query for the transaction database; execute the data warehouse query and the real-time query to obtain the historic data and the real-time data; and an update module to update the report with both the historic data and the real-time data. - View Dependent Claims (8, 9, 10, 11, 12, 13)
-
-
14. A computerized method for updating historic data and real-time data to a report, the method comprising:
-
identifying one or more data objects associated with a user request to view both the historic data and the real-time data; identifying one or more extract, transform and load (ETL) jobs associated with the identified one or more data objects, the one or more ETL jobs comprising transformations of a different one or more data objects; initiating a backtracking of the transformations in the identified one or more ETL jobs; determining a timestamp of a most recent data warehouse update associated with the identified one or more ETL jobs; based on the timestamp of the most recent data warehouse update, retrieving the historic data from a data warehouse up to the timestamp of the most recent data warehouse update; retrieving the real-time data for the transformations in the one or more ETL jobs from a transaction database since the timestamp of the most recent data warehouse update; and merging the historic data and the real-time data. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification