BIG-FAST DATA CONNECTOR BETWEEN IN-MEMORY DATABASE SYSTEM AND DATA WAREHOUSE SYSTEM
First Claim
1. An in-memory database system that supports fast ingest data transfer between the in-memory database system and a data warehouse system, the in-memory database system comprising:
- an in-memory database instance that receives and stores data;
a listener, communicatively coupled to the in-memory database instance, that, responsive to receiving notification that a data event has occurred in the in-memory database instance, selects a queue to which the data event will be sent and sends the data event to the selected queue to be sent to the data warehouse system; and
the queue system comprising a plurality of queues, each queue comprising a proxy table communicatively coupled to receive the data event from the listener and an associated write-behind listener that determines whether an update condition has been being satisfied for the queue and responsive to an update condition being satisfied, sends the data event to the data warehouse system.
3 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the present invention include systems and methods for insuring better query consistency between at least two different databases, where one faster database has more up-to-date information than another slower database, and wherein updates are typically applied to the faster database first and then to the slower database. In embodiments, the systems and methods also insure that a query to the slower database is not performed until a set of one or more updates from the faster database have been applied to that slower database.
-
Citations
20 Claims
-
1. An in-memory database system that supports fast ingest data transfer between the in-memory database system and a data warehouse system, the in-memory database system comprising:
-
an in-memory database instance that receives and stores data; a listener, communicatively coupled to the in-memory database instance, that, responsive to receiving notification that a data event has occurred in the in-memory database instance, selects a queue to which the data event will be sent and sends the data event to the selected queue to be sent to the data warehouse system; and the queue system comprising a plurality of queues, each queue comprising a proxy table communicatively coupled to receive the data event from the listener and an associated write-behind listener that determines whether an update condition has been being satisfied for the queue and responsive to an update condition being satisfied, sends the data event to the data warehouse system. - View Dependent Claims (2, 3, 4)
-
-
5. A computer-implement method for facilitating data transfer between an in-memory database system and a data warehouse system comprising:
-
receiving notification at a listener that a data event has been occurred at the in-memory database system; identifying a queue to which the data event should be sent; sending the data event to the identified queue to be sent to the data warehouse system; and responsive to an update condition being satisfied, sending the data event to the data warehouse system. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12)
-
-
13. A fast ingest system for facilitating data transfer between an in-memory database system and a data warehouse system, the fast ingest system comprising:
-
a listener that, responsive to receiving notification that a data event has occurred in the in-memory database system, selects a queue in a queue system comprising a plurality of queues to which the data event will be sent and sends the data event to the selected queue to be sent to the data warehouse system; and the queue system comprising a plurality of queues, each a queue comprising a proxy table communicatively coupled to receive the data event from the listener and an associated write-behind listener that determines whether an update condition has been being satisfied for the queue and responsive to an update condition being satisfied, writes the data event to the data warehouse system. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification