TECHNIQUES FOR PERFORMING ETL OVER A WAN

• US 20100082532A1
• Filed: 09/18/2009
• Published: 04/01/2010
• Est. Priority Date: 09/19/2008
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Verma, Saurabh, Shaik, Sadiq
• Granted Patent: US 8,380,657 B2
• Time in Patent Office: Days
• US Class Current: 707/609
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Abstract

Techniques that enable data extraction, transfer, and load (ETL) operations to be performed asynchronously over communication networks including a Wide Area Network (WAN).

Claims

1. A computer-readable storage medium storing a plurality of instructions controlling one or more processors to facilitate communication of data from a source data store to a target data store, the plurality of instructions comprising:

instructions that cause first data to be extracted at the source data store;

instructions that cause the first data to be pushed from the source data store to the target data store;

instructions that cause one or more transformations to be performed on the first data at the target data store;

instructions that cause the first data to be loaded at the target data store; and

instructions that enable the extraction of first data at the source data store, the first data to be pushed to the target data store, the performance of one or more transformations, and the loading of the first data to be performed asynchronously.

2. The computer-readable storage medium of claim 1 further comprising:

instructions that cause a transportable storage unit to be created at the source data store, the transportable storage unit comprising the first data;

wherein the instructions that cause the first data to be pushed from the source data store to the target data store comprise instructions that cause the transportable storage unit to be communicated from the source data store to the target data store over a communication network.

3. The computer-readable storage medium of claim 2 wherein the communication network is a wide area network (WAN).

4. The computer-readable storage medium of claim 2 wherein the instructions that cause the transportable storage unit to be created comprise:

instructions that cause the first data to be made read-only.

5. The computer-readable storage medium of claim 2 wherein the instructions that cause the transportable storage unit to be communicated from the source data store to the target data store over the communication network comprise instructions that cause the transportable storage unit to be communicated using a file transfer protocol (FTP).

6. The computer-readable storage medium of claim 2 wherein the plurality of instructions further comprise:

instructions that cause the first data to be made read-writable; and

instructions that cause the first data to be loaded into a file system of the target data store.

7. The computer-readable storage medium of claim 2 wherein the transportable storage unit is a tablespace.

8. The computer-readable storage medium of claim 1 wherein the source data store is part of an online transaction processing (OLTP) system and the target data store is a data warehouse of a software as a service (SaaS) vendor.

9. A system comprising:

a memory; and

a processor coupled to the memory, the processor configured to;

extract first data from the memory;

create a transportable storage unit comprising the first data; and

cause the transportable storage unit to be pushed to a target data store over a communication network, the first data being transformed and loaded at the target data store;

wherein the extraction of the first data is performed asynchronously from the transforming and loading of the data at the target data store.

10. The system of claim 9 wherein the communication network is a wide area network (WAN).

11. The system of claim 9 wherein the processor is configured to make the first data read-only.

12. The system of claim 9 wherein the first protocol is configured to cause the transportable storage unit to be pushed to a target data store using file transfer protocol (FTP).

13. The system of claim 9 wherein the transportable storage unit is a tablespace.

14. The system of claim 9 wherein the processor is configured to:

extract the first data from the source data store and store it as a tablespace;

make the tablespace read only; and

copy the tablespace from the source data store to the target data store.

15. A system comprising:

a memory; and

a processor coupled to the memory, the processor configured to;

receive a transportable storage unit from a source data store;

perform one or more transformations on the data from the transportable storage unit; and

load the data from the transportable storage unit into a file system in the memory;

wherein the processor is configured to perform the transformations on the data and the loading of the data asynchronously.

16. The system of claim 15 wherein the processor is configured to make the data in the transportable storage unit readable and writeable.