SYSTEM AND METHOD OF AUTOMATICALLY EXTRACTING DATA FROM PLURALITY OF DATA SOURCES AND LOADING THE SAME TO PLURALITY OF TARGET DATABASES
First Claim
1. A system for automatically extracting data from one or more data sources in various formats through one or more source channels and loading data contained therein to one or more target databases through one or more connectors, the system comprising:
- a data transformation module for transforming data received from the one or more data sources;
a data processing module for automatically analyzing and organising the received data for loading into the one or more target databases; and
a metadata repository for storing metadata of the processed data for future usage,wherein the metadata regarding data structure of the one or more data sources is automatically extracted from the data sources and used to create predefined data structures of the one or more target databases.
0 Assignments
0 Petitions
Accused Products
Abstract
The present invention discloses system and method for automatically extracting data from plurality of data sources in various formats through source channels and loading data to plurality of target databases through connectors. The system includes a data transformation module for transforming data received from the plurality of data sources, a data processing module for automatically analyzing and organising the received data for loading into the plurality of target databases, and a metadata repository for storing metadata of the processed data for future usage. The metadata regarding data structure of the data sources is automatically extracted from the data sources and used to create predefined data structures of the target databases. The data processing module includes a data input handling module for identifying mime-type, extension and the metadata of the data sources, a data structure identification module for identifying type and subtype of the data sources and a target-data-structure creation module for creating the predefined data structures of the target databases.
33 Citations
17 Claims
-
1. A system for automatically extracting data from one or more data sources in various formats through one or more source channels and loading data contained therein to one or more target databases through one or more connectors, the system comprising:
-
a data transformation module for transforming data received from the one or more data sources; a data processing module for automatically analyzing and organising the received data for loading into the one or more target databases; and a metadata repository for storing metadata of the processed data for future usage, wherein the metadata regarding data structure of the one or more data sources is automatically extracted from the data sources and used to create predefined data structures of the one or more target databases. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of automatically extracting data from one or more data sources through one or more source channels and loading data contained therein to one or more target databases comprising:
-
loading one or more data sources from one or more source channels; transforming data received from the one or more data sources by a data transformation module; analyzing and organising the received data automatically for loading into the one or more target databases by a data processing module; generating predefined data structures of the one or more target databases and loading therein through one or more connectors; and storing metadata of the processed data for future usage by a metadata repository, wherein the metadata regarding data structure of the one or more data sources is automatically extracted from the data sources and used to create predefined data structures of the one or more target databases. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method of automatically extracting data from one or more data sources through one or more source channels and loading data contained therein to one or more target databases, said method comprising:
-
loading one or more data sources from one or more source channels; transforming data received from the one or more data sources by a data transformation module; analyzing and organising the received data automatically for loading into the one or more target databases by a data processing module; generating predefined data structures of the one or more target databases and loading therein through one or more connectors; and storing metadata of the processed data for future usage by a metadata repository, wherein the metadata regarding data structure of the one or more data sources is automatically extracted from the data sources and used to create predefined data structures of the one or more target databases.
-
Specification