Set-oriented real-time data processing based on transaction boundaries
First Claim
1. A method for processing a plurality of data records, comprising:
- setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets;
processing via a database transformation each of the one or more data sets thereby producing a multiplicity of results from the one or more data sets; and
completing the processing of the plurality of data records by synchronizing the transaction boundaries and combining said multiplicity of results.
8 Assignments
0 Petitions
Accused Products
Abstract
A method is provided for real-time data processing based on data sets or data sets defined by applicable rules or user-defined logic. Also provided is a real-time data processing system that implements such method. Transaction boundaries are set and propagated through cascades of multiple data transformations on multitudes of data records or rows. The method may be implemented in conjunction with a relational database management system (DBMS), object DBMS, or any other DBMS. The method and system for real-time data processing may be advantageously applied in Extract, Transform, and Load (ETL), Enterprise Application Integration (EAI), and Enterprise Information Integration (EII).
-
Citations
52 Claims
-
1. A method for processing a plurality of data records, comprising:
-
setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets; processing via a database transformation each of the one or more data sets thereby producing a multiplicity of results from the one or more data sets; and completing the processing of the plurality of data records by synchronizing the transaction boundaries and combining said multiplicity of results. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for performing a series of transformations on a plurality of data records, wherein said series of transformations initiate at a source and conclude at a target, said method comprises:
-
setting transaction boundaries among said plurality of data records at said source thereby dividing the plurality of data records into one or more data sets; propagating the transaction boundaries through the series of transformations from the source to the target; performing said series of transformations based on the one or more data sets thereby producing a multiplicity of results from said series of transformations; and completing the series of transformations by synchronizing the transaction boundaries and combining said multiplicity of results. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A system for processing a plurality of data records, comprising:
-
means for setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets; means for processing via a database transformation each of said one or more data sets thereby producing a multiplicity of results from the one or more data sets; and means for synchronizing the transaction boundaries and combining said multiplicity of results thereby completing said processing. - View Dependent Claims (27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A system for performing a series of transformations on a plurality of data records, wherein said series of transformations initiate at a source and conclude at a target, said system comprises:
-
means for setting transaction boundaries among said plurality of data records at the source thereby dividing the plurality of data records into one or more data sets; means for propagating the transaction boundaries through the series of transformations from the source to the target; means for performing said series of transformations based on the one or more data sets thereby producing a multiplicity of results from said series of transformations; and means for synchronizing the transaction boundaries and combining the multiplicity of results thereby completing the series of transformations. - View Dependent Claims (38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50)
-
-
51. A computer readable medium having recorded thereon program instructions which when processed by a computer are capable of executing a method for processing a plurality of data records, said method comprising:
-
setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets; processing via a database transformation each of said one or more data sets thereby producing a multiplicity of results from the one or more data sets; and completing the processing of said plurality by synchronizing the transaction boundaries and combining said multiplicity of results.
-
-
52. A computer readable medium having recorded thereon program instructions which when processed by a computer are capable of executing a method for performing a series of transformations on a plurality of data records, said method comprising:
-
setting transaction boundaries among said plurality of data records thereby dividing the plurality of data records into one or more data sets; propagating the transaction boundaries through said series of transformations; performing said series of transformations based on the one or more data sets thereby producing a multiplicity of results from said series of transformations; and completing the series of transformations by synchronizing the transaction boundaries and combining said multiplicity of results.
-
Specification