Method and System for Implementing Parallel Transformations of Records
First Claim
1. A method for transforming data records, comprising:
- identifying a data unit;
generating a first record to place into the data unit;
generating a second record to place into the data unit, wherein the first record and the second records are concurrently generated;
generating a first transformation corresponding to the first record; and
generating a second transformation corresponding to the second record, in which the first and second transformations are generated after generation of the first and second records but before placement of the record in the data unit, and wherein the first and second transformations are concurrently generated.
1 Assignment
0 Petitions
Accused Products
Abstract
An improved approach is described for implementing transformations of data records in high concurrency environments. Each transformation is performed in parallel at the source when the data record is first generated. According to one approach for data integrity validation, record generators compute an integrity checksum for a newly generated record before copying into a data unit in shared memory. Subsequent generators may aggregate integrity checksums for data records into checksums for data units incrementally. This approach achieves end-to-end protection of data records against corruption using an efficient method of maintaining verifiable data integrity. In another approach, compression and encryption data transformations may be performed by themselves, or in combination with an integrity checksum transformation.
-
Citations
39 Claims
-
1. A method for transforming data records, comprising:
-
identifying a data unit; generating a first record to place into the data unit; generating a second record to place into the data unit, wherein the first record and the second records are concurrently generated; generating a first transformation corresponding to the first record; and generating a second transformation corresponding to the second record, in which the first and second transformations are generated after generation of the first and second records but before placement of the record in the data unit, and wherein the first and second transformations are concurrently generated. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A system for transforming data records, comprising:
-
means for identifying a data unit; means for generating a first record to place into the data unit; means for generating a second record to place into the data unit, wherein the first record and the second records are concurrently generated; and means for generating a first transformation corresponding to the first record; means for generating a second transformation corresponding to the second record, in which the first and second transformations are generated after generation of the first and second records but before placement of the record in the data unit, and wherein the first and second transformations are concurrently generated. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A computer program product that includes a computer readable medium, the computer readable medium comprising a plurality of computer instructions which, when executed by a processor, cause the processor to transform data records, the process comprising:
-
identifying a data unit; generating a first record to place into the data unit; generating a second record to place into the data unit, wherein the first record and the second records are concurrently generated; generating a first transformation corresponding to the first record; and generating a second transformation corresponding to the second record, in which the first and second transformations are generated after generation of the first and second records but before placement of the record in the data unit, and wherein the first and second transformations are concurrently generated. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39)
-
Specification