Segmentation and processing of continuous data streams using transactional semantics
First Claim
Patent Images
1. A method for processing a continuous stream of transactional data, the method comprising:
- applying transactional semantics to the continuous stream of transactional data to identify a plurality of segments of the continuous stream of transactional data, wherein the continuous stream of transactional data is from at least one transaction in progress, and wherein each of the plurality of segments contains transactional data,processing the transactional data in each of the plurality of segments of the continuous stream of transactional data to produce results for each of the plurality of segments; and
in response to processing the transactional data in one of the plurality of segments to produce results for one of the plurality of segments, outputting the results produced for the one of the plurality of segments to a storage device,wherein the continuous stream of transactional data is a log of information relating to a plurality of reguests issued to a server, and wherein the applying step comprises reading information relating to one of the plurality of reguests from the log of information; and
applying the transactional semantics to the information,wherein the information relating to the one of the plurality of reguests includes a plurality of fields, and wherein the transactional semantics are defined by a function of the plurality of fields, andwherein the transactional data in the continuous stream of transactional data has a seguence, and wherein there are multiple sources of the continuous stream of transactional data,determining whether a particular portion of transactional data in the continuous stream of transactional data is in seguence, andif the particular portion of transactional data is determined to be out of sequence, interrupting the processing step, inserting the particular portion of transactional data in a particular segment in the plurality of segments according to the transactional semantics, reprocessing the particular segment, and continuing the processing step.
2 Assignments
0 Petitions
Accused Products
Abstract
With a continuous source of data relating to transactions, the data may be segmented and processed in a data flow arrangement, optionally in parallel, and the data may be processed without storing the data in an intermediate database. Data from multiple sources may be processed in parallel. The segmentation also may define points at which aggregate outputs may be provided, and where checkpoints may be established.
-
Citations
16 Claims
-
1. A method for processing a continuous stream of transactional data, the method comprising:
-
applying transactional semantics to the continuous stream of transactional data to identify a plurality of segments of the continuous stream of transactional data, wherein the continuous stream of transactional data is from at least one transaction in progress, and wherein each of the plurality of segments contains transactional data, processing the transactional data in each of the plurality of segments of the continuous stream of transactional data to produce results for each of the plurality of segments; and in response to processing the transactional data in one of the plurality of segments to produce results for one of the plurality of segments, outputting the results produced for the one of the plurality of segments to a storage device, wherein the continuous stream of transactional data is a log of information relating to a plurality of reguests issued to a server, and wherein the applying step comprises reading information relating to one of the plurality of reguests from the log of information; and
applying the transactional semantics to the information,wherein the information relating to the one of the plurality of reguests includes a plurality of fields, and wherein the transactional semantics are defined by a function of the plurality of fields, and wherein the transactional data in the continuous stream of transactional data has a seguence, and wherein there are multiple sources of the continuous stream of transactional data, determining whether a particular portion of transactional data in the continuous stream of transactional data is in seguence, and if the particular portion of transactional data is determined to be out of sequence, interrupting the processing step, inserting the particular portion of transactional data in a particular segment in the plurality of segments according to the transactional semantics, reprocessing the particular segment, and continuing the processing step. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
Specification