CONSISTENCY SENSITIVE STREAMING OPERATORS
First Claim
1. A computer-implemented system for stream processing, comprising:
- a stream component for receiving an input stream that includes event imperfections based on speculative execution and for providing consistency in an output; and
a set of operators for providing multiple consistency levels via which consistency in the output is guaranteed.
2 Assignments
0 Petitions
Accused Products
Abstract
A new approach for handling stream imperfections based on speculative execution involves the retraction of incorrect events facilitated using operators to remove speculatively produced incorrect output. Additionally, parameters are disclosed that define a spectrum of consistency levels. A first parameter, maximum blocking time, exposes a tradeoff between a degree of speculation and latency. A second parameter, the maximum time data is remembered before being purged from the system, exposes a tradeoff between state size and correctness. Varying these two parameters produces a spectrum of consistency levels (e.g., strong, middle, weak) which address the specific tradeoffs built into other systems. Retraction is accomplished using operators that include Select, AlterLifetime, Join, Sum, Align, and Finalize.
-
Citations
20 Claims
-
1. A computer-implemented system for stream processing, comprising:
-
a stream component for receiving an input stream that includes event imperfections based on speculative execution and for providing consistency in an output; and a set of operators for providing multiple consistency levels via which consistency in the output is guaranteed. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented method of processing a stream of events, comprising:
-
receiving a stream of events that includes out-of-order events based on speculative execution; executing a query against the stream of events; processing the stream of events associated with the query based on multiple levels of consistency defined by a set of operators; correcting the out-of-order events based on the set of operators; and generating an output in which consistency is guaranteed based on the corrected out-of-order events. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. A computer-implemented system, comprising:
-
computer-implemented means for receiving a stream of events that includes out-of-order events based on speculative execution; computer-implemented means for executing a query against the stream of events; computer-implemented means for processing the stream of events associated with the query based on multiple levels of consistency defined by a set of operators; computer-implemented means for correcting the out-of-order events based on the set of operators; and computer-implemented means for generating an output in which consistency is guaranteed based on the corrected out-of-order events.
-
Specification