Apparatus and method for pipelined event processing in a distributed environment
First Claim
Patent Images
1. A method, comprising:
- receiving first data from a first data source that continuously generates a first set of records with first common fields, wherein the first set of records characterize a first real-lime event,filtering the first data by selecting a first sub-set of fields of the first common fields to form first filtered data, wherein filtering the first data includes accessing in dynamic memory the first data stored as in-flight data;
receiving second data from a second data source that continuously generates a second set of records with second common fields, wherein the second set of records characterize a second real-time event different than the first real-time event,filtering the second data by selecting a second sub-set of fields of the second common fields to form second filtered data, wherein filtering the second data includes accessing in dynamic memory the second data stored as in-flight data, wherein the first filtered data and the second filtered data are generated simultaneously by separate nodes in a network and reside in dynamic memory as in-flight data;
applying rules to the first filtered data and the second filtered data at the separate nodes in the network in real-time to identify selected real-time events stored in dynamic memory as in-flight data; and
reporting the selected real-time events prior to persistently storing the first filtered data, the second filtered data and the selected real-time events.
2 Assignments
0 Petitions
Accused Products
Abstract
A method includes receiving first data from a first data source that continuously generates a first set of records with first common fields. The first data is filtered by selecting a first sub-set of fields of the first common fields to form first filtered data. Second data is received from a second data source that continuously generates a second set of records with second common fields. The second data is filtered by selecting a second sub-set of fields of the second common fields to form second filtered data, where the first filtered data and the second filtered data are generated simultaneously. Rules are applied to the first filtered data and the second filtered data in real-time to identify selected real-time events. The selected real-time events are reported prior to persistently storing the first filtered data, the second filtered data and the selected real-time events.
16 Citations
20 Claims
-
1. A method, comprising:
-
receiving first data from a first data source that continuously generates a first set of records with first common fields, wherein the first set of records characterize a first real-lime event, filtering the first data by selecting a first sub-set of fields of the first common fields to form first filtered data, wherein filtering the first data includes accessing in dynamic memory the first data stored as in-flight data; receiving second data from a second data source that continuously generates a second set of records with second common fields, wherein the second set of records characterize a second real-time event different than the first real-time event, filtering the second data by selecting a second sub-set of fields of the second common fields to form second filtered data, wherein filtering the second data includes accessing in dynamic memory the second data stored as in-flight data, wherein the first filtered data and the second filtered data are generated simultaneously by separate nodes in a network and reside in dynamic memory as in-flight data; applying rules to the first filtered data and the second filtered data at the separate nodes in the network in real-time to identify selected real-time events stored in dynamic memory as in-flight data; and reporting the selected real-time events prior to persistently storing the first filtered data, the second filtered data and the selected real-time events. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system, comprising:
-
a first data source that continuously generates a first set of records with first common fields;
wherein the first set of records characterize a first real-time event;a second data source that continuously generates a second set of records with second common fields, wherein the second set of records characterize a second real-time event different than the first real-time event; a first data processor to filter the first data by accessing the first data stored in dynamic memory as in-flight data and selecting a first sub-set of fields of the first common fields to form first filtered data stored in dynamic memory as in-flight data; and a second data processor to filter the second data by accessing the second data in dynamic memory as in-flight data and selecting a second sub-set of fields of the second common fields to form second filtered data stored in dynamic memory as in-flight data, wherein the first data processor and the second data processor are on separate nodes in a network, and apply rules to the first filtered data and the second filtered data in real-time to identify and report selected real-time events stored in dynamic memory as in-flight data prior to persistently storing the first filtered data, the second filtered data and the selected real-time events. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification
-
- Resources
Litigation Campaign Assessment
Thank you for your request. You will receive a custom alert email when the Litigation Campaign Assessment is available.
×
-
Current AssigneeStriim, Inc.
-
Original AssigneeStriim, Inc.
-
InventorsPareek, Alok, Kutay, Ali, Wilkes, Steve, Akbay, Sami
-
Primary Examiner(s)Le, Debbie
-
Application NumberUS14/285,428Publication NumberTime in Patent Office1,202 DaysField of Search707608, 707694US Class CurrentCPC Class CodesH04L 41/0604 using filtering, e.g. reduc...H04L 67/10 in which an application is ...
