METHODS AND APPARATUS FOR PERFORMING REAL-TIME ANALYTICS BASED ON MULTIPLE TYPES OF STREAMED DATA

• US 20160019258A1
• Filed: 07/17/2014
• Published: 01/21/2016
• Est. Priority Date: 07/17/2014
• Status: Active Grant

• Current Assignee: Illumina Consulting Group, Inc.
• Original Assignee: Illumina Consulting Group, Inc.
• Inventors: Clark, Ed, Foughner, Thomas, Halper, John, Hicks, John, Stroh, Nicholas, Waldrop, David, Weideman, Graydon
• Granted Patent: US 9,703,827 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 16/2423 Interactive query statement specification based on a database schema
• CPC Class Codes: G06F 21/44 Program or device authentication
• CPC Class Codes: G06F 21/6272 by registering files or documents with a third party
• CPC Class Codes: G06F 2221/2113 Multi-level security, e.g. mandatory access control
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass

Abstract

Streaming data from a plurality of streaming data sources can be received. The streaming data may not be stored in persistent storage. A query can be received from a client device. A rule can be defined based on the query. The rule can be applied to the streaming data. Alerts associated with a subset of the streaming data that matches the rule can be stored in persistent storage. A signal associated with the alerts can be sent to the client device such that the graphical user interface is updated based on the alerts.

Claims

1. A method comprising:

receiving, at a first compute device, streaming data from a plurality of streaming data sources, at least a portion of the streaming data not being stored in persistent storage;

receiving, from a client device, a signal associated with a query against the plurality of streaming data sources, the query associated with a user interacting with a graphical user interface;

defining a rule based on the query;

applying the rule to the streaming data, a subset of streaming data from the plurality of streaming data sources matching the rule;

storing, in persistent storage, a plurality of alerts, the plurality of alerts associated with the subset of streaming data; and

sending a signal associated with the plurality of alerts to a second compute device.

2. The method of claim 1, wherein the second compute device is the client device, the signal associated with the plurality of alerts is sent to the client device such that the graphical user interface is updated based on the plurality of alerts.

3. The method of claim 1, wherein the client device is a first client device, the graphical user interface is a first graphical user interface, and the signal associated with the plurality of alerts is sent to the second compute device is at least one of an email, a representational state transfer, or a signal sent to a second client device such that a second graphical user interface is updated based on an alert from the plurality of alerts.

4. The method of claim 1, wherein applying the rule includes applying the rule to each streaming data source from the plurality of streaming data sources in parallel.

5. The method of claim 1, wherein:

a first streaming data source from the plurality of streaming data sources is associated with a first access control level;

a second streaming data source from the plurality of streaming data sources is associated with a second access control level different from the first access control level; and

applying the rule to the streaming data includes;

identifying an authorization level associated with the client device; and

applying the rule to the first streaming data source but not to the second streaming data source based on the authorization level not being below the first access control level but being below the second access control level.

6. The method of claim 1, wherein the query is a first query, the rule is a first rule, the subset of streaming data is a first subset of streaming data, and the plurality of alerts is a first plurality of alerts, the method further comprising:

applying a second rule to the plurality of streaming data sources before applying the first rule to the plurality of streaming data sources, a second subset of streaming data from the plurality of streaming data sources matching the second rule;

storing, in persistent storage, a second plurality of alerts, the second plurality of alerts associated with the second subset of streaming data receiving, from the client device, a signal associated with a second query against the first alert set and the second alert set;

defining a third rule based on the second query;

applying the third rule to the first alert set and the second alert set;

generating an alert based on at least one datum from the first alert set or at least one datum from the second alert set satisfying the third rule; and

sending a signal associated with the alert to the client device such that the graphical user interface is updated based on the alert.

7. A non-transitory processor readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

receive, at a compute device, streaming data from a plurality of data sources, at least a portion of the streaming data not being stored in persistent storage;

send a first signal to a client device such that the client device renders a graphical user interface presenting at least a portion of the streaming data;

receive, from the client device, a request to define a rule in response to a user of the client device making a form-based selection via the graphical user interface;

apply the rule to the streaming data, a datum from the streaming data matching the rule;

store the datum in persistent storage; and

send a second signal to the client device such that an alert is presented via the graphical user interface, the alert based on the datum.

8. The non-transitory processor readable medium of claim 7, wherein the rule is a first rule, the datum is a first datum, and the graphical user interface is a first graphical user interface configured to present alerts associated with the first rule, the code further comprising code to cause the processor to:

store a second datum matching the first rule in persistent storage; and

send a third signal to the client device such that a second graphical user interface presents a notification, the third signal sent in response to a quantity of data from the streaming data matching the first rule exceeding a pre-defined threshold, the second graphical user interface configured to present notifications associated with the first rule and a second rule.

9. The non-transitory processor readable medium of claim 7, wherein the client device is a first client device, the rule is a first rule, the datum is a first datum, and the graphical user interface is a first graphical user interface configured to present alerts associated with the first rule, the code further comprising code to cause the processor to:

receive, from a second client device, a request to define a second rule;

apply the second rule to the streaming data, a second datum from the streaming data matching the rule;

store the second datum in persistent storage; and

send a third signal to the second client device such that a second graphical user interface presents a notification, the notification based on the first datum and the second datum.

10. The non-transitory processor readable medium of claim 7, wherein the client device is a first client device, the rule is a first rule, the datum is a first datum, and the graphical user interface is a first graphical user interface configured to present alerts associated with the first rule, the code further comprising code to cause the processor to:

receive, from a second client device, a request to define a second rule;

apply the second rule to the streaming data, a second datum from the streaming data matching the rule;

store the second datum in persistent storage; and

send a third signal to the first client device such that a second graphical user interface presents a notification, the third signal sent in response to at least one of (1) a quantity of data from the streaming data matching the first rule or (2) a quantity of data from the streaming data matching the second rule exceeding a pre-defined threshold.

11. The non-transitory processor readable medium of claim 7, wherein the client device is a first client device, the rule is a first rule, the datum is a first datum, and the alert is a first alert, the code further comprising code to cause the processor to:

receive, from a second client device, a request to define a second rule; and

generate a second alert based, at least in part, on the first datum satisfying the second rule.

12. The non-transitory processor readable medium of claim 7, wherein the alert is a first alert, the signal sent to the client device such that the first alert is presented is sent at a first time, the code further comprising code to cause the processor to:

store the rule; and

send a signal to the client device at a second time after the first time such that a second alert is presented via the graphical user interface.

13. The non-transitory processor readable medium of claim 7, wherein the rule is a first rule, and the signal sent to the client device at the second time is sent without receiving a request from the client device to generate a second rule.

14. The non-transitory processor readable of claim 7, the code further comprising code to cause the processor to:

apply an analytic to at least one data source from the plurality of data sources, the streaming data including an output of the analytic, the datum being from the output of the analytic.

15. The non-transitory processor readable medium of claim 7, wherein the rule is a first rule, the first rule is applied to a first data source from the plurality of data sources, the code further comprising code to cause the processor to:

define the first rule, the first rule having a first set of parameters associated with the first data source; and

define a second rule, the second rule having a second set of parameters associated with a second data source from the plurality of data sources; and

apply the second rule to the second data source.

16. The non-transitory processor readable medium of claim 7, wherein the client device is a first client device, the graphical user interface is a first graphical user interface, and the alert is a first alert, the code further comprising code to cause the processor to:

define the rule in response to receiving the request to define the rule;

send a signal representing the rule to a second client device different from the first client device;

receive, from the second client device, a request to apply the rule to the streaming data; and

send a signal to the second client device such that a second alert associated with the rule is presented via a second graphical user interface.

17. The non-transitory processor readable medium of claim 7, wherein the rule is associated with a first location at a first time and a second location at a second time, and applying the rule is applying the rule at the first time, and the datum matching the rule is a first datum associated with the first location, the code further comprising code to cause the processor to:

apply the rule to the streaming data at a second time, a second datum from the streaming data associated with the second location matching the rule at the second time.

18. A non-transitory processor readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

render a graphical user interface presenting a first datum, the first datum being from a streaming data source from a plurality of streaming data sources, at least a portion of the streaming data sources not being stored in persistent storage;

receive a signal associated with a user input via a graphical user interface;

send, to a server, a signal representing the user input such that the server defines a rule; and

receive, from the server, a second datum from the streaming data source in response to sending the signal to the server.