Systems and/or methods for capability-aware dynamic distributed event processing

• US 9,633,087 B2
• Filed: 06/06/2014
• Issued: 04/25/2017
• Est. Priority Date: 06/06/2014
• Status: Active Grant

• Current Assignee: Software AG
• Original Assignee: Software AG
• Inventors: Schoening, Harald
• Primary Examiner(s): Moser, Bruce
• Application Number:
  US14/298,140
• Publication Number:
  US 20150356153A1
• Time in Patent Office: 1,054 Days
• Field of Search: None
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 16/285 Clustering or classification

Abstract

In a system including processing resources and a capability repository, a first processing resource: receives event streams from operating contexts; identifies, based upon the received event streams, a dynamically changing condition in a first one of the operating contexts; automatically decomposes, using the repository, a complex event processing query to effect a change responsive to the identified dynamically changing condition in the first one of the operating contexts; causes the first one of the operating contexts to effect the change based upon the decomposed query; and effects a related change to operation of the first processing resource that corresponds to the change caused to the first one of the operating contexts. The repository stores information regarding event sources that transmit events to the processing resources, and the operating contexts. Each operating context is associated with a respective group of event sources and with at least one of the processing resources.

Claims

1. A system for distributed event processing, comprising:

a plurality of computer systems that each include processing resources the processing resources of each of the plurality of computer systems including at least a hardware processor and memory, the plurality of computer systems including a first computer system; and

an electronic storage system configured to store a capability repository, wherein;

the processing resources of the first computer system are configured to;

receive, via electronic data communications network, a plurality of event streams from a plurality of event sources that generate event data included in an event stream, each one of the plurality of event sources being associated with an operating context;

execute a complex event processing (CEP) query against the received plurality of event streams;

identify a change in the operating context for at least one of the plurality of event sources;

responsive to identification of the change in operating context for at least one of the plurality of event sources, automatically decompose, based upon information stored in the capability repository, the complex event processing (CEP) query by generating a first sub-query that is based on the CEP query;

deploy the generated first sub-query to a second computer system of the plurality of computer systems that is remote from the first computer and associated with the operating context of the at least one of the plurality of event sources;

the capability repository including information regarding (a) the plurality of event sources that each transmit event data, and (b) operating context(s) that are each associated with one or more of the event sources;

wherein prior to identification of the change in the operating context for at least one of the plurality of event sources, execution of the CEP query is carried out using the processing resources of the first computer system and after deployment of the first sub-query, the execution of the CEP query is carried out using a combination of the processing resources from the first and second computer systems.

2. The system according to claim 1, wherein the generating the first sub-query comprises:

determining an operator graph for the query;

computing the determined operator graph in accordance with at least one predetermined execution condition; and

determining the first sub-query based upon a sub-graph in the operator graph.

3. The system according to claim 2, wherein the predetermined execution condition includes (a) executability of the query using processing resources of the second computer system, and (b) executability of the query in view of bandwidth availability between the first computer system and the second computer system.

4. The system according to claim 1, wherein the deploying the first sub-query to a second computer system comprises:

perform a comparison between the first sub-query to a previously deployed sub-query, wherein the deployment of the first sub-query is based on the performed comparison.

5. The system according to claim 1, wherein the operating context for other ones of the plurality of event sources are altered based on the identified change in the operating context for at least one of the plurality of event source.

6. The system according to claim 1, wherein the first processing resource is further configured to update the stored information in accordance with the identified change in operating context of the at least one of the plurality of event sources, the automatic decomposition of the CEP query is based upon the stored information including the updated stored information.

7. The system according to claim 1, wherein the automatic decomposing is based upon the stored information including information regarding bandwidth capabilities, processor capabilities, or both bandwidth capabilities and processor capabilities associated with the operating context for at least one of the plurality of event sources.

8. The system according to claim 1, wherein the change in the operating context for the at least one of the plurality of event sources includes a change in a location of the event source, a change in local processing resources available for processing event data from the event source, or a change in bandwidth between the first and second computer systems.

9. The system according to claim 1, wherein the first processing resource is further configured to cause the second computer system to transmit locally-generated events based on bandwidth availability between the second computer system and the first computer system.

10. A method for distributed event processing using plurality of computer systems that each include processing resources, the processing resources of each of the plurality of computer systems including at least a hardware processor and memory, the plurality of computer systems including a first computer system, the method comprising:

receiving, via electronic data communications network, event streams from a plurality of event sources that generate event data included in an event stream, each one of the plurality of event sources being associated with an operating context;

storing, to an electronic storage system, a capability repository that includes information regarding (a) the plurality of event sources that each transmit event data, and (b) operating context(s) that are each associated with one or more of the event sources;

executing, using the processing resources of the first computer system, a complex event processing (CEP) query against the received plurality of event streams;

identifying a change in the operating context for at least one of the plurality of event sources;

responsive to identification of the change in operating context for at least one of the plurality of event sources, automatically decomposing, based upon the stored information, the complex event processing (CEP) query by generating a first sub-query that is based on the CEP query; and

deploying the generated first sub-query to a second computer system of the plurality of computer systems that is remote from the first computer and associated with the operating context of the at least one of the plurality of event sources;

wherein prior to identification of the change in the operating context for at least one of the plurality of event sources, execution of the CEP query is carried out using the processing resources of the first computer system and after deployment of the first sub-query, the execution of the CEP query is carried out using a combination of the processing resources from the first and second computer systems.

11. The method according to claim 10, further comprising modifying the complex event query of the first computer system to be a second sub-query that is based on the executing CEP query.

12. The method according to claim 10, wherein the operating context for other ones of the plurality of event sources are altered based on the identified change in the operating context for at least one of the plurality of event sources.

13. The method according to claim 10, wherein the first processing resource is further configured to update the stored information in accordance with the identified change in operating context of the at least one of the plurality of event source, and wherein the automatic decomposition of the CEP query is based upon the stored information including the updated stored information.

14. The method according to claim 10, wherein the automatic decomposing is based upon the stored information including information regarding bandwidth capabilities, processor capabilities, or both bandwidth capabilities and processor capabilities associated with the operating context for at least one of the plurality of event sources.

15. The method according to claim 10, wherein the change in the operating context for the at least one of the plurality of event sources includes a change in a location of the event source, a change in local processing resources available for processing event data from the event source, or a change in bandwidth between the first and second computer systems.

16. A non-transitory computer readable storage medium having instructions stored thereon for use with a first computer system of a plurality of computer systems that each include processing resources, the processing resources of each of the plurality of computer systems including at least a hardware processor and memory, the stored instructions causing the processing resources of the first computer system to perform operations comprising:

receiving, via electronic data communications network, event streams from a plurality of event sources that generate event data included in an event stream, each one of the plurality of event sources being associated with an operating context, wherein an electronic storage system is configured to store a capability repository that includes information regarding (a) the plurality of event sources that each transmit event data, and (b) operating context(s) that are each associated with one or more of the event sources;

executing a complex event processing (CEP) query against the received plurality of event streams;

identifying a change in the operating context for at least one of the plurality of event sources;

responsive to identification of the change in operating context for at least one of the plurality of event sources, automatically decomposing, based upon the stored information, the complex event processing (CEP) query by generating a first sub-query that is based on the CEP query; and

deploying the generated first sub-query to a second computer system of the plurality of computer systems that is remote from the first computer and associated with the operating context of the at least one of the plurality of event sources;

wherein prior to identification of the change in the operating context for at least one of the plurality of event sources, execution of the CEP query is carried out using the processing resources of the first computer system and after deployment of the first sub-query, the execution of the CEP query is carried out using a combination of the processing resources from the first and second computer systems.

17. The non-transitory computer readable medium according to claim 16, wherein the operating context for other ones of the plurality of event sources are altered based on the identified change in the operating context for at least one of the plurality of event sources.

18. The non-transitory computer readable medium according to claim 16, wherein the first processing resource is further configured to update the stored information in accordance with the identified change in operating context of the at least one of the plurality of event sources, and wherein the automatic decomposition of the CEP query is based upon the stored information including the updated stored information.