COMPLEX EVENT PROCESSING (CEP) BASED SYSTEM FOR HANDLING PERFORMANCE ISSUES OF A CEP SYSTEM AND CORRESPONDING METHOD

• US 20150286684A1
• Filed: 08/15/2014
• Published: 10/08/2015
• Est. Priority Date: 11/06/2013
• Status: Active Grant

• Current Assignee: Software AG
• Original Assignee: Software AG
• Inventors: Cammert, Michael, Krmer, Jrgen, Riemenschneider, Tobias, HEINZ, Christoph, Schfer, Daniel
• Granted Patent: US 10,229,162 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3096 wherein the means or processing minimize the use of computing system or of computing system component resources, e.g. non-intrusive monitoring which minimizes the probe effect: sniffing, intercepting, indirectly deriving the monitored data from other directly available data
• CPC Class Codes: G06F 11/328 Computer systems status display G06F11/327 takes precedence
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3447 Performance evaluation by modeling
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/2452 Query translation
• CPC Class Codes: G06F 16/24549 Run-time optimisation
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 2201/88 Monitoring involving counting

Abstract

Certain example embodiments relate to a system (1) for handling performance issues of a production Complex Event Processing, CEP, system (2) during runtime. The production CEP system (2) includes at least one event source, at least one continuous query and at least one event sink. The system (1) includes: at least one monitoring sensor for producing a stream of status events relating to the production CEP system (2); and a monitoring CEP system (10) for executing at least one continuous analysis query on the stream of status events to produce a stream of monitoring events. The stream of monitoring events indicates performance issues of the production CEP system (2) relating to the throughput, the latency, and/or the memory consumption of the production CEP system (2).

Claims

1. A system for handling performance issues of a production Complex Event Processing (CEP) system during runtime, wherein the production CEP system comprises at least one event source, at least one continuous query and at least one event sink, and wherein the system comprises:

at least one monitoring sensor configured to produce a stream of status events relating to the production CEP system; and

a monitoring CEP system configured to execute at least one continuous analysis query on the stream of status events to produce a stream of monitoring events,

wherein the stream of monitoring events indicates performance issues of the production CEP system relating to the throughput, the latency, and/or the memory consumption of the production CEP system.

2. The system of claim 1, wherein the at least one monitoring sensor is attached to an operator of the at least one continuous query of the production CEP system and is configured to count input and/or output events of the operator and/or to compute a memory consumption of the operator.

3. The system of claim 1, further comprising an analytics component, configured to analyze the stream of monitoring events using stream mining and to generate at least one statistical model of the performance of the production CEP system.

4. The system of claim 3, further comprising a statistical model database configured to store the at least one statistical model generated by the analytics component,

wherein the analytics component is further configured to derive a forecast of the status of the production CEP system based on the at least one stored statistical model and a current statistical model of the production CEP system.

5. The system of claim 1, further comprising a graphical user interface configured to indicate at least one identified performance issue of the production CEP system.

6. The system of claim 5, wherein the graphical user interface is configured to display the at least one continuous query of the production CEP system as an operator graph, wherein operators of the operator graph involving a performance issue are indicated.

7. The system of claim 1, further comprising a system stabilization component configured to indicate to a user a recommended action for resolving an identified performance issue of the production CEP system.

8. The system of claim 7, wherein the recommended action for resolving an identified performance issue of the production CEP system is selected from the group comprising:

stopping the at least one continuous query of the production CEP system,

moving the at least one continuous query of the production CEP system to another processing component, and/or

modifying the at least one continuous query of the production CEP system.

9. The system of claim 8, wherein modifying the at least one continuous query of the production CEP system comprises reducing a window size of the at least one continuous query, reducing an output rate of the at least one continuous query, and/or removing event attributes not used by the at least one continuous query.

10. The system of claim 1, further comprising a system stabilization component configured to automatically initiate an action for resolving an identified performance issue of the production CEP system.

11. The system of claim 10, wherein the action for resolving an identified performance issue of the production CEP system is selected from the group comprising:

rejecting new input streams, continuous queries and/or query consumers of the production CEP system,

executing a query optimizer,

sorting a plurality of continuous queries of the production CEP system by memory consumption and stopping queries and/or moving queries to another processing component until memory consumption is in a reasonable range, and/or

sorting input streams of the production CEP system by input rate and sorting a plurality of continuous queries of the production CEP system by output rate and stopping queries and/or moving queries to another processing component until bandwidth consumption is in a reasonable range.

12. A method for handling performance issues of a production Complex Event Processing (CEP) system during runtime, the production CEP system comprising at least one event source, at least one continuous query and at least one event sink, the method comprising:

producing a stream of status events relating to the production CEP system by at least one monitoring sensor; and

executing, by a monitoring CEP system including at least one computer processor, at least one continuous analysis query on the stream of status events to produce a stream of monitoring events,

wherein the stream of monitoring events indicates performance issues of the production CEP system relating to the throughput, the latency, and/or the memory consumption of the production CEP system.

13. The method of claim 12, further comprising analyzing, the stream of monitoring events using stream mining and generating at least one statistical model of the performance of the production CEP system.

14. The method of claim 12, further comprising indicating, by a graphical user interface, at least one identified performance issue of the production CEP system;

and/or indicating, by a system stabilization component, a recommended action for resolving an identified performance issue of the production CEP system.

15. A non-transitory computer readable storage medium tangibly storing a computer program comprising instructions that, when executed, implement a method in accordance with claim 12.