Complex event processing (CEP) based system for handling performance issues of a CEP system and corresponding method
First Claim
1. A system for handling performance issues of a production Complex Event Processing (CEP) system during runtime, wherein the production CEP system is configured to execute a continuous production query that includes a plurality of operators that are executed as part the continuous query, the system comprising:
- a processing system that includes at least one hardware processor, the processing system configured to;
receive a stream of status events produced via a plurality of monitoring sensors that are each assigned to an operator of the continuous query, where each monitoring sensor is configured to acquire status information from a corresponding operator that is then included in the stream of status events;
execute a monitoring CEP system that is configured to run at least one continuous analysis query on the stream of status events to produce a stream of monitoring events, wherein the stream of monitoring events indicates performance issues of the production CEP system relating to the throughput, the latency, and/or the memory consumption of the production CEP system;
execute a system stabilization component that is configured to;
in response to identification of a first performance issue indicated in the stream of monitoring events, (1) sort a plurality of continuous queries of the production CEP system based on memory consumption of the plurality of continuous queries, and (2) based on the sorted plurality of continuous queries, stop at least some of the plurality of continuous queries and/or move at least one query to another processing component, andin response to identification of a second performance issue indicated in the stream of monitoring events, (1) sort input streams of the production CEP system by input rate, (2) sort the plurality of continuous queries of the production CEP system by output rate, and (3) based on the sorted inputted streams and sorted plurality of continuous queries, stop and/or move at least one of the plurality of continuous queries to another processing component.
1 Assignment
0 Petitions
Accused Products
Abstract
Certain example embodiments relate to a system (1) for handling performance issues of a production Complex Event Processing, CEP, system (2) during runtime. The production CEP system (2) includes at least one event source, at least one continuous query and at least one event sink. The system (1) includes: at least one monitoring sensor for producing a stream of status events relating to the production CEP system (2); and a monitoring CEP system (10) for executing at least one continuous analysis query on the stream of status events to produce a stream of monitoring events. The stream of monitoring events indicates performance issues of the production CEP system (2) relating to the throughput, the latency, and/or the memory consumption of the production CEP system (2).
-
Citations
19 Claims
-
1. A system for handling performance issues of a production Complex Event Processing (CEP) system during runtime, wherein the production CEP system is configured to execute a continuous production query that includes a plurality of operators that are executed as part the continuous query, the system comprising:
a processing system that includes at least one hardware processor, the processing system configured to; receive a stream of status events produced via a plurality of monitoring sensors that are each assigned to an operator of the continuous query, where each monitoring sensor is configured to acquire status information from a corresponding operator that is then included in the stream of status events; execute a monitoring CEP system that is configured to run at least one continuous analysis query on the stream of status events to produce a stream of monitoring events, wherein the stream of monitoring events indicates performance issues of the production CEP system relating to the throughput, the latency, and/or the memory consumption of the production CEP system; execute a system stabilization component that is configured to; in response to identification of a first performance issue indicated in the stream of monitoring events, (1) sort a plurality of continuous queries of the production CEP system based on memory consumption of the plurality of continuous queries, and (2) based on the sorted plurality of continuous queries, stop at least some of the plurality of continuous queries and/or move at least one query to another processing component, and in response to identification of a second performance issue indicated in the stream of monitoring events, (1) sort input streams of the production CEP system by input rate, (2) sort the plurality of continuous queries of the production CEP system by output rate, and (3) based on the sorted inputted streams and sorted plurality of continuous queries, stop and/or move at least one of the plurality of continuous queries to another processing component. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 18)
-
11. A method for handling performance issues of a production Complex Event Processing (CEP) system during runtime, the production CEP system comprising at least one event source, at least one continuous query and at least one event sink, the method comprising:
-
producing a stream of status events based on status data acquired by a plurality of monitoring sensors that are each attached to a different operator of the at least one continuous query of the production CEP system; executing, by a monitoring CEP system including at least one computer processor, at least one continuous analysis query on the stream of status events to produce a stream of monitoring events; based on the produced stream of monitoring events from the monitoring CEP system, adjust a parameter of at least one of the plurality of monitoring sensors to change how the corresponding monitoring sensor acquires the status information that is included in the stream of status events; executing, using the monitoring CEP system, a system stabilization component; using the system stabilization component for; identifying a first performance issue indicated in the stream of monitoring events and in response to identification of the first performance issue;
(1) sorting a plurality of continuous queries of the production CEP system based on memory consumption of the plurality of continuous queries, and (2) based on the sorted plurality of continuous queries, stopping, using the system stabilization component, at least some of the plurality of continuous queries and/or moving at least one query to another processing component;identifying a second performance issue indicated in the stream of monitoring events and in response to identification of the second performance issue;
(1) sorting input streams of the production CEP system by input rate, (2) sorting the plurality of continuous queries of the production CEP system by output rate, and (3) based on the sorted inputted streams and sorted plurality of continuous queries, stopping and/or moving at least one of the plurality of continuous queries to another processing component. - View Dependent Claims (12, 13, 19)
-
-
14. A non-transitory computer readable storage medium tangibly storing a computer program for use with a processing system that includes at least one hardware processor, wherein the processing system is for use in handling performance issues of a production Complex Event Processing (CEP) system during runtime, the production CEP system is configured to execute a continuous production query that includes a plurality of operators that are executed as part the continuous query, the computer program comprising instructions that are configured to cause the processing system to:
-
receive, via monitoring sensors that are each attached to an operator of the executing continuous production query on the production CEP system, a stream of status events, where each of the monitoring sensors is configured to acquire status information from an attached operator based on execution of the continuous production by the production CEP system, the acquired status information being included in the stream of status events; communicate the stream of status events to a monitoring CEP system that is separate from the production CEP system; execute, as part of the monitoring CEP system, a continuous analysis query on the stream of status events to thereby create a stream of monitoring events, wherein the stream of monitoring events are performance metrics of the production CEP system relating to the throughput, the latency, and/or the memory consumption of the production CEP system; determine, at the monitoring system and based on the stream of status events, whether the performance metrics exceed a threshold; in response to determination that the performance metrics exceed the threshold, cause at least one parameter of at least one of the monitoring sensors to be adjusted to change how the monitoring sensor acquires the status information, which is included in the stream of status events, from the corresponding operator of the executing continuous production query; identify a first performance issue indicated in the stream of monitoring events and in response to identification of the first performance issue;
(1) sort a plurality of continuous queries of the production CEP system based on memory consumption of the plurality of continuous queries, and (2) based on the sorted plurality of continuous queries, stop, using the system stabilization component, at least some of the plurality of continuous queries and/or moving at least one query to another processing component; andidentify a second performance issue indicated in the stream of monitoring events and in response to identification of the second performance issue;
(1) sort input streams of the production CEP system by input rate, (2) sort the plurality of continuous queries of the production CEP system by output rate, and (3) based on the sorted inputted streams and sorted plurality of continuous queries, stop and/or move at least one of the plurality of continuous queries to another processing component. - View Dependent Claims (15, 16, 17)
-
Specification