Complex event processing system having multiple redundant event processing engines

• US 9,009,234 B2
• Filed: 02/05/2008
• Issued: 04/14/2015
• Est. Priority Date: 02/06/2007
• Status: Active Grant

• Current Assignee: Software AG
• Original Assignee: Software AG
• Inventors: Mitchell, Robert Scott, Horsburgh, Mark K., Bentley, Richard M.
• Primary Examiner(s): JEAN, FRANTZ B
• Application Number:
  US12/026,254
• Publication Number:
  US 20080189352A1
• Time in Patent Office: 2,625 Days
• Field of Search: 709/203, 709/206, 709/217, 709/219, 709/223
• US Class Current: 709/206
• CPC Class Codes: G06F 2209/544 Remote
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: H04L 1/1809 Selective-repeat protocols
• CPC Class Codes: H04L 1/22 using redundant apparatus to increase reliability

Abstract

A system and method for replicating a distributed computer system state among a plurality of deterministic event processing engines are disclosed. A sender module receives a plurality of input events or input event streams and generates a serialized message sequence describing an order in which input events are processed. The serialized message sequence is then transmitted to a plurality of deterministic event processing engines for processing. As the event processing engines are deterministic, each event processing engine produces the same ordered sequence responsive to the received serialized message sequence. The ordered sequences from each deterministic event processing engine are transmitted to a merger module which generates an output from the plurality of ordered sequences. The merger module removes one or more redundant ordered sequences and associates the resulting output with a client device.

Claims

1. A system for complex event processing comprising:

a sender module for receiving an input event and for generating a serialized message sequence from the input event;

a plurality of deterministic event processing engines for processing the serialized message sequence and generating a plurality of redundant ordered sequences;

a merger module for receiving the plurality of redundant ordered sequences and for generating an output result for transmission; and

wherein at least one of the sender module, deterministic event processing engines and merger module comprises at least one hardware component.

5. The system of claim 1, wherein the merger module stores a copy of one of the plurality of redundant ordered sequences and a current position in the one of the plurality of redundant ordered sequences.

6. The system of claim 5, wherein the merger module deletes the copy of the one of the plurality of redundant ordered sequences responsive to receiving an acknowledgement.

2. The system of claim wherein the sender module stores a copy of the input event and an ordering of the input event.

3. The system of claim 2, wherein the sender module deletes the copy of the input event responsive to receiving an acknowledgement from one of the plurality of deterministic event processing engines.

4. The system of claim 2, wherein the sender module deletes the copy of the input event responsive to receiving an acknowledgement from all of the plurality of deterministic event processing engines.

7. A method executable by a processor of a computer for complex event processing, the method comprising:

receiving an input event;

generating a serialized message sequence including the received input event;

processing the serialized message sequence using a plurality of event processing engines to generate a plurality of redundant ordered sequences; and

generating an output result from one of the plurality of redundant ordered sequences.

8. The method of claim 7, wherein generating the serialized message sequence comprises:

associating a first sequence number with the input event; and

associating a second sequence number with a second input event.

9. The method of claim 8, wherein the second sequence number is greater than the first sequence number.

10. The method of claim 8 comprising:

storing a copy of the input event in a persistent storage; and

storing the first sequence number associated with the input event in the persistent storage.

11. The method of claim 10 comprising deleting the stored copy of the input event from the persistent storage and deleting the first sequence number associated with the input event from persistent storage.

12. The method of claim 7, wherein generating the output result comprises removing one or more redundant ordered sequences from the plurality of redundant ordered sequences.

13. The method of claim 12, wherein removing the one or more redundant ordered sequences comprises:

identifying a sequence number; and

discarding all but one ordered sequence from the plurality of redundant ordered sequences associated with the identified sequence number.

14. The method of claim 7, wherein generating the output result comprises associating the output result with an output client device.

15. The method of claim 7 comprising:

storing a copy of the output result; and

storing a sequence number associated with the output result.

16. The method of claim 15 comprising deleting the stored copy of the output result and deleting the sequence number associated with the output result.

17. The method of claim 7 comprising:

retrieving a state of one of the plurality of event processing engines; and

starting a new event processing engine with the received state.

18. The method of claim 17 comprising:

determining a point in processing of the serialized message sequence to which event processing has progressed; and

sending input events after the point in the serialized message sequence to the new event processing engine.

19. A computer program product for complex event processing, the computer program product comprising a non-transitory computer-readable medium containing computer program code for performing the method comprising:

receiving an input event;

generating a serialized message sequence including the received input event;

processing the serialized message sequence using a plurality of event processing engines to generate a plurality of redundant ordered sequences; and

generating an output result from one of the plurality of redundant ordered sequences.

20. The computer program product of claim 19, wherein generating the serialized message sequence comprises:

associating a first sequence number with the input event; and

associating a second sequence number with a second input event.

21. The computer program product of claim 20, wherein the second sequence number is greater than the first sequence number.

22. The computer program product of claim 19, wherein generating the output result comprises removing one or more redundant ordered sequences from the plurality of redundant ordered sequences.

23. The computer program product of claim 22, wherein removing the one or more redundant ordered sequences comprises:

identifying a sequence number; and

discarding all but one ordered sequence from the plurality of redundant ordered sequences associated with the identified sequence number.

24. The computer program product of claim 19, wherein generating the output result comprises associating the output result with an output client device.

25. The computer program product of claim 19 comprising:

retrieving a state of one of the plurality of event processing engines; and

starting a new event processing engine with the received state.

26. The computer program product of claim 25 comprising:

determining a point in processing of the serialized message sequence to which event processing has progressed; and

sending input events after the point in the serialized message sequence to the new event processing engine.

27. A system for complex event processing comprising:

anon-transitory computer-readable medium storing computer-executable code, the computer-executable code comprising;

a sender module for receiving an input event and for generating a serialized message sequence from the input event;

a plurality of deterministic event processing engines for processing the serialized message sequence and generating a plurality of redundant ordered sequences; and

a merger module for receiving the plurality of redundant ordered sequences, generating an output result for transmission and storing a current position (1) associated with the input event and (2) specifying a position of processing in one of the plurality of redundant ordered sequences.