Delivery acknowledgment in event stream processing

• US 10,102,028 B2
• Filed: 08/02/2013
• Issued: 10/16/2018
• Est. Priority Date: 03/12/2013
• Status: Active Grant

• Current Assignee: SAS Institute Incorporated
• Original Assignee: SAS Institute Incorporated
• Inventors: Baulier, Gerald Donald, Kolodzieski, Scott J., Deters, Vincent L.
• Primary Examiner(s): Blair, Douglas B
• Assistant Examiner(s): Boustany, Jihad Kamal
• Application Number:
  US13/958,096
• Publication Number:
  US 20140280986A1
• Time in Patent Office: 1,901 Days
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: H04L 61/35 involving non-standard use of addresses for implementing network functionalities, e.g. coding subscription information within the address or functional addressing, i.e. assigning an address to a function
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

A method of acknowledging receipt of an event block object is provided. First connection information for connecting to an event stream processing (ESP) engine executing at a first computing device is received. A first connection to the ESP engine is established using the received first connection information. Second connection information for connecting to a publishing client executing at a second computing device is received. A second connection to the publishing client is established using the received second connection information, wherein the first connection differs from the second connection. An event block object is received from the ESP engine using the established first connection, wherein the event block object includes a unique identifier for the event block object. Successful processing of the event block object is determined. Responsive to the successful processing determination, an acknowledgment message including the unique identifier is sent to the publishing client using the established second connection.

Claims

1. A non-transitory computer-readable medium having stored thereon computer-readable instructions that when executed by a computing device cause the computing device to:

instantiate a continuous query that includes a source window to receive an event block object and a derived window connected to the source window to process the event block object received by the source window and to output the processed event block object to a plurality of subscribing clients;

establish a first connection between a publishing device executing an event publishing application and an event publishing client;

establish a second connection between the event publishing client and an event stream processing engine (ESPE) executing the instantiated continuous query, wherein the event publishing client sends the received event block object to the source window;

establish a third connection between the ESPE and each of a plurality of subscribing clients;

establish a fourth connection between each subscribing client of the plurality of subscribing clients and an associated subscribing device executing an event subscription application;

establish a fifth connection between each subscribing client of the plurality of subscribing clients and the event publishing client, wherein the second connection differs from each filth connection, and each fifth connection is a direct connection that is not through the ESPE;

receive, by the event publishing client, the event block object from the publishing device using the established first connection;

publish the received event block object to the source window of the ESPE using the established second connection, wherein the event block object includes a unique identifier,

perform, by the ESPE, a computation on a field extracted from the event block object based on the instantiated continuous query to define a processed event block object;

output, by the ESPE, the defined, processed event block object to each subscribing client of the plurality of subscribing clients using the established third connection to each subscribing client, wherein the output event block object includes the unique identifier;

send, by each subscribing client, the output event block object to the associated subscribing device using the established fourth connection;

receive, by each subscribing client, an acknowledgement message from the associated subscribing device using the established fourth connection when the sent event block object is successfully processed by the associated subscribing device;

send, by each subscribing client, a second acknowledgement message to the event publishing client using the established fifth connection when the acknowledgement message is received, wherein the second acknowledgement message includes the unique identifier;

receive, by the event publishing client, each sent second acknowledgement message;

for each received second acknowledgement message including the unique identifier, increment, by the event publishing client, a counter to determine a number of second acknowledgement messages received;

compare, by the event publishing client, the number of second acknowledgement messages received to a specified number of acknowledged subscribers;

based on the comparison and responsive to determining that the number of second acknowledgement messages received is less than the specified number of acknowledged subscribers, determine, by the event publishing client, if a timeout period has expired; and

responsive to determining that the timeout period has expired, execute a failed callback function.

2. The non-transitory computer-readable medium of claim 1, wherein connection information to establish the second connection includes a host identifier and a port number.

3. The non-transitory computer-readable medium of claim 1, wherein connection information to establish the third connection includes a host identifier and a port number.

4. The non-transitory computer-readable medium of claim 1, wherein connection information to establish each fourth connection is received from an instance of the event subscription application executing at the associated subscribing device.

5. The non-transitory computer-readable medium of claim 1, wherein a determination that the event block object:

is successfully processed is performed by an instance of the event subscription application.

6. The non-transitory computer-readable medium of claim 1, wherein connection information to establish each fourth connection is received by reading a configuration file identified by an instance of the event subscription application.

7. The non-transitory computer-readable medium of claim 1, wherein the event block object further includes connection information and the computer-readable instructions further cause the computing device to establish each fifth connection based on the connection information included in the event block object.

8. The non-transitory computer-readable medium of claim 1, wherein the computer-readable instructions further cause the computing device to:

execute a successful callback function based on the comparison and responsive to determining that the number of acknowledgement messages received equals the number of acknowledgement messages specified for the unique identifier.

9. The non-transitory computer-readable medium of claim 1, wherein the computer-readable instructions further cause the computing device to:

before receiving each sent second acknowledgement message, add, by t;

he event publishing client, the unique identifier to an unacknowledged identifier list; and

responsive to determining that the timeout period has expired, remove, by the event publishing client, the unique identifier from the unacknowledged identifier list.

10. The non-transitory computer-readable medium of claim 1, wherein the computer-readable instructions further cause the computing device to remove, by the event publishing client, the unique identifier from the unacknowledged identifier list in response to determining that the number of acknowledgement messages received is equal to the number of acknowledgement messages specified for the unique identifier.

11. The non-transitory computer-readable medium of claim 1, wherein the failed callback function republishes the received event block object to the source window of the ESPE using the established second connection.

12. The non-transitory computer-readable medium of claim 1, wherein the failed callback function sends a failed message to the publishing device.

13. The non-transitory computer-readable medium of claim 1, wherein the failed callback function is executed using a pointer to the failed callback function.

14. The non-transitory computer-readable medium of claim 13, wherein the pointer is sent to the event publishing client from the publishing device by the event publishing application.

15. The non-transitory computer-readable medium of claim 8, wherein the successful callback function is executed using a pointer to the successful callback function.

16. The non-transitory computer-readable medium of claim 15, wherein the successful callback function removes the event block object from a recoverable location.

17. A system comprising:

a processor; and

a non-transitory computer-readable medium operably coupled to the processor, the computer-readable medium having computer-readable instructions stored thereon that, when executed by the processor, cause the system to

instantiate a continuous query that includes a source window to receive an event block object and a derived window connected to the source window to process the event block object received by the source window and to output the processed event block object to a plurality of subscribing clients;

establish a first connection between a publishing device executing an event publishing application and an event publishing client;

establish a second connection between the event publishing client and an event stream processing engine (ESPE) executing the instantiated continuous query, wherein the event publishing client sends the received event block object to the source window;

establish a third connection between the ESPE and each of a plurality of subscribing clients;

establish a fourth connection between each subscribing client of the plurality of subscribing clients and an associated subscribing device executing an event subscription application;

establish a fifth connection between each subscribing client of the plurality of subscribing clients and the event publishing client, wherein the second connection differs from each filth connection, and each fifth connection is a direct connection that is not through the ESPE;

receive, by the event publishing client, the event block object from the publishing device using the established first connection;

publish the received event block object to the source window of the ESPE using the established second connection, wherein the event block object;

includes a unique identifier;

perform, by the ESPE, a computation on a field extracted from the event block object based on the instantiated continuous query to define a processed event;

block object;

output, by the ESPE, the defined, processed event block object to each subscribing client of the plurality of subscribing clients using the established third connection to each subscribing client, wherein the output event block object includes the unique identifier;

send, by each subscribing client, the output event block object to the associated subscribing device using the established fourth connection;

receive, by each subscribing client, an acknowledgement message from the associated subscribing device using the established fourth connection when the sent event block object is successfully processed by the associated subscribing device;

send, by each subscribing client a second acknowledgement message to the event publishing client using the established fifth connection when the acknowledgement message is received;

receive by the event publishing client, each sent second acknowledgement message;

for each received second acknowledgement message including the unique identifier increment, by the event publishing client, a counter to determine a number of second acknowledgement messages received;

compare, by the event publishing client, the number of second acknowledgement messages received to a specified number of acknowledged subscribers;

based on the comparison and responsive to determining that the number of second acknowledgement messages received is less than the specified number of acknowledged subscribers, determine, by the event publishing client, if a timeout period has expired; and

responsive to determining that the timeout period has expired, execute a failed callback function.

18. The system of claim 17, wherein the event block object further includes connection information and the computer-readable instructions further cause the computing device to establish each fifth connection based on the connection information included in the event block object.

19. The system of claim 17, wherein the computer-readable instructions further cause the computing device to;

execute a successful callback function based on the comparison and responsive to determining that the number of acknowledgement messages received equals the number of acknowledgement messages specified for the unique identifier.

20. The system of claim 17, wherein the computer-readable instructions further cause the computing device to:

before receiving each sent second acknowledgement message, add, by the event publishing client the unique identifier to an unacknowledged identifier list; and

responsive to determining that the timeout period has expired, remove, by the event publishing client, the unique identifier from the unacknowledged identifier list.

21. The system of claim 20, wherein the computer-readable instructions further cause the computing device to remove, by the event publishing client, the unique identifier from the unacknowledged identifier list in response to determining that the number of acknowledgement messages received is equal to the number of acknowledgement messages specified for the unique identifier.

22. The system of claim 17, wherein the failed callback function is executed using a pointer to the failed callback function.

23. The system of claim 17, wherein the failed callback function republishes the received event block object to the source window of the ESPE using the established second connection.

24. The system of claim 17, wherein the failed callback function sends a failed message to the publishing device.

25. A method of confirming receipt of an event block object the method comprising:

instantiating a continuous query that includes a source window to receive an event block object and a derived window connected to the source window to process the event block object received by the source window and to output the processed event block object to a plurality of subscribing clients;

establishing a first connection between a publishing device executing an event publishing application and an event publishing client;

establishing a second connection between the event publishing client and an event stream processing engine (ESPE) executing the instantiated continuous wherein the event publishing client sends the received event block object to the source window;

establishing a third connection between the ESPE and each of a plurality of subscribing clients;

establishing a fourth connection between each subscribing client of the plurality of subscribing clients and an associated subscribing device executing an event subscription application;

establishing a fifth connection between each subscribing client of the plurality of subscribing clients and the event publishing client, wherein the second connection differs from each fifth connection, and each fifth connection is a direct connection that is not through the ESPE;

receiving, by the event publishing client, the event block object from the publishing device using the established first connection;

publishing the received event block object to the source window of the ESPE using the established second connection, wherein the event block object includes a unique identifier;

performing, by the ESPE, a computation on a field extracted from t;

he event block object based on the instantiated continuous query to define a processed event block object;

outputting, by the ESPE, the defined, processed event block object to each subscribing client of the plurality of subscribing clients using the established third connection to each subscribing wherein the output event block object includes the unique identifier;

sending, by each subscribing client, the output event block object to the associated subscribing device using the established fourth connection;

receiving, by each subscribing client, an acknowledgement message from the associated subscribing device using the established fourth connection when the sent event block object is successfully processed by the associated subscribing device;

sending, by each subscribing client, a second acknowledgement message to the event publishing client using the established fifth connection when the acknowledgement;

message is received, wherein the second acknowledgement message includes the unique identifier;

receiving, by the event publishing client, each sent second acknowledgement message;

for each received second acknowledgement message including the unique identifier, incrementing, by t;

he event publishing client, a counter to determine a number of second acknowledgement messages received;

comparing, by the event publishing client, the number of second acknowledgement messages received to a specified number of acknowledged subscribers;

based on the comparison and responsive to determining that the number of second acknowledgement messages received is less than the specified number of acknowledged subscribers, determining, by the event publishing client, if a timeout period has expired; and

responsive to determining that the timeout period has expired, executing a failed callback function.

26. The method of claim 25, wherein connection information to establish each fourth connection is received from an instance of the event subscription application executing at the associated subscribing device.

27. The method of claim 25, wherein a determination that the event block object is successfully processed is performed by an instance of the event subscription application.

28. The method of claim 25, further comprising:

executing a successful callback function based on the comparison and responsive to determining that the number of acknowledgement messages received equals the number of acknowledgement messages specified for the unique identifier.

29. The method of claim 25, wherein the failed callback function is executed using a pointer to the failed callback function.

30. The method of claim 25, wherein connection information to establish the third connection includes a host identifier and a port number.

31. The method of claim 25, wherein connection information to establish each fourth connection is received by reading a configuration file identified by an instance of the event subscription application.

32. The method of claim 25, further comprising establishing each fifth connection based on connection information included in the event block object.

33. The method of claim 25, further comprising:

before receiving each sent second acknowledgement message, adding, by the event publishing client, the unique identifier to an unacknowledged identifier list; and

responsive to determining that the timeout period has expired, removing, by the event publishing client, the unique identifier from t;

he unacknowledged identifier list.

34. The method of claim 33, further comprising removing, by the event publishing client, the unique identifier from the unacknowledged identifier list in response to determining that the number of acknowledgement messages received is equal to the number of acknowledgement messages specified for the unique identifier.

35. The method of claim 25, wherein the failed callback function republishes the received event block object to the source window of the ESPE using the established second connection.

36. The method of claim 25, wherein the failed callback function sends a failed message to the publishing device.

37. The method of claim 25, wherein establishing the first connection, establishing the second connection, establishing the third connection, establishing the fourth connection, and establishing the fifth connection can be performed in any order.