SYSTEMS AND METHODS FOR EVENT STREAM PROCESSING

• US 20130346625A1
• Filed: 07/19/2012
• Published: 12/26/2013
• Est. Priority Date: 06/26/2012
• Status: Active Grant

• Current Assignee: Walmart Apollo, LLC (WalMart Inc.)
• Original Assignee: Wal-Mart Stores Texas LLC (WalMart Inc.)
• Inventors: Lam, Wang Chee, Liu, Lu, Siripurapu, Taraka Subrahmanya Prasad, Rajaraman, Anand, Vacheri, Zoheb, Doan, AnHai
• Granted Patent: US 9,304,809 B2
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications

Abstract

Disclosed are systems and methods for processing events in an event stream using a map-update application. The events may be embodied as a key-attribute pair. An event is processed by one or more instances implementing either a map or an update function. A map function receives an input event from the event stream and publishes one or more events to the event stream. An update function receives an event and updates a corresponding slate and publishes zero or more events. Systems and methods are also disclosed herein for implementing a map-update application in a multithreaded architecture and for handling overloading of a particular thread or node. Systems and methods for providing access to slates updated according to update operations are also disclosed.

Claims

1. A method for performing event processing comprising:

processing an event stream by an application executed by a computers system, the application comprising a plurality event handlers each receiving an input stream from the event stream, each event handler performing an event handling function and at least one of outputting an output stream to the event stream and updating a state;

detecting an overload condition for an event handler of the plurality of event handlers; and

in response to detection of an overload condition, processing at least a portion of a plurality of events received from the input stream according to a degraded handling function, the degraded handling function having lower latency than the event handling function.

2. The method of claim 1, wherein the degraded handling function is a bypass function placing at least a portion of the plurality of events received form the input stream into the output stream.

3. The method of claim 1, wherein the event handling function requires a greater number of computations than the degraded handling function.

4. The method of claim 1, wherein the event handling function accesses an external resource and the degraded handling function does not require access to the external resource.

5. The method of claim 1, wherein the event handling function makes a network function call and the degraded handling function does not make a network function call.

6. The method of claim 1, wherein the event handlers include mappers and updaters, the mappers having an event handling function operable to perform a stateless computation and the updaters having an event handling function operable to perform a state dependent computation.

7. The method of claim 1, wherein the event stream includes a plurality of events each including an attribute and value pair.

8. A system for performing event processing comprising one or more processors and one or more memory devices operably coupled to the one or more processors, the one or memory devices storing executable and operational code effective to cause the one or more processors to:

process an event stream by an application, the application comprising a plurality event handlers each receiving an input stream from the event stream, each event handler performing an event handling function and at least one of outputting an output stream to the event stream and updating a state;

detect an overload condition for an event handler of the plurality of event handlers; and

in response to detection of an overload condition, process at least a portion of a plurality of events received from the input stream according to a degraded handling function, the degraded handling function having lower latency than the event handling function.

9. The system of claim 8, wherein the degraded handling function is a bypass function effective to cause the one or more processors to place at least a portion of the plurality of events received form the input stream into the output stream.

10. The system of claim 8, wherein the event handling function is effective to cause the one or more processors to perform a greater number of computations than the degraded handling function.

11. The system of claim 8, wherein the event handling function is effective to cause the one or more processors to access an external resource and the degraded handling function is not operable to cause the one or more processors to access the external resource.

12. The system of claim 8, wherein the event handling function is effective to cause the one or more processors to make a network function call and the degraded handling function does not make a network function call.

13. The system of claim 8, wherein the event handlers include mappers and updaters, the mappers having an event handling function effective to cause the one or more processors to perform a stateless computation and the updaters having an event handling function effective to cause the one or more processors to perform a state dependent computation.

14. The system of claim 8, wherein the event stream includes a plurality of events each including an attribute and value pair.

15. A computer program product for managing a transaction, the computer program product being embodied in a computer readable storage medium and comprising computer instructions for:

processing an event stream by an application executed by a computers system, the application comprising a plurality event handlers each receiving an input stream from the event stream, each event handler performing an event handling function and at least one of outputting an output stream to the event stream and updating a state;

detecting an overload condition for an event handler of the plurality of event handlers; and

in response to detection of an overload condition, processing at least a portion of a plurality of events received from the input stream according to a degraded handling function, the degraded handling function having lower latency than the event handling function.

16. The computer program product of claim 15, wherein the degraded handling function is a bypass function placing at least a portion of the plurality of events received form the input stream into the output stream.

17. The computer program product of claim 15, wherein the event handling function requires a greater number of computations than the degraded handling function.

18. The computer program product of claim 15, wherein the event handling function accesses an external resource and the degraded handling function does not require access to the external resource.

19. The computer program product of claim 15, wherein the event handling function makes a network function call and the degraded handling function does not make a network function call.

20. The computer program product of claim 15, wherein the event handlers include mappers and updaters, the mappers having an event handling function operable to perform a stateless computation and the updaters having an event handling function operable to perform a state dependent computation.

21. The computer program product of claim 15, wherein the event stream includes a plurality of events each including an attribute and value pair.