OPTIMIZING PERFORMANCE IN CEP SYSTEMS VIA CPU AFFINITY

• US 20150347509A1
• Filed: 06/27/2014
• Published: 12/03/2015
• Est. Priority Date: 05/27/2014
• Status: Active Grant

• Current Assignee: Sybase Incorporated (SAP SE)
• Original Assignee: Ibrahim Ahmed, Palaniappan Gandhi
• Inventors: Theiding, Mark, Ahmed, Ibrahim, Gandhi, Palaniappan
• Granted Patent: US 9,921,881 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/5033 considering data affinity

Abstract

In an example embodiment, performance is optimized in a complex event stream (CEP) system. Information about a plurality of CEP threads is obtained. Then nearness among the plurality of CEP threads is determined, wherein nearness between a first and a second CEP thread indicates how much interaction is expected to occur between the first and second CEP thread. Based on the determined nearness, the plurality of CEP threads are organized into a plurality of CEP thread groups. Then, each of the plurality of CEP thread groups are assigned to a different processing node, with each processing node having one or more processors and a memory.

Claims

1. A method for optimizing performance in a complex event stream (CEP) system, the method comprising:

obtaining information about a plurality of CEP threads;

determining nearness among the plurality of CEP threads, wherein nearness between a first and a second CEP thread indicates how much interaction is expected to occur between the first and second CEP thread;

organizing the plurality of CEP threads into a plurality of CEP thread groups, based on the determined nearness; and

assigning each of the plurality of CEP thread groups to a different processing node, each processing node having one or more processors and a memory.

2. The method of claim 1, wherein each processing node is a non-uniform memory access (NUMA) node.

3. The method of claim 1, further comprising:

assigning each of the plurality of CEP threads a value representing processing capacity requested by a corresponding CEP thread; and

wherein the organizing is also based on the values for each of the plurality of CEP threads and information about processing capacity of each processing node.

4. The method of claim 3, wherein the determining nearness includes creating a directed acyclic graph (DAG) with each of the plurality of CEP threads assigned a different node in the DAG and edges between nodes representing data dependencies among the threads;

and

wherein each edge in the DAG is assigned a nearness value.

5. The method of claim 1, wherein the method is performed during startup time.

6. The method of claim 1, wherein the method is performed during runtime.

7. The method of claim 6, wherein the nearness between the first and second threads is measured by calculating an actual amount of data transmitted between the first and second threads during a set period.

8. The method of claim 1, wherein the nearness is determined at least partially based on one or more user hints, the one or more user hints indicating whether a particular thread is dynamic, semi-static, or static.

10. The apparatus of claim 8, wherein the apparatus is coupled to one or more input adapters receiving input from at least one of the following:

market data feeds, a message bus, network monitoring, application transactions, and internal event streams.

11. The apparatus of claim 8, wherein the event stream processing engine further comprises a stream monitor configured to monitor real-time processing of the one or more threads on the plurality of processing nodes and pass metric information to the affinity analyzer for use in reassigning one or more of the CEP thread groups to a different processing node.

12. The apparatus of claim 8, wherein the event stream processing engine further comprises a stream monitor configured to monitor real-time processing of the one or more threads on the plurality of processing nodes and pass metric information to the affinity analyzer for use in recalculating nearness among the plurality of CEP threads.

9. An apparatus comprising:

an event stream processing engine comprising;

an affinity analyzer executable by a processor and configured to;

obtain information about a plurality of CEP threads;

determine nearness among the plurality of CEP threads,

wherein nearness between a first and a second CEP thread indicates how much interaction is expected to occur between the first and second CEP thread;

organize the plurality of CEP threads into a plurality of CEP thread groups, based on the determined nearness; and

assign each of the plurality of CEP thread groups to a different processing node, each processing node having one or more processors and a memory.

13. A non-transitory machine-readable storage medium comprising instructions, which when implemented by one or more machines, cause the one or more machines to perform operations for optimizing performance in a complex event stream (CEP) system, the operations comprising:

obtaining information about a plurality of CEP threads;

determining nearness among the plurality of CEP threads, wherein nearness between a first and a second CEP thread indicates how much interaction is expected to occur between the first and second CEP thread;

organizing the plurality of CEP threads into a plurality of CEP thread groups, based on the determined nearness; and

assigning each of the plurality of CEP thread groups to a different processing node, each processing node having one or more processors and a memory.

14. The non-transitory machine-readable storage medium of claim 13, wherein each processing node is a non-uniform memory access (NUMA) node.

15. The non-transitory machine-readable storage medium of claim 13, further comprising:

assigning each of the plurality of CEP threads a value representing processing capacity requested by a corresponding CEP thread; and

wherein the organizing is also based on the values for each of the plurality of CEP threads and information about processing capacity of each processing node.

16. The non-transitory machine-readable storage medium of claim 15, wherein the determining nearness includes creating a directed acyclic graph (DAG) with each of the plurality of CEP threads assigned a different node in the DAG and edges between nodes representing data dependencies among the threads;

and

wherein each edge in the DAG is assigned a nearness value.

17. The non-transitory machine-readable storage medium of claim 13, wherein the method is performed during startup time.

18. The non-transitory machine-readable storage medium of claim 13, wherein the method is performed during runtime.

19. The non-transitory machine-readable storage medium of claim 18, wherein the nearness between the first and second threads is measured by calculating an actual amount of data transmitted between the first and second threads during a set period.

20. The non-transitory machine-readable storage medium of claim 13, wherein the nearness is determined at least partially based on one or more user hints, the one or more user hints indicating whether a particular thread is dynamic, semi-static, or static.