Executing continuous event processing (CEP) queries in parallel

• US 10,083,210 B2
• Filed: 06/08/2016
• Issued: 09/25/2018
• Est. Priority Date: 02/19/2013
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Alves, Alexandre de Castro, Srinivasan, Anand
• Primary Examiner(s): Pham, Michael
• Application Number:
  US15/177,147
• Publication Number:
  US 20160283555A1
• Time in Patent Office: 839 Days
• Field of Search: 707769
• CPC Class Codes: G06F 16/24532 of parallel queries
• CPC Class Codes: G06F 16/24565 Triggers; Constraints
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/2474 Sequence data queries, e.g. querying versioned data

Abstract

A continuous event processing (CEP) query processor determines how and when a CEP query can be processed in a concurrent manner, such that multiple threads of execution can concurrently perform at least some of the CEP query'"'"'s operations concurrently with each other. According to one technique, a user can instruct a CEP query processor to attempt to execute a CEP query in a concurrent manner. The CEP query processor responsively determines whether the CEP query'"'"'s execution, or parts thereof, can be made concurrent based on certain constraints that can depend on inheritance and operation type. Based on this determination, the CEP query processor can execute at least certain parts of a CEP query in parallel relative to the same event within an event stream.

Claims

1. A computer-readable memory storing a plurality of instructions for causing a processor to perform operations, the plurality of instructions comprising:

instructions that cause the processor to determine that multiple portions of a continuous event processing (CEP) query can be executed concurrently relative to an event in an event stream, the instructions comprising;

instructions that cause the processor to split the CEP query into a plurality of separate operators;

instructions that cause the processor to determine a separate constraint for each operator within the plurality of separate operators; and

instructions that cause the processor to determine, based at least in part on the separate constraint for each operator within the plurality of separate operators, whether at least a part of the CEP query can be executed in a concurrent manner;

instructions that cause the processor to execute the multiple portions of the CEP query concurrently against a first event received via the event stream in response to determining that at least part of the CEP query can be executed in a concurrent manner; and

instructions that cause the processor to merge, into a single shared operator, (a) a first operator that is used by a first CEP query that processes at least the first event in the event stream, and (b) a second operator that is used by a second CEP query that also processes at least the first event in the event stream, in response to determining that the first operator and the second operator both perform a particular type of operation.

2. The computer-readable memory of claim 1, wherein the plurality of instructions that cause the processor to execute the multiple portions of the CEP query concurrently against the first event received via the event stream further comprise instructions that cause the processor to spawn multiple threads of execution that concurrently process the multiple portions of the CEP query against the first event received via the event stream.

3. The computer-readable memory of claim 1, wherein the plurality of instructions further comprise instructions that cause the processor to determine a constraint for the CEP query based at least in part on the separate constraint determined for each operator within the plurality of separate operators.

4. The computer-readable memory of claim 1, wherein the plurality of instructions that cause the processor to determine the separate constraint for each operator within the plurality of separate operators comprise instructions that cause the processor to determine the separate constraint for the operator based at least in part on one or more constraints of one or more other operators from which the operator receives input.

5. The computer-readable memory of claim 4, wherein the plurality of instructions that cause the processor to determine the separate constraint for each operator within the plurality of separate operators further comprise instructions that cause the processor to determine the separate constraint for the operator based at least in part on determining that an operation type of the operator is at least one of a filtering operation type, a selection operation type, a projection operation type, or a join operation type.

6. The computer-readable memory of claim 1, wherein the plurality of instructions that cause the processor to determine the separate constraint for each operator within the plurality of separate operators comprise instructions that cause the processor to:

determine a first constraint for the operator based on constraints of one or more operators from which the operator receives input;

determine a second constraint for the operator based on an operation type of the operator; and

determine a final constraint for the operator based at least in part on the first constraint and the second constraint.

7. The computer-readable memory of claim 6, wherein the first constraint comprises an inherited constraint for the operator and the second constraint comprises a type-based constraint associated with the operator and wherein the final constraint for the operator is determined based at least in part on the inherited constraint for the operator and the type-based constraint associated with the operator.

8. The computer-readable memory of claim 7, wherein the final constraint for the operator comprises at least one of a completely ordered constraint, a partition-ordered constrained, or an unordered constraint.

9. The computer-readable memory of claim 1, wherein the instructions that cause the processor to determine the separate constraint for each operator within the plurality of separate operators comprise instructions that cause the processor to determine a constraint for a third operator, which receives input from the single shared operator, based at least in part on a constraint of the single shared operator;

wherein the instructions that cause the processor to determine the constraint for each operator within the plurality of separate operators comprise instructions that cause the processor to determine a constraint for a fourth operator, which receives input from the single shared operator, based at least in part on the constraint of the single shared operator;

wherein the third operator is used by the first CEP query and is not used by the second CEP query; and

wherein the fourth operator is used by the second CEP query and is not used by the first CEP query.

10. A system for processing a data stream of events, the system comprising:

a memory storing a plurality of instructions; and

a processor coupled to the memory, the processor configured to execute the plurality of instructions to;

determine that multiple portions of a continuous event processing (CEP) query can be executed concurrently relative to an event in an event stream, the instructions to determine that multiple portions of the CEP query can be executed concurrently relative to an event in an event stream comprising instructions to;

split the CEP query into a plurality of separate operators;

determine a separate constraint for each operator within the plurality of separate operators; and

determine, based at least in part on the separate constraint for each operator within the plurality of separate operators, whether at least a part of the CEP query can be executed in a concurrent manner;

execute the multiple portions of the CEP query concurrently against a first event received via the event stream in response to determining that at least part of the CEP query can be executed in a concurrent manner; and

merge, into a single shared operator, (a) a first operator that is used by a first CEP query that processes at least the first event in the event stream, and (b) a second operator that is used by a second CEP query that also processes at least the first event in the event stream, in response to determining that the first operator and the second operator both perform a particular type of operation.

11. The system of claim 10, wherein the processor is configured to execute the multiple portions of the CEP query concurrently against the first event received via the event stream by spawning multiple threads of execution that concurrently process the multiple portions of the CEP query against the first event received via the event stream.

12. The system of claim 10, wherein the processor is configured to determine the separate constraint for each operator within the plurality of separate operators at least in part by determining the separate constraint for the operator based at least in part on one or more constraints of one or more other operators from which the operator receives input.

13. The system of claim 12, wherein the processor is configured to determine the separate constraint for each operator within the plurality of separate operators at least in part by determining the separate constraint for the operator based at least in part on whether an operation type of the operator is a filtering operation type, a selection operation type, a projection operation type, or a join operation type.

14. The system of claim 10, wherein the processor is configured to determine the separate constraint for each operator within the plurality of separate operators by:

determining a first constraint for the operator based on constraints of one or more operators from which the operator receives input;

determining a second constraint for the operator based on an operation type of the operator; and

determining a final constraint for the operator based at least in part on the first constraint and the second constraint.

15. The system of claim 14, wherein the first constraint comprises an inherited constraint for the operator and the second constraint comprises a type-based constraint associated with the operator.

16. A method for processing a data stream of events, the method comprising:

determining that multiple portions of a continuous event processing (CEP) query can be executed concurrently relative to an event in an event stream, the determining comprising;

splitting the CEP query into a plurality of separate operators;

determining a separate constraint for each operator within the plurality of separate operators; and

determining, based on the separate constraint for each operator within the plurality of separate operators, whether at least a part of the CEP query can be executed in a concurrent manner;

executing the multiple portions of the CEP query concurrently against a first event received via the event stream in response to determining that at least part of the CEP query can be executed in a concurrent manner; and

merging, into a single shared operator, (a) a first operator that is used by a first CEP query that processes at least the first event in the event stream, and (b) a second operator that is used by a second CEP query that also processes at least the first event in the event stream, in response to determining that the first operator and the second operator both perform a particular type of operation.

17. The method of claim 16, further comprising executing the multiple portions of the CEP query concurrently against the first event received via the event stream by spawning multiple threads of execution that concurrently process the multiple portions of the CEP query against the first event received via the event stream.

18. The method of claim 16, wherein determining the separate constraint for each operator within the plurality of separate operators comprises determining the separate constraint for the operator based at least in part on one or more constraints of one or more other operators from which the particular operator receives input.

19. The method of claim 16, wherein determining the separate constraint for each operator within the plurality of separate operators comprises determining the separate constraint for the operator based at least in part on determining that an operation type of the operator is at least one of a filtering operation type, a selection operation type, a projection operation type, or a join operation type.