METHODS AND SYSTEMS FOR QUERYING EVENT STREAMS USING MULTIPLE EVENT PROCESSORS

• US 20110246445A1
• Filed: 06/17/2011
• Published: 10/06/2011
• Est. Priority Date: 06/05/2007
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Mishra, Shailendra, Jain, Namit, Srinivasan, Anand
• Granted Patent: US 8,326,822 B2
• Time in Patent Office: Days
• US Class Current: 707/713
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

In one embodiment, a system for distributed event processing includes a first event processor and a second event processor. The first event processor receives event data associated with an event stream. The second event processor receives a query associated with the event stream. A request to the first event processor is generated by the second event processor based on the query for a first portion of event data associated with the event stream. The second event processor receives the first portion of event data from the first event processor. The second event processor then generates an event based on the first portion of event data.

Claims

1. A method for processing events, the method comprising:

receiving, at one or more computer systems, a first query for event data associated with a plurality of event streams;

determining, with the one or more processors associated with the one or more computer systems, a window associated with the first query defining a temporal scope of operations on the event data associated with the plurality of event streams;

determining, with the one or more processors associated with the one or more computer systems, a rate at which the temporal scope of operations applies to the event data associated with the plurality of event streams;

generating, with the one or more processors associated with the one or more computer systems, one or more additional queries based on the first query, the determined window, and the determined rate, at least one query in the one or more additional queries requesting a subset of event data associated with one or more event streams located at a first event processor, at least one query in the one or more additional queries requesting a subset of event data associated with one or more event streams located at a second event processor; and

generating, with the one or more processors associated with the one or more computer systems, a sequence of one or more events based on information obtained by the first event processor that satisfies the determined window and the determined rate and information obtained by the second event processor that satisfies the determined window and the determined rate.

2. The method of claim 1 wherein generating the one or more additional queries comprises generating an instruction to the first event processor or the second event processor indicating to locally query the one or more event streams.

3. The method of claim 1 wherein generating the one or more additional queries comprises generating an instruction to the first event processor or the second event processor indicating to collocate a subset of the one or more event streams at another event processor.

4. A non-transitory computer-readable medium storing computer-executable code for processing events associated with a plurality of event streams, the non-transitory computer-readable medium comprising:

code for receiving a first query for event data associated with a plurality of event streams;

code for determining a window associated with the first query defining a temporal scope of operations on the event data associated with the plurality of event streams;

code for determining a rate at which the temporal scope of operations applies to the event data associated with the plurality of event streams;

code for generating one or more additional queries based on the first query, the determined window, and the determined rate, at least one query in the one or more additional queries requesting a subset of event data associated with one or more event streams located at a first event processor, at least one query in the one or more additional queries requesting a subset of event data associated with one or more event streams located at a second event processor; and

code for generating a sequence of one or more events based on information obtained by the first event processor that satisfies the determined window and the determined rate and information obtained by the second event processor that satisfies the determined window and the determined rate.

5. The non-transitory computer-readable medium of claim 4 wherein the code for generating the one or more additional queries comprises code for generating an instruction to the first event processor or the second event processor indicating to locally query the one or more event streams.

6. The non-transitory computer-readable medium of claim 4 wherein the code for generating the one or more additional queries comprises code for generating an instruction to the first event processor or the second event processor indicating to collocate a subset of the one or more event streams at another event processor.

7. A method for distributed processing of events, the method comprising:

receiving, at one or more computer systems, a query requesting event data from a virtual event stream;

identifying, with one or more processors associated with the one or more computer systems, an event processor that is configured to process event data for components forming the virtual event stream;

optimizing, with the one or more processors associated with the one or more computer systems, the query such that another query is forwarded to each identified event processor that instructs the event processor to either take the query over a component of the virtual event stream locally accessible to the event processor or collocate the component of the virtual event stream locally accessible to the event processor at another event processor; and

generating, with the one or more processors associated with the one or more processors, event data associated with the virtual event stream in response to the optimized query.

8. The method of claim 7 wherein optimizing the query comprises rewriting the query to use remote mapping that takes the query over the component of the virtual event stream locally accessible to the event processor.

9. The method of claim 7 wherein optimizing the query comprises rewriting the query to use remote row sourcing that collocates the component of the virtual event stream locally accessible to the event processor at another event processor.