VARIABLE DURATION WINDOWS ON CONTINUOUS DATA STREAMS

• US 20140201355A1
• Filed: 03/15/2013
• Published: 07/17/2014
• Est. Priority Date: 01/15/2013
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Bishnoi, Sandeep, Srinivasan, Anand
• Granted Patent: US 10,298,444 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: H04L 41/0622 based on time
• CPC Class Codes: H04L 41/0686 Additional information in the notification, e.g. enhancement of specific meta-data
• CPC Class Codes: H04L 41/069 using logs of notifications; Post-processing of notifications

Abstract

Improved techniques are provided for processing streams of data. The duration of the time that an event is eligible for remaining in a time-based window can be variable for different events received via the same event stream. In certain embodiments, the duration of time that an input event spends in a time-based window is a function of one or more values of one or more attributes of the event. Since different events can have different one or more attribute values, the different events can spend different amounts of time in the time-based window for that event stream. The amount of time that an event spends in a time-based window can be controlled via the one or more attributes of the event.

Claims

1. A method comprising:

determining, by a computing device, a first duration of time for a first event received via an event stream, the first duration of time indicating a time duration that the first event is eligible to remain in a time-based window specified for the event stream; and

determining, by the computing device, a second duration of time for a second event received via the event stream, the second duration of time indicating a time duration that the second event is eligible to remain in the time-based window, wherein the second time duration is different from the first time duration.

2. The method of claim 1 further comprising:

removing, by the computing device, the first event from the time-based window after the first time event has been in the time-based window for the first time duration; and

removing, by the computing device, the second event from the time-based window after the second time event has been in the time-based window for the second time duration.

3. The method of claim 1 wherein:

the first event has an associated first time;

the second event has an associated second time; and

the first time is same as the second time.

4. The method of claim 1 wherein:

the first event has an associated first time;

the second event has an associated second time; and

the first time is different from the second time.

5. The method of claim 1 wherein:

determining the first time duration comprises computing the first time duration based upon one or more values of one or more attributes of the first event; and

determining the second time duration comprises computing the second time duration based upon one or more values of the one or more attributes of the second event.

6. The method of claim 1 further comprising:

determining, based upon a value of a first attribute of the first event, a first partition for the first event; and

determining, based upon a value of the first attribute of the second event, that the second event belongs to the first partition;

wherein the time-based window is for the first partition.

7. The method of claim 1 further comprising:

determining, by the computing device, a first expiration time for the first event based upon a first time associated with the first event and the first duration of time;

determining, by the computing device, a second expiration time for the second event based upon a second time associated with the second event and the second duration of time;

removing the first event from the time-based window at or after the occurrence of the first expiration time; and

removing the second event from the time-based window at or after the occurrence of the second expiration time.

8. A computing device comprising:

a memory; and

a set of processing units, wherein one or more processing units from the set of processing units are adapted to;

determine a first duration of time for a first event received via an event stream, the first duration of time indicating a time duration that the first event is eligible to remain in a time-based window specified for the event stream; and

determine a second duration of time for a second event received via the event stream, the second duration of time indicating a time duration that the second event is eligible to remain in the time-based window, wherein the second time duration is different from the first time duration

9. The computing device of claim 8 wherein the one or more processing units from the set of processing units are adapted to:

remove the first event from the time-based window after the first time event has been in the time-based window for the first time duration; and

remove the second event from the time-based window after the second time event has been in the time-based window for the second time duration.

10. The computing device of claim 8 wherein:

the first event has an associated first time;

the second event has an associated second time; and

the first time is same as the second time.

11. The computing device of claim 8 wherein:

the first event has an associated first time;

the second event has an associated second time; and

the first time is different from the second time.

12. The computing device of claim 8 wherein the one or more processing units from the set of processing units are adapted to:

determine the first time duration based upon one or more values of one or more attributes of the first event; and

determine the second time duration based upon one or more values of the one or more attributes of the second event.

13. The computing device of claim 8 wherein the one or more processing units from the set of processing units are adapted to:

determine, based upon a value of a first attribute of the first event, a first partition for the first event; and

determine, based upon a value of the first attribute of the second event, that the second event belongs to the first partition;

wherein the time-based window is for the first partition.

14. The computing device of claim 8 wherein the one or more processing units from the set of processing units are adapted to:

determine a first expiration time for the first event based upon a first time associated with the first event and the first duration of time;

determine a second expiration time for the second event based upon a second time associated with the second event and the second duration of time;

remove the first event from the time-based window at or after the occurrence of the first expiration time; and

remove the second event from the time-based window at or after the occurrence of the second expiration time.

15. A computer-readable memory storing a plurality of instructions executable by one or more processing units, the plurality of instructions comprising:

instructions that cause at least one processing unit from the one or more processing units to determine a first duration of time for a first event received via an event stream, the first duration of time indicating a time duration that the first event is eligible to remain in a time-based window specified for the event stream; and

instructions that cause at least one processing unit from the one or more processing units to determine a second duration of time for a second event received via the event stream, the second duration of time indicating a time duration that the second event is eligible to remain in the time-based window, wherein the second time duration is different from the first time duration.

16. The computer-readable memory of claim 15 wherein the plurality of instructions comprises:

instructions that cause at least one processing unit from the one or more processing units to remove the first event from the time-based window after the first time event has been in the time-based window for the first time duration; and

instructions that cause at least one processing unit from the one or more processing units to remove the second event from the time-based window after the second time event has been in the time-based window for the second time duration.

17. The computer-readable memory of claim 15 wherein:

the first event has an associated first time;

the second event has an associated second time; and

the first time is same as the second time.

18. The computer-readable memory of claim 15 wherein the plurality of instructions comprises:

instructions that cause at least one processing unit from the one or more processing units to determine the first time duration based upon one or more values of one or more attributes of the first event; and

instructions that cause at least one processing unit from the one or more processing units to determine the second time duration based upon one or more values of the one or more attributes of the second event.

19. The computer-readable memory of claim 15 wherein the plurality of instructions comprises:

instructions that cause at least one processing unit from the one or more processing units to determine, based upon a value of a first attribute of the first event, a first partition for the first event; and

instructions that cause at least one processing unit from the one or more processing units to determine, based upon a value of the first attribute of the second event, that the second event belongs to the first partition;

wherein the time-based window is for the first partition.

20. The computer-readable memory of claim 15 wherein the plurality of instructions comprises:

instructions that cause at least one processing unit from the one or more processing units to determine a first expiration time for the first event based upon a first time associated with the first event and the first duration of time;

instructions that cause at least one processing unit from the one or more processing units to determine a second expiration time for the second event based upon a second time associated with the second event and the second duration of time;

instructions that cause at least one processing unit from the one or more processing units to remove the first event from the time-based window at or after the occurrence of the first expiration time; and

instructions that cause at least one processing unit from the one or more processing units to remove the second event from the time-based window at or after the occurrence of the second expiration time.