Time-based event processing using punctuation events

• US 8,413,169 B2
• Filed: 10/21/2009
• Issued: 04/02/2013
• Est. Priority Date: 10/21/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Grabs, Torsten W., Goldstein, Jonathan, Sezgin, Beysim
• Primary Examiner(s): CAO, DIEM K
• Application Number:
  US12/603,445
• Publication Number:
  US 20110093866A1
• Time in Patent Office: 1,259 Days
• Field of Search: 719/318, 707/104.1
• US Class Current: 719/318
• CPC Class Codes: G06F 11/3065 Monitoring arrangements determined by the means or processing involved in reporting the monitored data error or fault reporting or logging G06F11/0766
• CPC Class Codes: G06F 11/3075 the data filtering being achieved in order to maintain consistency among the monitored data, e.g. ensuring that the monitored data belong to the same timeframe, to the same system or component
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications

Abstract

Methods, systems, and computer-readable media are disclosed for time-based event processing using punctuation events. A particular method includes receiving a first event object comprising a first validity start time and a first validity end time, where the first validity end time is initially undefined. A punctuation object is received after the first event object. The punctuation event object has a punctuation timestamp indicating a time subsequent to the first validity start time. The punctuation event object indicates that event objects to be received at the computer system after the punctuation event object have validity start times later than the time indicated by the punctuation timestamp. The method includes setting the first validity end time to a value later than or equal to the time indicated by the punctuation timestamp.

Claims

1. A method, comprising:

at a computer system, receiving a first event object comprising a first validity start time and a first validity end time, wherein the first validity end time is initially undefined or unfinalized;

after receiving the first event object, receiving a punctuation event object comprising a punctuation timestamp indicating a time subsequent to the first validity start time, wherein the punctuation event object indicates that event objects received at the computer system after the punctuation event object will have validity start times later than the time indicated by the punctuation timestamp; and

setting the first validity end time to a value later than or equal to the time indicated by the punctuation timestamp.

2. The method of claim 1, wherein the time indicated by the punctuation timestamp is greater than the first validity start time by at least a smallest unit of time measurement at the computer system.

3. The method of claim 1, wherein the punctuation event is a current time increment (CTI) event.

4. The method of claim 1, further comprising receiving a second event object comprising a second validity start time and a second validity end time.

5. The method of claim 4, wherein when the time indicated by the punctuation timestamp is subsequent to the second validity start time, the method further comprises setting the second validity end time to the value later than or equal to the time indicated by the punctuation timestamp.

6. The method of claim 5, wherein when the second validity start time is subsequent to the time indicated by the punctuation timestamp, the method further comprises:

after receiving the second event object, receiving a second punctuation event object comprising a second punctuation timestamp indicating a time subsequent to the second validity start time, wherein the second punctuation event object indicates that event objects to be received at the computer system after the second punctuation event object have validity start times later than the time indicated by the second punctuation timestamp; and

setting the second validity end time to a second value later than or equal to the time indicated by the second punctuation timestamp.

7. The method of claim 6, wherein the first event object further comprises a payload.

8. The method of claim 1, further comprising, prior to receiving the punctuation event object:

executing a query to generate a preliminary query result; and

transmitting the preliminary query result to a client of the computer system.

9. The method of claim 8, wherein the client is remote from the computer system.

10. The method of claim 8, wherein the first event object is classified as a finalized event object after the first validity end time of the first event object is set.

11. The method of claim 8, further comprising, after setting the first validity end time:

executing the query to generate a finalized result; and

transmitting the finalized result to the client of the computer system.

12. A system, comprising:

a processor; and

a memory, communicatively coupled to the processor, storing instructions that, when executed by the processor, trigger;

an insertion event indicating the arrival of an unfinalized event object with a valid payload;

a punctuation event represented by a punctuation event object, wherein the punctuation event object has a timestamp preventing later received event objects from overwriting the valid payload of the unfinalized event object;

a lifetime shrink event creating a finalized object by setting a newly defined validity end time for the unfinalized event object to a value later than or equal to the time indicated by the punctuation timestamp.

13. The system of claim 12, wherein a continuously executing query at a query engine of the system generates a preliminary result based on the unfinalized event object and a finalized result based on the finalized event object.

14. The system of claim 13, wherein the query is a sliding window query, a hopping window query, or any combination thereof

15. The system of claim 13, wherein the query is a limited latency query.

16. The system of claim 12, wherein the punctuation event object is generated based on a hardware clock of a processor at the system.

17. The system of claim 12, wherein the punctuation event object is generated based on a software clock at the system.

18. A computer-readable storage medium comprising instructions, that when executed by a computer, cause the computer to:

receive a plurality of unfinalized event objects, wherein each unfinalized event object comprises a validity start time and a validity end time that is initially undefined or unfinalized;

generate a plurality of preliminary results with respect to the plurality of unfinalized event objects;

receive a punctuation event object comprising a punctuation timestamp indicating a time subsequent to the validity start times of each of the plurality of unfinalized event objects;

receive a post-punctuation event object comprising a post-punctuation validity start time subsequent to the time indicated by the punctuation timestamp;

convert the plurality of unfinalized event objects to a plurality of finalized event objects by setting the validity end times of each of the plurality of unfinalized event objects to be equal to the post-punctuation validity start time; and

generate a plurality of finalized results with respect to the plurality of finalized event objects.

19. The computer-readable storage medium of claim 18, wherein the plurality of preliminary results are transmitted to a client.

20. The computer-readable storage medium of claim 19, wherein the plurality of finalized results are transmitted to the client after the transmission of the plurality of preliminary results.