Stream operator

• US 8,683,074 B2
• Filed: 05/16/2011
• Issued: 03/25/2014
• Est. Priority Date: 05/16/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Meek, Colin Joseph, Ali, Mohamed Hassan, Yen, Galex Sunyul, Gerea, Ciprian, Raman, Balan Sethu, Goldstein, Jonathan David, Chandramouli, Badrish, Verona, Tomer, Grabs, Torsten Walther
• Primary Examiner(s): Mui, Gary
• Assistant Examiner(s): JAHANGIR, KABIR U
• Application Number:
  US13/108,005
• Publication Number:
  US 20120297080A1
• Time in Patent Office: 1,044 Days
• Field of Search: 709/231, 709/232, 370/395.21, 370/395.4, 370/395.43, 375/240.08, 375/369, 375/356
• US Class Current: 709/232
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications

Abstract

Aspects of the subject matter described herein relate to stream operators. In aspects, a stream event is received. Based on a timestamp associated with the stream event and the number of stream operators that have asked to be activated prior to or at the timestamp, zero or more stream objects are informed of one or more time events and torn down if no longer needed. In addition, a destination stream operator is instantiated, if needed, data (e.g., the timestamp and packet, if any) corresponding to the stream event is provided to a stream operator, output data, if any, is received from the stream operator, and the stream operator is torn down if it no longer needs state data between invocations.

Claims

1. A method implemented at least in part by a computer, the method comprising:

receiving a streaming event;

if the streaming event is a time only event, then performing a first set of actions, comprising;

determining a first set of stream operators that have indicated interest in receiving the time only event, and

sending an indication of the time only event to each of the stream operators of the first set when the first set includes at least one stream operator;

if the streaming event is not a time only event, then performing a second set of actions, comprising;

determining a second set of stream operators that are to receive stream data corresponding to the streaming event, and

sending the stream data to each of the stream operators of the second set when the second set includes at least one stream operator; and

if the streaming event is or is not a time only event, performing additional actions, comprising;

receiving output data from at least one of the stream operators to which the indication of the time only event or the stream data was sent, the at least one of the stream operators being configured to operate on the indication of the time only event or the stream data to generate the output data, and

obtaining an indication from each stream operator to which the indication of the time only event or the stream data was sent whether the stream operator is now disposable.

2. The method of claim 1, wherein performing a first set of actions further comprises determining whether a stream operator of the first set is already instantiated, and if not, instantiating the stream operator prior to sending an indication of the time only event.

3. The method of claim 2, further comprising if the stream operator of the first set indicates that it is now disposable, freeing memory associated with the stream operator.

4. The method of claim 3, further comprising calling a destroy method of the stream operator prior to freeing memory associated with the stream operator.

5. The method of claim 1, wherein determining a first set of stream operators that have indicated interest in receiving the time only event comprises querying, when the first set includes at least one stream operator, each stream operator of the first set to ask a first time at which to activate the stream operator if no other stream data for the stream operator is received first.

6. The method of claim 1, wherein receiving a streaming event that is not a time only event comprises receiving a timestamp and a field that includes data, wherein the timestamp is an integer.

7. The method of claim 1, wherein determining a second set of stream operators that are to receive stream data corresponding to the streaming event comprises, when the second set includes at least one stream operator, for each stream operator of the second set applying a partition function to the stream data, the partition function applying a set of conditions to the stream data to determine whether a stream operator is to receive the stream data.

8. The method of claim 1, wherein the second set of actions further comprises determining whether a stream operator of the second set is already instantiated, and if not, instantiating the stream operator prior to providing the stream data to the stream operator.

9. The method of claim 1, further comprising receiving other streaming events out of temporal order, and ordering the streaming events in temporal order before performing the first or second set of actions.

10. In a computing environment, a system, comprising:

an event receiver operable to receive stream data for a streaming event, the stream data including a timestamp with or without a payload of data;

an operator selector operable to determine a stream operator to which to send the stream data, the stream operator being configured to operate on the stream data to generate output data; and

an operator manager operable to instantiate the stream operator if needed, provide the stream data to the stream operator, receive the output data from the stream operator, and tear down the stream operator after the stream operator no longer needs to maintain state data.

11. The system of claim 10, further comprising a temporal processor operable to order streaming events that are received out of temporal order into a temporal order such that stream data for any two stream events that are to be provided to the stream operator, a first stream event having a first timestamp is provided to the stream operator before stream data for a second stream event having a second timestamp if the first timestamp is temporally before the second timestamp.

12. The system of claim 10, further comprising a temporal processor operable to order streaming events deterministically.

13. The system of claim 12, wherein the temporal processor is operable to order streaming events deterministically by performing actions, comprising:

receiving an event associated with a timestamp; and

informing each stream operator that has requested activation at timestamps up to the timestamp of the event prior to processing the event.

14. The system of claim 13, wherein the temporal processor is operable to call a given stream operator multiple times before processing the event if the given stream operator indicates one or more additional activation times that are prior to or equal to the timestamp.

15. The system of claim 10, wherein the operator selector is operable to determine a stream operator to which to send the stream data by using a data structure that indicates activation times for stream operators, an entry in the data structure indicating an activation time for a corresponding stream operator.

16. The system of claim 10, wherein the operator manager is further operable to query the stream operator to ask whether the stream operator still needs to maintain state data.

17. A computer storage memory having computer-executable instructions, which when executed perform actions, comprising:

receiving a streaming event;

obtaining a timestamp of the streaming event;

determining a stream operator to which to provide data corresponding to the streaming event, the stream operator being configured to operate on the data to generate output data;

prior to providing the streaming event to the stream operator, performing a first set of actions, comprising;

determining a set of stream operators that have requested activation at an activation timestamp at or before the timestamp,

when the set includes at least one stream operator, activating each stream operator in the set and informing each stream operator in the set that the activation timestamp has occurred; and

after the first set of actions has completed, performing a second set of actions using the stream operator.

18. The computer storage memory of claim 17, wherein performing the second set of actions comprises if the streaming event is a time event without a payload, informing the stream operator that the time event has occurred and receiving the output data from the stream operator.

19. The computer storage memory of claim 17, wherein performing the second set of actions comprises if the streaming event is a time event with a payload, instantiating the stream operator, providing the data corresponding to the streaming event to the stream operator, and receiving the output data from the stream operator.

20. The computer storage memory of claim 17, wherein the second set of actions comprises tearing down each of the stream operators that has indicated that it is disposable.