Event stream transformations

• US 10,235,436 B2
• Filed: 10/15/2014
• Issued: 03/19/2019
• Est. Priority Date: 08/29/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Nano, Olivier, Santos, Ivo Jose Garcia dos, Akchurin, Eldar, Novik, Lev, Tarnavski, Tihomir, Periorellis, Panagiotis
• Primary Examiner(s): Lewis, Cheryl
• Application Number:
  US14/515,382
• Publication Number:
  US 20160063080A1
• Time in Patent Office: 1,616 Days
• CPC Class Codes: G06F 16/2456 Join operations
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

The formulation of transformations on one or more input event streams to generation one or more output event streams. Accordingly, the transformations may be considered to be a query on the original input event stream(s). The event query includes event stream source representations representing an input event stream available in a particular execution context. The event query also includes a transformation module identifying the transformation set to be performed on the input event streams in the execution context. Once the query is properly formed, an execution module may then cause the transformations to be executed upon the designated input event stream(s) to generate output event streams.

Claims

1. A computer program product comprising one or more computer-readable hardware storage media having stored thereon computer-executable instructions that are executable by one or more processors to transform at least two event stream data sources, the computer-executable instructions including instructions that are executable to cause a computing device to perform at least the following:

receiving, at the computing device, at least two input event streams, each of the at least two input event steams comprising a plurality of discrete events, each discrete event having a timestamp, wherein each of the at least two input event streams are available within a different execution context, and wherein one of the received input event streams is identified as a contemporary event stream with a first execution context, and one of the received input event streams is identified as an historical event steam with a different execution context;

based at least on a received user query, authoring a transformation set of one or more transformations to be performed on the at least two input event streams, based on the first and different execution contexts of the at least two input event streams; and

an execution module executing the transformation set such that one or more of the plurality of discrete events from the contemporary event stream are joined with one or more of the plurality of discrete events from the historical event stream according to the first and different execution context of the respective input event streams to generate a resulting joined event stream.

2. The computer program product in accordance with claim 1, the computer-readable storage media further having thereon the following:

an authoring module configured to allow an author to author the transformation set.

3. The computer program product in accordance with claim 2, the authoring module configured to provide a set of programming abstractions including an event stream abstraction that is the same regardless of the event stream.

4. The computer program product in accordance with claim 2, the authoring module configured to provide a set of programming abstractions including an abstraction that is utilized to generate the resulting joined event stream by joining the contemporary event stream with the historical event stream.

5. The computer program product in accordance with claim 1, the computer-readable storage media further having thereon the following:

a context identification module identifying the execution context to the execution module so that the execution module can cause the transformation set to be performed in the execution context.

6. The computer program product in accordance with claim 5, the execution context being a local computing system.

7. The computer program product in accordance with claim 5, the execution context being a cloud computing environment.

8. The computer program product in accordance with claim 5, the computer-readable storage media further having thereon the following:

an authoring module configured to allow an author to author the context identification module.

9. The computer program product in accordance with claim 1, the computer-readable storage media further having thereon the following:

an initiation control configured to initiate the execution module upon detection of user input.

10. The computer program product of claim 1, wherein the plurality of discrete events within the historical event stream are each associated with a single timestamp that occurred in the past.

11. The computer program product of claim 1, where the event streams comprise discrete events that describe one or more of the following:

resource consumption, resource utilization, log records, performance counters, identified anomalies, communication records, user interactions, status updates, sensor data, or trend data.

12. The computer program product of claim 11, wherein the historical event stream comprises a plurality of resource consumption events for a plurality of resources, each of resource consumption events being identified by a unique timestamp that occurred in the past.

13. The computer program product of claim 12, wherein the contemporary event stream comprises a plurality of different resource consumption events for the plurality of resources.

14. A method, executed at a computer system including one or more processors, for causing a resulting event stream to be generated by executing a transformation set on one or more input event streams, the method comprising:

accessing, at the computer system, at least two input event streams, each of the at least two input event streams comprising a plurality of discrete events, each discrete event having a timestamp, wherein each of the at least two input event streams are available within a different execution context, and wherein one of the received input event streams is identified as a contemporary event stream with a first execution context, and one of the received input event streams is identified as an historical event stream with a different execution context,

based at least on a received user query, authoring, at the computer system, a transformation set of one or more transformations to be performed on the at least two input event streams, based on the first and different execution contexts of the at least two input event streams; and

executing, at the computer system, the transformation set such that one more of the plurality of discrete events from the contemporary event stream are joined with one or more of the plurality of discrete events from the historical event stream, according to the first and different execution context of the respective input event streams, to generate a resulting joined event stream.

15. The method in accordance with claim 14, the one or more transformations comprising a filtering operation that is applied to the at least two input event streams.

16. The method in accordance with claim 15, the one or more transformations comprising event generation logic for generating events of the resulting joined event stream, the event generation logic using a filtered particular event stream as input.

17. The method in accordance with claim 14, the one or more transformations comprising event generation logic for generating events of the resulting joined event stream.

18. The method in accordance with claim 14, further comprising:

accessing, at the computer system, an event stream sink representation representing a particular event sink available in the execution context and providing the resulting event stream into the particular event sink.

19. A computer system comprising:

one or more processors; and

one or more computer-readable hardware storage media having thereon computer executable instructions that are structured such that, when executed by the one or more processing units, causes the computer system to perform the following;

obtaining, at the computer system, a transformation set of one or more transformations to be performed on at least two received input event streams including at least one input event stream that is identified as a contemporary event stream available within a first execution context, and at least one of the received input event stream that is identified as an historical event stream available within a different execution context, wherein each of the at least two input event streams comprises a plurality of discrete events with an associated timestamp;

coupling, at the computer system, the transformation set to the contemporary event stream and to the historical event stream such that when the transformation set executes, the transformation set is performed on the contemporary event stream and the historical event stream; and

executing, at the computer system, the transformation set to generate a resulting joined event stream by at least joining one or of the plurality of discrete events of the contemporary event stream with one or more of discrete events of the historical event stream.

20. The computer system in accordance with claim 19, the historical event stream being a historical time-shifted version of the contemporary event stream.

21. The computer system in accordance with claim 19, the transformation set comprising a filtering operation that is applied to at least one of the contemporary event stream and the historical event stream.

22. The computer system in accordance with claim 19, the transformation set comprising event generation logic for generating events of the resulting joined event stream, the event generation logic using at least a portion of the contemporary event stream and at least a portion of the historical event stream as input.