INDICATING PARALLEL OPERATIONS WITH USER-VISIBLE EVENTS

• US 20110307905A1
• Filed: 06/15/2010
• Published: 12/15/2011
• Est. Priority Date: 06/15/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Essey, Edward G., Ostrovsky, Igor, Yildiz, Huseyin S., Shafi, Hazim, Colburn, William T., Nagpal, Pooja
• Granted Patent: US 9,846,628 B2
• Time in Patent Office: Days
• US Class Current: 719/318
• CPC Class Codes: G06F 11/323 Visualisation of programs or trace data
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 2201/86 Event-based monitoring

Abstract

The present invention extends to methods, systems, and computer program products for indicating parallel operations with user-visible events. Event markers can be used to indicate an abstracted outer layer of execution as well as expose internal specifics of parallel processing systems, including systems that provide data parallelism. Event markers can be used to show a variety of execution characteristics including higher-level markers to indicate the beginning and end of an execution program (e.g., a query). Inside the execution program (query) individual fork/join operations can be indicated with sub-levels of markers to expose their operations. Additional decisions made by an execution engine, such as, for example, when elements initially yield, when queries overlap or nest, when the query is cancelled, when the query bails to sequential operation, when premature merging or re-partitioning are needed can also be exposed.

Claims

1. At a computer system including a plurality of processor elements and system memory, the computer system configured to utilize the plurality of processor elements for parallel execution of programs across a plurality of threads, a method for presenting program execution details resulting from parallel execution of a program at the computer system, the method comprising:

an act of executing a program at the computer system, the program configured for parallel execution on the plurality of processor elements across the plurality of threads;

an act of inserting event markers in the runtime system that correspond to events that are of interest to a user in order understand performance of the program;

an act of merging an event log with one or more of;

processor utilization information and thread activity information into graphical data representing one or more of how the plurality of processing elements and plurality of threads were utilized during execution of instructions that generated the events of interest, the processor utilization information indicative of the utilization of each of the plurality of processing elements during execution of the instructions, the thread activity indicating thread state of the plurality of threads during execution of the instructions;

an act of supplementing the graphical data with further graphical data representing visualizations of the event markers generated by the instructions; and

an act of visually presenting the graphical data and the further graphical data so as to visually indicate one or more of processor utilization and thread activity at least during execution of the instructions along with the visualizations of the event markers indicating the events of interest.

2. The method as recited in claim 1, wherein the act of inserting event markers in the runtime system comprises an act of inserting at least one pair of high level markers into an event log during execution of the program on the plurality of processor elements, the pair of high level markers indicating the span of execution of a query, the pair of high level markers including a query begin event marker indentifying the beginning of the query'"'"'s execution and a query end event marker identifying the end of the query'"'"'s execution.

3. The method as recited in claim 2, further comprising:

an act of inserting one or more pairs of task event markers between the query begin event marker and the query end event marker in the event log, each set of task event markers indicating the span of execution of a task within the query, each pair of task markers including a task begin event marker indentifying the beginning of the corresponding task'"'"'s execution and a task end event marker identifying the end of the corresponding task'"'"'s execution, each pair of task markers including the unique query identifier and a task identifier, the query identifier indicating that the task belongs to the query, the task identifier indicating which task in the computer system is executing.

4. The method as recited in claim 3, further comprising:

an act of inserting one or more pairs of query group event markers between the query begin event marker and the query end event marker in the event log, each set of query group event markers used to nest one of multiple levels of fork/joins, each pair of query group markers including a query group begin event marker indentifying the beginning of a query group at one of the multiple levels of fork/joins and a query group end event marker identifying the end of the query group at one of the multiple levels of fork/joins.

5. The method as recited in claim 4, wherein the act of inserting one or more pairs of query group event markers between the query begin event marker and the query end event marker in the event log comprises an act of inserting a pair of query group event markers between the query begin event marker and the query end event marker in the event log;

and further comprising;

an act of inserting one or more pairs of task event markers between the query group begin event marker and the query group end event marker in the event log.

6. The method as recited in claim 2, wherein the query begin event marker and the query end event marker each include a unique query identifier identifying the query for the query and a task identifier specifying the originating task that called the query.

7. The method as recited in claim 6, wherein the act of visually presenting the graphical data and the further graphical data comprises an act of visually presenting one or more of the unique query identifier and task identifier.

8. The method as recited in claim 2, further comprising an act of inserting one or more other event markers between query begin event marker and the query end event marker in the event log to indicate state changes in the computer system, the one or more other event markers for indicating state changes selected from among:

a sequential fall back event indicating when a query was not run in parallel,

a partial sequential fall back event indicating when a query was ran partially in parallel and then fell back to sequential execution,

a cancellation event that indicates where a query was expressly cancelled,

a first element yielded event that indicates a time after the query begin event and before the query end event when the first result element was produced by parallel execution,

a query premature merge event that indicates a time mid-query when the computer system deemed it necessary to force a merge, and

a query repartitioned event that indicates when parallel execution may have needed to partition a data source mid-query.

9. The method as recited in claim 1, wherein the act of inserting event markers in the runtime system comprises an act of inserting a pair of high level markers into an event log during execution of the program on the plurality of processor elements, the pair of high level markers indicating the span of execution of the program, the pair of high level markers including a parallel operation begin event marker indentifying the beginning of the program'"'"'s execution and a parallel operation end event marker identifying that the program has executed all iterations to completion.

10. The method as recited in claim 1, wherein the act of executing a program comprises an act of execution a PLINQ query.

11. The method as recited in claim 1, wherein the act of inserting event markers in the runtime system comprises an act of inserting a plurality of event markers into an event log during execution of the PLINQ query to provide data on how PLINQ and TPL interact together.

12. The method as recited in claim 1, wherein the act of visually presenting the graphical data and the further graphical data comprises an act of presenting one of text or a callstack indicating an event of interest.

13. The method as recited in claim 1, wherein the act of visually presenting the graphical data and the further graphical data comprises an act of indicating one of when an event of interest occurred and where an event of interest occurred in the source code for the program.

14. The method as recited in claim 1, wherein the act of executing the programming using parallel execution on the plurality of processing elements comprises an act of executing the programming using parallel execution on one of:

a plurality of different processors and a plurality of different processing cores in the same processors.

15. A computer program product for use at computer system including a plurality of processor elements and system memory, the computer system configured to utilize the plurality of processor elements for parallel execution of programs across a plurality of threads, the computer program product for implementing a method for presenting program execution details resulting from parallel execution of a program at the computer system, the computer program product comprising one or more computer storage media having stored thereon computer executable instructions that, when executed, cause the computer system to perform the method, including the following:

execute the program using parallel execution on the plurality of processor elements across the plurality of threads;

insert event markers in the runtime system that correspond to events that are of interest to a user in order to understand performance of the program;

merge the event log with one or more of;

processor utilization information and thread activity information into graphical data representing one or more of how the plurality of processing elements and plurality of threads were utilized during execution of instructions that generated the events of interest, the processor utilization information indicative of the utilization of each of the plurality of processing elements during execution of the instructions, the thread activity indicating thread state of the plurality of threads during execution of the instructions;

supplement the graphical data with further graphical data representing visualizations of the event markers generated by the instructions; and

visually present the graphical data and further graphical data so as to visually indicate one or more of processor utilization and thread activity at least during execution of the instructions along with the visualizations of the event markers indicating the events of interest.

16. The computer program product as recited in claim 15, wherein computer executable instructions that, when executed, cause the computer system to insert event markers in the runtime system that correspond to events that are of interest to a user comprise computer executable instructions that, when executed, cause the computer system to insert at least one pair of high level markers into an event log during execution of the program on the plurality of processor elements, the pair of high level markers indicating the span of execution of a query, the pair of high level markers including a query begin event marker indentifying the beginning of the query'"'"'s execution and a query end event marker identifying the end of the query'"'"'s execution.

17. The computer program product as recited in claim 16, further comprising computer executable instructions that, when executed, cause the computer system to inserting one or more pairs of query group event markers between the query begin event marker and the query end event marker in the event log, each set of query group event markers used to nest one of multiple levels of fork/joins, each pair of query group markers including a query group begin event marker indentifying the beginning of a query group at one of the multiple levels of fork/joins and a query group end event marker identifying the end of the query group at one of the multiple levels of fork/joins.

18. The computer program product as recited in claim 17, wherein computer executable instructions that, when executed, cause the computer system to insert one or more pairs of query group event markers between the query begin event marker and the query end event marker in the event log comprise computer executable instructions that, when executed, cause the computer system to inserting a pair of query group event markers between the query begin event marker and the query end event marker in the event log;

and further comprising computer executable instructions that, when executed, cause the computer system to;

insert one or more pairs of task event markers between the query group begin event marker and the query group end event marker in the event log.

19. The computer program product as recited in claim 15, wherein computer executable instructions that, when executed, cause the computer system to insert event markers in the runtime system that correspond to events that are of interest to a user in order to understand performance of the program comprise computer executable instructions that, when executed, cause the computer system to insert a pair of high level markers into an event log during execution of the program on the plurality of processor elements, the pair of high level markers indicating the span of execution of the program, the pair of high level markers including a parallel operation begin event marker indentifying the beginning of the program'"'"'s execution and a parallel operation end event marker identifying that the program has executed all iterations to completion.

20. A computer system, the computer system comprising:

system memory;

a plurality of processing elements;

a display; and

one or more computer storage media having stored thereon computer- executable instructions representing a PLINQ query, an event log generator, a process monitor, and a merging component, wherein the PLINQ query is configured to;

execute on the plurality of processor elements across a plurality of threads;

insert at least one pair of high level markers into an event stream during execution on the plurality of processor elements, the pair of high level markers indicating the span of execution of the PLINQ query, the pair of high level markers including a query begin event marker indentifying the beginning of the query'"'"'s execution and a query end event marker identifying the end of the query'"'"'s execution;

wherein the event log generator is configured to access the event stream and convert the event stream into an event log including the at least one pair of high level markers;

wherein the process monitor is configured to monitor processor utilization and thread activity during execution of the PLINQ query and converting the processor utilization and thread activity into overlay information indicative of the utilization of each of the plurality of processing elements during execution of the PLINQ query and indicative of thread state of the plurality of threads during execution of the PLINQ query;

wherein the merging component is configured to;

merge the event log with the overlay data into graphical data representing processor utilization and thread activity relative to events in the event log and send the graphical data to the display; and

supplement the graphical data with further graphical data representing visualizations of the pair of high level event markers indicating the span of execution of PLINQ query; and

wherein the display is configured to receive and display the graphical data and the further graphical data so as to visually indicate one or more of processor utilization and thread activity at least during execution of the PLINQ query along with visualizations for the pair of high level event markers indicating the span of execution of PLINQ query.