Navigating performance data from different subsystems

• US 9,430,522 B2
• Filed: 10/05/2015
• Issued: 08/30/2016
• Est. Priority Date: 04/12/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Bhoovaraghavan, Mukundan, Black, Corrina, Lanka, Raghuram
• Primary Examiner(s): Kang, Insun
• Application Number:
  US14/874,840
• Publication Number:
  US 20160026679A1
• Time in Patent Office: 330 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/32 with visual or acoustical indication of the functioning of the machine
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/2428 Query predicate definition using graphical user interfaces, including menus and forms G06F16/2423 takes precedence
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

Performance data can be collected from different runtime environment subsystems of a computer system while the computer system is running a program in the runtime environment. A visualization model can be displayed, and a visual query of the integrated data can be received at the visualization model. Queried data can be compiled and displayed in response to the visual query. The queried data can be drilled into in response to user input. In response to a navigation request, navigation can lead to a programming element related to a portion of the queried data.

Claims

1. A computer-implemented method, comprising:

collecting integrated performance data from a plurality of different runtime environment subsystems of a computer system while the computer system is running a program in a runtime environment, at least a portion of the integrated data representing performance of the running of the program, the running of the program while the integrated performance data is being collected comprising executing a programming element of the program, the execution of the programming element of the program contributing to the performance of the running of the program that is represented by the integrated data;

displaying a visualization model representing the integrated data from the plurality of subsystems, with the visualization model comprising a data graph representing quantitative performance data values along a time line, and with the quantitative performance data values representing performance of multiple different subsystems of the plurality of different runtime environment subsystems that are using resources;

receiving a visual query of the integrated data at the visualization model;

compiling queried data in response to the visual query, with the compiling comprising combining data of similar types from multiple subsystems of the plurality of subsystems;

drilling down into the queried data in response to user input; and

in response to a navigation request directed at the visualization model, navigating to the programming element of the program, the programming element being related to at least a portion of the queried data.

2. The method of claim 1, wherein receiving the visual query comprises receiving user input directed at a displayed element of the visualization model.

3. The method of claim 1, wherein the visualization model further comprises at least one textual data element displayed along with the data graph.

4. The method of claim 1, further comprising navigating across the queried data.

5. The method of claim 1, wherein drilling down into the queried data comprises:

receiving user input directed at a visual element representing at least a portion of the queried data; and

in response to the user input directed at the visual element, displaying more information about performance data represented by the visual element than had been displayed previously.

6. The method of claim 1, wherein the plurality of subsystems comprise a first subsystem selected from a group consisting of a graphics subsystem, a user code execution subsystem, a media decoding subsystem, a networking subsystem, an overall programming environment and combinations thereof.

7. The method of claim 6, wherein the plurality of subsystems further comprise a second subsystem that is different from the first subsystem, the second subsystem selected from the group consisting of a graphics subsystem, user code execution subsystem, a media decoding subsystem, a networking subsystem, an overall programming environment and combinations thereof.

8. The method of claim 1, wherein the navigation request comprises user input selecting a visual element that represents a set of performance data representing resource usage caused at least in part by the programming element.

9. The method of claim 1, further comprising displaying an indication of a type of problem with the programming element.

10. The method of claim 1, wherein the queried data comprises a list of one or more performance issues within parameters indicated by the visual query.

11. The method of claim 1, wherein the programming element comprises code, the code comprising at least one of script and source code, wherein navigating to the programming element comprises displaying at least a portion of the code of the programming element in a display area, and wherein the method further comprises modifying the code of the programming element in response to user input received while the code is displayed in the display area.

12. A computer system comprising:

at least one hardware processor; and

at least one memory comprising instructions stored thereon that when executed by the at least one processor cause the at least one processor to perform acts comprising;

collecting integrated performance data from a plurality of different runtime environment subsystems of a computer system while the computer system is running a program in a runtime environment, at least a portion of the integrated data representing performance of the running of the program, the running of the program while the integrated performance data is being collected comprising executing a programming element of the program, the execution of the programming element of the program contributing to the performance of the running of the program that is represented by the integrated data;

displaying a visualization model representing the integrated data from the plurality of subsystems, with the visualization model comprising a data graph representing quantitative performance data values along a timeline, and with the quantitative performance data values representing performance of multiple different subsystems of the plurality of different runtime environment subsystems that are using resources;

receiving a visual query at the visualization model;

in response to the visual query, performing an analysis of at least a portion of the integrated performance data that meets one or more parameters of the visual query, the analysis including determining that the integrated performance data indicates that one or more performance rules have been broken within the one or more parameters of the visual query, and the analysis further including identifying one or more instances of broken performance rules as one or more performance issues;

displaying a list of the one or more performance issues identified in the analysis;

drilling down into a performance issue in response to user input selecting the performance issue from the displayed list, drilling down including displaying a representation of the programming element of the program, the execution of the programming element having contributed to the selected performance issue; and

in response to user input directed at the representation of the programming element, navigating to the programming element.

13. The computer system of claim 12, wherein the visualization model further comprises one or more textual data elements displayed along with the one or more data graphs.

14. The computer system of claim 12, wherein receiving the visual query comprises receiving user input indicating a region of the one or more data graphs.

15. The computer system of claim 12, wherein the acts further comprise editing the programming element in response to user input.

16. The computer system of claim 12, wherein the acts further comprise displaying an indication of a type of problem with the programming element.

17. The computer system of claim 12, wherein drilling down into one of the one or more performance issues comprises:

receiving a user input selecting a visual element from among a plurality of displayed visual elements related to the performance issue; and

in response to the user input selecting the visual element, displaying more information about performance data represented by the visual element than had been displayed previously.

18. A computer system comprising:

at least one hardware processor; and

at least one memory comprising instructions stored thereon that when executed by the at least one processor cause the at least one processor to perform acts comprising;

collecting integrated performance data from a plurality of different runtime environment subsystems of a computer system while the computer system is running a program in a runtime environment, at least a portion of the performance data representing performance of the running of the program, the running of the program while the integrated performance data is being collected comprising executing a programming element of the program, the execution of the programming element of the program contributing to the performance of the running of the program that is represented by the integrated data;

displaying a visualization model representing the integrated data from the plurality of subsystems, with the visualization model comprising a data graph representing quantitative performance data values along a time line, and with the quantitative performance data values representing performance of multiple different subsystems of the plurality of different runtime environment subsystems that are using resources;

receiving a visual query of the integrated data at the visualization model;

compiling queried data in response to the visual query, with the compiling comprising combining data of similar types from multiple subsystems of the plurality of subsystems;

drilling down into the queried data in response to user input; and

in response to a navigation request directed at the visualization model, navigating to the programming element of the program, the programming element being related to at least a portion of the queried data.

19. The computer system of claim 18, wherein the programming element is a declarative programming element.

20. The computer system of claim 18, wherein receiving the visual query comprises receiving user input directed at a displayed element of the visualization model.