STREAM APPLICATION PERFORMANCE MONITORING METRICS

• US 20130054779A1
• Filed: 08/26/2011
• Published: 02/28/2013
• Est. Priority Date: 08/26/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: CRADICK, RYAN K., PFEIFER, MICHAEL D., SANTOSUOSSO, JOHN M.
• Granted Patent: US 9,396,157 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 43/12 Network monitoring probes
• CPC Class Codes: H04L 65/70 Media network packetisation

Abstract

Techniques are disclosed for calculating performance metrics associated with a data stream. A processing element configured to process data tuples flowing through a stream-based computing system receives data tuples via the data stream. Each of the one or more tuples is processed at the processing element, and each of the one or more tuples are associated with metadata that includes information related to the processing of the tuple by the processing element. Performance metrics are then calculated for the data stream based on the metadata associated with the one or more tuples.

Claims

1-11. -11. (canceled)

12. A computer-readable storage medium storing an application, which, when executed on a processor in a stream-based computing system, performs a process, comprising:

receiving, at a first processing element configured to process data tuples flowing through the stream-based computing system, one or more tuples associated with a first data stream;

processing each of the one or more tuples at the first processing element;

associating each of the one or more tuples with metadata that includes information related to the processing of the tuple by the first processing element;

calculating performance metrics based on the metadata associated with the one or more tuples; and

displaying the calculated performance metrics via a user interface on a display device.

13. The computer-readable storage medium of claim 12, wherein the metadata information includes a timestamp, an identification (ID) of the first processing element, an ID of an operator graph in which the first processing element is included, an ID of a compute node on which the first processing element is executing, and a different counter value for each data attribute included in the tuple.

14. The computer-readable storage medium of claim 13, wherein the calculated performance metrics indicate, for each of the one or more tuples received via the first data stream, an amount of time for the first processing element and other processing elements included in the stream-based computing system to process the tuple.

15. The computer-readable storage medium of claim 13, wherein the calculated performance metrics indicate, for each of the one or more tuples received via the first data stream, an amount of time for two or more processing elements included in the stream-based computing system to process the tuple.

16. The computer-readable storage medium of claim 13, wherein the calculated performance metrics indicate an amount of time for each of the one or more tuples to travel through the stream-based computing system.

17. The computer-readable storage medium of claim 13, wherein the calculated performance metrics indicate an amount of time for each of the one or more tuples to travel between two or more compute nodes included in the stream-based computing system.

18. The computer-readable storage medium of claim 13, wherein the calculated performance metrics indicate, for each of the one or more tuples received via the first data stream, a number of times that each processing element, operator graph, and/or compute node included in the stream-based computing system processes the tuple.

19. The computer-readable storage medium of claim 13, wherein the calculated performance metrics indicate, for each of the one or more tuples received via the first data stream, a number of times that each data attribute included in the tuple has been modified.

20. The computer-readable storage medium of claim 12, wherein the calculated performance metrics are used to automatically adjust a configuration of the stream-based computing system.

21. A system, comprising:

a plurality of compute nodes, each comprising a processor and a memory, wherein the memory stores a stream performance manager which, when executed the compute node, is configured to perform an operation for calculating performance metrics, the operation comprising;

receiving, at a first processing element configured to process data tuples flowing through the stream-based computing system, one or more tuples associated with a first data stream;

processing each of the one or more tuples at the first processing element;

associating each of the one or more tuples with metadata that includes information related to the processing of the tuple by the first processing element;

calculating performance metrics based on the metadata associated with the one or more tuples; and

displaying the calculated performance metrics via a user interface on a display device.

22. The system of claim 21, wherein the metadata information includes a timestamp, an identification (ID) of the first processing element, an ID of an operator graph in which the first processing element is included, an ID of a compute node on which the first processing element is executing, and a different counter value for each data attribute included in the tuple.