Method and system for monitoring performance of an application system

• US 8,732,302 B2
• Filed: 07/15/2011
• Issued: 05/20/2014
• Est. Priority Date: 07/15/2011
• Status: Active Grant

• Current Assignee: INETCO Systems Ltd.
• Original Assignee: INETCO Systems Ltd.
• Inventors: Jorgenson, Loki, Pang, Alfred Yu-Han
• Primary Examiner(s): BIAGINI, CHRISTOPHER D
• Application Number:
  US13/184,274
• Publication Number:
  US 20130019008A1
• Time in Patent Office: 1,040 Days
• Field of Search: 709/224
• US Class Current: 709/224
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation

Abstract

A method for monitoring performance of an application system which is distributed across a plurality of network connected nodes, comprising: generating a hierarchical model for the application system, the hierarchical model having a plurality of levels, each level including components of a span specific to that level; mapping the application system onto the hierarchical model according to a network topology of the application system; monitoring network traffic between the plurality of network connected nodes of the application system to gather network traffic data; assembling the network traffic data into application messages; correlating the application messages into sets of one or more application messages that are causally associated in accordance with the hierarchical model, wherein the sets of causally associated application messages constitute transactions corresponding to a lowest level of the hierarchical model; and, generating records of individual transactions occurring within the application system for at least the transactions corresponding to the lowest level of the hierarchical model.

Claims

1. A method for monitoring performance of an application system which is distributed across a plurality of network connected nodes, comprising:

generating a hierarchical model for the application system, the hierarchical model having a plurality of levels, each level including components having a span of network connected nodes specific to that level;

mapping the application system onto the hierarchical model according to a network topology of the application system;

using a processor, monitoring network traffic between the plurality of network connected nodes of the application system to gather network traffic data;

assembling the network traffic data into application messages;

correlating the application messages into sets of one or more application messages that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a lowest level of the hierarchical model; and

,

generating records of individual transactions occurring within the application system for at least the transactions corresponding to the lowest level of the hierarchical model.

2. The method of claim 1 and further comprising correlating transactions corresponding to the lowest level of the hierarchical model into sets of transactions that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a higher level of the hierarchical model.

3. The method of claim 2 and further comprising correlating transactions corresponding to the higher level of the hierarchical model into sets of transactions that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a next higher level of the hierarchical model.

4. The method of claim 3 and further comprising correlating transactions corresponding to the next higher level of the hierarchical model into sets of transactions that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a highest level of the hierarchical model.

5. The method of claim 4 wherein in the transactions corresponding to the lowest level of the hierarchical model, the transactions corresponding to the higher level of the hierarchical model, the transactions corresponding to the next higher level of the hierarchical model, and the transactions corresponding to the highest level of the hierarchical model are link transactions, service transactions, application transactions, and business transactions, respectively.

6. The method of claim 5 and further comprising, for transactions corresponding to each of the plurality of levels of the hierarchical model, identifying attributes of behavior relating to performance and applying one or more metrics to the attributes.

7. The method of claim 6 wherein the metrics applied are specific to each of the plurality of levels of the hierarchical model and are related to conventions, standards, perspectives, or role-based objectives associated with each of the plurality of levels of the hierarchical model.

8. The method of claim 6 wherein the metrics for the link, service, application, and business transactions include performance of networks, measures specific to a service level agreement or other third party agreement, end-user experience, and business performance, respectively.

9. The method of claim 8 wherein the metrics relating to performance of networks include at least one of estimated network packet loss, delay variation, minimum delay, and maximum throughput.

10. The method of claim 8 wherein the metrics relating to service level agreement or other third party agreement include at least one of average transaction rate, number of transactions per unit time, rate of failed transactions, peak transaction rate, and availability.

11. The method of claim 8 wherein the metrics relating to end-user experience include at least one of Apdex value, average response time, minimum response time, maximum response time, percentage of incomplete transactions, and rate of failed transactions caused by application system problems.

12. The method of claim 8 wherein the metrics relating to business performance include at least one of customer satisfaction, employee productivity, and cost savings.

13. The method of claim 2 wherein the correlating of the transactions corresponding to the lowest level of the hierarchical model into the transactions corresponding to the higher level of the hierarchical model includes determining potential causal relationships through analysis of the network topology.

14. The method of claim 2 wherein the correlating of the transactions corresponding to the lowest level of the hierarchical model into the transactions corresponding to the higher level of the hierarchical model includes a probabilistic association between the transactions corresponding to the lowest level of the hierarchical model based on one or more of contents of multiple application message payloads of related transactions corresponding to the lowest level of the hierarchical model, contents of multiple application message headers of related transactions corresponding to the lowest level of the hierarchical model, and timing of multiple application messages of related transactions corresponding to the lowest level of the hierarchical model.

15. The method of claim 14 wherein the probabilistic method is one of a hidden Markov model, a real-time Bayesian network analysis, and a Kalman filter.

16. The method of claim 1 wherein the correlating of the application messages includes a rule-based comparison of attributes between application messages that yields an exact match.

17. The method of claim 1 wherein the correlating of the application messages includes a probabilistic association between the application messages based on one or more of contents of the application message payloads, contents of the application message headers, timing of the application messages, and sequence of the application messages.

18. The method of claim 17 wherein the probabilistic association is derived from one of a hidden Markov model, a real-time Bayesian network analysis, and a Kalman filter.

19. The method of claim 1 wherein the monitoring of network traffic is performed simultaneously at one or more nodes within the application system.

20. A system for monitoring performance of an application system which is distributed across a plurality of network connected nodes, comprising:

a processor coupled to memory and an interface to the network; and

,

at least one of hardware and software modules within the memory and controlled or executed by the processor, the modules including;

a module for generating a hierarchical model for the application system, the hierarchical model having a plurality of levels, each level including components having a span of network connected nodes specific to that level;

a module for mapping the application system onto the hierarchical model according to a network topology of the application system;

a module for monitoring network traffic between the network connected nodes of the application system to gather network traffic data;

a module for assembling the network traffic data into application messages;

a module for correlating the application messages into sets of one or more application messages that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a lowest level of the hierarchical model; and

,

a module for generating records of individual transactions occurring within the application system for at least the transactions corresponding to the lowest level of the hierarchical model.

21. The system of claim 20 and further comprising a module for correlating transactions corresponding to the lowest level of the hierarchical model into sets of transactions that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a higher level of the hierarchical model.

22. The system of claim 21 and further comprising a module for correlating transactions corresponding to the higher level of the hierarchical model into sets of transactions that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a next higher level of the hierarchical model.

23. The system of claim 22 and further comprising a module for correlating transactions corresponding to the next higher level of the hierarchical model into sets of transactions that are associated in accordance with the hierarchical model and that constitute transactions corresponding to a highest level of the hierarchical model.

24. The system of claim 23 wherein in the transactions corresponding to the lowest level of the hierarchical model, the transactions corresponding to the higher level of the hierarchical model, the transactions corresponding to the next higher level of the hierarchical model, and the transactions corresponding to the highest level of the hierarchical model are link transactions, service transactions, application transactions, and business transactions, respectively.

25. The system of claim 24 and further comprising, for transactions corresponding to each of the plurality of levels of the hierarchical model, a module for identifying attributes of behavior relating to performance and applying one or more metrics to the attributes.

26. The system of claim 25 wherein the metrics applied are specific to each of the plurality of levels of the hierarchical model and are related to conventions, standards, perspectives, or role-based objectives associated with each of the plurality of levels of the hierarchical model.

27. The system of claim 25 wherein the metrics for the link, service, application, and business transactions include performance of networks, measures specific to a service level agreement or other third party agreement, end-user experience, and business performance, respectively.

28. The system of claim 27 wherein the metrics relating to performance of networks include at least one of estimated network packet loss, delay variation, minimum delay, and maximum throughput.

29. The system of claim 27 wherein the metrics relating to service level agreement or other third party agreement include at least one of average transaction rate, number of transactions per unit time, rate of failed transactions, peak transaction rate, and availability.

30. The system of claim 27 wherein the metrics relating to end-user experience include at least one of Apdex value, average response time, minimum response time, maximum response time, percentage of incomplete transactions, and rate of failed transactions caused by application system problems.

31. The system of claim 27 wherein the metrics relating to business performance include at least one of customer satisfaction, employee productivity, and cost savings.

32. The system of claim 21 wherein the module for correlating of the transactions corresponding to the lowest level of the hierarchical model into the transactions corresponding to the higher level of the hierarchical model includes a module for determining potential relationships through analysis of the network topology.

33. The system of claim 21 wherein the module for correlating of the transactions corresponding to the lowest level of the hierarchical model into the transactions corresponding to the higher level of the hierarchical model includes a probabilistic association between the transactions corresponding to the lowest level of the hierarchical model based on one or more of contents of multiple application message payloads of related transactions corresponding to the lowest level of the hierarchical model, contents of multiple application message headers of related transactions corresponding to the lowest level of the hierarchical model, and timing of multiple application messages of related transactions corresponding to the lowest level of the hierarchical model.

34. The system of claim 33 wherein the probabilistic method is one of a hidden Markov model, a real-time Bayesian network analysis, and a Kalman filter.

35. The system of claim 20 wherein the module for correlating of the application messages includes a rule-based comparison of attributes between application messages that yields an exact match.

36. The system of claim 20 wherein the module for correlating of the application messages includes a probabilistic association between the application messages based on one or more of contents of the application message payloads, contents of the application message headers, timing of the application messages, and sequence of the application messages.

37. The system of claim 36 wherein the probabilistic association is derived from one of a hidden Markov model, a real-time Bayesian network analysis, and a Kalman filter.

38. The system of claim 20 wherein the module for monitoring of network traffic performs monitoring simultaneously at one or more nodes within the application system.