System and method to monitor performance of different domains associated with a computer system or network

• US 7,568,025 B2
• Filed: 06/27/2003
• Issued: 07/28/2009
• Est. Priority Date: 06/27/2003
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Vasudeva, Vivek
• Primary Examiner(s): Bruckart, Benjamin R
• Application Number:
  US10/608,686
• Publication Number:
  US 20040267691A1
• Time in Patent Office: 2,223 Days
• Field of Search: 709/202, 709/208, 709/223, 709/224, 709/226, 709/220
• US Class Current: 709/224
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: H04L 43/12 Network monitoring probes

Abstract

A system to monitor performance may include at least one probe to collect data related to performance of an associated domain. The system may also include at least one base station to receive data from associated ones of the at least one probe.

Claims

1. A system to monitor performance, comprising:

at least one host machine, each at least one host machine comprising at least one probe to collect data and metrics related to performance of an associated domain, each at least one probe being embedded in the associated domain and including an associated control module containing user selectable parameters for controlling operation of each probe, the user selectable parameters comprising at least one of a type of data to be collected by the probe or a metric to be collected by the probe;

at least one base station to receive the collected data or metric from associated ones of the at least one probe, the collected data being transferred from the at least one probe of the at least one host to the at least one base station on a low priority thread scheduled when higher priority threads of an operating system of the at least one host machine are not doing any useful work;

a server, the server interfacing between a browser and the at least one base station, a data structure running on the server being capable of retrieving selected data and streaming out live or real-time trends and reports of operation or performance of each of the domains; and

an interoperable naming service to register each base station and to assign a unique identifier associated with each base station in response to the base station becoming active,

wherein each at least one probe may dynamically receive a new control module containing changes to the user selectable parameters and operate using the changes without affecting operation of the associated domain, the at least one probe releasing any resources utilizable by the probe in response to the probe being unable to associate with the at least one base station, and

wherein the at least one probe comprises a system probe to gather operating system data and metrics.

2. The system of claim 1, wherein the system probe gathers at least one of network data and performance data related to operation of an associated at least one host machine.

3. The system of claim 2 wherein the system probe comprises a data structure to gather kernel data.

4. The system of claim 3, wherein the system probe comprises a data structure to gather data in a single process address by taking a snapshot of a kernel image at a selected time interval and to categorize the data.

5. The system of claim 2, wherein the system probe comprises a Java Native Interface to gather data.

6. The system of claim 2, wherein the system probe transmits data to an associated base station using Transmission Control Protocol.

7. The system of claim 2, wherein the at least one base station transmits signals to an associated system probe using User Datagram Protocol.

8. The system of claim 1, wherein the at least one probe comprises at least one application probe associated with an application.

9. The system of claim 8, wherein each application probe and an associated base station communicate using User Datagram Protocol.

10. The system of claim 8, further comprising a queue to store data collected by the at least one application probe until transferred to an associated base station.

11. The system of claim 10, wherein the queue comprises a circular queue of a predetermined capacity.

12. The system of claim 10, wherein the base station comprises a data structure to request transfer of any data stored in the queue and any data is transferred during time periods of internal host processor resource utilization that is below a predetermined level.

13. The system of claim 10, further comprising a Java Virtual Machine on which the queue resides.

14. The system of claim 10, wherein the stored data is transferred to the base station on a low priority thread relative to normal operations of a host processor.

15. The system of claim 1, wherein each probe is dynamically controlled by an associated base station using User Datagram Protocol.

16. The system of claim 1, wherein each probe is dynamically controlled to alter at least a type of performance data being collected and a frequency at which the data is being collected without affecting operation of the associated domain.

17. The system of claim 1, wherein the base station comprises a copy of the control module associated with each probe served by the base station, wherein the control module and copy are updated each time a user selects a new parameter.

18. The system of claim 1, wherein the base station comprises a data structure to periodically ping each probe served by the base station to check a status of the probe and wherein the probe transmits its current control module information in response to the ping.

19. The system of claim 1, further comprising performance gathering code in a source code or a byte code associated with each domain to be monitored by an associated one of the at least one probe.

20. The system of claim 1, wherein the at least one probe comprises a network probe associated with each host processor to gather network data.

21. The system of claim 1, wherein the at least one probe comprises a data structure written in a Java7 programming language.

22. The system of claim 1, wherein the base station comprises a data collector to collect data from the at least one probe.

23. The system of claim 22, further comprising at least one relational database to store data from the data collector.

24. The system of claim 23, wherein the collected data is stored in relation to a time interval in the at least one relational database.

25. The system of claim 1, further comprising:

a plurality of base stations; and

a negotiator to balance a quantity of probes served by each base station.

26. The system of claim 1, further comprising a plurality of base stations, wherein each base station comprises a probe table and wherein the probe table includes a list of probe identifications and an associated probe control module for each probe served by the base station.

27. The system of claim 1, further comprising a probes application to run on the server to control operation of the at least one probe and to retrieve and display the selected data from collected data in response to the query.

28. The system of claim 27, wherein the probes application runs on a Java Server Page (JSP) engine.

29. The system of claim 1, further comprising a file to store predetermined queries to retrieve selected data from the collected data.

30. The system of claim 29, wherein the file comprises predetermined structured query language (SQL) queries to retrieve the selected data from a relational database.

31. The system of claim 29, wherein the file comprises predetermined mark-up language queries to retrieve the selected data from a relational database.

32. The system of claim 29, further comprising a data structure to substitute parameters entered by a user into a chosen query to retrieve the selected data.

33. The system of claim 29, further comprising a data structure to provide a link on a web page to a universal resource locator containing a path to a chosen query in the file in response to parameters selected or entered by a user on the web page.

34. The system of claim 1, further comprising a data structure to display collected data related to performance from one or more domains together.

35. The system of claim 1, further comprising a data structure to periodically retrieve updated data related to performance for one or more domains and to display the updated data.

36. The system of claim 35, further comprising an image streaming servlet to display the updated data.

37. The system of claim 1, further comprising a data structure to select the parameters for retrieving data by the at least one probe.

38. The system of claim 1, further comprising a plurality of probes each to collect data related to performance of a different domain within a distributed enterprise system.

39. A system to monitor performance, comprising:

at least one host machine, each at least one host machine comprising at least one probe of a plurality of probes to collect data and metrics related to performance from each of a plurality of domains, each at least one probe being embedded in an associated domain of the plurality of domains and including an associated control module containing user selectable parameters for controlling operation of each probe, the user selectable parameters comprising at least one of a type of data to be collected by the probe or a metric to be collected by the probe;

at least one base station to receive the collected data or metric from associated ones of the plurality of probes and to control operation the probes associated with the base station, the collected data being transferred from the at least one probe of the at least one host to the at least one base station on a low priority thread scheduled when higher priority threads of an operating system of the at least one host machine are not doing any useful work;

at least one database to store the collected data; and

a server to interface between a browser and the at least one base station and to retrieve and display selected data from the at least one database in response to a query, a data structure running on the server being capable of retrieving the selected data and streaming out live or real-time trends and reports of operation or performance of each of the domains,

an interoperable naming service to register each base station and to assign a unique identifier associated with each base station in response to the base station becoming active,

wherein each at least one probe may dynamically receive a new control module containing changes to the user selectable parameters from the server and operate using the changes without affecting operation of the associated domain, the at least one probe releasing any resources utilizable by the probe in response to the probe being unable to associate with the at least one base station, and

wherein the at least one probe comprises a system probe associated with the at least one host machine to gather operating system data and metrics.

40. The system of claim 39, wherein the system probe gathers at least one of network data and performance data related to operation of the associated at least one host machine.

41. The system of claim 40, wherein the system probe transmits data to an associated base station using Transmission Control Protocol.

42. The system of claim 40, wherein the at least one base station transmits signals to an associated system probe using User Datagram Protocol.

43. The system of claim 39, further comprising at least one application probe associated with each application of a plurality of applications.

44. The system of claim 43, wherein each application probe and an associated base station communicate using User Datagram Protocol.

45. The system of claim 43, further comprising a queue to store data collected by the at least one application probe until transferred to an associated base station.

46. The system of claim 39, wherein each probe is dynamically controlled to alter at least a type of performance data being collected and a frequency at which the data is being collected without affecting operation of the associated domain.

47. The system of claim 39, wherein the at least one base station comprises a data collector to collect data from the at least one probe.

48. The system of claim 47, further comprising at least one relational database to store data from the data collector.

49. The system of claim 48, wherein the data is stored with an associated time stamp.

50. The system of claim 39, further comprising:

a plurality of base stations; and

a negotiator to balance a quantity of probes served by each base station.

51. The system of claim 39, further comprising a plurality of base stations, wherein each base station comprises a probe table and wherein the probe table includes a list of probe identifications and an associated probe control module for each probe served by the base station.

52. The system of claim 39, further comprising:

a plurality of base stations; and

an interoperability naming service to register each base station and to assign a unique identifier associated with each base station in response to the base station becoming active to service probes.

53. The system of claim 39, further comprising a probes application to run on the server to control operation of each of the probes and to display at least some of the collected data.

54. The system of claim 39, further comprising a data structure to display at least some of the collected data for different domains together for a common time period.

55. The system of claim 39, further comprising a file to store predetermined queries to retrieve the selected data from the database for a predetermined time interval.

56. The system of claim 55, further comprising a data structure to substitute parameters entered by a user into a chosen query to retrieve the selected data.

57. The system of claim 56, further comprising a data structure to display the selected data over the predetermined time interval.

58. The system of claim 56, further comprising a data structure to periodically retrieve updated data related to the query and to display the update data.