Enterprise management system and method which includes semantically correct summarization

• US 6,560,647 B1
• Filed: 03/04/1999
• Issued: 05/06/2003
• Est. Priority Date: 03/04/1999
• Status: Expired due to Term

• Current Assignee: BMC Software Incorporated (KKR & Co., Inc.)
• Original Assignee: BMC Software Incorporated (KKR & Co., Inc.)
• Inventors: Rocco, Joseph, Agrawal, Subhash, Hafez, Amr
• Primary Examiner(s): Lim, Krisna
• Application Number:
  US09/262,229
• Time in Patent Office: 1,524 Days
• Field of Search: 709/223, 709/224
• US Class Current: 709/224
• CPC Class Codes: H04L 41/0681 Configuration of triggering conditions
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 43/022 by sampling
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 43/06 Generation of reports
• CPC Class Codes: H04L 43/106 using time related information in packets, e.g. by adding timestamps
• CPC Class Codes: H04L 43/12 Network monitoring probes

Abstract

A system and method for summarizing metric data in a semantically correct way. The system preferably comprises a distributed computing environment, i.e., an enterprise, which comprises a plurality of interconnected computer systems. At least one of the computer systems is an agent computer system which collects raw data relating to one or more metrics, i.e., measurements of system resources on the agent computer system. A Universal Data Repository (UEDR) receives a set of data points representing metric data from one or more agent computer systems. The UDR summarizes the set of data points into a more compact yet meaningful form. In summarization, the UDR determines a data type of the set of data points, applies a summarization rule according to the data type, and then creates a summarized data structure which corresponds to the set of data points. The summarization rule varies according to the semantics of the data type. The UDR can summarize both raw data and data that has previously been summarized one or more times. So that the record of a particular process is never totally lost, process state changes are preserved throughout.

Claims

1. A method for managing the performance of an enterprise, wherein the enterprise comprises one or more computer systems, the method comprising:

receiving a set of data points from the one or more computer systems, wherein the set of data points comprises a series of measurements of one or more system resources of the one or more computer systems over a period of time;

summarizing the set of data points, wherein the summarizing comprises;

determining a data type of the set of data points; and

creating a summarized data structure including a plurality of data structures;

applying a summarization rule on the set of data points according to the data type; and

storing data from said application of the summarization rule to a first data structure of the plurality of data structures.

2. The method of claim 1,

wherein the data type is a counter, wherein the counter is a measurement which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

3. The method of claim 2,

wherein the applying the summarization rule comprises determining a starting value, an ending value, and a total number of data points for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the total number of data points.

4. The method of claim 1,

wherein the data type is a gauge, wherein the gauge is a measurement which is capable of increasing or decreasing from one data point to a next data point.

5. The method of claim 4,

wherein the applying the summarization rule comprises determining an average value of all the data points and a total number of data points for the set of data points;

wherein the summarized data structure comprises the average and the total number of data points.

6. The method of claim 1,

wherein the data type is a string, wherein the string is a series of characters which can be manipulated as a group.

7. The method of claim 6,

wherein the applying the summarization rule comprises determining a first string value and a total number of data points for the set of data points;

wherein the summarized data structure comprises the first string value and the total number of data points.

8. The method of claim 1,

wherein the data type is a clock, wherein the clock is a measurement of elapsed time which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

9. The method of claim 8,

wherein the applying the summarization rule comprises determining a starting value, an ending value, and a frequency of the clock for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the frequency.

10. The method of claim 1,

wherein each of the set of data points includes a timestamp indicating a time of collection;

wherein the summarizing the set of data points further comprises determining a first timestamp and a last timestamp for the set of data points;

wherein the summarized data structure includes the first timestamp and the last timestamp.

11. The method of claim 1,

wherein the set of data points further comprises measurements of one or more processes of one or more computer systems over the period of time;

wherein the summarizing the set of data points further comprises determining one or more state changes from the set of data points, wherein the state changes comprise a starting time for each process begun within the period of time and an ending time for each process ended within the period of time;

wherein the summarized data structure includes the state changes.

12. The method of claim 1,

wherein the receiving the set of data points from the one or more computer systems and the summarizing the set of data points are performed for a plurality of sets of data points, and wherein the receiving the set of data points from the one or more computer systems and the summarizing the set of data points are performed a plurality of times.

13. The method of claim 12,

wherein at least one set of data points comprises a set of summarized data structures, wherein the set of summarized data structures corresponds to a plurality of sets of data points, wherein each of the plurality of sets of data points was previously summarized into a summarized data structure.

14. The method of claim 1, further comprising:

gathering the set of data points from the one or more computer systems, wherein the gathering the set of data points from the one or more computer systems occurs prior to the receiving the set of data points from the one or more computer systems.

15. The method of claim 14,

wherein the gathering the set of data points from the one or more computer systems, the receiving the set of data points from the one or more computer systems, and the summarizing the set of data points occur on the same computer system.

16. The method of claim 14,

wherein the gathering the set of data points from the one or more computer systems and the summarizing the set of data points from the one or more computer systems occur on different computer systems.

17. The method of claim 1, wherein said summarizing further comprises:

applying another summarization rule on at least part of the data stored in the first data structure according to the data type of the first data structure; and

storing data from said application of the another summarization rule to a second data structure of the plurality of data structures.

18. A system for managing the performance of an enterprise, wherein the enterprise comprises one or more computer systems, the system comprising:

a CPU;

a system memory coupled to the CPU, wherein the system memory stores one or more computer programs executable by the CPU;

wherein the computer programs are executable to;

receive a set of data points, wherein the set of data points comprises a series of measurements of one or more system resources of one or more computer systems over a period of time; and

summarize the set of data points, wherein in summarizing the set of data points, the computer programs are executable to;

determine a data type of the set of data points;

create a summarized data structure including a plurality of data structures;

apply a summarization rule on the set of data points according to the data type; and

store data from said application of the summarization rule to a first data structure of the plurality of data structures.

19. The system of claim 18, wherein in said summarizing the set of data points the computer programs are further executable to:

apply another summarization rule on at least part of the data stored in the first data structure according to the data type of the first data structure; and

store data from said application of the another summarization rule to a second data structure of the plurality of data structures.

20. The system of claim 18,

wherein the data type is a gauge, wherein the gauge is a measurement which is capable of increasing or decreasing from one data point to a next data point.

21. The system of claim 20,

wherein in applying the summarization rule, the computer programs are executable to determine an average value of all the data points in the set of data points and a total number of data points for the set of data points;

wherein the summarized data structure comprises the average and the total number of data points.

22. The system of claim 18,

wherein the data type is a string, wherein the string is a series of characters which can be manipulated as a group.

23. The system of claim 22,

wherein in applying the summarization rule, the computer programs are executable to determine a first string value and a total number of data points for the set of data points;

wherein the summarized data structure comprises the first string value and the total number of data points.

24. The system of claim 18,

wherein the data type is a clock, wherein the clock is a measurement of elapsed time which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

25. The system of claim 24,

wherein in applying the summarization rule, the computer programs are executable to determine a starting value, an ending value, and a frequency for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the frequency.

26. The system of claim 18,

wherein each of the set of data points includes a timestamp indicating a time of collection;

wherein in summarizing the set of data points, the computer programs are executable to determine a first timestamp and a last timestamp for the set of data points;

wherein the summarized data structure includes the first timestamp and the last timestamp.

27. The system of claim 18,

wherein the set of data points further comprises measurements of one or more processes of one or more computer systems over the period of time;

wherein in summarizing the set of data points, the computer programs are executable to determine one or more state changes from the set of data points, wherein the state changes comprise a starting time for each process begun within the period of time and an ending time for each process terminated within the period of time;

wherein the summarized data structure includes the state changes.

28. The system of claim 18,

wherein the computer programs are executable to receive the set of data points and summarize the set of data points for a plurality of sets of data points.

29. The system of claim 28,

wherein at least one set of data points comprises a set of summarized data structures, wherein the set of summarized data structures corresponds to a plurality of sets of data points, wherein each of the plurality of sets of data points was previously summarized into a summarized data structure.

30. The system of claim 18,

wherein the data type is a counter, wherein the counter is a measurement which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

31. The system of claim 30,

wherein in applying the summarization rule, the computer programs are executable to determine a starting value, an ending value, and a total number of data points for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the total number of data points.

32. A system for managing an enterprise, wherein the enterprise comprises a plurality of computer systems, the system comprising:

a network comprising a plurality of interconnected computer systems, wherein each of the plurality of interconnected computer systems includes one or more system resources;

wherein at least one computer system of the plurality of interconnected computer systems is operable to store a set of data points received from the plurality of interconnected computer systems, wherein the set of data points comprises a series of measurements of one or more system resources of the plurality of interconnected computer systems over a period of time;

wherein the at least one computer system comprises;

a CPU;

a system memory coupled to the CPU, wherein the system memory stores one or more computer programs executable by the CPU;

wherein the computer programs are executable to;

receive the set of data points; and

summarize the set of data points, wherein in summarizing the set of data points, the computer programs are executable to;

determine a data type of the set of data points;

create a summarized data structure including a plurality of data structures;

apply a summarization rule on the set of data points according to the data type; and

store data from said application of the summarization rule to a first data structure of the plurality of data structures.

33. The system of claim 32,

wherein the data type is a gauge, wherein the gauge is a measurement which is capable of increasing or decreasing from one data point to a next data point.

34. The system of claim 33,

wherein in applying the summarization rule, the computer programs are executable to determine an average value of all the data points in the set of data points and a total number of data points for the set of data points;

wherein the summarized data structure comprises the average and the total number of data points.

35. The system of claim 32,

wherein the data type is a string, wherein the string is a series of characters which can be manipulated as a group.

36. The system of claim 35,

wherein in applying the summarization rule, the computer programs are executable to determine a first string value and a total number of data points for the set of data points;

wherein the summarized data structure comprises the first string value and the total number of data points.

37. The system of claim 32,

wherein the data type is a clock, wherein the clock is a measurement of elapsed time which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

38. The system of claim 37,

wherein in applying the summarization rule, the computer programs are executable to determine a starting value, an ending value, and a frequency for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the frequency.

39. The system of claim 32,

wherein each of the set of data points includes a timestamp indicating a time of collection;

wherein in summarizing the set of data points, the computer programs are executable to determine a first timestamp and a last timestamp for the set of data points;

wherein the summarized data structure includes the first timestamp and the last timestamp.

40. The system of claim 32,

wherein the set of data points further comprises measurements of one or more processes of the one or more computer systems over the period of time;

wherein in summarizing the set of data points, the computer programs are executable to determine one or more state changes from the set of data points, wherein the state changes comprise a starting time for each process begun within the period of time and an ending time for each process terminated within the period of time;

wherein the summarized data structure includes the state changes.

41. The system of claim 32,

wherein the computer programs are executable to receive the set of data points and summarize the set of data points for a plurality of sets of data points.

42. The system of claim 41,

wherein at least one set of data points comprises a set of summarized data structures, wherein the set of summarized data structures corresponds to a plurality of sets of data points, wherein each of the plurality of sets of data points was previously summarized into a summarized data structure.

43. The system of claim 32,

wherein at least one computer system of the plurality of interconnected computer systems is operable to gather the set of data points from itself, wherein the set of data points comprises a series of measurements of one or more system resources of the plurality of interconnected computer systems over a period of time.

44. The system of claim 43,

wherein at least one computer system that is operable to gather the set of data points is the same as at least one computer system that is operable to summarize the set of data points.

45. The system of claim 43,

wherein at least one computer system that is operable to gather the set of data points is different from at least one computer system that is operable to summarize the set of data points.

46. The system of claim 32,

wherein the data type is a counter, wherein the counter is a measurement which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

47. The system of claim 46,

wherein in applying the summarization rule, the computer programs are executable to determine a starting value, an ending value, and a total number of data points for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the total number of data points.

48. The system of claim 32, wherein in said summarizing the set of data points the computer programs are further executable to:

apply another summarization rule on at least part of the data stored in the first data structure according to the data type of the first data structure; and

store data from said application of the another summarization rule to a second data structure of the plurality of data structures.

49. A memory medium which stores program instructions for managing the performance of an enterprise, wherein the enterprise comprises one or more computer systems, wherein the program instructions are executable to implement:

summarizing a set of data points from the one or more computer systems, wherein the set comprises a series of measurements of one or more system resources of the one or more computer systems over a period of time, wherein the summarizing comprises;

determining a data type of the set of data points;

applying a summarization rule according to the data type of the set of data points; and

creating a summarized data structure corresponding to the set of data points.

50. The memory medium of claim 49,

wherein the data type is a gauge, wherein the gauge is a measurement which is capable of increasing or decreasing from one data point to a next data point.

51. The memory medium of claim 49,

wherein the data type is a string, wherein the string is a series of characters which can be manipulated as a group.

52. The memory medium of claim 51,

wherein the applying the summarization rule comprises determining a first string value and a total number of data points for the set of data points;

wherein the summarized data structure comprises the first string value and the total number of data points.

53. The memory medium of claim 49,

wherein the data type is a clock, wherein the clock is a measurement of elapsed time which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

54. The memory medium of claim 53,

wherein the applying the summarization rule comprises determining a starting value, an ending value, and a frequency of the clock for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the frequency.

55. The memory medium of claim 49,

wherein each of the set of data points includes a timestamp indicating a time of collection;

wherein the summarizing the set of data points further comprises determining a first timestamp and a last timestamp for the set of data points;

wherein the summarized data structure includes the first timestamp and the last timestamp.

56. The memory medium of claim 49,

wherein the set of data points further comprises measurements of one or more processes of one or more computer systems over the period of time;

wherein the summarizing the set of data points further comprises determining one or more state changes from the set of data points, wherein the state changes comprise a starting time for each process begun within the period of time and an ending time for each process ended within the period of time;

wherein the summarized data structure includes the state changes.

57. The memory medium of claim 49,

wherein the summarizing a set of data points is performed a plurality of times for a plurality of sets of data points.

58. The memory medium of claim 57,

wherein at least one set of data points comprises a set of summarized data structures, wherein the set of summarized data structures corresponds to a plurality of sets of data points, wherein each of the plurality of sets of data points was previously summarized into a summarized data structure.

59. The memory medium of claim 49,

wherein the data type is a counter, wherein the counter is a measurement which is capable of increasing or staying the same and not capable of decreasing from one data point to a next data point.

60. The memory medium of claim 59,

wherein the applying the summarization rule comprises determining a starting value, an ending value, and a total number of data points for the set of data points;

wherein the summarized data structure comprises the starting value, the ending value, and the total number of data points.

61. The memory medium of claim 50,

wherein the applying the summarization rule comprises determining an average value of all the data points and a total number of data points for the set of data points;

wherein the summarized data structure comprises the average and the total number of data points.