Systems and methods for organizing and storing data

• US 7,895,012 B2
• Filed: 05/03/2005
• Issued: 02/22/2011
• Est. Priority Date: 05/03/2005
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Turicchi, Thomas E. Jr.
• Primary Examiner(s): Dunn; Drew A
• Assistant Examiner(s): VO, HIEN XUAN
• Application Number:
  US11/121,279
• Publication Number:
  US 20060265192A1
• Time in Patent Office: 2,121 Days
• Field of Search: 702/127, 702182-186, 700/32, 700/33, 700/108, 700/174, 700/10, 719/315, 717/101, 717/104, 717/128, 711/112, 711/117, 707/999.102
• US Class Current: 702/127
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2201/88 Monitoring involving counting

Abstract

One embodiment includes a method for tracking usage of system components such that for each system component to be tracked the value of that component is measured on a successive time unit basis and the measured value is stored together with the number of successive time units that value repeats. Another embodiment includes a system for handling data representative of system conditions in which rapidly changing data values are received from at least one of the monitored sources such that each data value is representative of system conditions with respect to a small period of time; and such that the data is compressed while preserving the data values for each of the small periods of time.

Claims

1. A system for handling data representative of system conditions, said system comprising:

means for receiving rapidly changing data values from at least one source being monitored;

each said data value representative of system conditions with respect to a small period of time;

means for run-length encoding said data values, by assigning bin-ids to said data values where a particular data value falls within a range associated with a bin-id assigned to said particular data value, so as to preserve said data values for each said small period of time; and

means for storing said data values.

2. The system of claim 1 wherein said small period of time is under one minute.

3. The system of claim 1 wherein said small period of time is under 20 seconds.

4. The system of claim 1 wherein said compressing means comprises:

means for quantizing certain of said data prior to said compression.

5. The system of claim 1 wherein the means for storing comprises:

means for converting said data into a format wherein a value representative of the value of said data is presented together with a particular value representing the number of consecutive times that particular value appears in received ones of said data.

6. The system of claim 5 further comprising:

means for analyzing said presented data.

7. A computer system having a number of components each having parameters to be monitored, said system comprising:

storage for receiving a string of values representative of measured parameters with respect to certain of said components;

a process for converting received ones of said string of values into a run length string; and

wherein certain of said component parameters are measurable directly as integer quantities and others of said component parameters must be quantized into integer parameters, said computer system further comprising;

a process for quantizing said others of said parameters prior to said converting.

8. The system of claim 7 wherein the number of CPUs allocated to a workgroup for a period of time is represented as an integer number, or as a fractional or floating point number to be quantized.

9. The system of claim 8 wherein the number of CPUs requested by or on behalf of a workgroup for a period of time is represented as an integer number, or as a fractional or floating point number to be quantized.

10. The system of claim 8 wherein the CPU utilization of a workgroup for a period of time is represented as an integer number, or as a fractional or floating point number to be quantized.

11. The system of claim 7 wherein the run queue length of the system or of a workgroup for a period of time is represented as an integer number, or as a fractional or floating point number to be quantized.

12. The system of claim 7 wherein said period of time is variable.

13. The system of claim 7 wherein said quantizing comprises:

assigning each measurement a value, said values corresponding to ranges, each said range having a lower limit and an upper limit.

14. The system of claim 13 wherein said period of time is 15 seconds.

15. The system of claim 13 wherein said ranges are selected from the list of:

10%, 15%, 20%.

16. A method for handling data values, said method comprising:

receiving, performed by a computer system, rapidly changing data values from at least one computer resource, each said data value representative of a parameter of said resource with respect to a small period of time;

separating, performed by said computer system, said data values into data values that can be compressed directly and data values that must first be quantized;

quantizing, performed by said computer system, said data values that must be quantized;

said quantized data values yielding data values that can be compressed directly; and

storing, performed by said computer system, said data values.

17. The method of claim 16 wherein said storing comprises:

compressing said data values that can be compressed while preserving said data values for each said small period of time.

18. The method of claim 17 wherein said small period of time is under one minute.

19. The method of claim 17 wherein said small period of time is under 20 seconds.

20. The method of claim 17 wherein said compressing comprises run length encoding said data values.

21. The method of claim 17 further comprising:

converting said data values into a format wherein a value representative of the value of said data is presented together with a particular value representing the number of consecutive times that particular value appears in received ones of said data.

22. The method of claim 17 further comprising:

calculating how long a metric exceeded a threshold value.

23. A computer non-transitory readable storage medium having instructions embodied therein that when executed cause a computer system to perform a method comprising:

code for controlling the receipt of rapidly changing data values from at least one computer resource, each said data value representative of a parameter of said resource with respect to a small period of time;

code for controlling the separation of said data values into data values that can be compressed directly and data values that must first be quantized; and

code for controlling the quantizing of said data values that must be quantized;

said quantized data values yielding data values that can be compressed directly.

24. The computer non-transitory readable storage medium of claim 23 further comprising:

code for controlling the compression of said data values that can be compressed while preserving said data values for each said small period of time.

25. The computer non-transitory readable storage medium of claim 24 further comprising:

code for controlling the conversion of said data values into a format wherein a value representative of the value of said data is presented together with a particular value representing the number of consecutive times that particular value appears in received ones of said data.