Method and apparatus for managing and archiving performance information relating to storage system

• US 8,498,968 B2
• Filed: 10/28/2011
• Issued: 07/30/2013
• Est. Priority Date: 08/17/2000
• Status: Expired due to Fees

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Zahavi, William, Sapiro, Lee W., Thammavong, Saymai, Arnan, Ron
• Primary Examiner(s): CHANNAVAJJALA, SRIRAMA T
• Application Number:
  US13/284,075
• Publication Number:
  US 20120278292A1
• Time in Patent Office: 641 Days
• Field of Search: 711/118, 711/114, 711/156, 711/170, 711161-164, 711/112, 710/52, 710/74, 709/203, 709/206, 709215-220, 707/609, 707/625, 707/627, 707/634, 707/640, 707/687, 707/688, 707/690, 707/694, 707821-825, 707804-805, 707/802, 707/798, 707/725, 707/668, 707/661, 702/179, 345440-4402, 345/594, 345/650, 715/700
• US Class Current: 707/688
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3485 for I/O devices
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 2201/88 Monitoring involving counting
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A data management and archive method and apparatus, for implementation in an automated system to monitor and manage status, performance and configuration data for networked storage components. Analysis and cross-correlation of data related to the storage components can be done individually, collectively and/or comparatively. A collection manager component of a workload analyzer is implemented to start and stop data collection. The collection manager includes a command and control module that coordinates requests of data from at least one collection agent configured on at least one host connected to the storage component(s). The collection manager manages collection of data and effects file transfer of collected data according to a user specified policy, and maintains status of the data collected. The user specified policy allows the user to specify data collection “shifts” (i.e. periodicity).

Claims

1. An apparatus for managing performance information relating to a plurality of storage system components, comprising:

at least one collection agent configured to collect storage system performance information from at least one of said plurality of storage system components;

a command and control module communicating with said at least one collection agent automatically issuing commands to said at least one collection agent to start or stop collection of said storage system performance information in accordance with a user-specified policy;

a policy engine communicating with said command and control module, said policy engine responsive to said user-specified policy for collection of storage system performance information in accordance with at least one of user specified data collection timing intervals and start and stop times;

a user selection and policy interface communicating with said policy engine and configured for a user to specify said user-specified policy by specifying at least one of said data collection timing intervals, said start and stop times for collection of said storage system performance information, where to store said storage system performance information, and how long to retain said storage system performance information; and

a performance view component configured to access said storage system performance information and archives and having an autocorrelation mode adapted to receive a selection of a set of objects and a selection of associated set of metrics from said user, and generate a first table of said objects and metrics sorted by respective coefficients of correlation for said selected objects and metrics.

2. The apparatus of claim 1, wherein said policy engine includes a policy file for storing said user-specified policy.

3. The apparatus of claim 2, further including a policy interface screen for said user to interface with said policy engine and said policy file.

4. The apparatus of claim 1, further comprising a data manager receiving said storage system performance information and configured to perform computation and conversion of said storage system performance information to generate computed metrics and converted metrics.

5. The apparatus of claim 4, further comprising archives receiving and storing at least one of said computed metrics and converted metrics from said data manager.

6. The apparatus of claim 1, wherein said performance view component includes a user interface configured to generate factory and user defined views of at least one of said storage system performance information, computed metrics, and converted metrics.

7. The apparatus of claim 1, wherein said user selection and policy interface is configured for said user to specify said collection timing intervals as automatic collection intervals of at least one of minutes, hours, days, daily shifts, weekly shifts, and monthly shifts.

8. A method for managing performance information relating to a plurality of storage system components, comprising:

allowing, by a user selection and policy interface, a user to specify a user-specified policy by specifying at least one of data collection timing intervals, start and stop times for collection of storage system performance information, where to store said storage system performance information, and how long to retain said storage system performance information;

storing, by a policy engine, said user-specified policy for collection of storage system performance information in accordance with at least one of user specified data collection timing intervals and start and stop times;

accessing, by a command and control module, said user-specified policy;

automatically issuing commands, by said command and control module, to at least one collection agent to start or stop collection of said storage system performance information in accordance with said user-specified policy;

collecting, by said at least one collection agent, said storage system performance information from at least one of said plurality of storage system components in response to said commands; and

accessing said storage system performance information and receiving a set of objects and an associated set of metrics from said user, and generating a first table of said objects and metrics sorted by respective coefficients of correlation for said selected objects and metrics.

9. The method of claim 8, wherein said storing, by said policy engine, said user-specified policy includes storing said user-specified policy in a policy file.

10. The method of claim 9, further comprising presenting to said user a policy interface screen for said user to interface with said policy engine and said policy file.

11. The method of claim 8, further comprising receiving, by a data manager, said storage system performance information;

and performing, by said data manager, computation and conversion of said storage system performance information to generate computed metrics and converted metrics.

12. The method of claim 11, further comprising receiving and storing, by an archive, at least one of said computed metrics and converted metrics from said data manager.

13. The method of claim 12, further comprising accessing, by a performance view component, said storage system performance information and said archives.

14. A system for managing performance information, comprising:

a plurality of storage system components;

at least one computer system in communication with at least one of said plurality of storage system components, said at least one computer system including,

a collection agent configured to collect storage system performance information from said at least one of said plurality of storage system components;

a command and control module communicating with said at least one collection agent and automatically issuing commands to said at least one collection agent to start or stop collection of said storage system performance information in accordance with a user-specified policy;

a policy engine communicating with said command and control module, said policy engine responsive to said user-specified policy for collection of storage system performance information in accordance with at least one of user specified data collection timing intervals and start and stop times;

a user selection and policy interface communicating with said policy engine and configured for a user to specify said user-specified policy by specifying at least one of said data collection timing intervals, said start and stop times for collection of said storage system performance information, where to store said storage system performance information, and how long to retain said storage system performance information; and

a performance view component configured to access said storage system performance information and archives and adapted to receive a selection of a set of objects and a selection of associated set of metrics from said user, and generate a table of said objects and metrics sorted by respective coefficients of correlation for said selected objects and metrics.

15. The system of claim 14, wherein said at least one computer system further includes a data manager receiving said storage system performance information and configured to perform computation and conversion of said storage system performance information to generate computed metrics and converted metrics.