Method, apparatus and program storage device for providing adaptive, attribute driven, closed-loop storage management configuration and control

• US 20060161752A1
• Filed: 01/18/2005
• Published: 07/20/2006
• Est. Priority Date: 01/18/2005
• Status: Abandoned Application

• Current Assignee: Xiotech Corporation
• Original Assignee: Xiotech Corporation
• Inventors: Burkey, Todd R.
• Application Number:
  US11/037,404
• Publication Number:
  US 20060161752A1
• Time in Patent Office: Days
• US Class Current: 711/170
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method, apparatus and program storage device for providing adaptive, attribute driven, closed-loop storage management configuration and control is disclosed. The closed loop control mechanism provides not only continuous self-tuning to the storage system, but also allows the system to perform the initial configuration better.

Claims

1. A method for providing closed-loop management and control for a storage system, comprising:

monitoring at least one storage cluster for adherence to predetermined objectives; and

controlling virtual disks and virtual links associated with the at least one storage cluster in response to the monitoring.

2. The method of claim 1 further comprises masking the at least one physical storage cluster.

3. The method of claim 2, wherein the masking further comprises providing a virtual view into the at least one storage cluster to facilitate management and modification to storage configurations.

4. The method of claim 3 wherein the providing a virtual view into the cluster comprises providing performance and configuration information to the user.

5. The method of claim 1, wherein the monitoring at least one storage cluster for adherence to predetermined objectives further comprises monitoring at least one storage cluster for adherence to initial objectives supplied by a user.

6. The method of claim 5, wherein the monitoring at least one storage cluster for adherence to initial objectives further comprises monitoring at least one storage cluster for adherence to initial objectives defining a desired storage configuration.

7. The method of claim 1, wherein the monitoring further comprises verifying operations of the at least one storage cluster to modify a configuration of the at least one storage cluster.

8. The method of claim 1, wherein the monitoring enables the user to be removed from configuring the storage systems.

9. The method of claim 1, wherein the monitoring further comprises observing data usage patterns and performance rules to induce dynamic re-adjustment.

10. The method of claim 1, wherein the monitoring further comprises identifying characteristic parameters for physical disks in the storage clusters.

11. The method of claim 1, wherein the monitoring further comprises measuring system performance including total throughput and bandwidth, CPU utilization and bus utilization.

12. The method of claim 1, wherein the controlling virtual disks and virtual links further comprises creating, expanding, deleting and prioritizing physical storage.

13. The method of claim 1 further comprises classifying physical disks of the at least one storage cluster into characterized pools and characterizing higher level abstractions for defining the performance of virtual disks that are striped over the pools.

14. The method of claim 1, wherein the controlling further comprises prioritizing a first virtual disk over a second virtual disk.

15. The method of claim 1, wherein the controlling further comprises providing a selection of RAID types and stripe sizes and mirror depths and styles to achieve performance gradients within a specific pool.

16. The method of claim 1, wherein the controlling further comprises dynamically changing RAID characteristics.

17. The method of claim 1, wherein the controlling further comprises pausing mirroring and performing load balancing.

18. The method of claim 1, wherein the monitoring further comprises using the objectives and a knowledge of current operational dynamics of the at least one storage cluster to automatically create at least one virtual disk.

19. The method of claim 1, wherein the monitoring further comprises at least one process selected from the group comprising:

determining whether virtual disk dynamics match a desired storage system utilization;

reporting system configuration update information to the user;

gathering system data and storing the gathered data in a database; and

computing statistics on the virtual disks;

20. The method of claim 1, wherein the monitoring and controlling includes weighting of the objectives to allow preferences to be used when making automatic calculations.

21. The method of claim 1, wherein the controlling further comprises making change to configuration and providing information regarding configuration and control changes.

22. The method of claim 1, wherein the controlling further comprises changing RAID levels.

23. The method of claim 1, wherein the controlling further comprises increasing capacity across the at least one storage cluster.

24. A closed-loop storage system, comprising:

an interface for providing a virtual view into at least one storage cluster to facilitate management and modification to configurations of the at least one storage cluster;

a monitoring and feedback device, coupled to the interface, for monitoring the at least one storage cluster for adherence to predetermined objectives; and

a configuration and control device, coupled to the monitoring and feedback device, for controlling virtual disks and virtual links associated with the at least one storage cluster in response to input from the monitoring and feedback device.

25. The storage system of claim 24, wherein the mask provides performance and configuration information for use by a user.

26. The storage system of claim 24, wherein the monitoring and feedback device monitors the at least one storage cluster for adherence to initial objectives supplied by a user.

27. The storage system of claim 26, wherein the initial objectives defines a desired storage configuration.

28. The storage system of claim 24, wherein the monitoring and feedback device modifies a configuration of the at least one storage cluster.

29. The storage system of claim 24, wherein the monitoring and feedback device enables the user to be removed from configuring the storage systems.

30. The storage system of claim 24, wherein the monitoring and feedback device observes data usage patterns and performance rules to induce dynamic re-adjustment.

31. The storage system of claim 24, wherein the monitoring and feedback device identifies characteristic parameters for physical disks in the storage clusters.

32. The storage system of claim 24, wherein the monitoring and feedback device measures system performance including total throughput and bandwidth, CPU utilization and bus utilization.

33. The storage system of claim 24, wherein the configuration and control device creates, expands, deletes and prioritizes physical storage.

34. The storage system of claim 24, wherein the mask classifies physical disks of the at least one storage cluster into characterized pools and characterizes higher level abstractions for defining the performance of virtual disks that are striped over the pools.

35. The storage system of claim 24, wherein the configuration and control device prioritizes a first virtual disk over a second virtual disk.

36. The storage system of claim 24, wherein the configuration and control device provides a selection of RAID types and stripe sizes and mirror depths and styles to achieve performance gradients within a specific pool.

37. The storage system of claim 24, wherein the configuration and control device dynamically changes RAID characteristics.

38. The storage system of claim 24, wherein the configuration and control device pauses mirroring and performs load balancing.

39. The storage system of claim 24, wherein the monitoring and feedback device uses the objectives and a knowledge of current operational dynamics of the at least one storage cluster to automatically create at least one virtual disk.

40. The storage system of claim 24, wherein the monitoring and feedback device determines whether virtual disk dynamics match a desired storage system utilization, reports system configuration update information to the user, gathers system data, stores the gathered data in a database and computes statistics on the virtual disks;

41. The storage system of claim 24, wherein the monitoring and feedback device and the configuration and control device provide weighting of the objectives to allow preferences to be used when making automatic calculations.

42. The storage system of claim 24, wherein the configuration and control device makes changes to configuration of the at least one storage cluster and provides information regarding configuration and control changes to the monitoring and feedback device.

43. The storage system of claim 24, wherein the configuration and control device changes RAID levels within the at least one storage controller.

44. The storage system of claim 24, wherein the controlling further comprises increasing capacity across the at least one storage cluster.

45. A program storage device, comprising:

program instructions executable by a processing device to perform operations for providing a closed-loop storage system, the operations comprising;

monitoring at least one storage cluster for adherence to predetermined objectives; and

controlling virtual disks and virtual links associated with the at least one storage cluster in response to the monitoring.

46. The program storage device of claim 45 further comprises masking the at least one physical storage cluster.

47. The program storage device of claim 46, wherein the masking further comprises providing a virtual view into the at least one storage cluster to facilitate management and modification to storage configurations.

48. The program storage device of claim 47, wherein the providing a virtual view into the cluster comprises providing performance and configuration information to the user.

49. The program storage device of claim 45, wherein the monitoring at least one storage cluster for adherence to predetermined objectives further comprises monitoring at least one storage cluster for adherence to initial objectives supplied by a user.

50. The program storage device of claim 49, wherein the monitoring at least one storage cluster for adherence to initial objectives further comprises monitoring at least one storage cluster for adherence to initial objectives defining a desired storage configuration.

51. The program storage device of claim 45, wherein the monitoring further comprises verifying operations of the at least one storage cluster to modify a configuration of the at least one storage cluster.

52. The program storage device of claim 45, wherein the monitoring enables the user to be removed from configuring the storage systems.

53. The program storage device of claim 45, wherein the monitoring further comprises observing data usage patterns and performance rules to induce dynamic re-adjustment.

54. The program storage device of claim 45, wherein the monitoring further comprises identifying characteristic parameters for physical disks in the storage clusters.

55. The program storage device of claim 45, wherein the monitoring further comprises measuring system performance including total throughput and bandwidth, CPU utilization and bus utilization.

56. The program storage device of claim 45, wherein the controlling virtual disks and virtual links further comprises creating, expanding, deleting and prioritizing physical storage.

57. The program storage device of claim 45 further comprises classifying physical disks of the at least one storage cluster into characterized pools and characterizing higher level abstractions for defining the performance of virtual disks that are striped over the pools.

58. The program storage device of claim 45, wherein the controlling further comprises prioritizing a first virtual disk over a second virtual disk.

59. The program storage device of claim 45, wherein the controlling further comprises providing a selection of RAID types and stripe sizes and mirror depths and styles to achieve performance gradients within a specific pool.

60. The program storage device of claim 45, wherein the controlling further comprises dynamically changing RAID characteristics.

61. The program storage device of claim 45, wherein the controlling further comprises pausing mirroring and performing load balancing.

62. The program storage device of claim 45, wherein the monitoring further comprises using the objectives and a knowledge of current operational dynamics of the at least one storage cluster to automatically create at least one virtual disk.

63. The program storage device of claim 45, wherein the monitoring further comprises at least one process selected from the group comprising:

determining whether virtual disk dynamics match a desired storage system utilization;

reporting system configuration update information to the user;

gathering system data and storing the gathered data in a database; and

computing statistics on the virtual disks;

64. The program storage device of claim 45, wherein the monitoring and controlling includes weighting of the objectives to allow preferences to be used when making automatic calculations.

65. The program storage device of claim 45, wherein the controlling further comprises making change to configuration and providing information regarding configuration and control changes.

66. The program storage device of claim 45, wherein the controlling further comprises changing RAID levels.

67. The program storage device of claim 45, wherein the controlling further comprises increasing capacity across the at least one storage cluster.

68. A closed-loop storage system, comprising:

means for providing a virtual view into at least one storage cluster to facilitate management and modification to configurations of the at least one storage cluster;

means, coupled to the means for providing a virtual view, for monitoring the at least one storage cluster for adherence to predetermined objectives; and

means, coupled to the means for monitoring, for controlling virtual disks and virtual links associated with the at least one storage cluster in response to input from the monitoring and feedback device.