Method for a workload-adaptive high performance storage system with data protection

• US 7,152,142 B1
• Filed: 10/23/2003
• Issued: 12/19/2006
• Est. Priority Date: 10/25/2002
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: COPAN Systems, Inc. (Hewlett-Packard Enterprise Company)
• Inventors: Layton, Will Hays, Santilli, Chris T., Guha, Aloke
• Primary Examiner(s): Bataille, Pierre
• Assistant Examiner(s): SCHLIE, PAUL W
• Application Number:
  US10/691,838
• Time in Patent Office: 1,153 Days
• Field of Search: 711/114, 711/154, 714/5, 714/6, 714/10
• US Class Current: 711/114
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3485 for I/O devices
• CPC Class Codes: G06F 3/0625 Power saving in storage systems
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A method for adaptation of data organization by a data storage system controller is disclosed. Data organization in a data storage system is adapted according to varying workload profiles and system constraints. The data storage system also consists of a plurality of data storage units. On receipt of a request to write data, various workload and data storage system parameters are determined. On the basis of these parameters, target data storage units and appropriate data organization schemes are optimally selected. In the case where the volume of data to be written is less than a threshold value, a RAID organization scheme is preferred. In this scheme the data is written to the selected drives simultaneously. In the case where the volume of data to be written is more than the threshold value, a power managed RAID organization scheme, where all data drives need not be simultaneously powered on, is used.

Claims

1. A method for allocating storage resources in a system including a data storage system controller coupled to a data storage system, the method comprising:

determining workload parameters, wherein the workload parameters include a determined access pattern of the workload;

determining data storage system parameters, wherein the data storage system parameters include a determined current I/O load per data storage unit;

using the parameters to determine if a condition is met; and

determining a configuration of the data storage system by writing the data in a power managed organizational scheme if the condition is met and by writing the data in a non-power managed organizational scheme if the condition is not met.

2. The method as recited in claim 1 wherein determining the workload parameters comprises:

determining a volume size of the workload; and

determining an I/O block size.

3. The method as recited in claim 1 wherein determining the workload parameters further comprises determining a target I/O rate for the workload.

4. The method as recited in claim 1 wherein determining the data storage system parameters comprises:

determining current storage utilization per data storage unit for each data storage unit in the data storage system; and

determining I/O bandwidth per data storage unit.

5. The method as recited in claim 1 wherein determining the data storage system parameters further comprises determining the number of drives currently powered on per data storage unit.

6. The method as recited in claim 1 wherein determining the data storage system parameters further comprises determining the maximum number of drives that can be powered on per data storage unit.

7. The method as recited in claim 1 wherein determining the configuration of the data storage system:

determining target data storage unit;

determining a data organization scheme for I/O performance of volumes based on the specified parameters; and

determining a set of drives, in the target data storage unit, on which the volume is to be written.

8. The method as recited in claim 7 wherein determining the target data storage unit is based on the lowest disk utilization.

9. The method as recited in claim 7 wherein determining the data organization scheme comprises selecting a Redundant Array of Inexpensive Disks (RAID) organization.

10. The method as recited in claim 7 wherein determining the data organization scheme comprises selecting a power managed Redundant Array of Inexpensive Disks (RAID) organization.

11. The method of claim 10, wherein the power managed RAID organization includes a Redundant Array of Independent Volumes (RAIV) organization.

12. The method as recited in claim 7 wherein determining the data organization scheme is based on power allocated to simultaneously power a maximum number of drives in the data storage unit.

13. The method as recited in claim 7 wherein a determination of a set of drives is based on environmental considerations relating to electrical noise and heating.

14. The method as recited in claim 1 further comprising allocating volumes to a location within the data storage system for continuous load balancing of the storage I/O performance of all allocated storage volumes.

15. The method as recited in claim 1 further comprising organizing volumes to I/O needs of each volume for continuous load balancing of the storage I/O performance of all allocated storage volumes.

16. The method of claim 1, wherein the determining a configuration is performed in response to receiving a write request to write the data.

17. The method of claim 16, wherein the determining a configuration is performed substantially at the time of processing the write request.

18. The method of claim 1, further comprising accepting a signal from a user input device to define at least in part an organizational scheme.

19. The method of claim 18, wherein the accepting a signal is performed at a time of configuration of the system.

20. The method of claim 18, wherein the accepting a signal is performed at a time of installation of the system.

21. The method of claim 1, further comprising:

processing the data prior to writing the data to the system, wherein the data is processed in accordance with one or more of the workload or data storage system parameters; and

writing the processed data to the system.

22. A method for configuring I/O performance and power consumption of a data storage system on receipt of a request for writing data, the I/O performance being measured in terms of the I/O rate, the data storage system comprising a plurality of data storage units and a data storage unit controller, each of the plurality of data storage units comprising multiple disk drives, the data being written on to the disk drives, the method comprising:

determining workload parameters, wherein the workload parameters include a determined access pattern of the workload;

determining data storage system parameters, wherein the data storage system parameters include a determined current I/O load per data storage unit;

identifying target data storage units for writing the data; and

if a volume of data to be written is greater than a threshold volume then writing data using a non-power managed configuration else writing data using a power managed configuration.

23. The method as recited in claim 22 wherein identifying the target data storage units comprises:

estimating possible candidate data storage units having sufficient storage capacity to allocate for writing the data; and

designating one of the possible candidate data storage units as a target data storage.

24. The method as recited in claim 22 wherein the step of writing data using a non-power managed configuration comprises determining the number of drives for writing the data from workload parameters.

25. The method as recited in claim 22 wherein the step of writing data using a power managed configuration comprises:

determining the number of drives in the target data storage units for writing the data from the workload and data storage system parameters; and

sequentially writing the data to a chain of drives in the target data storage unit.

26. A method for handling a write request in a data storage system, the method comprising the following actions performed by a processor:

receiving the write request, wherein the write request specifies an amount of data to be written;

comparing the amount of data to a condition comprising;

determining workload parameters, wherein the workload parameters include a determined access pattern of the workload;

determining data storage system parameters, wherein the data storage system parameters include a determined current I/O load per data storage unit;

writing the amount of data in a power managed organization scheme if the condition is met; and

writing the amount of data in a non-power managed organization scheme if the condition is not met.

27. The method of claim 26, wherein an organization scheme includes a Redundant Array of Inexpensive Disks (RAID) organization.

28. The method of claim 27, wherein an organization scheme includes a power managed RAID organization.

29. The method of claim 27, wherein an organization scheme includes a non-power managed RAID organization.

30. The method of claim 27, wherein an organization scheme includes a a power managed Redundant Array of Independent Volumes (RAIV) organization.

31. A storage controller for handling a write request in a data storage system, the storage controller comprising:

a processor;

a machine-readable storage medium including instructions executable by the processor for performing the method of claim 26.

32. A machine-readable storage medium including instructions executable by a processor for handling a write request in a data storage system, the machine-readable medium comprising one or more instructions for performing the method of claim 26.