Maximizing storage system throughput by measuring system performance metrics

• US 7,401,198 B2
• Filed: 10/06/2005
• Issued: 07/15/2008
• Est. Priority Date: 10/06/2005
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Johnston, Craig Anthony, Stager, Roger Keith
• Primary Examiner(s): Verbrugge; Kevin
• Application Number:
  US11/244,523
• Publication Number:
  US 20070083727A1
• Time in Patent Office: 1,013 Days
• Field of Search: None
• US Class Current: 711/170
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0686 Libraries, e.g. tape libraries, jukebox

Abstract

A method for stream allocation in a data storage system begins by determining whether a stream needs storage space. Storage space for the stream is requested, and a device on which to allocate the storage space is selected. The storage space on the selected device is allocated to the stream.

Claims

1. A method for stream allocation in a data storage system, comprising the steps of:

determining whether a stream needs storage space;

requesting storage space for the stream;

selecting a device on which to allocate the storage space, including

determining if there is an unused device in the system;

selecting the unused device if an unused device exists in the system;

if there are no unused devices in the system, then

determining if there is an input limited device in the system; and

selecting an input limited device having a lowest amount of traffic if an input limited device exists in the system; and

allocating the storage space on the selected device to the stream.

2. The method according to claim 1, wherein the method is used to allocate additional storage space to an existing stream.

3. The method according to claim 1, wherein the determining step includes a trigger being activated to indicate that storage space is needed.

4. The method according to claim 3, wherein the trigger is activated by a stream exhausting its allocated storage space.

5. The method according to claim 1, wherein the determining step includes:

determining a length of time a command on the device requires for completion;

measuring a data transfer rate of the device;

multiplying the length of time by the data transfer rate to obtain a value; and

determining that the device is input limited if the value is less than or equal to one.

6. The method according to claim 1, wherein if there are no input limited devices in the system, then the selecting step further includes:

selecting a device having a lowest command completion time.

7. A method for selecting a device to use in a data storage system, comprising the steps of:

(a) determining if there is an unused device in the system;

(b) selecting the unused device if an unused device exists in the system;

(c) determining if there is an input limited device in the system if there are no unused devices in the system;

(d) selecting an input limited device having a lowest amount of traffic if an input limited device exists in the system; and

(e) selecting a device having a lowest command completion time if there are no input limited devices in the system.

8. The method according to claim 7, wherein step (c) includes:

determining a length of time a command on the device requires for completion;

measuring a data transfer rate of the device;

multiplying the length of time by the data transfer rate to obtain a value; and

determining that the device is input limited if the value is less than or equal to one.

9. A system for performing load balancing in a data storage system having a plurality of storage devices, the system comprising:

a command queue configured to process commands;

a device driver configured to send commands to the plurality of storage devices;

a statistics device configured to gather statistics from said device driver regarding command completion times; and

a device allocator configured to allocate space on one of the plurality of storage devices based on the gathered statistics, whereby the data storage system is load balanced.

10. The system according to claim 9, wherein said command queue includes:

a command handler configured to process a command; and

a statistics-gathering node configured to gather statistics from said device driver regarding command completion times, said statistics device requesting statistics from said statistics-gathering node.

11. The system according to claim 10, wherein said command queue further includes:

a virtual target configured to determine whether said command handler can process the command, said virtual target further configured to request an appropriate command handler if said command handler cannot process the command.

12. The system according to claim 11, further comprising:

a virtual tape device configured to process any command type and configured to instantiate a command handler in said command queue upon request of said virtual target.

13. The system according to claim 10, further comprising:

a virtual tape volume configured to request space on one of the plurality of storage devices, said command handler communicating with said virtual tape volume to request space needed by the command.

14. The system according to claim 13, further comprising:

a data map configured to allocate a portion of the space in the plurality of storage devices.

15. The system according to claim 14, wherein if said data map has no space to allocate, said data map is further configured to request additional space in the plurality of storage devices from said device allocator.