Enforcing quality of service in a storage network

• US 7,421,509 B2
• Filed: 01/18/2002
• Issued: 09/02/2008
• Est. Priority Date: 09/28/2001
• Status: Expired due to Term

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Lolayekar, Santosh C., Cheng, Yu-Ping, Tan, Enyew
• Primary Examiner(s): LIN, WEN TAI
• Application Number:
  US10/051,339
• Publication Number:
  US 20030079019A1
• Time in Patent Office: 2,419 Days
• Field of Search: 709/201, 709/223, 709/226, 709/228, 709/219, 370/231, 370/399, 318/105, 707/205
• US Class Current: 709/235
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements

Abstract

A system in accordance with an embodiment of the invention provides Quality of Service (QoS) for Storage Access. Such QoS is partially enabled in one embodiment by the automatic pooling of storage devices and provisioning virtual targets from those pools. QoS is enforced in one embodiment by keeping the bandwidth for each connection within a specified range, and particularly, by controlling the number of allowed concurrent requests from an initiator. Load balancing is also provided in one embodiment, improving response times for requests, further easing the ability to provide QoS.

Claims

1. A method for use in a storage network, the storage network including at least one initiator, at least one storage device, and a storage switch having a linecard connected to the at least one initiator and the at least one storage device for communication with the at least one initiator and the at least one storage device, the method comprising:

providing, by the linecard of the storage switch, quality of service to the at least one initiator for accessing the at least one storage device in the storage network, wherein providing quality of service includes guaranteeing a minimum bandwidth to the at least one initiator to access the storage device by estimating an actual bandwidth utilized by the initiator, where the actual bandwidth is estimated by a number of requests per second times an average size of requests from the at least one initiator, and wherein a request includes the packets sent back and forth between the at least one initiator and the at least one storage device necessary to complete the request.

2. The method of claim 1, wherein the step of providing quality of service includes controlling the number of packets from the at least one initiator to the at least one storage device during a period of time.

3. The method of claim 1, wherein the step of providing quality of service includes controlling the number of requests from the at least one initiator to the at least one storage device.

4. The method of claim 1, wherein the step of providing quality of service includes adjusting a number of concurrent requests allowed to be sent by the at least one initiator.

5. The method of claim 1, wherein the step of guaranteeing a minimum bandwidth to the at least one initiator includes adjusting the number of requests allowed the at least one initiator to keep the bandwidth utilized by the at least one initiator within a specified range.

6. The method of claim 5, further including:

guaranteeing up to a maximum bandwidth to the at least one initiator to access the at least one storage device; and

wherein adjusting the number of requests includes reducing the number of concurrent requests allowed by the at least one initiator when the actual bandwidth exceeds the maximum bandwidth.

7. A method for use in a storage network, the storage network including at least one initiator, at least one storage device, and at least one storage switch having a linecard, wherein the at least one initiator and the at least one storage device are both in communication with the linecard of the storage switch, the method comprising:

guaranteeing, by the linecard of the storage switch, a minimum bandwidth to the at least one initiator to access the at least one storage device in the storage network; and

estimating, by the linecard of the storage switch, an actual bandwidth utilized by the at least one initiator, where the actual bandwidth is estimated by a number of requests per second times an average size of requests from the at least one initiator, and wherein a request includes the packets sent back and forth between the at least one initiator and the at least one storage device necessary to complete the request.

8. The method of claim 7, further comprising:

adjusting a number of concurrent requests allowed to be sent by the at least one initiator.

9. The method of claim 8, wherein the step of adjusting includes:

reducing the number of concurrent requests allowed to be sent by the at least one initiator.

10. The method of claim 8, wherein the step of adjusting includes:

increasing the number of concurrent requests allowed to be sent by the at least one initiator.

11. The method of claim 7, further including guaranteeing, by the storage switch up to a maximum bandwidth to the at least one initiator to access the storage device.

12. The method of claim 11, further including:

reducing the number of concurrent requests allowed by the at least one initiator when the actual bandwidth exceeds its maximum bandwidth.

13. The method of claim 7, wherein estimating the actual bandwidth includes determining if a buffer includes a number of packets beyond a specified threshold.

14. A method for use in a storage network, the storage network including a plurality of initiators, a plurality of targets, and a storage switch having a linecard for communicating with the at least one initiator and the at least one storage device, the method comprising:

guaranteeing, by the linecard of the storage switch, a respective minimum bandwidth for each of a plurality of connections, wherein each respective connection is a connection from a respective initiator to a respective target via the storage switch in the storage network;

monitoring, by the linecard of the storage switch, an actual bandwidth utilized by each initiator, where the actual bandwidth is estimated by a number of requests per second from the initiator times an average size of the requests from the initiator, where a request includes the packets sent back and forth between an initiator and a target necessary to complete the request; and

determining if the actual bandwidth used by one initiator is excessive, and, if excessive, adjusting, by the linecard of the storage switch, a number of allowed concurrent requests for at least one initiator.

15. The method of claim 14, wherein monitoring the actual bandwidth includes determining if a buffer includes a number of packets beyond a specified threshold.

16. The method of claim 14, wherein adjusting a number of allowed concurrent requests includes reducing the number of allowed concurrent requests to the one initiator that is using excessive bandwidth.

17. The method of claim 16, wherein adjusting a number of allowed concurrent requests includes increasing the number of allowed concurrent requests to another initiator.

18. The method of claim 14, wherein the targets are virtual targets.

19. The method of claim 14, further including guaranteeing, by the storage switch, up to a respective maximum bandwidth for each of the plurality of connections, wherein determining if the actual bandwidth used by one initiator is excessive includes determining if the one initiator has exceeded its maximum bandwidth.

20. A method for use in a storage network, the storage network including at least one initiator, at least one storage device, and a storage switch having a linecard, wherein the at least one initiator and the at least one storage device are both in communication with the linecard of the storage switch, the method comprising:

providing a connection from the at least one initiator to the at least one storage device via the linecard of the storage switch in the storage network; and

adjusting, by the linecard of the storage switch, the number of requests allowed the at least one initiator to keep the bandwidth utilized by the at least one initiator within a specified range, wherein the bandwidth is estimated by a number of requests per second from the at least one initiator times an average size of the requests from the at least one initiator, and wherein a request includes the packets sent back and forth between the at least one initiator and the at least one storage device necessary to complete the request.

21. The method of claim 20, wherein the number of requests allowed the at least one initiator is the number of concurrent requests allowed the at least one initiator.

22. A switch for use in a storage network, the switch having a linecard comprising:

a port to be coupled to an external device, wherein the external device includes at least one initiator and a storage device; and

a bandwidth controller, the bandwidth controller including a processor, a traffic manager, and a buffer, for controlling bandwidth through the port by controlling a number of requests per second times an average size of the requests so as to keep the bandwidth utilized by the at least one initiator within a specified range, where a request includes the packets sent back and forth between the at least one initiator and the storage device necessary to complete the request.

23. The switch of claim 22, wherein the processor is a storage processor.

24. The switch of claim 22, wherein the port and the bandwidth controller are on one of a plurality of linecards in the switch, wherein each linecard includes a respective port and a respective bandwidth controller.

25. A switch having a linecard, the linecard including:

a storage processor, including a request controller that estimates bandwidth by a number of requests per second times an average size of the requests, and wherein the request controller is designed to adjust the number of requests allowed to an initiator to keep the bandwidth utilized by the initiator within a specified range, where a request includes the packets sent back and forth between an initiator and a target necessary to complete the request;

a traffic manager in communication with the storage processor;

a buffer in communication with the traffic manager;

wherein if a specified threshold in the buffer is reached, the traffic manager is designed to activate the request controller to control the bandwidth.

26. A storage switch for use in a storage network, the storage switch having a linecard comprising:

a first port to be coupled to at least one initiator;

a second port to be coupled to at least one storage device; and

means for providing quality of service for a connection from the at least one initiator to the at least one storage device in the storage network, comprising;

means for guaranteeing a minimum bandwidth to at least one initiator to access a storage device; and

means for estimating an actual bandwidth utilized by the at least one initiator, where the actual bandwidth is estimated by the number of requests per second times the average size of the requests from the at least one initiator, and where a request includes the packets sent back and forth between the at least one initiator and the storage device necessary to complete the request.

27. The switch of claim 26, wherein means for providing quality of service further comprises:

means for adjusting the number of concurrent requests allowed to be sent by the at least one initiator to keep the bandwidth utilized by the at least one initiator within a specified range having as a lower limit the minimum bandwidth.

28. The switch of claim 26, wherein means for providing quality of service includes:

a processor;

a traffic manager; and

a buffer.

29. The switch of claim 28, wherein the processor is a storage processor.

30. A storage network, including:

an initiator;

a storage device;

a switch having a linecard in communication with the initiator and the storage device;

wherein the linecard of the switch includes a traffic manager in communication with a buffer;

wherein when the buffer includes a number of packets from the initiator that exceeds a specified threshold, then the switch is designed to notify the initiator to reduce a number of concurrent requests, and where a request includes the packets sent back and forth between the an initiator and a target necessary to complete the request.

31. A machine readable media which has instructions stored thereon, which when executed on a linecard of a storage switch in a storage network including an initiator and a storage device in communication with the linecard of the storage switch causes the linecard of the storage switch to perform the following steps:

guaranteeing a minimum bandwidth to the initiator to access the storage device in the storage network; and

estimating an actual bandwidth utilized by the initiator, where the actual bandwidth is estimated by a number of requests per second times an average size of requests from the initiator, where a request includes the packets sent back and forth between the initiator and the storage device necessary to complete the request.

32. The machine readable media of claim 31, further including instructions for performing the step of:

adjusting a number of concurrent requests allowed to be sent by the initiator.

33. The machine readable media of claim 32, wherein the step of adjusting includes:

reducing the number of concurrent requests allowed to be sent by the initiator.

34. The machine readable media of claim 32, wherein the step of adjusting includes:

increasing the number of concurrent requests allowed to be sent by the initiator.

35. The machine readable media of claim 31, further including instructions for performing the step of:

guaranteeing, by the linecard of the storage switch, up to a maximum bandwidth to the initiator to access the storage device.

36. The machine readable media of claim 35, further including instructions for performing the step of:

reducing the number of concurrent requests allowed by the initiator when it exceeds its maximum bandwidth.

37. The machine readable media of claim 31, wherein estimating the actual bandwidth includes determining if a buffer includes a number of packets beyond a specified threshold.