Load balancing in a storage system

• US 8,447,872 B2
• Filed: 11/01/2006
• Issued: 05/21/2013
• Est. Priority Date: 11/01/2006
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Duerk, Vicky P., Seto, Pak-Lung
• Primary Examiner(s): Nawaz, Asad
• Assistant Examiner(s): HARLEY, JASON A
• Application Number:
  US11/591,873
• Publication Number:
  US 20080104264A1
• Time in Patent Office: 2,393 Days
• Field of Search: 709/223, 709/220
• US Class Current: 709/230
• CPC Class Codes: H04L 69/18 Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
• CPC Class Codes: H04L 69/324 in the data link layer [OSI layer 2], e.g. HDLC

Abstract

Link level load balancing is provided based on time utilization of a link or workload utilization of a device. Time utilization achieves load balancing by giving each device the same amount of connection time to perform Input/Output tasks. Workload utilization achieves load balancing by managing a number of frames or bytes transmitted to each device.

Claims

1. An apparatus comprising:

a port task scheduler to maintain a list of tasks associated with a remote storage device each task involving a data transfer using a serial storage protocol between a local initiator port in a storage Input/Output controller and the remote storage device over at least one of a plurality of physical links, the port task scheduler to include a load balancer to schedule tasks from among the list of tasks by scheduling the data transfer over at least one of the plurality of physical links associated with a connection established between the remote storage device and the local initiator port, the load balancer to provide a fair share of link servicing to each of a plurality of remote storage devices sharing the plurality of physical links such that each remote storage device receives a fair share of communication bandwidth, the load balancer to maintain a load balancing timeout timer associated with a connection established between the remote storage device and the local initiator port, the load balancer to count frames transferred over the connection and decrement the load balancing timeout timer only while frames are being transferred over the connection, the load balancer to cause the connection to be closed when the load balancing timeout timer expires, the load balancer to return a partially completed task to the list of tasks when the load balancing timeout timer expires and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the load balancer.

2. The apparatus of claim 1, wherein the remote storage device communicates over a link using a connection oriented protocol.

3. The apparatus of claim 2, wherein the connection oriented protocol is Serial Attached Small Computer System Interface.

4. The apparatus of claim 1, wherein the remote storage device communicates over the link using a non-connection oriented protocol.

5. The apparatus of claim 4, wherein the fair share of link servicing is frame based.

6. The apparatus of claim 5, wherein the non-connection oriented protocol is Fibre Channel.

7. The apparatus of claim 5, wherein the non-connection oriented protocol is Serial Advanced Technology Attachment (SATA).

8. The apparatus of claim 1, wherein at least two of the links are configured as a wide port to transfer data between the local port and the remote storage device.

9. The apparatus of claim 1, the load balancer to cause the connection to be closed based on whether the load balancing timeout timer expires or whether a count of frames transferred over the connection before the timer expires exceeds a threshold count, the load balancer to return a partially completed task to the list of tasks when the connection is closed and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the load balancer.

10. A method comprising:

storing, by a storage controller, a list of tasks associated with a remote storage device each task involving a data transfer using a serial storage protocol between a local initiator port in the storage controller and the remote storage device over at least one of a plurality of physical links; and

scheduling tasks, by the storage controller, the storage controller scheduling the data transfer over at least one of the plurality of physical links associated with a connection established between the remote device and the local initiator port, the storage controller to provide a fair share of link servicing to each of a plurality of remote storage devices sharing the plurality of physical links such that each remote storage device receives a fair share of communication bandwidth, the storage controller to maintain a load balancing timeout timer associated with a connection established between the remote storage device the local initiator port, the storage controller to count frames transferred over the connection and decrement the load balancing timeout timer only while frames are being transferred over the connection, the storage controller to close the connection when the load balancing timeout timer expires, the storage controller to return a partially completed task to the list of tasks when the load balancing timeout timer expires and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the storage controller.

11. The method of claim 10, wherein the remote storage device communicates over the link using a connection oriented protocol.

12. The method of claim 11, wherein the connection oriented protocol is Serial Attached Small Computer System Interface.

13. The method of claim 10, wherein the remote storage device communicates over the link using a non-connection oriented protocol.

14. The method of claim 13, wherein the fair share of link servicing is frame based.

15. The method of claim 14, wherein the non-connection oriented protocol is Fibre Channel.

16. The method of claim 14, wherein the non-connection oriented protocol is Serial Advanced Technology Attachment (SATA).

17. The method of claim 10, wherein at least two of the links are configured as a wide port to transfer data between the local port and the remote port.

18. The method of claim 10, the storage controller to close the connection either when the load balancing timeout timer expires or when a count of frames transferred over the connection before the timer expires exceeds a threshold count, the storage controller to return a partially completed task to the list of tasks when the connection is closed and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the storage controller.

19. A computer usable non-transitory medium including a computer readable code stored thereon having associated information, wherein the information, when accessed, results in a storage controller performing:

storing a list of tasks associated with a remote storage device, each task involving a data transfer using a serial storage protocol between a local initiator port and the remote storage device over at least one of a plurality of physical links; and

scheduling tasks by scheduling the data transfer over at least one of the plurality of physical links associated with a connection established between the remote device and the local initiator port, to provide a fair share of link servicing to each of a plurality of remote ports sharing the plurality of physical links such that each remote storage device receives a fair share of communication bandwidth, the storage controller to maintain a load balancing timeout timer associated with a connection established between the remote storage device and the local initiator port, the storage controller to count frames transferred over the connection and decrement the load balancing timeout timer only while frames are being transferred over the connection, the storage controller to close the connection when the load balancing timeout timer expires, the storage controller to return a partially completed task to the list of tasks when the load balancing timeout timer expires and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the storage controller.

20. The computer usable medium of claim 19, the storage controller to close the connection either when the load balancing timeout timer expires or when a count of frames transferred over the connection before the timer expires exceeds a threshold count, the storage controller to return a partially completed task to the list of tasks when the connection is closed and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the storage controller.

21. A system comprising:

a disk drive; and

a storage I/O controller comprising;

a port task scheduler to maintain a list of tasks associated with a remote storage device each task involving a data transfer using a serial storage protocol between a local initiator port in a storage Input/Output controller and the remote storage device over at least one of a plurality of physical links; and

a load balancer to schedule tasks from among the list of tasks by scheduling the data transfer over at least one of the plurality of physical links associated with a connection established between the remote device and the local initiator port, the load balancer to provide a fair share of link servicing to each of a plurality of remote storage devices sharing the plurality of physical links such that each remote storage device receives a fair share of communication bandwidth, the load balancer to maintain a load balancing timeout timer associated with a connection established between the remote storage device and the local initiator port, the load balancer to count frames transferred over the connection and decrement the load balancing timeout timer only while frames are being transferred over the connection, the load balancer to cause the connection to be closed connection when the load balancing timeout timer expires, the load balancer to return a partially completed task to the list of tasks when the load balancing timeout timer expires and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the load balancer.

22. The system of claim 21, the load balancer to cause the connection to be closed based on whether the load balancing timeout timer expires or whether a count of frames transferred over the connection before the timer expires exceeds a threshold count, the load balancer to return a partially completed task to the list of tasks when the connection is closed and there are pending tasks in the list of tasks, the partially completed task to be re-scheduled by the load balancer.