Shared storage access load balancing for a large number of hosts

• US 8,819,344 B1
• Filed: 08/09/2007
• Issued: 08/26/2014
• Est. Priority Date: 08/09/2007
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Faibish, Sorin, Brashers, Per, Glasgow, Jason, Jiang, Xiaoye, Pedone, James
• Primary Examiner(s): DOAN, DUC T
• Application Number:
  US11/836,735
• Time in Patent Office: 2,574 Days
• Field of Search: None
• US Class Current: 711/147
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A data processing system includes host data processors, a data storage system including data storage shared among the host data processors, and a data switch coupling the host data processors to the data storage system. The data storage system has host adapter ports coupled to the data switch. The data switch is programmed for distributing block I/O requests from the host data processors over the operable host adapter ports for load balancing of the block I/O requests among the operable host adapter ports. The shared data storage can be a file system striped across RAID sets of disk drives for load balancing upon disk director ports of the data storage system. The data processing system can be expanded by adding more data storage systems, switches for the additional data storage systems, and switches for routing block I/O requests from the host processors to the data storage systems.

Claims

1. A method of load balancing in a data processing network, the data processing network including host data processors, a data storage system, and at least one data switch coupling the host data processors to the data storage system for receiving block I/O requests from the host data processors and transmitting block I/O requests to the data storage system, the data storage system including a storage controller and disk storage devices, the storage controller having host adapters and disk directors, the host adapters having host adapter ports coupled to said at least one data switch for receiving the block I/O requests transmitted by said at least one data switch, and disk directors having disk director ports coupled to RAID sets of the disk storage devices for transmission of single-block I/O requests from the disk director ports to the disk storage devices, said method comprising:

(a) configuring the storage system so that each disk storage device is accessible from each host adapter port;

(b) striping a file system across the RAID sets of the disk storage devices so that the file system is accessible by using all of the disk director ports of the storage system, and block I/O transfers for sequential read and write access to the file system are distributed across a set of disk director ports of the storage system;

(c) configuring said at least one switch to distribute block read and write requests across the host adapter ports that are operable; and

(d) programming the hosts to break up multi-block read or write requests into single block read or write requests for distribution of the single block read or write requests across the operable host adapter ports of the storage system; and

(e) operating the data processing system so that the host data processors convert multi-block I/O requests into single-block I/O requests and send the single-block I/O requests to said at least one data switch and said at least one data switch distributes the single-block I/O requests over the operable host adapter ports for load-balancing of the single-block I/O requests among the operable host adapter ports.

2. The method as claimed in claim 1, wherein at least one of the host adapter ports is inoperable, and the method includes said at least one data switch skipping an inoperable host adapter port in a rotational sequence when distributing at least one of the single-block I/O requests to a next operable one of the host adapter ports in the rotational sequence.

3. The method as claimed in claim 1, wherein the disk storage devices are disk drives, and which includes partitioning the disk drives to provide more than one file system that is shared among the disk drives, shared among the host data processors, and striped across the RAID sets of disk storage devices.

4. The method as claimed in claim 3, which includes striping each of the file systems across the RAID sets of disk storage devices in a different sequence of the RAID sets of disk storage devices in order to reduce contention among the disk director ports during concurrent sequential access of the files systems.

5. A method of load balancing in a data processing network, the data processing network including host data processors, a data storage system, and at least one data switch coupling the host data processors to the data storage system for receiving block I/O requests from the host data processors and transmitting block I/O requests to the data storage system, the data storage system including a storage controller and disk storage devices, the storage controller having host adapters and disk directors, the host adapters having host adapter ports coupled to said at least one data switch for receiving the block I/O requests transmitted by said at least one data switch, and disk directors having disk director ports coupled to RAID sets of the disk storage devices for transmission of single-block I/O requests from the disk director ports to the disk storage devices, said method comprising:

(a) configuring the storage system so that each disk storage device is accessible from each host adapter port;

(b) striping a file system across the RAID sets of the disk storage devices so that the file system is accessible by using all of the disk director ports of the storage system, and block I/O transfers for sequential read and write access to the file system are distributed across a set of disk director ports of the storage system;

(c) configuring said at least one switch to distribute block read and write requests across the host adapter ports that are operable; and

(d) programming the switch to break up multi-block read or write requests from the host data processors into single block read or write requests for distribution of the single block read or write requests across the operable host adapter ports of the storage system; and

(e) operating the data processing system so that said at least one data switch receives multi-block I/O requests from the host data processors and converts each multi-block I/O request into single-block I/O requests and distributes the single-block I/O requests over the operable host adapter ports for load-balancing of the single-block I/O requests among the operable host adapter ports.

6. The method as claimed in claim 5, wherein at least one of the host adapter ports is inoperable, and the method includes said at least one data switch skipping an inoperable host adapter port in a rotational sequence when distributing at least one of the single-block I/O requests to a next operable one of the host adapter ports in the rotational sequence.

7. The method as claimed in claim 5, wherein the disk storage devices are disk drives, and which includes partitioning the disk drives to provide more than one file system that is shared among the disk drives, shared among the host data processors, and striped across the RAID sets of disk storage devices.

8. The method as claimed in claim 7, which includes striping each of the file systems across the RAID sets of disk storage devices in a different sequence of the RAID sets of disk storage devices in order to reduce contention among the disk director ports during concurrent sequential access of the files systems.