Distributed disk array architecture

• US 5,787,459 A
• Filed: 12/27/1995
• Issued: 07/28/1998
• Est. Priority Date: 03/11/1993
• Status: Expired due to Term

• Current Assignee: EMC Corporation (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Hall, Randy, Brant, William A., Stallmo, David C.
• Primary Examiner(s): Swann, Tod R.
• Assistant Examiner(s): Tran, Denise
• Application Number:
  US08/579,553
• Time in Patent Office: 944 Days
• Field of Search: 395/800, 395/445, 395/446, 395/447, 395/448, 395/449, 395/455, 395/431, 395/439, 395/440, 395/441, 395/412, 395/416, 395/182.04, 395/182.05, 395/730 , 395/200.31, 395/200.81, 395/293, 395/800.28, 711/112, 711/114, 711/113, 711/148, 371/40.15
• US Class Current: 711/112
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0634 by changing the state or mode of one or more devices
• CPC Class Codes: G06F 3/0658 Controller construction arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A RAID-compatible data storage system which allows incremental increases in storage capacity at a cost that is proportional to the increase in capacity. The system does not require changes to the host system. The control and interface functions previously performed by a single (or redundant) central data storage device controller are distributed among a number of modular control units (MCUs). Each MCU is preferably physically coupled to a data storage device to form a basic, low-cost integrated storage node. One of two bus ports interfaces an MCU with the host computer on a host bus, and the other bus port interfaces an MCU with one or more data storage devices coupled to the MCU by a data storage device bus. The serial interface ports provide a means by which each of the MCUs may communicate with each other MCU to facilitate the implementation of a memory array architecture. The entire data storage array may appear as a single device capable of responding to a single identification number on the host bus, or may appear as a number of independent device. A controlling MCU receives a command and notifies the other MCUs that are involved in a read or write operation. Control of the host bus is transferred from one MCU to the next MCU in sequence so that the data is received by the host computer, or written to each data storage device, in the proper order.

Claims

1. A distributed storage array system configured to be coupled to a host computer having a host bus, comprising:

a plurality of data storage devices for storing and retrieving data in a selected sequence;

a communications link; and

a plurality of modular control units, each configured to communicate with the host computer directly over the host bus, each modular control unit being coupled to at least one corresponding data storage device and to each other modular control unit by said communications link, wherein;

at least one modular control unit includes a receiver for receiving input/output requests from the host computer directly over the host bus for determining a next data storage device of a sequence of data storage devices involved in responding to a pending one of the received input/output requests; and

each modular control unit includes a receiver for receiving configuration information from another modular control unit over the communications link separately from communications over the host bus.

2. The distributed storage array system of claim 1 wherein said configuration information comprises control information for controlling said modular control units.

3. The distributed storage array system of claim 1 wherein said configuration information comprises configuration table information.

4. The distributed storage array system of claim 1 wherein said configuration information comprises a table of logical system information.

5. The distributed storage array system of claim 1 wherein said configuration information comprises information defining an array of said plurality of data storage devices.

6. The distributed storage array system of claim 1 wherein said configuration information comprises redundancy group information.

7. The distributed storage array system of claim 1 wherein said configuration information comprises logical volume information.

8. The distributed storage array system of claim 1 wherein said configuration information comprises logical disk information.

9. The distributed storage array system of claim 1 wherein said configuration information comprises information for transferring over said communications link responsibility for responding to the pending one of the received input/output requests to the modular control units corresponding to the sequence of involved data storage devices.

10. The distributed storage array system of claim 1 wherein said configuration information comprises a data structure configuration information for each of said modular control units that is communicated from each of said modular control units to another of said modular control units.

11. The distributed storage array system of claim 10 wherein said modular control units each further comprise means for updating its own configuration data structure and sending a change configuration message to another modular control unit.

12. The distributed storage array system of claim 10 wherein said data storage devices further comprise means for updating its own configuration data structure if said modular control unit receives changed configuration data and sending a change configuration message to another modular control unit.

13. The distributed storage array system of claim 1 wherein said configuration information comprises time-stamped configuration data.

14. The distributed storage array system of claim 1 wherein said modular control units each further comprise means for detecting a failure of another modular control unit.

15. The distributed storage array system of claim 14 wherein said configuration information comprises an operational message provided from each modular control unit, and said means for detecting a failure of another modular control unit comprises means for detecting an absence of said operational message.

16. The distributed storage array system of claim 11 wherein said configuration information comprises a logical volume to physical volume location map.

17. The distributed storage array system of claim 11 wherein said configuration table information comprises a redundancy group to physical volume location map.

18. The distributed storage array system of claim 11 wherein said configuration information comprises a logical data set to physical volume location map.

19. A distributed storage array system configured to be coupled to a host computer having a host bus, comprising:

a plurality of data storage devices for storing and retrieving data in a selected sequence;

a communications link;

a plurality of modular control units, each configured to communicate with the host computer directly over the host bus, each modular control unit being coupled to at least one corresponding data storage device and to each other modular control unit by said communications link, wherein;

at least one modular control unit includes a receiver for receiving input/output requests from the host computer directly over the host bus for determining a next data storage device of a sequence of data storage devices involved in responding to a pending one of the received input/output requests; and

each modular control unit includes a receiver for receiving configuration information from another modular control unit over the communications link separately from communications over the host bus; and

a cache for caching at least some I/O transactions handled by said modular control units.

20. The distributed storage array system of claim 19 wherein said at least one modular control unit including the receiver for receiving the input/output requests further comprises means for generating a write complete message to the host computer when data to be written by said modular control unit is written to said cache.

21. The distributed storage array system of claim 19 wherein said cache is sized to enable said modular control units to process a transfer without logically disconnecting from the host computer.

22. The distributed storage array system of claim 19 wherein the at least selected ones of said plurality of modular control units includes a RAM and wherein said cache for caching at least some transactions comprises the RAM included to form a portion of at least the selected ones of said plurality of modular control units, each RAM forming a cache for an associated modular control units.

23. The distributed storage array system of claim 22 wherein the at least selected ones of said plurality of modular control units including the RAM comprises each of said plurality of modular control units.

24. The distributed storage array system of claim 19 wherein one of said modular control units is dedicated to caching.

25. A distributed storage array system configured to be coupled to a host computer having a host bus, comprising:

a plurality of data storage devices for storing and retrieving data in a selected sequence;

a communications link; and

a plurality of modular control units, each configured to communicate with the host computer directly over the host bus, each modular control unit being coupled to at least one corresponding data storage device and to each other modular control unit by said communications link, wherein;

at least one modular control unit includes a receiver for receiving input/output requests from the host computer directly over the host bus for determining a next data storage device of a sequence of data storage devices involved in responding to a pending one of the received input/output requests; and

each modular control unit includes a receiver for receiving information from another modular control unit over the communications link separately from communications over the host bus.

26. The distributed array system of claim 25 wherein at least a portion of said information received by each modular control unit comprises configuration information.

27. The distributed array system of claim 25 wherein at least a portion of said information received by each modular control unit comprises control information.

28. The distributed array system of claim 25 wherein at least a portion of said information received by each modular control unit comprises data.

29. The distributed array system of claim 25 wherein at least a portion of said information received by each modular control unit comprises redundancy data.