Storage device array architecture with copyback cache

• US 5,911,779 A
• Filed: 03/31/1997
• Issued: 06/15/1999
• Est. Priority Date: 01/04/1991
• Status: Expired due to Term

• Current Assignee: EMC Corporation (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Brant, William A., Stallmo, David C.
• Primary Examiner(s): Hua, Ly
• Application Number:
  US08/825,625
• Time in Patent Office: 806 Days
• Field of Search: 395/182.04, 395/441, 395/182.05, 395/182.07, 395/440, 395/182, 371/40.4, 371/51.1, 711/114, 711/113
• US Class Current: 714/6.12
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1441 Resetting or repowering
• CPC Class Codes: G06F 11/1666 where the redundant component is memory or memory area
• CPC Class Codes: G06F 11/20 using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
• CPC Class Codes: G06F 11/2087 with a common controller
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 12/0804 with main memory updating G06F12/0806 takes precedence
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 2211/1019 Fast writes, i.e. signaling the host that a write is done before data is written to disk
• CPC Class Codes: G06F 2211/1059 Parity-single bit-RAID5, i.e. RAID 5 implementations
• CPC Class Codes: G11B 20/1833 by adding special lists or symbols to the coded information G11B20/1806, G11B20/1866 take precedence

Abstract

A fault-tolerant storage device array using a copyback cache storage unit for temporary storage. When a Write occurs to the RAID system, the data is immediately written to the first available location in the copyback cache storage unit. Upon completion of the Write to the copyback cache storage unit, the host CPU is immediately informed that the Write was successful. Thereafter, further storage unit accesses by the CPU can continue without waiting for an error-correction block update for the data just written. In a first embodiment of the invention, Read-Modify-Write operations are performed during idle time. In a second embodiment of the invention, normal Read-Modify-Write operation by the RAID system controller continue use Write data in the controller'"'"'s buffer memory. In a third embodiment, at least two controllers, each associated with one copyback cache storage unit, copy Write data from controller buffers to the associated copyback cache storage unit. If a copyback cache storage unit fails, more than one controller share a single copyback storage unit. In a fourth embodiment, Write data is copied from a controller buffer to a reserved area of each storage unit comprising the array.

Claims

1. A fault-tolerant storage device array including:

a. a plurality of failure independent storage units for storing information as stripes of blocks, including at least data blocks and associated error-correction blocks;

b. at least one copyback cache storage unit for temporarily storing data blocks; and

c. a storage unit controller, coupled to the plurality of storage units and to the at least one copyback cache storage unit, including control means for;

(1) writing received data blocks initially onto the at least one copyback cache storage unit as pending data blocks;

(2) during idle time of at least some of the plurality of storage units;

(a) reading at least one pending data block from at least one copyback cache storage unit;

(b) accessing the storage units and reading information corresponding to each read pending data block;

(c) generating an associated error-correction block from the read information and each read pending data block; and

(d) writing each such read pending data block and associated error-correction block to a corresponding stripe of the idle storage units; and

(3) acknowledging completion of writing each received data block to the at least one copyback cache storage unit before writing such data block to one of the storage units.

2. The storage device array of claim 1, wherein the information corresponding to each read pending data block includes a corresponding old error-correction block and corresponding old data block read from the corresponding stripe of idle storage units.

3. The storage device array of claim 1, wherein generating an error-correction block further includes:

a. reading a corresponding old data block from the corresponding stripe of the idle storage units;

b. reading a corresponding old error-correction block from the corresponding stripe of the idle storage units; and

c. exclusively-ORing the old data block, the old error correction block and the read pending data block, thereby generating a new error-correction block.

4. The fault-tolerant storage device array of claim 1, wherein at least one copyback cache storage unit is non-volatile.

5. A fault-tolerant storage device array including:

a. a plurality of failure independent storage units for storing information as stripes of blocks, including at least data blocks and associated error-correction blocks;

b. at least one copyback cache storage unit for temporarily storing data blocks, at least one of said at least one copyback cache storage unit being non-volatile; and

c. a storage unit controller, coupled to the plurality of storage units and to the at least one copyback cache storage unit, including control means for;

(1) writing received data blocks initially onto the at least one copyback cache storage unit as pending data blocks;

(2) during idle time of at least some of the plurality of storage units;

(a) reading at least one pending data block from at least one copyback cache storage unit;

(b) accessing the storage units and reading information corresponding to each read pending data block;

(c) generating an associated error-correction block from the read information and each read pending data block; and

(d) writing each such read pending data block and associated error-correction block to a corresponding stripe of the idle storage units.

6. The storage device array of claim 5, wherein the control means acknowledges completion of writing each received data block to the at least one copyback cache storage unit before writing such data block to one of the storage units.

7. The storage device array of claim 6, wherein the information corresponding to each read pending data block includes a corresponding old error-correction block and corresponding old data block read from the corresponding stripe of idle storage units.

8. The storage device array of claim 7, wherein generating an error-correction block further includes:

a. reading a corresponding old data block from the corresponding stripe of the idle storage units;

b. reading a corresponding old error-correction block from the corresponding stripe of the idle storage units; and

c. exclusively-ORing the old data block, the old error correction block and the read pending data block, thereby generating a new error-correction block.

9. A fault-tolerant storage device array including:

a. a plurality of failure independent storage units for storing information as stripes of blocks, including at least data blocks and associated error-correction blocks;

b. at least one copyback cache storage unit for temporarily storing data blocks, at least one of said at least one copyback cache storage unit being non-volatile; and

c. a storage unit controller, coupled to the plurality of storage units and to the at least one copyback cache storage unit, including control means for;

(1) writing received data blocks initially onto the at least one copyback cache storage unit as pending data blocks;

(2) during idle time of at least some of the plurality of storage units;

(a) reading at least one pending data block from at least one copyback cache storage unit;

(b) accessing the storage units and reading information corresponding to each read pending data block;

(c) generating an associated error-correction block from the read information and each read pending data block; and

(d) writing each such read pending data block and associated error-correction block to a corresponding stripe of the idle storage units; and

(3) acknowledging completion of writing each received data block to the at least one copyback cache storage unit before writing such data block to one of the storage units.

10. The storage device array of claim 9, wherein the information corresponding to each read pending data block includes a corresponding old error-correction block and corresponding old data block read from the corresponding stripe of idle storage units.

11. The storage device array of claim 9, wherein generating an error-correction block further includes:

a. reading a corresponding old data block from the corresponding stripe of the idle storage units;

b. reading a corresponding old error-correction block from the corresponding stripe of the idle storage units; and

c. exclusively-ORing the old data block, the old error correction block and the read pending data block, thereby generating a new error-correction block.

12. A fault-tolerant storage device array including:

a. a plurality of failure independent storage units for storing information as stripes of blocks, including at least data blocks and associated error-correction blocks;

b. at least one copyback cache storage unit for temporarily storing data blocks; and

c. a storage unit controller, coupled to the plurality of storage units and to the at least one copyback cache storage unit, including control means for;

(1) writing received data blocks initially onto the at least one copyback cache storage unit as pending data blocks;

(2) reading at least one pending data block from at least one copyback cache storage unit;

(3) accessing the storage units and reading information corresponding to each read pending data block;

(4) generating an associated error-correction block from the read information and each read pending data block;

(5) writing each such read pending data block and associated error-correction block to a corresponding stripe of the storage units; and

(6) acknowledging completion of writing each received data block to the at least one copyback cache storage unit before writing such data block to one of the storage units.

13. The storage device array of claim 12, wherein the information corresponding to each read pending data block includes a corresponding old error-correction block and corresponding old data block read from the corresponding stripe of the storage units.

14. The storage device array of claim 12, wherein generating an error-correction block further includes:

a. reading a corresponding old data block from the corresponding stripe of the storage units;

b. reading a corresponding old error-correction block from the corresponding stripe of the storage units; and

c. exclusively-ORing the old data block, the old error correction block and the read pending data block, thereby generating a new error-correction block.

15. The storage device array of claim 12, wherein at least one copyback cache storage unit is non-volatile.

16. The storage device array of claim 12, wherein said storage unit controller further includes control means for reading requested data blocks from at least one copyback cache storage unit when such requested data blocks have not been written to the plurality of storage units, otherwise from the plurality of storage units.

17. A fault-tolerant storage device array including:

a. a plurality of failure independent storage units for storing information as stripes of blocks, including at least data blocks and associated error-correction blocks;

b. at least one copyback cache storage unit for temporarily storing data blocks, at least one of said at least one copyback cache storage unit being non-volatile; and

c. a storage unit controller, coupled to the plurality of storage units and to the at least one copyback cache storage unit, including control means for;

(1) writing received data blocks initially onto the at least one copyback cache storage unit as pending data blocks;

(2) reading at least one pending data block from at least one copyback cache storage unit;

(3) accessing the storage units and reading information corresponding to each read pending data block;

(4) generating an associated error-correction block from the read information and each read pending data block; and

(5) writing each such read pending data block and associated error-correction block to a corresponding stripe of the storage units.

18. The storage device array of claim 17, wherein the control means acknowledges completion of writing each received data block to the at least one copyback cache storage unit before writing such data block to one of the storage units.

19. The storage device array of claim 18, wherein the information corresponding to each read pending data block includes a corresponding old error-correction block and corresponding old data block read from the corresponding stripe of the storage units.

20. The storage device array of claim 19, wherein generating an error-correction block further includes:

a. reading a corresponding old data block from the corresponding stripe of the storage units;

b. reading a corresponding old error-correction block from the corresponding stripe of the storage units; and

c. exclusively-ORing the old data block, the old error correction block and the read pending data block, thereby generating a new error-correction block.

21. The storage device array of claim 17, wherein said storage unit controller further includes control means for reading requested data blocks from at least one copyback cache storage unit when such requested data blocks have not been written to the plurality of storage units, otherwise from the plurality of storage units.

22. A fault-tolerant storage device array including:

a. a plurality of failure independent storage units for storing information as stripes of blocks, including at least data blocks and associated error-correction blocks;

b. at least one copyback cache storage unit for temporarily storing data blocks, at least one of said at least one copyback cache storage unit being non-volatile; and

c. a storage unit controller, coupled to the plurality of storage units and to the at least one copyback cache storage unit, including control means for;

(1) writing received data blocks initially onto the at least one copyback cache storage unit as pending data blocks;

(2) reading at least one pending data block from at least one copyback cache storage unit;

(3) accessing the storage units and reading information corresponding to each read pending data block;

(4) generating an associated error-correction block from the read information and each read pending data block;

(5) writing each such read pending data block and associated error-correction block to a corresponding stripe of the storage units; and

(6) acknowledging completion of writing each received data block to the at least one copyback cache storage unit before writing such data block to one of the storage units.

23. The storage device array of claim 22, wherein the information corresponding to each read pending data block includes a corresponding old error-correction block and corresponding old data block read from the corresponding stripe of the storage units.

24. The storage device array of claim 22, wherein generating an error-correction block further includes:

a. reading a corresponding old data block from the corresponding stripe of the storage units;

b. reading a corresponding old error-correction block from the corresponding stripe of the storage units; and

c. exclusively-ORing the old data block, the old error correction block and the read pending data block, thereby generating a new error-correction block.

25. The storage device array of claim 22, wherein said storage unit controller further includes control means for reading requested data blocks from at least one copyback cache storage unit when such requested data blocks have not been written to the plurality of storage units, otherwise from the plurality of storage units.