Method and system for caching data in a storage system

• US 20030070041A1
• Filed: 11/13/2002
• Published: 04/10/2003
• Est. Priority Date: 03/03/1999
• Status: Active Grant

• Current Assignee: Brent Cameron Beardsley, Kenneth Wayne Todd, Michael Thomas Benhase, Robert Louis Morton
• Original Assignee: Brent Cameron Beardsley, Kenneth Wayne Todd, Michael Thomas Benhase, Robert Louis Morton
• Inventors: Benhase, Michael Thomas, Todd, Kenneth Wayne, Beardsley, Brent Cameron, Morton, Robert Louis
• Granted Patent: US 6,658,542 B2
• Time in Patent Office: Days
• US Class Current: 711/113
• CPC Class Codes: G06F 11/004 Error avoidance G06F11/07 and subgroups take precedence
• CPC Class Codes: G06F 11/0724 in a multiprocessor or a multi-core unit multiprocessors per se G06F15/80
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/073 in a memory management context, e.g. virtual memory or cache management memory management G06F12/00; testing of static memory units G11C29/00
• CPC Class Codes: G06F 11/0793 Remedial or corrective actions recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40
• CPC Class Codes: G06F 12/0804 with main memory updating G06F12/0806 takes precedence
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 2212/312 In storage controller

Abstract

Disclosed is a system and method for caching data. A processor receives data from a host to modify a track in a first storage device. The processor stores a copy of the modified data in a cache and indicates in a second storage device the tracks for which there is modified data in cache. During data recovery operations, the processor processes the second storage device and data therein to determine the tracks for which there was modified data in cache. The processor then marks the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure is resolved. In further embodiments, in response to detecting a partial failure within the storage system, the processor would scan the cache to determine tracks for which there is modified data stored in the cache. The processor then stores in the second storage device information indicating the tracks having modified data in cache and schedules the destaging of the modified data from the cache to the first storage device. The processor is further capable of receiving and processing read/write requests directed to the first storage device before all the modified data is destaged from cache.

Claims

1. A method for caching data, comprising the steps of:

receiving data to modify a track in a first storage device;

storing a copy of the modified data in a cache;

indicating in a second storage device the tracks for which there is modified data in cache; and

processing the second storage device and data therein during data recovery operations to determine the tracks for which there was modified data in cache; and

marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure is resolved.

2. The method of claim 1, further comprising the step of determining whether the received data is one of sequential data and random data before indicating in the second storage device the tracks having modified data in cache, wherein the step of indicating in the second storage device the tracks having modified data in cache occurs after determining that the received data is sequential data.

3. The method of claim 2, further comprising the step of storing the modified data for the track in the second storage device after determining that the received data is random data.

4. A method for handling a partial failure in a storage system, wherein the storage system processes read/write operations directed to data tracks stored in a first storage device, comprising the steps of:

detecting a partial failure within the storage system;

scanning a cache to determine tracks for which there is modified data stored in the cache after detecting the partial failure;

storing in a second storage device information indicating the tracks having modified data in cache;

scheduling the destaging of the modified data from the cache to the first storage device; and

receiving and processing read/write requests directed to the first storage device before all modified data is destaged from cache.

5. The method of claim 4, further comprising the step of removing the indication in the second storage device that a track has modified data in cache after the modified data is destaged to the track in the first storage device.

6. The method of claim 4, further comprising the steps of:

placing an indicator of modified data tracks on a destage list, wherein the tracks on the destage list are scheduled for destage; and

determining whether a received read/write request is directed to a track in the first storage device having modified data in cache scheduled for destage, wherein the step of processing the read/write request to the track is delayed after determining that the request is directed toward a track scheduled for destage until the modified data for the track is destaged from cache.

7. The method of claim 4, further comprising the steps of:

shutting the storage system down after detecting a second failure;

restarting the storage system after correcting the failure;

processing the second storage device, after restarting the storage system, to determine the tracks having modified data in cache before the second failure; and

marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure of the tracks is resolved.

8. A system for caching data received from a host system, wherein the storage system is capable of processing read/write operations from a host system and reading and writing to a first storage device including data tracks, comprising:

a processor;

a cache in communication with the processor;

a second storage device for backing-up data stored in the cache;

control logic executed by the processor, comprising;

(i) means for receiving data to modify a track in the first storage device;

(ii) means for indicating in the second storage device the tracks for which there is modified data in cache; and

(iii) means for processing the second storage device and data therein during data recovery operations to determine the tracks for which there was modified data in cache; and

(iv) means for marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure is resolved.

9. The system of claim 8, wherein the control logic further comprises means for determining whether the received data is one of sequential data and random data before indicating in the second storage device the tracks having modified data in cache, wherein the step of indicating in the second storage device the tracks having modified data in cache occurs after determining that the received data is sequential data.

10. The system of claim 9, wherein the control logic further comprises means for storing the modified data for the track in the second storage device after determining that the received data is random data.

11. A system for handling a partial failure, wherein the storage controller is capable of processing read/write operations from a host system and reading and writing to a first storage device including data tracks, comprising:

a processor;

a cache in communication with the processor;

a second storage device for backing-up data stored in the cache;

control logic executed by the processor, comprising;

(i) means for detecting a partial failure within the storage controller;

(ii) means for scanning the cache to determine tracks for which there is modified data stored in the cache after detecting the partial failure;

(iii) means for storing in the second storage device information indicating tracks having modified data in cache;

(iv) means for scheduling the destaging of the modified data from the cache to the first storage device; and

(v) means for receiving and processing read/write requests directed to the first storage device before all modified data is destaged from cache.

12. The system of claim 11, wherein the control logic further comprises means for removing the indication in the second storage device that a track has modified data in cache after the modified data is destaged to the track in the first storage device.

13. The system of claim 11, wherein the control logic further comprises:

means for placing an indicator of modified data tracks on a destage list, wherein the tracks on the destage list are scheduled for destage; and

determining whether a received read/write request is directed to a track in the first storage device having modified data in cache scheduled for destage, wherein the step of processing the read/write request to the track is delayed after determining that the request is directed toward a track scheduled for destage until the modified data for the track is destaged from cache.

14. The system of claim 11, wherein the control logic further comprises:

means for shutting the storage system down after detecting a second failure;

means for restarting the storage system after correcting the failure;

means for processing the second storage device, after restarting the storage system, to determine the tracks for which there was modified data in cache; and

means for marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure of the tracks is resolved.

15. The system of claim 11, wherein the processor and cache are a first processor and first cache, wherein a first cluster includes the first processor, the first cache and the second storage device, comprising:

a second cluster, comprising;

(i) a second processor;

(ii) a second cache, wherein the second storage device stores provides backup for data in the second cache; and

(iii) a third storage device for providing backup for data in the first cache.

16. The system of claim 15, wherein the second storage device is closer in physical proximity to the second processor and the second cache than to the first processor and the first cache, respectively, and wherein the third storage device closer in physical proximity to the first processor and the first cache than to the second processor and the second cache, respectively.

17. The system of claim 15, wherein the control logic further comprises:

means for detecting a partial failure within the second cluster; and

means for indicating that the third storage device does not contain valid data after detecting a partial failure within the second cluster; and

means for indicating that the second storage device has valid data after storing in the second storage device information indicating tracks having modified data in cache.

18. The system of claim 17, wherein the control logic further comprises means for:

shutting down the system after detecting an additional failure;

restarting the system after correcting the cause of the failure; and

determining whether the second and third storage devices include valid data, wherein the control logic processes the second storage device to determine the tracks for which there was modified data in cache after determining that the second storage device includes valid data.

19. A storage system for caching data received from a host system, wherein the storage system is capable of processing read/write operations from a host system, comprising:

a processor;

a cache in communication with the processor;

a first storage device storing data tracks, wherein the processor is capable of reading and writing to data tracks in the first storage device;

a second storage device for backing-up data stored in the cache;

control logic executed by the processor, comprising;

(i) means for receiving data to modify a track in the first storage device;

(ii) means for indicating in the second storage device the tracks for which there is modified data in cache; and

(iii) means for processing the second storage device and data therein during data recovery operations to determine the tracks for which there was modified data in cache; and

(iv) means for marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure is resolved.

20. The storage system of claim 19, wherein the control logic further comprises means for determining whether the received data is one of sequential data and random data before indicating in the second storage device the tracks having modified data in cache, wherein the step of indicating in the second storage device the tracks having modified data in cache occurs after determining that the received data is sequential data.

21. A storage system for handling a partial failure, wherein the storage controller is capable of processing read/write operations from a host system, comprising:

a processor;

a cache in communication with the processor;

a first storage device storing data tracks, wherein the processor is capable of reading and writing to data tracks in the first storage device;

a second storage device for backing-up data stored in the cache;

control logic executed by the processor, comprising;

(i) means for detecting a partial failure within the storage controller;

(ii) means for scanning the cache to determine tracks for which there is modified data stored in the cache after detecting the partial failure;

(iii) means for storing in the second storage device information indicating tracks having modified data in cache;

(iv) means for scheduling the destaging of the modified data from the cache to the first storage device; and

(v) means for receiving and processing read/write requests directed to the first storage device before all modified data is destaged from cache.

22. The storage system of claim 21, wherein the control logic further comprises:

means for placing an indicator of modified data tracks on a destage list, wherein the tracks on the destage list are scheduled for destage; and

determining whether a received read/write request is directed to a track in the first storage device having modified data in cache scheduled for destage, wherein the step of processing the read/write request to the track is delayed after determining that the request is directed toward a track scheduled for destage until the modified data for the track is destaged from cache.

23. The storage system of claim 21, wherein the processor and cache are a first processor and first cache, wherein a first cluster includes the first processor, the first cache and the second storage device, comprising:

a second cluster, comprising;

(i) a second processor;

(ii) a second cache, wherein the second storage device stores provides backup for data in the second cache; and

(iii) a third storage device for providing backup for data in the first cache.

24. A data processing system for caching data, comprising:

a processor;

a host system, wherein the processor is capable of processing read/write operations from the host system;

a cache in communication with the processor;

a first storage device storing data tracks, wherein the processor is capable of reading and writing to data tracks in the first storage device;

a second storage device for backing-up data stored in the cache;

control logic executed by the processor, comprising;

(i) means for receiving data to modify a track in the first storage device;

(ii) means for indicating in the second storage device the tracks for which there is modified data in cache; and

(iii) means for processing the second storage device and data therein during data recovery operations to determine the tracks for which there was modified data in cache; and

(iv) means for marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure is resolved.

25. The data processing system of claim 24, wherein the control logic further comprises means for determining whether the received data is one of sequential data and random data before indicating in the second storage device the tracks having modified data in cache, wherein the step of indicating in the second storage device the tracks having modified data in cache occurs after determining that the received data is sequential data.

26. A data processing system for handling a partial failure, comprising:

a processor;

a host system, wherein the processor is capable of processing read/write operations from the host system;

a cache in communication with the processor;

a first storage device storing data tracks, wherein the processor is capable of reading and writing to data tracks in the first storage device;

a second storage device for backing-up data stored in the cache;

control logic executed by the processor, comprising;

(i) means for detecting a partial failure within the storage controller;

(ii) means for scanning the cache to determine tracks for which there is modified data stored in the cache after detecting the partial failure;

(iii) means for storing in the second storage device information indicating tracks having modified data in cache;

(iv) means for scheduling the destaging of the modified data from the cache to the first storage device; and

(v) means for receiving and processing read/write requests directed to the first storage device before all modified data is destaged from cache.

27. The data processing system of claim 26, wherein the control logic further comprises:

means for placing an indicator of modified data tracks on a destage list, wherein the tracks on the destage list are scheduled for destage; and

determining whether a received read/write request is directed to a track in the first storage device having modified data in cache scheduled for destage, wherein the step of processing the read/write request to the track is delayed after determining that the request is directed toward a track scheduled for destage until the modified data for the track is destaged from cache.

28. The data processing system of claim 26, wherein the processor and cache are a first processor and first cache, wherein a first cluster includes the first processor, the first cache and the second storage device, comprising:

a second cluster, comprising;

(i) a second processor;

(ii) a second cache, wherein the second storage device stores provides backup for data in the second cache; and

(iii) a third storage device for providing backup for data in the first cache.

29. An article of manufacture for use in programming a processor to cache data, wherein the processor is capable of receiving read/write requests from a host system to a first storage device, and wherein the processor is capable of writing data to the first storage device, a cache, and a second storage device, the article of manufacture comprising a computer usable medium including at least one computer program embedded therein that is capable of causing the processor to perform the steps of:

receiving data to modify a track in a first storage device;

storing a copy of the modified data in a cache;

indicating in a second storage device tracks for which there is modified data in cache;

processing the second storage device and data therein during data recovery operations to determine the tracks for which there was modified data in cache; and

marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure is resolved.

30. The article of manufacture of claim 29, wherein the computer program is further capable of causing the processor to perform the step of determining whether the received data is one of sequential data and random data before indicating in the second storage device the tracks having modified data in cache, wherein the step of indicating in the second storage device the tracks having modified data in cache occurs after determining that the received data is sequential data.

31. The article of manufacture of claim 29, wherein the computer program is further capable of causing the processor to perform the step of storing the modified data for the track in the second storage device after determining that the received data is random data.

32. An article of manufacture for use in programming a processor to handle a partial failure in a storage system, wherein the processor is capable of receiving read/write requests from a host system to a first storage device, and wherein the processor is capable of writing data to the first storage device, a cache, and a second storage device, the article of manufacture comprising a computer usable medium including at least one computer program embedded therein that is capable of causing the processor to perform the steps of:

detecting a partial failure within the storage system;

scanning a cache to determine tracks for which there is modified data stored in the cache after detecting the partial failure;

storing in a second storage device information indicating the tracks having modified data in cache;

scheduling the destaging of the modified data from the cache to the first storage device; and

receiving and processing read/write requests directed to the first storage device before all the modified data is destaged from cache.

33. The article of manufacture of claim 32, wherein the computer program is further capable of causing the processor to perform the step of removing the indication in the second storage device that a track has modified data in cache after the modified data is destaged to the track in the first storage device.

34. The article of manufacture of claim 32, wherein the computer program is further capable of causing the processor to perform the steps of:

shutting the storage system down after detecting a second failure;

restarting the storage system after correcting the failure;

processing the second storage device, after restarting the storage system, to determine the tracks for which there was modified data in cache; and

marking the determined tracks as failed to prevent data at the determined tracks in the first storage device from being returned in response to a read request until the failure of the tracks is resolved.