Techniques for using flash-based memory in recovery processing

• US 8,296,534 B1
• Filed: 06/29/2007
• Issued: 10/23/2012
• Est. Priority Date: 06/29/2007
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Gupta, Uday K., Hopkins, Charles H., Evans, Michael B.
• Primary Examiner(s): Peugh, Brian R.
• Assistant Examiner(s): Simonetti, Nicholas
• Application Number:
  US11/824,485
• Time in Patent Office: 1,943 Days
• Field of Search: 711/103, 711/113, 711/118, 711/135, 711/129, 710/57
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1441 Resetting or repowering
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 12/0804 with main memory updating G06F12/0806 takes precedence
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/0891 using clearing, invalidating or resetting means
• CPC Class Codes: G06F 2212/214 Solid state disk
• CPC Class Codes: G06F 2212/7202 Allocation control and policies
• CPC Class Codes: G06F 2212/7204 Capacity control, e.g. partitioning, end-of-life degradation

Abstract

Described are techniques for performing recovery processing in a data storage system. A providing a flash-based memory is provided with includes cached write data that has not been destaged to a data storage device. It is determined whether said flash-based memory has a threshold amount of storage available thereon. If the flash-based memory does not have the threshold amount of storage available thereon, portions of the cache write data are destaged until said flash-based memory has a threshold amount of storage available thereon. Received data requests are processed in accordance with a first policy different from a second policy used in connection with processing received data requests if said flash-based memory has a threshold amount of storage available thereon.

Claims

1. A method of performing recovery processing in a data storage system, the method comprising:

providing a flash-based memory including cached write data of write operations that has not been destaged to a non-volatile data storage device to which the write operations are directed;

determining whether a vault operation event has occurred to cause a transition from a normal processing mode to a vault operation processing mode, wherein, in the normal processing mode, the cached write data, on the flash-based memory is stored in a first area of the flash-based memory and not in a second area of the flash-based memory, and wherein, in said vault operation processing mode, said cached write data on the flash-based memory is stored in the first area and in the second area of the flash-based memory, wherein, upon transitioning to the vault operation processing mode, performing processing including;

determining whether said flash-based memory has a threshold amount of storage available thereon, and, if said flash-based memory does not have the threshold amount of storage available thereon, destaging portions of the cached write data until said flash-based memory has the threshold amount of storage available thereon, wherein said destaging destages the cached write data of the flash-based memory to the non-volatile data storage device to which the write operations are directed in accordance with an ordering of the first area and second area and said ordering indicates to destage cached write data from one of said first area and said second area prior to destaging cached write data from another of said first area and said second area; and

processing received data requests in accordance with a first policy different from a second policy used in connection with processing received data requests in the normal processing mode; and

determining whether to resume the normal processing mode, wherein, upon resuming the normal processing mode, processing received data requests according to the second policy, wherein the second policy indicates performing write request processing for a write request, said write request processing including caching data of the write request in a first portion of volatile memory and copying the data of the write request from the first portion of volatile memory to the first area, wherein said write request processing does not store data of write requests in the second area and wherein the first portion of volatile memory is designated as free and made available for another use once the data of the first portion has been copied to the first area.

2. The method of claim 1, wherein the data storage system utilizes a write back caching technique, and the first policy indicates that read requests are processed and that no write requests are processed.

3. The method of claim 1, wherein the data storage system utilizes a write back caching technique, and the first policy indicates that read requests and write requests are processed, and that data from write requests are stored to the non-volatile data storage device to which the write requests are directed without caching the data.

4. The method of claim 1, wherein the write request processing includes copying the data from the write request from the first area of the flash-based memory to the non-volatile data storage device to which the write request is directed.

5. The method of claim 4, wherein data from a write request stored in the first portion of the volatile memory is copied to the first area of the flash-based memory using a background process.

6. The method of claim 5, wherein the background process copies data from the volatile memory to the flash-based memory if there is a threshold amount of storage on the flash-based memory.

7. The method of claim 1, further comprising:

disconnecting the flash-based memory from a first data storage system; and

connecting the flash-based memory to the data storage system.

17. The method of claim 1, wherein the first area is used as a write cache and the second area is used as a vault area to which cached write data of said volatile memory, cache is stored upon the occurrence of the vault operation event, wherein said ordering indicates that the first area is destaged prior to said second area.

18. The method of claim 1, wherein the first area is used as a write cache and the second area is used as a vault area to which cached write data of said volatile memory cache is stored upon the occurrence of the vault operation event, wherein said ordering indicates that the second area is destaged prior to said first area.

8. A method of performing recovery processing in a data storage system having a plurality of storage processors, the method comprising:

providing, for each of said plurality of storage processors, a flash-based memory including cached write data of write operations that has not been destaged to a non-volatile data storage device to which the write operations are directed;

determining whether, a vault operation event has occurred to cause a transition from a normal processing mode to a vault operation processing mode, wherein, in the normal processing mode, the cached write data on the flash-based memory is stored in a first area flash-based memory and not in a second area of the flash-based memory, and wherein, in the vault operation mode, said cached write data on the flash-based memory is stored in the first area and the second area of the flash-based memory, wherein, upon transition to the vault operation processing mode, performing processing including;

determining whether each of said plurality of storage processors has a same copy of cached write data included in said flash-based memory;

if each of said plurality of storage processors does not have the same copy, then performing processing including;

determining, from a first of the plurality of storage processors, a most current copy of cached write data as stored on the flash-based memory of each of said plurality of storage processors; and

,

restoring the most current copy of the cached write data from said first storage processor to others of said plurality of storage processors;

for each of said plurality of storage processors, if the flash-based memory of said each storage processor does not have a threshold amount of storage available thereon, for said each storage processor, destaging portions of the cached write data until said flash-based memory has the threshold amount of storage available thereon, wherein said destaging destages cached write data of the flash-based memory to the non-volatile data storage device to which the write operations are directed in accordance with an ordering of the first, area and second area and said ordering indicates to destage cached write data from one of said first area and said second area prior to destaging cached write data from another of said first area and said second area; and

processing received data requests in accordance with a first policy different from a second policy used in connection with processing received data requests in the normal processing mode; and

determining whether to resume the normal processing mode, wherein, upon resuming the normal processing mode, processing received data requests according to the second policy, wherein the second policy indicates performing write request processing for a write request, said write request processing including caching data of the write request in a first portion of volatile memory and copying the data of the write request from the first portion of volatile memory to the first area, wherein said write request processing does not store data of write requests in the second area and wherein the first portion of volatile memory is designated as free and made available for another use once the data of the first portion has been copied to the first area.

9. The method of claim 8, wherein said step of destaging first destages cached write data included in the first area of said flash-based memory prior to destaging other cached write data on the flash-based memory, and wherein the write request processing further comprises destaging said cached write data from said first area to the non-volatile data storage device.

10. A method of performing recovery processing in a data storage system, the method comprising:

providing a flash-based memory including cached write data that has not been destaged to a data storage device, said flash-based memory including a first area used as a write cache and a second area used as a vault area to which cached write data in a volatile memory cache of the data storage system is stored upon the occurrence of a vault operation event causing a transition from a normal processing mode to a vault operation processing mode, wherein said vault operation event indicates failure of a power source of the data storage system, wherein, in the normal processing mode, the cached write data on the flash-based memory is stored in the first area of the flash-based memory and not in the second area of the flash-based memory, and wherein, in said vault operation processing mode, said cached write data on the flash-based memory is stored in the first area and in the second area of the flash-haled memory;

determining whether the vault operation event has occurred to cause the transition to the vault operation processing mode, wherein, upon transitioning to the vault operation processing mode, performing processing including;

copying cached write data from said volatile memory cache to said second area of the flash-based memory;

determining whether said flash-based memory has a threshold amount of storage available thereon, and, if said flash-based memory does not have the threshold amount of storage available thereon, destaging portions of the cached write data from the flash-based memory to the data storage device until said flash-based memory has the threshold amount of storage available thereon; and

processing received data requests in accordance with a first policy different from a second policy used in connection with processing received data requests in the normal processing mode; and

determining whether to resume the normal processing mode, wherein, upon resuming the normal processing mode, processing subsequently received write data in accordance with the second policy using said first area as a write cache and said second area as a vault area, said processing in accordance with the second policy including caching the subsequently received write data in the volatile memory cache, copying the subsequently received write data from the volatile memory cache to said first area and not the second area, and destaging the subsequently received write data to the device.

11. The method of claim 10, wherein an acknowledgement is sent to a host sending said subsequently received write data after said subsequently received write data is stored in said volatile memory cache by said caching step.

12. The method of claim 10, wherein said data storage system includes two or more data storage system processors, each of said two or more data storage system processors having its own volatile memory cache and wherein said acknowledgement is sent after said received write data is mirrored in the volatile memory cache of each of said two or more data storage systems processors.

13. The method of claim 10, wherein said data storage system includes a plurality of storage processors, the flash-based memory including a set of cached write data that has not been destaged to a data storage device for each of said plurality of storage processors, and the method further comprising:

determining whether each of said plurality of storage processors has a same copy of cached write data included said flash-based memory;

if each of said plurality of storage processors does not have the same copy, then performing processing including;

determining, from a first of the plurality of storage processors, a most current copy of cached write data as stored on the flash-based memory of each of said plurality of storage processors; and

restoring the most current copy of the cached write data from said first storage processor to others of said plurality of storage processors.

14. The method of claim 10, further comprising:

after resuming the normal processing mode, copying the cached write data from said second area to said volatile memory cache.

15. The method of claim 10, wherein said second area contains no write cache data used during said normal processing.

16. The method of claim 14,

wherein, prior to occurrence of the vault operation event, said volatile memory cache comprises one or more tables including information regarding which portions of the volatile memory cache contain cached write data to be moved to the first area and information regarding which portions of the flash-based memory contain cached write data to be destaged, wherein said one or more tables are stored in the volatile memory cache prior to occurrence of the vault operation event and, upon occurrence of the vault operation event, the one or more tables are updated as data is copied from the volatile memory area, the one or more tables are copied to the second area, and the one or more tables are restored to the volatile memory cache in said copying after resuming the normal processing mode.