Checkpointing of metadata into user data area of a content addressable storage system

• US 10,176,046 B1
• Filed: 06/29/2017
• Issued: 01/08/2019
• Est. Priority Date: 06/29/2017
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Hu, Ying, Kucherov, Anton, Schneider, Zvi, Chen, Xiangping, Shvaiger, Felix
• Primary Examiner(s): Bertram, Ryan
• Application Number:
  US15/637,613
• Time in Patent Office: 558 Days
• CPC Class Codes: G06F 11/1407 Checkpointing the instruction stream
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

An apparatus in one embodiment comprises a storage system having a plurality of storage devices and an associated storage controller. The storage devices are configured to provide a metadata area and a user data area, the user data area being separated into pages. The storage controller is configured to initiate generation of one or more checkpoints in the storage system. In conjunction with the generation of a given one of the one or more checkpoints in the storage system, the storage controller causes checkpointed metadata from the metadata area to be stored in the user data area. The storage controller further stores mapping information relating portions of the checkpointed metadata to respective pages of the user data area that store those portions of the checkpointed metadata. The mapping information illustratively comprises page location arrays and array location arrays, and in some embodiments further comprises one or more higher-level location arrays.

Claims

1. An apparatus comprising:

a storage system comprising a plurality of storage devices and an associated storage controller;

the storage devices being configured to provide a metadata area and a user data area, the user data area being separated into pages;

the storage controller being configured to initiate generation of one or more checkpoints in the storage system;

wherein in conjunction with the generation of a given one of the one or more checkpoints in the storage system, the storage controller causes checkpointed metadata from the metadata area to be stored in the user data area;

wherein the storage controller further stores mapping information relating portions of the checkpointed metadata to respective pages of the user data area that store those portions of the checkpointed metadata, the mapping information comprising;

a plurality of page location arrays each having a plurality of entries specifying respective locations of checkpointed metadata pages in the user data area; and

one or more array location arrays each indexed by a corresponding set of page location array identifiers specifying respective locations of page location arrays in the user data area;

wherein the storage controller is implemented using at least one processing device comprising a processor coupled to a memory.

2. The apparatus of claim 1 wherein the mapping information further comprises locations of respective ones of a plurality of the array location arrays in the user data area.

3. The apparatus of claim 2 wherein the locations of the respective ones of the array location arrays are stored in at least one of:

a checkpoint object for the given checkpoint in a system memory of the storage system; and

an additional higher-level location array.

4. The apparatus of claim 1 wherein the storage system comprises a content addressable storage system and wherein the metadata comprises hash metadata providing a mapping between content-based digests of respective pages of the user data and corresponding physical locations of the respective pages of the user data in the user data area.

5. The apparatus of claim 1 wherein the storage devices comprise respective non-volatile memory devices.

6. The apparatus of claim 1 wherein the storage system comprises a clustered storage system having a plurality of storage nodes each having a plurality of storage devices.

7. The apparatus of claim 6 wherein the storage controller is implemented in a distributed manner so as to comprise a plurality of distributed storage controller components implemented on respective ones of the storage nodes of the clustered storage system.

8. The apparatus of claim 1 wherein the metadata is stored in the metadata area in a plurality of entries corresponding to respective buckets each comprising multiple cache lines.

9. The apparatus of claim 1 wherein the storage controller is configured:

to scan metadata entries of the metadata area;

for a given such entry, to identify an associated page identifier;

if the page corresponding to the page identifier has not already been checkpointed to the user data area, to determine all metadata entries associated with that page and to checkpoint the page to the user data area;

to store the page location in one of the page location arrays in order of page identifier; and

to repeat until all metadata entries of the metadata area are checkpointed.

10. The apparatus of claim 9 wherein the storage controller is configured:

for a given one of the page location arrays, to store its location and associated page location array identifier in one of the array location arrays in order of page location array identifier; and

to repeat until all of the page location arrays are indexed in the array location arrays.

11. The apparatus of claim 10 wherein the storage controller is configured:

for a given one of the array location arrays, to store its location and an associated array location array identifier in at least one of a checkpoint object for the given checkpoint and a higher-level location array; and

to repeat until all of the array location arrays are indexed in at least one of the checkpoint object and the higher-level location array.

12. The apparatus of claim 1 wherein in conjunction with recovery from the checkpoint in the storage system, the storage controller causes the checkpointed metadata to be retrieved from the user data area.

13. The apparatus of claim 12 wherein the system controller is configured:

to obtain the locations of the array location arrays from at least one of a checkpoint object for the given checkpoint and a higher-level location array;

for a given load request for a particular checkpointed metadata entry, if the particular checkpointed metadata entry has not already been loaded, to obtain its associated array location array, to determine from the array location array the location of its corresponding page location array, to determine from the page location array the location of its corresponding page, and to load that page to obtain the particular checkpointed metadata entry.

14. The apparatus of claim 1 wherein the pages of the user data area have a fixed size on the order of kilobytes that is multiple orders of magnitude less than a size of the checkpointed metadata which is on the order of gigabytes.

15. A method comprising:

configuring storage devices of a storage system to provide a metadata area and a user data area, the user data area being separated into pages;

initiating generation of one or more checkpoints in the storage system; and

in conjunction with the generation of a given one of the one or more checkpoints in the storage system;

storing checkpointed metadata from the metadata area in the user data area; and

storing mapping information relating portions of the checkpointed metadata to respective pages of the user data area that store those portions of the checkpointed metadata, the mapping information comprising;

a plurality of page location arrays each having a plurality of entries specifying respective locations of checkpointed metadata pages in the user data area; and

one or more array location arrays each indexed by a corresponding set of page location array identifiers specifying respective locations of page location arrays in the user data area;

wherein the method is implemented by at least one processing device comprising a processor coupled to a memory.

16. The method of claim 15 wherein the mapping information further comprises locations of respective ones of a plurality of the array location arrays in the user data area and wherein the locations of the respective ones of the array location arrays are stored in at least one of a checkpoint object for the given checkpoint and a higher-level location array.

17. The method of claim 15 wherein the storage system comprises a content addressable storage system and wherein the metadata comprises hash metadata providing a mapping between content-based digests of respective pages of the user data and corresponding physical locations of the respective pages of the user data in the user data area.

18. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes said at least one processing device:

to configure storage devices of a storage system to provide a metadata area and a user data area, the user data area being separated into pages;

to initiate generation of one or more checkpoints in the storage system; and

in conjunction with the generation of a given one of the one or more checkpoints in the storage system;

to store checkpointed metadata from the metadata area in the user data area; and

to store mapping information relating portions of the checkpointed metadata to respective pages of the user data area that store those portions of the checkpointed metadata, the mapping information comprising;

a plurality of page location arrays each having a plurality of entries specifying respective locations of checkpointed metadata pages in the user data area; and

one or more array location arrays each indexed by a corresponding set of page location array identifiers specifying respective locations of page location arrays in the user data area.

19. The computer program product of claim 18 wherein the mapping information further comprises locations of respective ones of a plurality of the array location arrays in the user data area and wherein the locations of the respective ones of the array location arrays are stored in at least one of a checkpoint object for the given checkpoint and a higher-level location array.

20. The computer program product of claim 18 wherein the storage system comprises a content addressable storage system and wherein the metadata comprises hash metadata providing a mapping between content-based digests of respective pages of the user data and corresponding physical locations of the respective pages of the user data in the user data area.