System and method for recovering a storage array

• US 9,990,261 B2
• Filed: 04/29/2016
• Issued: 06/05/2018
• Est. Priority Date: 04/29/2016
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Blount, Joseph, Delaney, William P., Binford, Charles, Moore, Joseph, Sterns, Randolph
• Primary Examiner(s): Schell, Joseph O
• Application Number:
  US15/142,999
• Publication Number:
  US 20170315888A1
• Time in Patent Office: 767 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/2069 Management of state, configuration or failover
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2211/104 Metadata, i.e. metadata associated with RAID systems with parity
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and techniques for recovering a storage array are disclosed. These systems and techniques include determining a size corresponding to a storage stripe of the storage array. Pieces assigned to the storage stripe are identified. A storage configuration corresponding to the pieces assigned to the storage stripe is detected. Ordinal information and parity information are determined corresponding to the pieces assigned to the storage stripe. The size determined corresponding to the storage stripe, identification of the pieces assigned to the storage stripe, the storage configuration, the ordinal information, and the parity information is stored in a data store to reconstruct lost or corrupted metadata corresponding to the storage array.

Claims

1. A method comprising:

determining a size corresponding to a storage stripe by parsing data from an array of physical storage devices that store the storage stripe;

associating pieces with the storage stripe;

parsing the pieces associated with the storage stripe to detect a storage configuration corresponding to the storage stripe and determine ordinal information corresponding to the pieces; and

in response to loss or corruption of metadata describing the storage stripe, reconstructing the metadata based on the determined size corresponding to the storage stripe, the pieces associated with the storage stripe, the detected storage configuration, and the determined ordinal information.

2. The method of claim 1, wherein determining the size corresponding to the storage stripe includes determining a size of a storage stripe piece, the determining of the size of the storage stripe piece comprising:

identifying a contiguous portion of sectors that are associated with a same write sequence number; and

determining a size of the contiguous portion of sectors.

3. The method of claim 1, wherein determining the size corresponding to the storage stripe comprises determining a size of a RAID piece, the determining of the size of the RAID piece comprising:

reading a descriptor of a first sector to identify a data portion that is stored in the first sector that extends to a first offset of another sector; and

reading descriptors corresponding to other sectors to locate a second sector that includes a second portion that begins at a second offset, wherein the second offset is located at an address that immediately follows the first offset.

4. The method of claim 1, wherein associating the pieces with the storage stripe comprises:

creating a data structure that is associated with a storage device included in the array of physical storage devices;

populating the data structure with a write sequence number that is read from a piece of the storage stripe;

performing a matching corresponding to the write sequence number to identify other pieces that include the write sequence number; and

associating each piece that includes the write sequence number with the storage stripe.

5. The method of claim 1, wherein detecting the storage configuration comprises:

reading a plurality of descriptors of sectors corresponding to the pieces associated with the storage stripe to detect indications corresponding to mirroring and parity.

6. The method of claim 1, wherein determining the ordinal information comprises:

reading a descriptor of a first sector to identify a data portion that is stored in the first sector that extends to a first offset of a second sector,

wherein the first sector is a last sector of a first piece that is associated with the storage stripe, and

wherein the second sector is a first sector of a second piece that is associated with the storage stripe; and

reading a descriptor of the second sector to identify that the second sector includes second portion that begins at a second offset, wherein the second offset is located at an address that immediately follows the first offset.

7. The method of claim 1, further comprising:

generating an expected parity corresponding to the pieces associated with the storage stripe; and

matching the expected parity with parity information stored in one or more other pieces that have not been assigned to any storage stripe.

8. The method of claim 1, further comprising:

mapping the storage stripe to a volume, the mapping including reading logical block address (LBA) information from a footer of a piece that is associated with the storage stripe.

9. The method of claim 1, further comprising validating the pieces associated with the storage stripe, the validating including:

generating a parity corresponding to the pieces associated with the storage stripe; and

comparing the generated parity with parity information stored in at least one parity piece associated with the storage stripe.

10. A non-transitory machine readable medium having stored thereon instructions for performing a method comprising machine executable code which when executed by at least one machine, causes the machine to:

determine a size corresponding to a storage stripe by parsing data from an array of physical storage devices that store the storage stripe;

associate pieces with the storage stripe;

parse the pieces associated with the storage stripe to detect a storage configuration corresponding to the storage stripe and determine ordinal information corresponding to the pieces; and

in response to loss or corruption of metadata describing the storage stripe, reconstruct the metadata based on the determined size corresponding to the storage stripe, the pieces associated with the storage stripe, the detected storage configuration, and the determined ordinal information.

11. The non-transitory machine readable medium of claim 10, wherein determining the size corresponding to the storage stripe includes determining a size of a storage stripe piece, the determining of the size of the storage stripe piece comprising:

identifying a contiguous portion of sectors that are associated with a same write sequence number; and

determining a size of the contiguous portion of sectors.

12. The non-transitory machine readable medium of claim 10, wherein determining the size corresponding to the storage stripe comprises determining a size of a RAID piece, the determining of the size of the RAID piece comprising:

reading a descriptor of a first sector to identify a data portion that is stored in a first sector that extends to a first offset of another sector; and

reading descriptors corresponding to other sectors to locate a second sector that includes a second portion that begins at a second offset, wherein the second offset is located at an address that immediately follows the first offset.

13. The non-transitory machine readable medium of claim 10, wherein associating the pieces with the storage stripe comprises:

creating a data structure that is associated with a storage device included in the array of physical storage devices;

populating the data structure with a write sequence number that is read from a piece of the storage stripe;

performing a matching corresponding to the write sequence number to identify other pieces that include the write sequence number; and

associating each piece that includes the write sequence number with the storage stripe.

14. The non-transitory machine readable medium of claim 10, further comprising:

determining a size of a RAID piece by reading a plurality of descriptors of sectors to identify a descriptor that stores a nonconsecutive value, wherein the nonconsecutive value indicates an end of the RAID piece; and

determining ordinal information corresponding to the RAID piece by identifying descriptors of the RAID piece and one or more other RAID pieces that store consecutive values.

15. The non-transitory machine readable medium of claim 10, wherein determining the ordinal information comprises:

reading a descriptor of a first sector to identify a data portion that is stored in the first sector that extends to a first offset of a second sector,

wherein the first sector is a last sector of a first piece that is associated with the storage stripe, and

wherein the second sector is a first sector of a second piece that is associated with the storage stripe; and

reading a descriptor of the second sector to identify that the second sector includes second portion that begins at a second offset, wherein the second offset is located at an address that immediately follows the first offset.

16. A computing device comprising:

a memory containing machine readable medium comprising machine executable code having stored thereon instructions for performing a method of recovering a storage array;

a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to;

determine a size corresponding to a storage stripe by parsing data from an array of physical storage devices that store the storage stripe;

associate pieces with the storage stripe;

parse the pieces associated with the storage stripe to detect a storage configuration corresponding to the storage stripe and determine ordinal information corresponding to the pieces; and

in response to loss or corruption of metadata describing the storage stripe, reconstruct the metadata based on the determined size corresponding to the storage stripe, the pieces associated with the storage stripe, the detected storage configuration, and the determined ordinal information.

18. The computing device of claim 16, wherein determining the size corresponding to the storage stripe comprises determining a size of a RAID piece, the determining of the size of the RAID piece comprising:

reading a descriptor of a first sector to identify a data portion that is stored in a first sector that extends to a first offset of another sector; and

reading descriptors corresponding to other sectors to locate a second sector that includes a second portion that begins at a second offset, wherein the second offset is located at an address that immediately follows the first offset.

19. The computing device of claim 16, wherein associating the pieces with the storage stripe comprises:

creating a data structure that is associated with a storage device included in the array of physical storage devices;

populating the data structure with a write sequence number that is read from a piece of the storage stripe;

performing a matching corresponding to the write sequence number to identify other pieces that include the write sequence number; and

associating each piece that includes the write sequence number with the storage stripe.

20. The computing device of claim 16, wherein determining the ordinal information comprises:

reading a descriptor of a first sector to identify a data portion that is stored in the first sector that extends to a first offset of a second sector,

wherein the first sector is a last sector of a first piece that is associated with the storage stripe, and

wherein the second sector is a first sector of a second piece that is associated with the storage stripe; and

reading a descriptor of the second sector to identify that the second sector includes second portion that begins at a second offset, wherein the second offset is located at an address that immediately follows the first offset.

17. The computing device of 16, wherein determining the size corresponding to the storage stripe includes determining a size of a storage stripe piece, the determining of the size of the storage stripe piece comprising:

identifying a contiguous portion of sectors that are associated with a same write sequence number; and

determining a size of the contiguous portion of sectors.