Storage zone set membership

• US 10,379,742 B2
• Filed: 12/28/2015
• Issued: 08/13/2019
• Est. Priority Date: 12/28/2015
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Smith, Maxim Gerard, Haskins, Jr., John William, Slik, David Anthony, Smith, Keith Arnold
• Primary Examiner(s): Perez-Velez, Rocio Del Mar
• Application Number:
  US14/979,873
• Publication Number:
  US 20170185312A1
• Time in Patent Office: 1,324 Days
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G11B 20/1217 on discs
• CPC Class Codes: G11B 2020/1242 the area forming one or more zones, wherein each zone is shaped like an annulus or a circular sector
• CPC Class Codes: G11B 2020/1292 Enhancement of the total storage capacity

Abstract

A storage system writes an object across zones of a set of zones (“zone set”). Each zone of a zone set is contributed from an independently accessible storage medium. To create a zone set, the storage system arbitrarily selects disks to contribute a zone for membership in the zone set. This results in a fairly even distribution of zone sets throughout the storage system, which increases fault tolerance of the storage system. Although disk selection for zone set membership is arbitrary, the arbitrary selection can be from a pool of disks that satisfy one or more criteria (e.g., health or activity based criteria). In addition, weights can be assigned to disks to influence the arbitrary selection. Although manipulating the arbitrary selection with weights or by reducing the pool of disks reduces the arbitrariness, this evenly distributes zone sets while accounting for client demand and/or disk health.

Claims

1. A method comprising:

determining whether a predetermined number of storage devices in a storage system have a zone available for writing, wherein the predetermined number corresponds to a protection scheme of the storage system, wherein the zone is associated with a zone identifier;

in response to determining that the predetermined number of storage devices have the available zone,

selecting at random a set of storage devices from the storage devices, wherein a number of the set of storage devices is at least equal to the predetermined number; and

creating a set of zones from available zones of the set of storage devices, wherein a first zone of the zone set is skipped over from a prior zone set creation, wherein a subset of the zones of the zone set is associated with a same zone identifier, and wherein the subset of zones and the first zone are associated with different zone identifiers.

2. The method of claim 1, wherein a service level criterion is based on health information of the set of storage devices.

3. The method of claim 1, wherein creating the zone set further comprises storing metadata that (i) identifies the zone set, (ii) indicates the different zone identifiers of the zones of the zone set, and (iii) identifies the set of storage devices.

4. The method of claim 1 further comprising maintaining metadata that indicates availability of the available zones across the storage system based on information collected from the storage devices.

5. The method of claim 4, wherein maintaining data that indicates availability of the available zones across the storage system further comprises maintaining a bit array for each zone identifier in the storage system, wherein the bit array includes an entry for each storage device in the storage system.

6. The method of claim 4, wherein selecting the first set of storage devices further comprises:

scanning the metadata to determine that the first zone was skipped over from the prior zone set creation.

7. The method of claim 1 further comprising writing data fragments of an object to the zone set, wherein each of the data fragments is written into a different one of the zones of the zone set.

18. The method of claim 1, wherein the storage devices include zones physically restricted from random writing.

19. The method of claim 1 wherein the first zone is included on a first storage device of the set of storage devices having a failed zone associated with the same zone identifier that is associated with the subset of zones of the zone set.

8. A non-transitory machine-readable storage medium having program code for creating a set of zones of a plurality of storage devices, the program code comprising instructions to:

determine whether a predetermined number of the plurality of storage devices have a zone available for writing, wherein the predetermined number corresponds to a protection scheme of the plurality of storage devices, wherein the zone is associated with a zone identifier;

in response to determining that there is a predetermined number of the storage devices having a zone available for writing,

select at random a set of storage devices from the plurality of storage devices, wherein a number of the set of storage devices is at least equal to the predetermined number; and

create a set of zones from available zones of the set of storage devices, wherein a first zone of the zone set is skipped over from a prior zone set creation, wherein a subset of the zones of the zone set is associated with a same zone identifier, and wherein the subset of zones and the first zone are associated with different zone identifiers.

9. The non-transitory machine-readable storage medium of claim 8, wherein the selected storage devices satisfy a service level criterion of the first set of storage devices.

10. The non-transitory machine-readable storage medium of claim 8, wherein the instructions to create the zone set further comprise instructions to store metadata that (i) identifies the zone set, (ii) indicates the different zone identifiers for the zones of the zone set, and (iii) identifies the set of storage devices.

11. The non-transitory machine-readable storage medium of claim 8, wherein the program code further comprises instructions to maintain metadata that indicates availability of the available zones across the plurality of storage devices based on information collected from the plurality of storage devices.

12. The non-transitory machine-readable storage medium of claim 11, wherein the instructions to maintain data that indicates availability of the available zones across the plurality of storage devices further comprise instructions to maintain a bit array for each zone identifier of the storage devices, wherein each bit array includes an entry for each of the plurality of storage devices.

13. The non-transitory machine-readable storage medium of claim 11, wherein the instructions to select the first set of storage devices further comprise instructions to:

scan the metadata to determine that the first zone was skipped over from the prior zone set creation.

14. The non-transitory machine-readable storage medium of claim 8, wherein the program code further comprises instructions to write data fragments of an object to the zone set, wherein each of the data fragments is written into a different one of the zones of the zone set.

20. The non-transitory machine-readable storage media of claim 8, wherein the first zone is included on a first storage device of the set of storage devices having a failed zone associated with the same zone identifier that is associated with the subset of zones of the zone set.

15. An apparatus comprising:

a processor coupled to a plurality of storage devices; and

a machine-readable medium having program code executable by the processor to cause the apparatus to,

determine whether a predetermined number of the storage devices have a zone available for writing, wherein the predetermined number corresponds to a protection scheme of the storage devices, wherein the zone is associated with a zone identifier;

in response to determining that there is a predetermined number of storage devices having a zone available for writing,

select at random a set of storage devices from the storage devices, wherein a number of the set of storage devices is at least equal to the predetermined number; and

create a set of zones from available zones of the set of storage devices, wherein a first zone of the zone set is skipped over from a prior zone set creation, wherein a subset of the zones of the zone set is associated with a same zone identifier, and wherein the subset of zones and the first zone are associated with different zone identifiers.

16. The apparatus of claim 15, wherein the first zone is included on a first storage device having a failed zone associated with the same zone identifier that is associated with the subset of zones of the zone set.

17. The apparatus of claim 15, wherein the storage devices include zones physically restricted from random writing.