Scalable non-uniform storage sizes

• US 9,798,477 B2
• Filed: 06/13/2016
• Issued: 10/24/2017
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Botes, Par, Colgrove, John, Davis, John, Hayes, John, Lee, Robert, Robinson, Joshua, Vajgel, Peter
• Primary Examiner(s): ELMORE, STEPHEN C
• Application Number:
  US15/180,787
• Publication Number:
  US 20160299707A1
• Time in Patent Office: 498 Days
• Field of Search: 711103, 711154, 711156, 711158, 711170, 711114, 713340, 714 62, 714 624, 714 632, 36518533
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

A plurality of storage nodes cooperating as a storage cluster is provided. Each of the plurality of storage nodes has storage memory. Each storage node of the plurality of storage nodes is configurable to direct erasure coded striping of data of one of an Mode or data segment across the plurality of storage nodes of the storage cluster, with at least one storage node of the plurality of storage nodes having a differing amount of storage capacity of the storage memory from an amount of storage capacity of another storage node in the plurality of storage nodes. A method of storing data in a storage cluster is also provided.

Claims

1. A storage cluster, comprising:

a plurality of storage nodes cooperating as the storage cluster, each of the plurality of storage nodes having storage memory; and

each storage node of the plurality of storage nodes is configurable to direct erasure coded striping of data of one of an inode or data segment across the plurality of storage nodes of the storage cluster, with at least one storage node of the plurality of storage nodes having a differing amount of storage capacity of the storage memory from an amount of storage capacity of another storage node in the plurality of storage nodes.

2. The storage cluster of claim 1, wherein the at least one storage node having a differing amount of storage capacity comprises:

a first one of the plurality of storage nodes having a greater number of storage units having storage memory than a second one of the plurality of storage nodes.

3. The storage cluster of claim 1, wherein the at least one storage node having a differing amount of storage capacity comprises:

a first one of the plurality of storage nodes having one or more storage units each with a greater amount of storage memory than at least one storage unit in a second one of the plurality of storage nodes.

4. The storage cluster of claim 1, wherein each storage node of the plurality of storage nodes is configurable to direct the erasure coded striping of data across the plurality of storage nodes comprises:

each storage node of the plurality of storage nodes is configurable to direct data striping across one or more higher capacity storage nodes and one or more lower capacity storage nodes.

5. The storage cluster of claim 1, wherein each storage node of the plurality of storage nodes is configurable to direct the erasure coded striping of data across the plurality of storage nodes comprises:

each storage node of the plurality of storage nodes is configurable to direct data striping of a wider data stripe across a greater number of storage nodes and a narrower data stripe across a lesser number of storage nodes, with the greater number of storage nodes and the lesser number of storage nodes including the at least one storage node having the differing amount of storage capacity.

6. The storage cluster of claim 1, wherein each storage node of the plurality of storage nodes is configurable to direct the erasure coded striping of data across the plurality of storage nodes comprises:

the plurality of storage nodes configurable to direct data stripes of differing sizes across the plurality of storage nodes including the at least one storage node having the differing amount of storage capacity.

7. The storage cluster of claim 1, wherein each storage node of the plurality of storage nodes is configurable to direct the erasure coded striping of data across the plurality of storage nodes comprises:

the plurality of storage nodes configurable to determine data striping schemes that maximize use of available storage capacity including the differing amount of storage capacity of the at least one storage node.

8. A method of storing data in a storage cluster, comprising:

determining, at a first storage node of the storage cluster, that a second storage node of the storage cluster has ownership of data of an inode or a data segment; and

directing, by the second storage node, erasure coded striping of the data of the inode or data segment across the plurality of storage nodes, with at least one of the plurality of storage nodes having a differing storage capacity relative to another storage node of the of the plurality of storage nodes.

9. The method of claim 8, wherein the directing the erasure coded striping across the plurality of storage nodes comprises:

directing the erasure coded striping across at least a first storage node that includes a greater number of storage units having storage memory and a second storage node that includes a lesser number of storage units having storage memory.

10. The method of claim 8, wherein the directing the erasure coded striping across the plurality of storage nodes comprises:

directing the erasure coded striping across at least one storage node having a storage unit with a greater amount of storage memory and at least one storage node having a storage unit with a lesser amount of storage memory.

11. The method of claim 8, wherein the directing the erasure coded striping across the plurality of storage nodes comprises:

directing a data stripe across at least one higher capacity storage node and at least one lower capacity storage node.

12. The method of claim 8, wherein the directing the erasure coded striping across the plurality of storage nodes comprises:

directing a wider data stripe across a greater number of storage nodes; and

directing a narrower data stripe across a lesser number of storage nodes, with the greater number of storage nodes and the lesser number of storage nodes including a storage node having a first storage capacity and a further storage node having a second, differing storage capacity.

13. The method of claim 8, wherein the directing the erasure coded striping across the plurality of storage nodes comprises:

directing a data stripe of a first size across the plurality of storage nodes having the differing amount of storage capacity; and

directing a data stripe of a second, differing size across the plurality of storage nodes having the differing amount of storage capacity.

14. The method of claim 8, further comprising:

determining one or more data striping schemes to maximize use of available storage capacity across the plurality of storage nodes having the differing amount of storage capacity.