Scalable non-uniform storage sizes

• US 9,367,243 B1
• Filed: 06/04/2014
• Issued: 06/14/2016
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Hayes, John, Colgrove, John, Lee, Robert, Robinson, Joshua, Vajgel, Peter, Davis, John, Botes, Par
• Primary Examiner(s): Elmore, Stephen
• Application Number:
  US14/296,167
• Time in Patent Office: 741 Days
• Field of Search: 711/103, 711/154, 711/156, 711/158, 711/170, 713/340, 714/6.2, 714/6.24, 714/6.32, 365/185.33
• US Class Current: 1/1
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

A plurality of storage nodes in a single chassis is provided. Each of the plurality of storage nodes has a storage capacity with nonvolatile solid-state memory for user data storage. The plurality of storage nodes is configured to support uniform storage capacities and non-uniform storage capacities among the plurality of storage nodes, as a storage cluster. The plurality of storage nodes is configured to distribute the user data and metadata throughout the plurality of storage nodes such that the plurality of storage nodes can read the user data, using erasure coding, despite loss of two of the plurality of storage nodes.

Claims

1. A plurality of storage nodes in a single chassis, comprising:

each of the plurality of storage nodes having a storage capacity with nonvolatile solid-state memory for user data storage;

the plurality of storage nodes configured to support uniform storage capacities and non-uniform storage capacities among the plurality of storage nodes, as a storage cluster; and

the plurality of storage nodes configured to distribute the user data and metadata throughout the plurality of storage nodes such that the plurality of storage nodes can read the user data, using erasure coding, despite loss of two of the plurality of storage nodes.

2. The plurality of storage nodes of claim 1, wherein the solid-state memory of each of the plurality of storage nodes includes flash memory.

3. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configured so that the plurality of storage nodes uses all of the storage capacities among the plurality of storage nodes via the erasure coding.

4. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configured to cooperate with others of the plurality of storage nodes in response to an addition of a further storage node, as to an erasure coding scheme that conforms to a storage capacity of the further storage node.

5. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configured to determine a data stripe width in accordance with an erasure coding scheme and configured to write the user data to the plurality of storage nodes in support of the uniform storage capacities and the non-uniform storage capacities.

6. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configured to choose an erasure coding scheme independent of a choice of an erasure coding scheme by others of the plurality of storage nodes.

7. The plurality of storage nodes of claim 1, wherein the erasure coding includes a plurality of RAID (redundant array of independent disks) schemes or a plurality of data stripe schemes.

8. A storage cluster, comprising:

a plurality of storage nodes within a single chassis;

each of the plurality of storage nodes having nonvolatile solid-state memory for storage of user data;

each of the plurality of storage nodes configured to cooperate with others of the plurality of storage nodes having differing storage capacities in applying erasure coding; and

the plurality of storage nodes configured to distribute the user data and metadata throughout the plurality of storage nodes such that the plurality of storage nodes can access the user data, via the erasure coding, with a failure of two of the plurality of storage nodes.

9. The storage cluster of claim 8, further comprising:

each of the plurality of storage nodes configured to select an erasure coding scheme with which to stripe data.

10. The storage cluster of claim 8, further comprising:

each storage node of the plurality of storage nodes configured to broadcast a storage capacity of the storage node; and

each storage node of the plurality of storage nodes configured to determine how to stripe data, based on storage capacities of the plurality of storage nodes.

11. The storage cluster of claim 8, further comprising:

each storage node of the plurality of storage nodes configured to create data stripes, according to an erasure coding scheme, that overlap differing subsets of the plurality of storage nodes.

12. The storage cluster of claim 8, further comprising:

each storage node of the plurality of storage nodes configured to create data stripes, according to an erasure coding scheme, that overlap ones of the plurality of storage nodes having differing storage capacities.

13. The storage cluster of claim 8, wherein ability of the plurality of storage nodes to self-configure upon introduction of a storage node, in combination with the each of the plurality of storage nodes configured to cooperate with others of the plurality of storage nodes having differing storage capacities, supports a non-disruptive upgrade.

14. The storage cluster of claim 8, further comprising:

each of the plurality of storage nodes configured to cooperate in configuration of the storage cluster as to data striping, responsive to addition of a storage node to the storage cluster.

15. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory, comprising:

distributing the user data throughout the plurality of storage nodes through erasure coding, wherein the plurality of storage nodes are housed within a single chassis that couples the storage nodes as a storage cluster, and wherein the plurality of storage nodes are configured to accommodate uniform and non-uniform storage capacities of the storage nodes;

determining that two of the plurality of storage nodes are unreachable; and

accessing the user data, via the erasure coding, from a remainder of the plurality of storage nodes, wherein a processor performs at least one step of the method.

16. The method of claim 15, further comprising:

adding a storage node, having a storage capacity differing from at least one of the plurality of storage nodes, to the storage cluster;

configuring the plurality of storage nodes, with the added storage node, to a second erasure coding scheme differing from a first erasure coding scheme held by the plurality of storage nodes prior to inclusion of the added storage node.

17. The method of claim 15, further comprising:

reading the user data in the plurality of storage nodes according to a first erasure coding scheme;

writing the user data to the plurality of storage nodes, including at least one storage node with a differing storage capacity, according to a second erasure coding scheme.

18. The method of claim 15, further comprising:

determining an erasure coding scheme based upon available resources of the storage cluster and making use of non-uniform storage capacity among the plurality of storage nodes, wherein the determining is performed by one of the plurality of storage nodes.

19. The method of claim 15, further comprising:

replacing a first storage node, having a first storage capacity, with a second storage node, having a second, differing storage capacity; and

configuring the plurality of storage nodes, with the second storage node, to a second erasure coding scheme differing from a first erasure coding scheme used by the first storage node, wherein the configuring is initiated by the plurality of storage nodes in response to replacing the first storage node.

20. The method of claim 15, further comprising:

adding a storage node to the storage cluster, the storage node having a differing storage capacity from one of the plurality of storage nodes;

recovering the user data from the remainder of the plurality of storage nodes; and

writing the user data to the remainder of the plurality of storage nodes plus the added storage node.