Automatically reconfiguring a storage memory topology

• US 9,959,170 B2
• Filed: 03/31/2017
• Issued: 05/01/2018
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Hayes, John, Colgrove, John, Lee, Robert, Ostrovsky, Igor, Robinson, Joshua, Vajgel, Peter
• Primary Examiner(s): Bansal, Gurtej
• Application Number:
  US15/476,331
• Publication Number:
  US 20170206136A1
• Time in Patent Office: 396 Days
• CPC Class Codes: G06F 11/1004 to protect a block of data words, e.g. CRC or checksum G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 12/0238 Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 2211/1004 Adaptive RAID, i.e. RAID system adapts to changing circumstances, e.g. RAID1 becomes RAID5 as disks fill up
• CPC Class Codes: G06F 2212/7208 Multiple device management, e.g. distributing data over multiple flash devices
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0629 Configuration or reconfiguration of storage systems
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

A storage cluster is provided. The storage cluster includes a plurality of storage nodes within a single chassis. Each of the plurality of storage nodes has nonvolatile solid-state memory for storage of user data. The plurality of storage nodes are configured to distribute the user data and metadata throughout the plurality of storage nodes with erasure coding of the user data such that the plurality of storage nodes can access the user data, via the erasure coding, with a failure of two of the plurality of storage nodes. The plurality of storage nodes are configured to employ the erasure coding to reconfigure redundancy of the user data responsive to one of adding or removing a storage node.

Claims

1. A plurality of storage nodes, comprising:

the plurality of storage nodes configured to communicate together as a storage cluster, each storage node of the plurality of storage nodes having a controller and having one or more authorities each transferable to another storage node in the storage cluster;

the controller and each of the one or more authorities for each of the plurality of storage nodes configured to select one of a plurality of redundancy schemes independent of each other such authority of the plurality of storage nodes and to distribute the user data in accordance with the selected redundancy scheme, and metadata, throughout the plurality of storage nodes; and

the plurality of storage nodes configured such that adding or removing a storage node triggers the plurality of storage nodes to reconfigure redundancy of the user data in the plurality of storage nodes.

2. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured such that the plurality of storage nodes read the user data, using erasure coding, despite loss of two of the plurality of storage nodes.

3. The plurality of storage nodes of claim 1, wherein the storage cluster has solid-state memory that includes flash.

4. The plurality of storage nodes of claim 1, wherein the user data and metadata are distributed using erasure coding, the erasure coding is in accordance with a first data striping scheme and wherein the reconfigured redundancy of the user data is in accordance with a second data striping scheme.

5. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured such that a storage overhead decreases, as a relative amount of a total storage capacity of the storage cluster, for increasing numbers of storage nodes, as a result of differing data striping schemes configured by the plurality of storage nodes.

6. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured to apply differing data striping schemes in successive data accesses.

7. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configured to select a data stripe width based upon storage capacity of the storage cluster.

8. A storage cluster, comprising:

a plurality of storage nodes;

each of the plurality of storage nodes having a controller and at least one authority that is transferable to another one of the plurality of storage nodes, each controller coupled to each other through an interconnect;

the controller and each such authority of each of the plurality of storage nodes configured to decide, independent of each other such authority of the plurality of storage nodes, which of a plurality of redundancy schemes to apply to distribute the user data and metadata throughout the plurality of storage nodes; and

the plurality of storage nodes configured to employ erasure coding to reconfigure redundancy of the user data responsive to one of adding or removing a storage node.

9. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured to accommodate differing redundant array of independent disks (RAID) schemes coexisting in the plurality of storage nodes.

10. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured to change a data striping scheme from two replicated copies to N plus 2 redundancy.

11. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured such that storage overhead, relative to total storage of the storage cluster, decreases, and storage efficiency increases, as storage nodes are added to the storage cluster.

12. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured to reconfigure storage overhead responsive to a storage cluster membership change.

13. The storage cluster of claim 8, further comprising:

each of the plurality of storage nodes configured to self-configure as to data striping scheme based upon membership in the storage cluster of others of the plurality of storage nodes.

14. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured such that differing portions of the user data have differing levels of redundancy in the plurality of storage nodes.

15. A method for accessing user data in a plurality of storage nodes of a storage cluster having nonvolatile solid-state memory, comprising:

distributing the user data throughout the plurality of storage nodes through erasure coding, wherein each of a plurality of authorities of the plurality of storage nodes is configured to, independent of each other of the plurality of storage nodes, select which of a plurality of redundancy schemes to use when a storage node distributes a portion of the user data throughout the plurality of storage nodes, and each of the plurality of authorities is transferable from one storage node to another storage node in the storage cluster;

changing membership of the plurality of storage nodes; and

reconfiguring redundancy of the user data in the plurality of storage nodes, by at least one of the plurality of authorities, responsive to the changing membership.

16. The method of claim 15, further comprising:

compressing the user data in the plurality of storage nodes.

17. The method of claim 15, further comprising:

reconstructing the user data from a first data striping scheme to a second data striping scheme.

18. The method of claim 15, further comprising:

writing second data into the plurality of storage nodes according to a second data striping scheme, wherein the user data, as first data, remains in the storage cluster according to a first data striping scheme.

19. The method of claim 15, further comprising:

selecting, by one of the plurality of storage nodes, a first redundant array of independent disks (RAID) level as erasure coding of the user data; and

selecting, by a differing one of the plurality of storage nodes, a second RAID level as the reconfigured redundancy of the user data.

20. The method of claim 15, wherein:

changing the membership of the plurality of storage nodes includes one of adding a storage node to the storage cluster or removing a storage node from the storage cluster; and

the erasure coding and the redundancy include two or more RAID levels coexisting among the plurality of storage nodes.