Automatically reconfiguring a storage memory topology

• US 9,612,952 B2
• Filed: 06/04/2014
• Issued: 04/04/2017
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Hayes, John, Colgrove, John, Lee, Robert, Robinson, Joshua, Ostrovsky, Igor, Vajgel, Peter
• Primary Examiner(s): Bansal, Gurtej
• Application Number:
  US14/296,149
• Publication Number:
  US 20150356005A1
• Time in Patent Office: 1,035 Days
• Field of Search: 711114
• CPC Class Codes: G06F 11/1004 to protect a block of data words, e.g. CRC or checksum G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 12/0238 Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 2211/1004 Adaptive RAID, i.e. RAID system adapts to changing circumstances, e.g. RAID1 becomes RAID5 as disks fill up
• CPC Class Codes: G06F 2212/7208 Multiple device management, e.g. distributing data over multiple flash devices
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0629 Configuration or reconfiguration of storage systems
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

A storage cluster is provided. The storage cluster includes a plurality of storage nodes within a single chassis. Each of the plurality of storage nodes has nonvolatile solid-state memory for storage of user data. The plurality of storage nodes are configured to distribute the user data and metadata throughout the plurality of storage nodes with erasure coding of the user data such that the plurality of storage nodes can access the user data, via the erasure coding, with a failure of two of the plurality of storage nodes. The plurality of storage nodes are configured to employ the erasure coding to reconfigure redundancy of the user data responsive to one of adding or removing a storage node.

Claims

1. A plurality of storage nodes, comprising:

each storage node of the plurality of storage nodes having a controller, at least one storage node of the plurality of storage nodes having multiple authorities, wherein each authority of the multiple authorities controls a corresponding range of data identifiers;

each authority of the plurality of storage nodes configurable to select one of a plurality of redundancy schemes independent of each other authority of the plurality of storage nodes and to distribute the user data in accordance with the selected redundancy scheme; and

the plurality of storage nodes configurable such that adding or removing a storage node triggers the plurality of storage nodes and the authorities to reconfigure redundancy of the user data in the plurality of storage nodes.

2. The plurality of storage nodes of claim 1, wherein each corresponding range of data identifiers is non-overlapping.

3. The plurality of storage nodes of claim 1, wherein the solid-state memory includes flash.

4. The plurality of storage nodes of claim 1, wherein the user data and metadata are distributed using erasure coding, the erasure coding is in accordance with a first data striping scheme and wherein the reconfigured redundancy of the user data is in accordance with a second data striping scheme.

5. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configurable such that a storage overhead decreases, as a relative amount of a total storage capacity of the storage cluster, for increasing numbers of storage nodes, as a result of differing data striping schemes configured by the plurality of storage nodes.

6. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configurable to apply differing data striping schemes in successive data accesses.

7. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configurable to select a data stripe width based upon storage capacity of the storage cluster.

8. A storage cluster, comprising:

a plurality of storage nodes;

each storage node of the plurality of storage nodes having a controller, each storage node of the plurality of storage nodes having nonvolatile solid-state memory for storage of user data, wherein at least one storage node of the plurality of storage nodes having multiple authorities, with each authority of the multiple authorities controls a corresponding range of data identifiers;

each authority of the plurality of storage nodes configurable to decide, independent of each other authority of the plurality of storage nodes, which of a plurality of redundancy schemes to apply to distribute the user data and metadata throughout the plurality of storage nodes; and

the plurality of storage nodes and the authorities configurable to employ erasure coding to reconfigure redundancy of the user data responsive to one of adding or removing a storage node.

9. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configurable to accommodate differing redundant array of independent disks (RAID) schemes coexisting in the plurality of storage nodes.

10. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configurable to change a data striping scheme from two replicated copies to N plus 2 redundancy.

11. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configurable such that storage overhead, relative to total storage of the storage cluster, decreases, and storage efficiency increases, as storage nodes are added to the storage cluster.

12. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configurable to reconfigure storage overhead responsive to a storage cluster membership change.

13. The storage cluster of claim 8, further comprising:

each of the plurality of storage nodes configurable to self-configure as to data striping scheme based upon membership in the storage cluster of others of the plurality of storage nodes.

14. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configurable such that differing portions of the user data have differing levels of redundancy in the plurality of storage nodes.

15. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory, comprising:

configuring at least one of the plurality of storage nodes to have multiple authorities, with each authority of the multiple authorities controlling a range of data identifiers;

distributing the user data throughout the plurality of storage nodes through erasure coding, wherein the plurality of storage nodes are housed within a single chassis that couples the plurality of storage nodes, each of the plurality of storage nodes having a controller coupled to each other controller through an interconnect of the single chassis, and wherein each authority of each of the plurality of storage nodes is able, independent of each other authority of the plurality of storage nodes, to choose which of a plurality of redundancy schemes to use when the storage node distributes a portion of the user data throughout the plurality of storage nodes;

changing membership of the plurality of storage nodes so as to add or remove a storage node; and

reconfiguring redundancy of the user data in the plurality of storage nodes, in accordance with the authorities, responsive to the changing membership.

16. The method of claim 15, further comprising:

compressing the user data in the plurality of storage nodes.

17. The method of claim 15, further comprising:

reconstructing the user data from a first data striping scheme to a second data striping scheme.

18. The method of claim 15, further comprising:

writing second data into the plurality of storage nodes according to a second data striping scheme, wherein the user data, as first data, remains in the storage cluster according to a first data striping scheme.

19. The method of claim 15, further comprising:

selecting, by one of the plurality of storage nodes, a first redundant array of independent disks (RAID) level as erasure coding of the user data; and

selecting, by a differing one of the plurality of storage nodes, a second RAID level as the reconfigured redundancy of the user data.

20. The method of claim 15, wherein:

changing the membership of the plurality of storage nodes includes one of adding a storage node to the storage cluster or removing a storage node from the storage cluster; and

the erasure coding and the redundancy include two or more RAID levels coexisting among the plurality of storage nodes.