AUTOMATICALLY RECONFIGURING A STORAGE MEMORY TOPOLOGY

• US 20150356005A1
• Filed: 06/04/2014
• Published: 12/10/2015
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: HAYES, John, COLGROVE, John, LEE, Robert, ROBINSON, Joshua, OSTROVSKY, Igor, VAJGEL, Peter
• Granted Patent: US 9,612,952 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1004 to protect a block of data words, e.g. CRC or checksum G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 12/0238 Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 2211/1004 Adaptive RAID, i.e. RAID system adapts to changing circumstances, e.g. RAID1 becomes RAID5 as disks fill up
• CPC Class Codes: G06F 2212/7208 Multiple device management, e.g. distributing data over multiple flash devices
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0629 Configuration or reconfiguration of storage systems
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays

Abstract

A storage cluster is provided. The storage cluster includes a plurality of storage nodes within a single chassis. Each of the plurality of storage nodes has nonvolatile solid-state memory for storage of user data. The plurality of storage nodes are configured to distribute the user data and metadata throughout the plurality of storage nodes with erasure coding of the user data such that the plurality of storage nodes can access the user data, via the erasure coding, with a failure of two of the plurality of storage nodes. The plurality of storage nodes are configured to employ the erasure coding to reconfigure redundancy of the user data responsive to one of adding or removing a storage node

Claims

1. A plurality of storage nodes in a single chassis, comprising:

the plurality of storage nodes configured to communicate together as a storage cluster, each storage node of the plurality of storage nodes having a controller, each of the plurality of storage nodes having nonvolatile solid-state memory for user data storage;

the controller for each of the plurality of storage nodes configured to distribute the user data and metadata throughout the plurality of storage nodes, through an interconnect coupling each controller within the single chassis; and

the plurality of storage nodes configured such that adding or removing a storage node triggers the plurality of storage nodes to reconfigure redundancy of the user data in the plurality of storage nodes.

2. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured such that the plurality of storage nodes read the user data, using the erasure coding, despite loss of two of the plurality of storage nodes.

3. The plurality of storage nodes of claim 1, wherein the solid-state memory includes flash.

4. The plurality of storage nodes of claim 1, wherein the user data and metadata are distributed using erasure coding, the erasure coding is in accordance with a first data striping scheme and wherein the reconfigured redundancy of the user data is in accordance with a second data striping scheme.

5. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured such that a storage overhead decreases, as a relative amount of a total storage capacity of the storage cluster, for increasing numbers of storage nodes, as a result of differing data striping schemes configured by the plurality of storage nodes.

6. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured to apply differing data striping schemes in successive data accesses.

7. The plurality of storage nodes of claim 1, further comprising:

each of the plurality of storage nodes configured to select a data stripe width based upon storage capacity of the storage cluster.

8. A storage cluster, comprising:

a plurality of storage nodes within a single chassis;

each of the plurality of storage nodes having a controller, each controller coupled to each other through an interconnect within the single chassis each of the plurality of storage nodes having nonvolatile solid-state memory for storage of user data;

the controller of each of the plurality of storage nodes configured to distribute the user data and metadata throughout the plurality of storage nodes with erasure coding of the user data such that the plurality of storage nodes; and

the plurality of storage nodes configured to employ erasure coding to reconfigure redundancy of the user data responsive to one of adding or removing a storage node.

9. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured to accommodate differing redundant array of independent disks (RAID) schemes coexisting in the plurality of storage nodes.

10. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured to change a data striping scheme from two replicated copies to N plus 2 redundancy.

11. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured such that storage overhead, relative to total storage of the storage cluster, decreases, and storage efficiency increases, as storage nodes are added to the storage cluster.

12. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured to reconfigure storage overhead responsive to a storage cluster membership change.

13. The storage cluster of claim 8, further comprising:

each of the plurality of storage nodes configured to self-configure as to data striping scheme based upon membership in the storage cluster of others of the plurality of storage nodes.

14. The storage cluster of claim 8, further comprising:

the plurality of storage nodes configured such that differing portions of the user data have differing levels of redundancy in the plurality of storage nodes.

15. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory, comprising:

distributing the user data throughout the plurality of storage nodes through erasure coding, wherein the plurality of storage nodes are housed within a single chassis that couples the plurality of storage nodes, each of the plurality of storage nodes having a controller coupled to each other controller through an interconnect of the single chassis;

changing membership of the plurality of storage nodes; and

reconfiguring redundancy of the user data in the plurality of storage nodes, responsive to the changing membership.

16. The method of claim 15, further comprising:

compressing the user data in the plurality of storage nodes.

17. The method of claim 15, further comprising:

reconstructing the user data from a first data striping scheme to a second data striping scheme.

18. The method of claim 15, further comprising:

writing second data into the plurality of storage nodes according to a second data striping scheme, wherein the user data, as first data, remains in the storage cluster according to a first data striping scheme.

19. The method of claim 15, further comprising:

selecting, by one of the plurality of storage nodes, a first redundant array of independent disks (RAID) level as erasure coding of the user data; and

selecting, by a differing one of the plurality of storage nodes, a second RAID level as the reconfigured redundancy of the user data.

20. The method of claim 15, wherein:

changing the membership of the plurality of storage nodes includes one of adding a storage node to the storage cluster or removing a storage node from the storage cluster; and

the erasure coding and the redundancy include two or more RAID levels coexisting among the plurality of storage nodes.