Storage cluster

• US 9,563,506 B2
• Filed: 09/19/2014
• Issued: 02/07/2017
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Hayes, John, Colgrove, John, Lee, Robert, Vajgel, Peter, Botes, Par
• Primary Examiner(s): ELMORE, STEPHEN C
• Application Number:
  US14/491,552
• Publication Number:
  US 20150355969A1
• Time in Patent Office: 872 Days
• Field of Search: 711/103, 711/154, 711/156, 711/158, 711/170, 713/340, 714/6.2, 714/6.24, 714/6.32
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1068 in sector programmable memories, e.g. flash disk G06F11/1072 takes precedence
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/108 Parity data distribution in semiconductor storages, e.g. in SSD
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 2201/845 Systems in which the redundancy can be transformed in increased performance
• CPC Class Codes: G06F 2212/7206 Reconfiguration of flash memory system
• CPC Class Codes: G06F 2212/7207 management of metadata or control data
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays
• CPC Class Codes: H03M 13/154 Error and erasure correction, e.g. by using the error and erasure locator or Forney polynomial

Abstract

A plurality of storage nodes is provided. The plurality of storage nodes is configured to communicate together as a storage cluster. Each of the plurality of storage nodes includes nonvolatile solid-state memory. The plurality of storage nodes is configured to distribute user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes maintain the ability to read the user data, using erasure coding, despite a loss of one of the plurality of storage nodes. A chassis enclosing the plurality of storage nodes includes power distribution, a high speed communication bus and the ability to install one or more storage nodes which may use the power distribution and communication bus in some embodiments. A method for accessing user data in a plurality of storage nodes having nonvolatile solid-state memory is also provided.

Claims

1. A plurality of storage nodes in a single chassis, comprising:

the plurality of storage nodes configured to communicate together as a storage cluster;

each of the plurality of storage nodes having nonvolatile solid-state memory for user data storage; and

the plurality of storage nodes configured to distribute the user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes maintain ability to read the user data, using erasure coding despite a loss of one of the plurality of storage nodes, wherein the single chassis is rack mountable and the single chassis includes internal power distribution to the plurality of storage nodes and an internal communication bus coupling the plurality of storage nodes.

2. The plurality of storage nodes of claim 1, further comprising:

the plurality of storage nodes configured to recover and rebuild the user data, responsive to a loss of one of the plurality of storage nodes.

3. The plurality of storage nodes of claim 1, wherein the single chassis couples the plurality of storage nodes to an external communication bus.

4. The plurality of storage nodes of claim 1, wherein the nonvolatile solid-state memory includes an array of flash memory.

5. The plurality of storage nodes of claim 4, wherein the non-volatile solid-state memory comprises:

a controller;

volatile memory coupled to the controller;

an energy reserve coupled to the volatile memory, wherein the non-volatile solid-state memory transfers data within the volatile memory to the array of flash memory upon detection of power loss.

6. The plurality of storage nodes of claim 1, wherein each of the plurality of storage nodes is configured to monitor and reply to a query, wherein a lack of response to the query is indicative of one of the plurality of storage nodes failing.

7. The plurality of storage nodes of claim 1, wherein the single chassis includes a plurality of slots, each slot of the plurality of slots configured to accommodate one storage node of the plurality of storage nodes.

8. The plurality of storage nodes of claim 1, wherein the plurality of storage nodes is configured to rebuild data without waiting until data is needed for a read access initiated from a client system.

9. The plurality of storage nodes of claim 1, wherein each of the plurality of storage nodes is hot pluggable.

10. The plurality of storage nodes of claim 1, wherein the plurality of storage nodes is configured to recognize insertion or removal of a storage node and to reconfigure responsive to the insertion or the removal.

11. A storage cluster, comprising:

a plurality of storage nodes within a single chassis, the single chassis comprising;

a communication bus providing communication between the plurality of storage nodes; and

a power distribution system providing power to the plurality of storage nodes;

each of the plurality of storage nodes having nonvolatile solid-state memory for storage of user data; and

the plurality of storage nodes configured to distribute the user data and metadata associated with the user data throughout the plurality of storage nodes such that the plurality of storage nodes can access the user data, via erasure coding, with a failure of one of the plurality of storage nodes.

12. The storage cluster of claim 11, further comprising:

the plurality of storage nodes configured to read data written according to a first erasure coding scheme across the plurality of storage nodes; and

the plurality of storage nodes configured to read data written according to a second erasure coding scheme across the plurality of storage nodes, wherein the data written according to the first erasure coding scheme coexists with the data written according to the second erasure coding scheme, in the plurality of storage nodes.

13. The storage cluster of claim 11, wherein the plurality of storage nodes comprises storage nodes have differing capacities of non-volatile solid state memory.

14. The storage cluster of claim 11, wherein each storage node of the plurality of storage nodes includes a printed circuit board having a processor coupled to a flash memory array.

15. The storage cluster of claim 11, wherein the single chassis includes a plurality of slots, each slot of the plurality of slots configured to accommodate one storage node of the plurality of storage nodes.

16. The storage cluster of claim 11, further comprising:

each of the plurality of storage nodes having a controller, volatile memory, and an energy reserve, the controller configured to transfer contents of the volatile memory to the non-volatile solid-state memory responsive to loss of electric power, the energy reserve configured to provide sufficient electrical power to the volatile memory to complete such a transfer.

17. The storage cluster of claim 11, wherein the plurality of storage nodes is configured to apply differing types of erasure coding for access to differing portions of the user data.

18. The storage cluster of claim 11, further comprising:

the plurality of storage nodes configured to recognize insertion of a storage node and to reconfigure responsive to the insertion, wherein each of the plurality of storage nodes is hot pluggable.

19. The storage cluster of claim 11, further comprising:

the plurality of storage nodes configured to recognize removal of a storage node and to reconfigure responsive to the removal, wherein each of the plurality of storage nodes is hot pluggable.

20. The storage cluster of claim 11, further comprising:

the plurality of storage nodes configured to detect the loss of the one of the plurality of storage nodes and to rebuild the user data, responsive to so detecting.