Point to point based backend communication layer for storage processing

• US 10,178,169 B2
• Filed: 04/09/2015
• Issued: 01/08/2019
• Est. Priority Date: 04/09/2015
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Botes, Par, Hayes, John, Tan, Zhangxi
• Primary Examiner(s): Etienne, Ario
• Assistant Examiner(s): Kassa, Elizabeth
• Application Number:
  US14/683,083
• Publication Number:
  US 20160301752A1
• Time in Patent Office: 1,370 Days
• Field of Search: 709218
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0661 Format or protocol conversion arrangements
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: H04L 49/15 Interconnection of switching modules
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A storage system is provided. The storage system includes a plurality of storage nodes, each of the plurality of storage nodes having a plurality of storage units with storage memory. The system includes a first network coupling the plurality of storage nodes and a second network coupled to at least a subset of the plurality of storage units of each of the plurality of storage nodes such that one of the plurality of storage units of a first one of the plurality of storage nodes can initiate or relay a command to one of the plurality of storage units of a second one of the plurality of storage nodes via the second network without the command passing through the first network.

Claims

1. A storage system, comprising:

a plurality of storage nodes, each of the plurality of storage nodes having a plurality of storage units with storage memory;

a first network coupling the plurality of storage nodes; and

a second network coupled to at least a subset of the plurality of storage units of each of the plurality of storage nodes such that one of the plurality of storage units of a first one of the plurality of storage nodes is configured to initiate or relay a command to one of the plurality of storage units of a second one of the plurality of storage nodes via the second network without the command passing through the first network, wherein one of the plurality of storage nodes is configured to perform data striping across the plurality of storage nodes by transferring a portion of a data stripe to each other of the plurality of storage nodes via the second network.

2. The storage system of claim 1, wherein the second network is a point to point backend communication physical layer coupling each storage unit of each storage node to each storage unit of each other storage node of the storage system.

3. The storage system of claim 1, wherein the second network includes a non-switched, non-shared I/O path.

4. The storage system of claim 1, wherein the first network includes a switch fabric that couples the plurality of storage nodes, the switch fabric distinct from the second network.

5. The storage system of claim 1, further comprising:

each storage node having a processor, wherein processors of storage nodes are configured to communicate with each other via a switch fabric of the first network that is distinct from the second network.

6. The storage system of claim 1, further comprising:

each storage unit having a processor, wherein processors of storage units in differing storage nodes are configured to communicate with each other via the second network.

7. A method for communicating in a storage system, comprising:

communicating a command from a processor of a storage node to a processor of a first storage unit of the storage node, wherein the storage node is coupled to further storage nodes of the storage system by a first network; and

communicating regarding the command from the processor of the first storage unit to a processor of a second storage unit of one of the further storage nodes via a second network coupling the first storage unit and the second storage unit such that one of a plurality of storage units of a first one of the plurality of storage nodes is configured to initiate or relay a command to one of the plurality of storage units of a second one of the plurality of storage nodes via the second network without the command passing through the first network, wherein the first network includes a switch fabric that couples the storage node and the further storage nodes, the switch fabric distinct from the second network.

8. The method of claim 7, wherein the second network includes a non-switched, non-shared I/O path.

9. The method of claim 7, wherein communicating regarding the command from the processor of the first storage unit includes communicating a request based on the command.

10. The method of claim 7, wherein the second network is a point to point backend communication physical layer coupling each storage unit of each storage node to each storage unit of each other storage node of the storage system.

11. The method of claim 7, further comprising:

completing an operation with a first storage memory of the first storage unit as a committed transaction; and

sending information regarding the committed transaction from the first storage unit to the second storage unit via the second network.

12. A storage system, comprising:

a plurality of storage nodes, each of the plurality of storage nodes coupled to each other of the plurality of storage nodes by a first network;

a plurality of storage drives, each having storage memory, wherein each of the plurality of storage nodes includes one or more of the plurality of storage drives; and

at least a subset of the plurality of storage drives coupled by a second network such that one of the plurality of storage drives included in a first one of the plurality of storage nodes is configured to initiate or relay a command via the second network to one of the plurality of storage drives included in a second one of the plurality of storage nodes via the second network without the command passing through the first network, wherein one of the plurality of storage nodes is configured to perform data striping across the plurality of storage nodes by transferring a portion of a data stripe to each other of the plurality of storage nodes via the second network.

13. The storage system of claim 12, further comprising:

a single chassis, having the plurality of storage nodes installed therein, wherein at least a portion of the first network and at least a portion of the second network are integral with the single chassis.

14. The storage system of claim 12, wherein the second network is a point to point backend communication physical layer coupling each storage unit of each storage node to each storage unit of each other storage node of the storage system.

15. The storage system of claim 12, wherein the second network includes a non-switched, non-shared I/O path coupling the first one of the plurality of storage drives to the second one of the plurality of storage drives.

16. The storage system of claim 12, the first network includes a switch fabric that couples the plurality of storage nodes, the switch fabric distinct from the second network.

17. The storage system of claim 12, wherein each storage node has a processor, wherein processors of storage nodes are configured to communicate with each other via a switch fabric that is distinct from the second network and wherein each storage unit has a processor, wherein processors of storage units in differing storage nodes are configured to communicate with each other via the second network.