Network-displaced direct storage

• US 10,708,357 B2
• Filed: 03/30/2018
• Issued: 07/07/2020
• Est. Priority Date: 04/11/2013
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Inventors: Hendel, Ariel, Kishore, Karagada Ramarao
• Primary Examiner(s): Etienne, Ario
• Assistant Examiner(s): Mendaye, Kidest
• Application Number:
  US15/941,910
• Publication Number:
  US 20180227365A1
• Time in Patent Office: 830 Days
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A network-displaced direct storage architecture transports storage commands over a network interface. In one implementation, the architecture maps, at hosts, block storage commands to remote direct memory access operations (e.g., over converged Ethernet). The mapped operations are communicated across the network to a network storage appliance. At the network storage appliance, network termination receives the mapped commands, extracts the operation and data, and passes the operation and data to a storage device that implements the operation on a memory.

Claims

1. A device, comprising:

a memory; and

network storage circuitry coupled to the memory, the network storage circuitry comprising a network interface, the network storage circuitry configured to;

map a block command data PUSH to a remote direct memory access over converged ethernet (RoCE) SEND work queue;

send a read PUSH via the RoCE SEND work queue;

receive a mapped block storage command at the network interface;

based on a mapping between an RoCE protocol and a block storage command set, determine a primary block storage command from the mapped block storage command;

process the primary block storage command to determine a memory operation;

execute the memory operation on the memory; and

generate a responsive communication based on the execution of the memory operation, wherein the responsive communication includes sending a command completion code to a host, from which the received mapped block storage command originated, via a network-displaced direct storage (NDSS) layer in the host configured to provide storage commands for direct storage to the NDSS, and wherein the command completion code uses a same queue pair as an initiating PUSH command.

2. The device of claim 1, wherein the network storage circuitry is configured to execute the memory operation as part of an object storage operation.

3. The device of claim 2, wherein the network storage circuitry is configured to write a data identifier and an unstructured data block to perform the object storage operation.

4. The device of claim 1, wherein the network storage circuitry is configured to reverse the mapping to recover the primary block storage command from the mapped block storage command.

5. The device of claim 1, wherein the network storage circuitry is configured to send the primary block storage command to a non-volatile memory express (NVME) controller to determine the memory operation.

6. The device of claim 1, wherein the memory is a network-displaced direct storage (NDDS).

7. The device of claim 1, wherein the network storage circuitry is configured to handle the mapped block storage command as a storage command for a direct attached storage (DAS) device.

8. The device of claim 1, wherein the network storage circuitry is configured to de-encapsulate an RoCE command and map the de-encapsulated RoCE command to a block storage command.

9. The device of claim 1, wherein the network storage circuitry is configured to execute two-way storage communications.

10. The device of claim 1, wherein the network storage circuitry is configured to map a RoCE command to the block storage command via a RoCE to block I/O mapping queue.

11. The device of claim 10, wherein the RoCE to block I/O mapping queue is configured to perform a synchronous write operation.

12. The device of claim 1, wherein the network storage circuitry includes a network storage appliance circuitry (NSAC) stack for an object storage system, and a data identifier is used to locate unstructured data corresponding to an object through an application programming interface (API).

13. The device of claim 12, wherein the NSAC is cloud-based and a file-structure within the NSAC is hidden.

14. The device of claim 12, wherein the network storage circuitry is configured to map API commands to RoCE commands.

15. The device of claim 14, wherein the network storage circuitry is configured to RoCE terminate a command.

16. The device of claim 15, wherein the network storage circuitry is configured to process the command once terminated through an API processing layer to translate the command into a form supporting object storage.

17. A non-transitory computer readable medium having instructions that when executed by a processor implement a network storage device coupled to a memory, the device comprising:

network storage circuitry configured by the executed instructions to;

map a block command data PUSH to a remote direct memory access over converged ethernet (RoCE) SEND work queue;

send a read PUSH via the RoCE SEND work queue;

receive a mapped block storage command at a network interface;

based on a mapping between an RoCE protocol and a block storage command set, determine a primary block storage command from the mapped block storage command;

process the primary block storage command to determine a memory operation;

execute the memory operation on the memory; and

generate a responsive communication based on the execution of the memory operation, wherein the responsive communication includes sending a command completion code to a host, from which the received mapped block storage command originated, via a network-displaced direct storage (NDSS) layer in the host configured to provide storage commands for direct storage to the NDSS, and wherein the command completion code uses a same queue pair as an initiating PUSH command.