Reservations over multiple paths on NVMe over fabrics

• US 9,747,039 B1
• Filed: 01/30/2017
• Issued: 08/29/2017
• Est. Priority Date: 10/04/2016
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Coleman, Gordon James, Dreier, Roland, Kirkpatrick, Peter E.
• Primary Examiner(s): Sun, Michael
• Application Number:
  US15/419,886
• Time in Patent Office: 211 Days
• Field of Search: None
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

A method includes receiving, by a storage drive and from a storage controller, a modified first reservation command including a first logical unit identifier. The first reservation command includes a first host identifier to identify a first host controller was previously received by the storage controller from the first host controller. The first reservation command was modified by the storage controller to replace the first host identifier with the first logical unit identifier. The method also includes responsive to receiving the modified first reservation command, identifying, by the storage drive, a first logical unit of storage based on the first logical unit identifier of the modified reservation command. The method includes granting, by the storage drive, a reservation for access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage.

Claims

1. A method comprising:

receiving, by a storage drive and from a storage controller, a modified first reservation command comprising a first logical unit identifier, wherein a first reservation command comprising a first host identifier to identify a first host controller was previously received by the storage controller from the first host controller in a multi-host storage system, wherein the first reservation command was modified by the storage controller to replace the first host identifier with the first logical unit identifier, wherein the first reservation command is compatible with a Nonvolatile Memory Express (NVMe) over Fabrics standard, and the modified first reservation command is compatible with a NVMe standard;

responsive to receiving the modified first reservation command, identifying, by the storage drive, a first logical unit of storage based on the first logical unit identifier of the modified reservation command; and

granting, by the storage drive, a reservation for access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage.

2. The method of claim 1, wherein granting, by the storage drive, the reservation to the access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage, further comprises:

holding, by the storage drive, the reservation for the first logical unit of storage of the storage drive based on the modified first reservation comprising the first logical unit identifier;

associating, by the storage drive, a second logical unit of storage of the storage drive with the reservation held for the first logical unit of storage; and

granting, by the storage drive, access to the first logical unit of storage and the second logical unit of storage of the storage drive on behalf of the first host controller, rather than a second host controller, based on the reservation for the first logical unit.

3. The method of claim 1, wherein the access to the storage drive comprises a write access, a read access, or a read-write access.

4. The method of claim 1, wherein first logical unit identifier is a first namespace identifier that identifies a first namespace that is the first logical unit of storage of the storage drive.

5. The method of claim 2, wherein a second logical unit identifier is a second namespace identifier that identifies a second namespace that is the second logical unit of storage of the storage drive.

6. The method of claim 2, wherein the first logical unit and the second logical unit represent a same physical storage of the storage drive.

7. A method comprising:

receiving, by a storage drive and from a storage controller, a modified first reservation command comprising a first logical unit identifier, wherein a first reservation command comprising a first host identifier to identify a first host controller was previously received by the storage controller from the first host controller in a multi-host storage system, wherein the first reservation command was modified by the storage controller to replace the first host identifier with the first logical unit identifier;

responsive to receiving the modified first reservation command, identifying, by the storage drive, a first logical unit of storage based on the first logical unit identifier of the modified reservation command;

granting, by the storage drive, a reservation for access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage;

receiving, from the second host controller and by the storage drive, a second reservation command to acquire the access to the storage drive, the reservation command comprising a second host identifier to identify the second host controller;

modifying, by the storage drive, the second reservation command by replacing the second host identifier with a second logical unit identifier that is associated with the second host controller and that identifies a second logical unit of storage of the storage drive;

sending the modified second reservation command comprising the second logical unit identifier to the storage drive; and

responsive to receiving the modified second reservation command, denying a reservation made using the modified second reservation command based on the reservation held for the first logical unit.

8. The method of claim 7, wherein responsive to receiving the modified second reservation command, denying the reservation made using the modified second reservation command based on the granted reservation for the access to the storage drive comprises:

identifying, based in the modified second reservation, the second logical unit of storage of the storage drive;

determining, by the storage drive, that the reservation is held for the first logical unit of storage and the reservation is associated with the second logical unit of storage; and

denying the reservation made using the modified second reservation comprising the second logical unit identifier.

9. A method comprising:

receiving, by a storage drive and from a storage controller, a modified first reservation command comprising a first logical unit identifier, wherein a first reservation command comprising a first host identifier to identify a first host controller was previously received by the storage controller from the first host controller in a multi-host storage system, wherein the first reservation command was modified by the storage controller to replace the first host identifier with the first logical unit identifier;

responsive to receiving the modified first reservation command, identifying, by the storage drive, a first logical unit of storage based on the first logical unit identifier of the modified reservation command;

granting, by the storage drive, a reservation for access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage;

receiving, from the first host controller, an input-output (I/O) command to access to the storage drive, the I/O command comprising the first host identifier to identify the first host controller;

modifying, by the storage drive, the I/O command by replacing the first host identifier with the first logical unit identifier that is associated with the first host controller;

sending the modified I/O command comprising the first logical unit identifier to the storage drive;

determining, by the storage drive, that the first logical identifier of the modified I/O command matches a logical unit identifier for which the reservation was granted; and

responsive to determining that the first logical identifier of the modified I/O command matches a logical unit identifier for which the reservation was granted, performing an I/O action specified by the modified I/O command.

10. A multi-host storage system comprising:

a memory;

a storage controller, communicatively coupled to the memory, to;

receive, from a first host controller of the multi-host storage system, a first reservation command to acquire access to a storage drive that is shared by a second host controller of the multi-host storage system, the reservation command comprising a first host identifier to identify the first host controller;

modify the first reservation command by replacing the first host identifier with a first logical unit identifier that is associated with the first host controller and that identifies a first logical unit of storage of the storage drive; and

send the modified first reservation command comprising the first logical unit identifier to a drive controller of the storage drive; and

a drive controller, communicatively coupled to the storage controller, to;

responsive to receiving the modified first reservation command, grant a reservation for the access to the storage drive on behalf of the first host controller based on the first logical unit identifier, wherein to grant the reservation for the access to the storage drive on behalf of the first host controller based on the first logical unit identifier further, the drive controller to;

hold the reservation for the first logical unit of storage of the storage drive based on the modified first reservation comprising the first logical unit identifier;

associate a second logical unit of storage of the storage drive with the reservation held for the first logical unit of storage; and

grant access to the first logical unit of storage and the second logical unit of storage of the storage drive on behalf of the first host controller, rather than the second host controller, based on the reservation for the first logical unit;

wherein the storage controller is further to;

receive, from the second host controller, a second reservation command to acquire the access to the storage drive, the reservation command comprising a second host identifier to identify the second host controller;

modify the second reservation command by replacing the second host identifier with a second logical unit identifier that is associated with the second host controller and that identifies a second logical unit of storage of the storage drive; and

send the modified second reservation command comprising the second logical unit identifier to the drive controller of the storage drive; and

the drive controller further to;

responsive to receiving the modified second reservation command, deny a reservation made using the modified second reservation command based on the reservation held for the first logical unit.

11. The multi-host storage system of claim 10, wherein responsive to receiving the modified second reservation command, to deny the reservation made using the modified second reservation command based on the granted reservation for the access to the storage drive, the drive controller further to:

identify, based in the modified second reservation, the second logical unit of storage of the storage drive;

determine that the reservation is held for the first logical unit of storage and the reservation is associated with the second logical unit of storage; and

deny the reservation made using the modified second reservation comprising the second logical unit identifier.

12. The multi-host storage system of claim 10, the storage controller further to:

receive, from the first host controller, an input-output (I/O) command to access to the storage drive, the I/O command comprising the first host identifier to identify the first host controller;

modify the I/O command by replacing the first host identifier with the first logical unit identifier that is associated with the first host controller; and

send the modified I/O command comprising the first logical unit identifier to the storage drive; and

the drive controller further to;

determine that the first logical identifier of the modified I/O command matches a logical unit identifier for which the reservation was granted; and

responsive to determining that the first logical identifier of the modified I/O command matches a logical unit identifier for which the reservation was granted, perform an I/O action specified by the modified I/O command.

13. A non-transitory computer-readable medium comprising instructions that, when executed by a multi-host storage system, cause the multi-host storage system to:

receive, by a storage drive of the multi-host storage system, a modified first reservation command comprising a first logical unit identifier, wherein a first reservation command comprising a first host identifier to identify a first host controller was previously received by a storage controller from the first host controller in the multi-host storage system, wherein the first reservation command was modified by the storage controller to replace the first host identifier with the first logical unit identifier;

responsive to receiving the modified first reservation command, identify, by the storage drive, a first logical unit of storage based on the first logical unit identifier of the modified reservation command;

grant, by the storage drive, a reservation for access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage, wherein to grant the reservation, the multi-host storage system to;

hold, by the storage drive, the reservation for the first logical unit of storage of the storage drive based on the modified first reservation comprising the first logical unit identifier;

associate, by the storage drive, a second logical unit of storage of the storage drive with the reservation held for the first logical unit of storage; and

grant, by the storage drive, access to the first logical unit of storage and the second logical unit of storage of the storage drive on behalf of the first host controller, rather than a second host controller, based on the reservation for the first logical unit;

wherein the multi-host storage system further to;

receive, from the second host controller of the multi-host storage system and by the storage drive, a second reservation command to acquire the access to the storage drive, the reservation command comprising a second host identifier to identify the second host controller;

modify, by the storage drive, the second reservation command by replacing the second host identifier with a second logical unit identifier that is associated with the second host controller and that identifies a second logical unit of storage of the storage drive;

send the modified second reservation command comprising the second logical unit identifier to the storage drive; and

responsive to receiving the modified second reservation command, deny a reservation made using the modified second reservation command based on the reservation held for the first logical unit.

14. The non-transitory computer-readable medium of claim 13, wherein responsive to receiving the modified second reservation command, to deny the reservation made using the modified second reservation command based on the granted reservation for the access to the storage drive, the multi-host storage system to:

identify, based in the modified second reservation, the second logical unit of storage of the storage drive;

determine, by the storage drive, that the reservation is held for the first logical unit of storage and the reservation is associated with the second logical unit of storage; and

deny the reservation made using the modified second reservation comprising the second logical unit identifier.

15. A non-transitory computer-readable medium comprising instructions that, when executed by a multi-host storage system, cause the multi-host storage system to:

receive, by a storage drive of the multi-host storage system, a modified first reservation command comprising a first logical unit identifier, wherein a first reservation command comprising a first host identifier to identify a first host controller was previously received by a storage controller from the first host controller in the multi-host storage system, wherein the first reservation command was modified by the storage controller to replace the first host identifier with the first logical unit identifier;

responsive to receiving the modified first reservation command, identify, by the storage drive, a first logical unit of storage based on the first logical unit identifier of the modified reservation command;

grant, by the storage drive, a reservation for access to the storage drive on behalf of the first host controller by associating the reservation for the first logical unit with a second logical unit of storage;

receive, from the first host controller, an input-output (I/O) command to access to the storage drive, the I/O command comprising the first host identifier to identify the first host controller;

modify, by the storage drive, the I/O command by replacing the first host identifier with the first logical unit identifier that is associated with the first host controller;

send the modified I/O command comprising the first logical unit identifier to the storage drive;

determine, by the storage drive, that the first logical identifier of the modified I/O command matches a logical unit identifier for which the reservation was granted; and

responsive to determining that the first logical identifier of the modified I/O command matches a logical unit identifier for which the reservation was granted, perform an I/O action specified by the modified I/O command.