METHODS AND APPARATUS FOR MANAGING ASYNCHRONOUS DEPENDENT I/O FOR A VIRTUAL FIBRE CHANNEL TARGET

• US 20110258480A1
• Filed: 04/16/2010
• Published: 10/20/2011
• Est. Priority Date: 04/16/2010
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: LSI Corporation (Broadcom, Inc.)
• Inventors: Rao, Srinivasa Nagaraja, Young, Howard
• Granted Patent: US 8,489,940 B2
• Time in Patent Office: Days
• US Class Current: 714/2
• CPC Class Codes: G06F 12/0223 User address space allocation, e.g. contiguous or non contiguous base addressing
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Methods and apparatus for managing exchange IDs for multiple asynchronous dependent I/O operations generated for virtual Fibre Channel (FC) target volumes. Features and aspects hereof allocate a range of exchange identifier (X_ID) values used in issuing a plurality of physical I/O operations to a plurality of physical FC target devices that comprise the virtual FC target volume. The plurality of physical I/O operations are dependent upon one another for completion of the original request to the virtual FC target volume and allow substantially parallel operation of the plurality of physical FC target devices. A primary X_ID is selected from the range of allocated X_ID values for communications with the attached host system that generated the original request to the virtual FC target volume.

Claims

1. A method operable in a virtualized storage system utilizing Fibre Channel (FC) communications, the storage system comprising a plurality of physical FC target devices, the method comprising:

receiving a read or write command over an FC communication medium from an attached host system, wherein the read or write command is directed to a virtual FC target, the virtual FC target comprising multiple physical FC target devices;

allocating a range of sequential exchange identifier (X_ID) values responsive to receipt of the read or write command;

issuing multiple physical I/O operations, each physical I/O operation directed to a corresponding one of the multiple physical FC target devices, wherein each of the multiple physical I/O operations is associated with a corresponding X_ID value of the range of sequential X_ID values;

selecting a primary X_ID (RX_ID) value based on the X_ID value associated with a first completed physical I/O operation of the multiple physical I/O operations;

transmitting a response to the host system indicating success or failure of the read or write command based on the completion of the multiple physical I/O operations, wherein the response transmitted to host system utilizes the RX_ID; and

releasing the allocated range of sequential X_ID values responsive to transmitting the response to the host system.

2. The method of claim 1

wherein the number (N) of X_ID values in the range of sequential X_ID values is a power of 2,

wherein the step of allocating the range comprises indicating that a main X_ID of the range is allocated where the main X_ID of the range has the value that is an integral multiple of N, and

wherein the step of releasing the allocated range comprises indicating that the main X_ID is no longer allocated.

3. The method of claim 1

wherein the number (N) of X_ID values in the range is greater than or equal to the number of physical FC target devices in the storage system.

4. The method of claim 1

wherein the step of issuing multiple physical I/O operations comprises issuing multiple physical I/O operations to be performed substantially in parallel by the multiple physical FC target devices.

5. The method of claim 1

wherein the virtual FC target comprises a striped logical volume,

wherein the step of issuing multiple physical I/O operations comprises issuing multiple unicast physical I/O operations to be performed substantially in parallel by the multiple physical FC target devices, and

wherein the step of selecting the primary X_ID value further comprises selecting the primary X_ID value based on the X_ID value associated with a first completed physical I/O operation of the multiple unicast physical I/O operations and based on the type of a frame received from the physical FC target device that first completed its unicast physical I/O operation.

6. The method of claim 1

wherein the virtual FC target comprises a mirrored logical volume,

wherein the step of issuing multiple physical I/O operations comprises issuing multiple multicast physical I/O operation to be performed substantially in parallel by the multiple physical FC target devices, and

wherein the step of selecting the primary X_ID value further comprises selecting the primary X_ID value based on the X_ID value associated with a first completed physical I/O operation of the multiple multicast physical I/O operations and based on the type of a frame received from the physical FC target device that first completed its physical I/O operation.

7. The method of claim 1 further comprising:

determining that one or more of the multiple physical FC target devices completed its physical I/O operation with an error completion; and

wherein the step of selecting the RX_ID further comprises, responsive to the determination that one or more physical FC target devices had an error completion, selecting the RX_ID as the X_ID associated with the physical I/O operation that generated a first of the one or more error completions.

8. The method of claim 1 further comprising:

determining that one or more of the physical FC target devices completed its physical I/O operation with an error completion; and

blocking processing of additional physical I/O operations until the error completion is resolved.

9. Apparatus in storage controller of a virtualized storage system, the system comprising a virtual Fibre Channel (FC) target which comprises a plurality of physical FC target devices, the apparatus comprising:

a virtual I/O processor, coupled with the plurality of physical FC target devices, the virtual I/O processor adapted to receive a host initiated read or write command directed to the virtual FC target and adapted to allocate a range of sequential exchange ID (X_ID) values in response to receipt of the read or write command, the virtual I/O processor further adapted to issue multiple physical I/O operations to the plurality of physical FC target devices where each physical I/O operation includes a corresponding X_ID from the range of sequential X_ID values;

a primary exchange selection component, coupled with the virtual I/O processor and coupled with the plurality of physical FC target devices, the primary exchange selection component adapted to select a primary X_ID (RX_ID) value based on the X_ID value associated with a first completed physical I/O operation of the multiple physical I/O operations; and

an I/O completion component, coupled with the virtual I/O processor and coupled with the plurality of physical FC target devices, the I/O completion component adapted to determine success or failure of the read or write command based on the completion of the multiple physical I/O operations and further adapted to communicate the success or failure to the virtual I/O processor,

the virtual I/O processor further adapted to transmit a response to the host system indicating success or failure of the read or write responsive to the communication from the I/O completion component, wherein the response transmitted to the host system utilizes the RX_ID,

the virtual I/O processor further adapted to release the allocated range of sequential X_ID values responsive to transmitting the response to the host system.

10. The apparatus of claim 9 further comprising:

a memory, coupled with the virtual I/O processor, the memory adapted to store information regarding the plurality of X_ID values.

11. The apparatus of claim 9

wherein the number of X_ID values in the range of sequential X_ID values is a power of 2 (N),

wherein the virtual I/O processor is further adapted to allocate the range by indicating that a main X_ID of the range is allocated where the main X_ID of the range has the value that is an integral multiple of N, and

wherein the virtual I/O processor is further adapted to release the range by indicating that the main X_ID is no longer allocated.

12. The apparatus of claim 9

wherein the virtual FC target comprises a striped logical volume,

wherein the virtual I/O processor is further adapted to issue multiple unicast physical I/O operations to be performed substantially in parallel by the multiple physical FC target devices, and

wherein the primary exchange selection component is further adapted to select the primary X_ID value based on the X_ID value associated with a first completed physical I/O operation of the multiple unicast physical I/O operations and based on the type of a frame received from the physical FC target device that first completed its unicast physical I/O operation.

13. The apparatus of claim 9

wherein the virtual FC target comprises a mirrored logical volume,

wherein the virtual I/O processor is further adapted to issue multiple multicast physical I/O operations to be performed substantially in parallel by the multiple physical FC target devices, and

wherein the primary exchange selection component is further adapted to select the primary X_ID value based on the X_ID value associated with a first completed physical I/O operation of the multiple multicast physical I/O operations and based on the type of a frame received from the physical FC target device that first completed its physical I/O operation.

14. The apparatus of claim 9

wherein the I/O completion component is further adapted to determine that one or more of the physical FC target devices completed its physical I/O operation with an error completion, and

wherein the primary exchange selection component is further adapted, responsive to the determination that one or more physical FC target device had an error completion, to select the RX_ID as the X_ID associated with the physical I/O operation that generated a first of the one or more error completions.

15. The apparatus of claim 9

wherein the I/O completion component is further adapted to determine that one or more of the physical FC target devices completed its physical I/O operation with an error completion, and

wherein the I/O completion component is further adapted to block processing of additional physical I/O operations until the error completion is resolved.

20. The method of claim 15

wherein the virtual FC target comprises a mirrored logical volume,

wherein the step of issuing multiple physical I/O operations comprises issuing multiple multicast physical I/O operations to be performed substantially in parallel by the plurality of physical FC target devices, and

wherein the primary X_ID value is selected based on the X_ID value associated with a first completed physical I/O operation of the multiple multicast physical I/O operations and based on the type of a frame received from the physical FC target device that first completed its physical I/O operation.

16. A method operable in virtualized Fibre Channel (FC) storage controller, the controller adapted to couple with one or more host systems and adapted to couple with a plurality of physical FC target devices, the method comprising:

defining, within the storage controller, a plurality of ranges of exchange identifier (X_ID) values wherein each range comprises a number (N) of sequential X_ID values;

receiving from a host system a read or write command directed to a virtual FC target, the virtual FC target comprising a portion of each of the plurality of physical FC target devices;

allocating, responsive to receipt of the command, a selected range from the plurality of ranges;

issuing multiple physical I/O operations, each physical I/O operation directed to a corresponding one of the plurality of physical FC target devices, wherein each of the multiple physical I/O operations is associated with a corresponding X_ID value of the allocated range;

communicating with the host system to complete processing of the command wherein the communication with the host system comprises a primary X_ID value selected from the allocated range; and

releasing the allocated range responsive to completing processing of the command.

17. The method of claim 16

wherein the number (N) of X_ID values in each range is a power of 2,

wherein each range has a main X_ID of the range having a value that is an integral multiple of N,

wherein the step of defining ranges further comprises entering the main X_ID of each range in a queue,

wherein the step of allocating the range comprises popping a next main X_ID from the queue, and

wherein the step of releasing the allocated range comprises pushing the main X_ID of the allocated range into the queue.

18. The method of claim 16

wherein the number of X_ID values in each range is greater than or equal to the number of physical FC target devices coupled to the storage controller.

19. The method of claim 16

wherein the virtual FC target comprises a striped logical volume,

wherein the step of issuing multiple physical I/O operations comprises issuing multiple unicast physical I/O operations to be performed substantially in parallel by the plurality of physical FC target devices, and

wherein the primary X_ID value is selected based on the X_ID value associated with a first completed physical I/O operation of the multiple unicast physical I/O operations and based on the type of a frame received from the physical FC target device that first completed its unicast physical I/O operation.