Management of an IOV adapter through a virtual intermediary in an IOV management partition

• US 8,141,093 B2
• Filed: 11/15/2007
• Issued: 03/20/2012
• Est. Priority Date: 11/15/2007
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Brown, Aaron C., Freimuth, Douglas M., Recio, Renato J., Thurber, Steven M.
• Primary Examiner(s): Puente, Emerson
• Assistant Examiner(s): KIM, DONG U
• Application Number:
  US11/940,360
• Publication Number:
  US 20090133016A1
• Time in Patent Office: 1,587 Days
• Field of Search: None
• US Class Current: 718/104
• CPC Class Codes: G06F 2009/45579 I/O management, e.g. providing access to device drivers or storage
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

Mechanisms that address the situation where an input/output (I/O) fabric is shared by more than one logical partition (LPAR) and where each LPAR can share with the other LPARs an I/O adapter (IOA) are provided. In particular, each LPAR is assigned its own separate address space to access a virtual function (VF) assigned to it such that each LPAR'"'"'s perception is that it has its own independent IOA. Each VF may be shared across multiple LPARs. Facilities are provided for management of the shared resources of the IOA via a Physical Function (PF) of the IOA by assignment of that PF to an I/O Virtualization Management Partition (IMP). The code running in the IMP acts as a virtual intermediary to the VFs for fully managing the VF error handling, VF reset, and configuration operations. The IMP also acts as an interface to the PF for accessing common VF functionality.

Claims

1. A method, in a data processing system, for managing input/output (I/O) virtualization, comprising:

creating one or more client partitions in the data processing system, each client partition having an associated portion of resources of the data processing system;

creating, in the data processing system, an I/O virtualization management partition (IMP), wherein the IMP performs I/O virtualization management operations with an I/O endpoint of the data processing system to thereby manage set of physical functions, comprising one or more physical functions of the I/O endpoint and wherein each client partition in the one or more client partitions is not permitted to perform I/O virtualization management operations on the set of physical functions but is permitted to perform I/O virtualization management operations on one or more virtual functions in the I/O endpoint that are associated with the client partition;

creating at least one communication structure for communicating between the IMP and the one or more client partitions; and

performing, by the IMP, the I/O virtualization management operations with the I/O endpoint using the at least one communication structure.

2. The method of claim 1, wherein creating one or more client partitions, creating the IMP, and creating the at least one communication structure are performed by a hypervisor associated with the data processing system.

3. The method of claim 2, wherein the hypervisor is provided with access to configuration spaces for physical functions and virtual functions in the I/O endpoint, and wherein the IMP is provided with access to only configuration spaces for physical functions assigned to the IMP and configuration spaces for virtual functions belonging to physical functions assigned to the IMP, in the I/O endpoint.

4. The method of claim 3, wherein the one or more client partitions do not have direct access to configuration spaces of virtual functions assigned to the one or more client partitions, in the one or more I/O endpoints I/O endpoint, and only access the configuration spaces of virtual functions assigned to the one or more client partitions via the IMP using the at least one communication structure.

5. The method of claim 4, wherein the IMP permits access by a client partition to configuration spaces of virtual functions, in the I/O endpoint, assigned to the client partition and blocks access by the client partition to configuration spaces of virtual functions, in the I/O endpoint, that are not assigned to the client partition.

6. The method of claim 1, further comprising receiving an input from a hardware management console (HMC) directing performance of the I/O virtualization management operations.

7. The method of claim 6, wherein the input from the HMC is a command to initiate a hot-plug operation for adding a new I/O endpoint to the data processing system, and wherein performing the I/O virtualization management operations comprises:

allocating resources to the one or more client partitions based on addition of the new I/O endpoint;

configuring the IMP based on the addition of the new I/O endpoint;

dynamically adding at least one virtual function of the new I/O endpoint to at least one client partition in the one or more client partitions; and

configuring the at least one virtual function via the IMP using the at least one communication structure.

8. The method of claim 6, wherein the input from the HMC is a command to initiate a hot-plug operation for removing an existing I/O endpoint from the data processing system, and wherein performing the I/O virtualization management operations comprises:

identifying at least one client partition in the one or more client partitions having resources associated with a virtual function of the I/O endpoint to be removed;

removing the virtual function and resources associated with the virtual function from use by the at least one client partition;

removing, from use by the IMP, a physical function and resources associated with the physical function of the I/O endpoint to be removed; and

powering down the I/O endpoint to be removed.

9. The method of claim 6, wherein the input from the HMC is a command to dynamically reconfigure the data processing system, and wherein performing the I/O virtualization management operations comprises:

receiving a selection of a virtual function of an I/O endpoint to add to a selected client partition in the one or more client partitions;

setting up resources for selected virtual function in the selected client partition;

creating at least one communication structure for the selected virtual function in the IMP and the selected client partition; and

loading a device driver for the selected virtual function in the selected client partition.

10. The method of claim 6, wherein the input from the HMC is a command to dynamically reconfigure the data processing system, and wherein performing the I/O virtualization management operations comprises:

receiving a selection of a virtual function of an I/O endpoint to remove from a selected client partition in the one or more client partitions;

removing the selected virtual function from further use by the selected client partition;

removing resources for selected virtual function in the selected client partition; and

removing a communication structure of the at least one communication structure for the selected virtual function in the IMP and the selected client partition.

11. The method of claim 6, wherein the input from the HMC is a command to change a network address associated with a selected virtual function of an I/O endpoint, and wherein performing the I/O virtualization management operations comprises:

identifying a physical function associated with the selected virtual function;

sending a management request to the IMP, wherein the management request includes address information for changing the network address of the selected virtual function; and

changing the network address of the selected virtual function via a device driver associated with the physical function based on the address information in the management request.

12. The method of claim 1, wherein performing the I/O virtualization management operations comprises:

receiving in the IMP, from a device driver in a client partition of the one or more client partitions, a query virtual function error state command via the at least one communication structure;

providing error information to the device driver from the IMP identifying an error state of a virtual function of an I/O endpoint;

logging, by the device driver, the error information received from the IMP;

sending a reset virtual function request from the device driver to the IMP via the at least one communication structure to reset the virtual function having the error state; and

configuring the virtual function after reset.

13. The method of claim 1, wherein performing the I/O virtualization management operations comprises:

detecting a client partition failure; and

posting an event to one or more communication structures, of the at least one communication structure, associated with virtual functions in the failed client partition, wherein the event causes the IMP to either remove the one or more communication structures associated with the virtual functions in the failed client partition or wait for the failed client partition to reboot and then re-establish a connection with the failed client partition.

14. The method of claim 1, wherein performing the I/O virtualization management operations comprises:

detecting a failure of the IMP;

posting an event to one or more communication structures, of the at least one communication structure, associated with the one or more client partitions for virtual functions associated with a physical function assigned to the IMP;

restoring operation of the failed IMP; and

restoring operations between the IMP and corresponding client partitions.

15. A computer program product comprising a computer readable storage medium having a computer readable program stored thereon, wherein the computer readable program, when executed in a data processing system, causes the data processing system to:

create one or more client partitions in the data processing system, each client partition having an associated portion of resources of the data processing system;

create, in the data processing system, an I/O virtualization management partition (IMP), wherein the IMP performs I/O virtualization management operations with an I/O endpoint of the data processing system to thereby manage a set of physical functions, comprising one or more physical functions of the I/O endpoint, and wherein each client partition in the one or more client partitions is not permitted to perform I/O virtualization management operations on the set of physical functions but is permitted to perform I/O virtualization management operations on one or more virtual functions in the I/O endpoint that are associated with the client partition;

create at least one communication structure for communicating between the IMP and the one or more client partitions; and

perform, by the IMP, the I/O virtualization management operations with the I/O endpoint using the at least one communication structure.

16. The computer program product of claim 15, wherein the computer readable program causes the data processing system to create one or more client partitions, create the IMP, and create the at least one communication structure using a hypervisor associated with the data processing system.

17. The computer program product of claim 16, wherein the hypervisor is provided with access to configuration spaces for physical functions and virtual functions in the I/O endpoint, and wherein the IMP is provided with access to only configuration spaces for physical functions assigned to the IMP and configuration spaces for virtual functions belonging to physical functions assigned to the IMP, in the I/O endpoint.

18. The computer program product of claim 17, wherein the one or more client partitions do not have direct access to configuration spaces of virtual functions assigned to the one or more client partitions, in the I/O endpoint, and only access the configuration spaces of virtual functions assigned to the one or more client partitions via the IMP using the at least one communication structure.

19. The computer program product of claim 18, wherein the IMP permits access by a client partition to configuration spaces of virtual functions, in the I/O endpoint, assigned to the client partition and blocks access by the client partition to configuration spaces of virtual functions, in the I/O endpoint, that are not assigned to the client partition.

20. A data processing system, comprising:

one or more client partitions, each client partition having an associated portion of resources of the data processing system;

an I/O virtualization management partition (IMP) in communication with the one or more client partitions;

I/O endpoint in communication with the IMP, wherein the IMP performs I/O virtualization management operations with an I/O endpoint of the data processing system to thereby manage a set of physical functions, comprising one or more physical functions of the I/O endpoint, and wherein each client partition in the one or more client partitions is not permitted to perform I/O virtualization management operations on the set of physical functions but is permitted to perform I/O virtualization management operations on one or more virtual functions in the I/O endpoint that are associated with the client partition; and

at least one communication structure provided in association with the IMP and the one or more client partitions, wherein the IMP performs the I/O virtualization management operations with the I/O endpoint using the at least one communication structure.