Remote shared server peripherals over an ethernet network for resource virtualization

• US 10,880,235 B2
• Filed: 04/03/2018
• Issued: 12/29/2020
• Est. Priority Date: 08/20/2009
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Cohen, Ariel, Krishnamurthi, Ashok, Krishnamurthy, Viswanath, Salzmann, Frank, Allison, David S., Tang, Cheng
• Primary Examiner(s): Joshi, Suraj M
• Assistant Examiner(s): Lin, Sherman
• Application Number:
  US15/944,391
• Publication Number:
  US 20180227248A1
• Time in Patent Office: 1,001 Days
• Field of Search: 709226, 709250, 709220, 709223
• CPC Class Codes: H04L 49/351 for local area network [LAN], e.g. Ethernet switches

Abstract

Provided is a novel approach for connecting servers to peripherals, such as NICs, HBAs, and SAS/SATA controllers. Also provided are methods of arranging peripherals within one or more I/O directors, which are connected to the servers over an Ethernet network. Such arrangement allows sharing the same resource among multiple servers.

Claims

1. A method to facilitate virtualizing I/0 resources, the method comprising:

communicatively connecting a plurality of Ethernet network interfaces to a plurality of servers via a first Ethernet network, each server of the plurality of servers comprising one or more processors and memory;

communicatively connecting a first plurality of output ports of an I/0 director to a first plurality of external devices over a second Ethernet network;

mapping with a network processor a plurality of virtual network interface cards with the first plurality of output ports;

maintaining a plurality of media access control (MAC) addresses for the plurality of servers with the network processor; and

facilitating, with the I/O director, sharing of one or more common, shared Network Interface Controllers (NICs) and Host Bus Adapters (HBAs) to the plurality of servers at least in part by;

associating the plurality of servers with a plurality of virtual network interface cards executed by the I/0 director;

communicating with each of the plurality of servers using a management protocol over the first Ethernet network;

processing multicast discovery packets transmitted from virtual network interface card drivers of the plurality of servers according to the management protocol to facilitate discovery of remote I/0 resources of the second Ethernet network by the plurality of servers, the multicast discovery packets comprising server identifiers and corresponding server attributes;

creating server objects based at least in part on the multicast discovery packets;

determining whether the I/O director retains corresponding server profiles;

responding to the plurality of servers with unicast packets containing first information facilitating establishment of connections with a session manager of the I/O director;

establishing with learning logic a mapping of the plurality of virtual network interface cards to the plurality of MAC addresses, at least in part by storing mapping specifications as data packets arrive from one or more servers of the plurality of servers; and

in response to a connection being established with one server of the plurality of servers using the first information of the unicast packets, uploading, to the one server of the plurality of servers, second information on one or more of the plurality of virtual network interface cards and/or a plurality of virtual host bus adapters allocated to the one server.

2. The method to facilitate virtualizing I/O resources of claim 1, where each server of the plurality of servers:

establishes communication with the I/O director using the management protocol; and

discovers the remote I/O resources on the second Ethernet network using the management protocol;

wherein the mapping of the plurality of virtual network interface cards with the first plurality of output ports is performed dynamically.

3. The method to facilitate virtualizing I/O resources of claim 1, further comprising:

communicatively connecting a second plurality of output ports to a second plurality of external devices over a first Fibre Channel network, wherein the plurality of servers is associated with the plurality of virtual host bus adapters; and

mapping the plurality of virtual host bus adapters with the second plurality of output ports, wherein the mapping of the plurality of virtual host bus adapters with the second plurality of output ports is performed dynamically.

4. The method to facilitate virtualizing I/O resources of claim 1, further comprising:

communicatively connecting a second plurality of output ports to a second plurality of external devices, wherein the plurality of servers is associated with a plurality of adapters selected from a group consisting of serial ATA (SATA) adapters, serial attached SCSI (SAS) adapters, RAID adapters, Fibre Channel host bus adapters, and iSCSI host bus adapters; and

mapping the plurality of adapters with the second plurality of output ports.

5. The method to facilitate virtualizing I/O resources of claim 1, further comprising:

facilitating, via the I/O director, communication among servers within the plurality of servers, wherein the communication is performed using one or more protocols selected from a group consisting of Sockets Direct Protocol (SDP), Reliable Datagram Sockets (RDS), and Message Passing Interface (MPI).

6. The method to facilitate virtualizing I/O resources of claim 1, further comprising:

removing transport protocol headers from the data packets received from the plurality of servers;

assigning internal headers to the data packets; and

sending the data packets with the internal headers to the one or more of the plurality of virtual network interface cards.

7. The method to facilitate virtualizing I/O resources of claim 1, wherein the storing the mapping specifications comprises populating a mapping table as the data packets arrive from the one or more servers of the plurality of servers, and the learning logic is configured to:

examine the data packets received from the one or more servers of the plurality of servers on the one or more of the plurality of virtual network interface cards; and

identify from the data packets one or more MAC addresses of the plurality of MAC addresses;

wherein the establishing the mapping comprises mapping the identified one or more MAC addresses to the one or more of the plurality of virtual network interface cards.

8. One or more non-transitory, machine-readable media having machine-readable instructions thereon, which, when executed by one or more processing devices, cause the one or more processing devices to:

cause communicatively connecting of a plurality of Ethernet network interfaces to a plurality of servers via a first Ethernet network, each server of the plurality of servers comprising one or more processors and memory;

cause communicatively connecting of a first plurality of output ports of an I/O director to a first plurality of external devices over a second Ethernet network;

map a plurality of virtual network interface cards with the first plurality of output ports;

maintain a plurality of media access control (MAC) addresses for the plurality of servers; and

facilitate, with the I/0 director, sharing of one or more common, shared Network Interface Controllers (NICs) and Host Bus Adapters (HBAs) to the plurality of servers at least in part by;

associate the plurality of servers with the plurality of virtual network interface cards executed by the I/0 director;

causing communicating with each of the plurality of servers using a management protocol over the first Ethernet network;

processing multicast discovery packets transmitted from virtual network interface card drivers of the plurality of servers according to the management protocol to facilitate discovery of remote I/0 resources of the second Ethernet network by the plurality of servers, the multicast discovery packets comprising server identifiers and corresponding server attributes;

creating server objects based at least in part on the multicast discovery packets;

determining whether the I/O director retains corresponding server profiles;

causing responding to the plurality of servers with unicast packets containing first information facilitating establishment of connections with a session manager of the I/O director;

establishing with learning logic a mapping of the plurality of virtual network interface cards to the plurality of MAC addresses, at least in part by storing mapping specifications as data packets arrive from one or more servers of the plurality of servers; and

in response to a connection being established with one server of the plurality of servers using the first information of the unicast packets, causing uploading, to the one server of the plurality of servers, of second information on one or more of the plurality of virtual network interface cards and/or a plurality of virtual host bus adapters allocated to the one server.

9. The one or more non-transitory, machine-readable media of claim 8, where each server of the plurality of servers:

establishes communication with the I/O director using the management protocol; and

discovers the remote I/O resources on the second Ethernet network using the management protocol;

wherein the mapping of the plurality of virtual network interface cards with the first plurality of output ports is performed dynamically.

10. The one or more non-transitory, machine-readable media of claim 8, the one or more processing devices further to:

cause communicatively connecting of a second plurality of output ports to a second plurality of external devices over a first Fibre Channel network, wherein the plurality of servers is associated with the plurality of virtual host bus adapters; and

map the plurality of virtual host bus adapters with the second plurality of output ports, wherein the mapping of the plurality of virtual host bus adapters with the second plurality of output ports is performed dynamically.

11. The one or more non-transitory, machine-readable media of claim 8, the one or more processing devices further to:

cause communicatively connecting of a second plurality of output ports to a second plurality of external devices, wherein the plurality of servers is associated with a plurality of adapters selected from a group consisting of serial ATA (SATA) adapters, serial attached SCSI (SAS) adapters, RAID adapters, Fibre Channel host bus adapters, and iSCSI host bus adapters; and

map the plurality of adapters with the second plurality of output ports.

12. The one or more non-transitory, machine-readable media of claim 8, the one or more processing devices further to:

facilitate, via the I/O director, communication among servers within the plurality of servers, wherein the communication is performed using one or more protocols selected from a group consisting of Sockets Direct Protocol (SDP), Reliable Datagram Sockets (RDS), and Message Passing Interface (MPI).

13. The one or more non-transitory, machine-readable media of claim 8, the one or more processing devices further to:

remove transport protocol headers from the data packets received from the plurality of servers;

assign internal headers to the data packets; and

cause sending of the data packets with the internal headers to the one or more of the plurality of virtual network interface cards.

14. The one or more non-transitory, machine-readable media of claim 8, wherein the storing the mapping specifications comprises populating a mapping table as the data packets arrive from the one or more servers of the plurality of servers, and wherein the learning logic is configured to:

examine the data packets received from the one or more servers of the plurality of servers on the one or more of the plurality of virtual network interface cards; and

identify from the data packets one or more MAC addresses of the plurality of MAC addresses;

wherein the establishing the mapping comprises mapping the identified one or more MAC addresses to the one or more of the plurality of virtual network interface cards.

15. A device to facilitate virtualizing I/O resources, the device comprising:

an I/O director communicatively connectable with a first Ethernet network and a second Ethernet network, the I/O director comprising;

a plurality of Ethernet network interfaces communicatively connectable to a plurality of servers over the first Ethernet network;

a first plurality of output ports communicatively connectable to a first plurality of external devices over the second Ethernet network; and

a network processor operable to map a plurality of virtual network interface cards with the first plurality of output ports, wherein the network processor is further operable to maintain a plurality of media access control (MAC) addresses for the plurality of servers;

the I/O director to facilitate sharing of one or more common, shared Network Interface Controllers (NICs) and Host Bus Adapters (HBAs) to the plurality of servers at least in part by;

associating the plurality of servers with the plurality of virtual network interface cards executed by the I/O director;

communicating with each of the plurality of servers using a management protocol over the first Ethernet network;

processing multicast discovery packets transmitted from virtual network interface card drivers of the plurality of servers according to the management protocol to facilitate discovery of remote I/O resources of the second Ethernet network by the plurality of servers, the multicast discovery packets comprising server identifiers and corresponding server attributes;

creating server objects based at least in part on the multicast discovery packets;

determining whether the I/O director retains corresponding server profiles;

responding to the plurality of servers with unicast packets containing first information facilitating establishment of connections with a session manager of the I/O director;

establishing with learning logic a mapping of the plurality of virtual network interface cards to the plurality of MAC addresses, at least in part by storing mapping specifications as data packets arrive from one or more servers of the plurality of servers; and

in response to a connection being established with one server of the plurality of servers using the first information of the unicast packets, uploading, to the one server of the plurality of servers, second information on one or more of the plurality of virtual network interface cards and/or a plurality of virtual host bus adapters allocated to the one server.

16. The device to facilitate virtualizing I/O resources of claim 15, where each server of the plurality of servers:

establishes communication with the I/O director using the management protocol; and

discovers the remote I/O resources on the second Ethernet network using the management protocol;

wherein the mapping of the plurality of virtual network interface cards with the first plurality of output ports is performed dynamically.

17. The device to facilitate virtualizing I/O resources of claim 15, the I/O director further to:

communicatively connect of a second plurality of output ports to a second plurality of external devices over a first Fibre Channel network, wherein the plurality of servers is associated with the plurality of virtual host bus adapters; and

map the plurality of virtual host bus adapters with the second plurality of output ports, wherein the mapping of the plurality of virtual host bus adapters with the second plurality of output ports is performed dynamically.

18. The device to facilitate virtualizing I/O resources of claim 15, the I/O director further to:

communicatively connect of a second plurality of output ports to a second plurality of external devices, wherein the plurality of servers is associated with a plurality of adapters selected from a group consisting of serial ATA (SATA) adapters, serial attached SCSI (SAS) adapters, RAID adapters, Fibre Channel host bus adapters, and iSCSI host bus adapters; and

map the plurality of adapters with the second plurality of output ports.

19. The device to facilitate virtualizing I/O resources of claim 15, the I/O director further to:

facilitate communication among servers within the plurality of servers, wherein the communication is performed using one or more protocols selected from a group consisting of Sockets Direct Protocol (SDP), Reliable Datagram Sockets (RDS), and Message Passing Interface (MPI).

20. The device to facilitate virtualizing I/O resources of claim 15, the I/O director further to:

remove transport protocol headers from the data packets received from the plurality of servers;

assign internal headers to the data packets; and

cause sending of the data packets with the internal headers to the one or more of the plurality of virtual network interface cards.