Implementing redundancy on infiniband (IB) networks

• US 9,369,334 B2
• Filed: 07/24/2014
• Issued: 06/14/2016
• Est. Priority Date: 08/30/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Gavrilov, Constantine, Machulsky, Zorik, Shalev, Leah
• Primary Examiner(s): Moore, Ian N
• Assistant Examiner(s): La, Phong
• Application Number:
  US14/339,894
• Publication Number:
  US 20140334290A1
• Time in Patent Office: 691 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04L 2101/622 Layer-2 addresses, e.g. medium access control [MAC] addresses
• CPC Class Codes: H04L 41/0654 using network fault recovery ring fault isolation or reconfiguration in loop networks without recovery actions by a network management system H04L12/437
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 45/28 using route fault recovery
• CPC Class Codes: H04L 61/103 across network layers, e.g. resolution of network layer into physical layer addresses or address resolution protocol [ARP]
• CPC Class Codes: H04L 61/2514 between local and global IP addresses

Abstract

Methods, systems, and physical computer-readable storage medium are provided to improve efficiency of systems operating on internet protocol (IP) over Infiniband (IB) networks. In an embodiment, by way of example only, a method is provided for implementing redundancy for IB networks. The method includes detecting a failure at a first source port of a source node having a plurality of source ports, selecting a new source port, sending an address resolution protocol (ARP) message to one or more other nodes in communication with the source node including an IP address of the source node and IB address of the new source port of the source node, and re-balancing host traffic.

Claims

1. A method of implementing redundancy for Infiniband (IB) networks, the method comprising:

detecting a failure at a first source port of a source node having a plurality of source ports;

selecting a new source port of the source node;

determining in a first level of an address resolution protocol (ARP) cache a corresponding IP over IB global unique identifier (GUID) of a destination node to the IP address of the destination node;

locating a corresponding IB address to the IP over IB GUID of the destination node in a second level of the ARP cache;

sending an ARP announce message to one or more other nodes in communication with the source node by identifying the one or more other nodes in communication with the source node from a global ARP cache, wherein the ARP announce message includes an IP address of a second source node and an IB address of the new source port of the source node;

re-balancing host traffic across the plurality of IB nodes; and

identifying from a plurality of source ports of the source node the new source port of the source node with which to receive traffic from the one or more other nodes, after the step of detecting.

2. The method of claim 1, wherein the global ARP cache comprises a first level and a second level, the first level includes a plurality of IP addresses and corresponding IP over IB GUIDs of at least one of the other nodes, and the second level includes the IP over IB GUIDs and corresponding IB addresses of at least one of the other nodes.

3. The method of claim 2, further comprising updating the global ARP cache to invalidate references to an address handle associated with the first source port in all entries in the global ARP cache.

4. The method of claim 1, wherein the step of rebalancing comprises identifying one or more nodes that communicate with the source node and notifying the one or more nodes of the address of the new source port.

5. The method of claim 4, wherein the step of notifying comprises multicasting the IB address of the new source port to the one or more nodes.

6. The method of claim 1, wherein:

the step of rebalancing comprises identifying one or more nodes that communicate with the source node and unicasting the IB address of the new source port to a destination node; and

the step of sending the ARP announce message comprises identifying the one or more nodes in communication with the source node from a global ARP cache.

7. An Infiniband system comprising:

a plurality of nodes, each node including more than one port;

an IB switch connected to the plurality of nodes; and

a processor configured

to detect a failure at a first port of a first node;

to select a new source port of the first node;

to determine in a first level of an address resolution protocol (ARP) cache a corresponding IP over IB global unique identifier (GUID) of a destination node to the IP address of the destination node;

to locate a corresponding IB address to the IP over IB GUID of the destination node in a second level of the ARP cache;

to send an ARP announce message to one or more nodes of the plurality of IB nodes in communication with the first node by identifying the one or more other nodes in communication with the source node from a global ARP cache, wherein the ARP announce message includes an IP address of the first node and IB address of the new port of the first node;

to re-balance host traffic across the plurality of IB nodes; and

to identify from a plurality of source ports of the source node the new source port of the source node with which to receive traffic from the one or more other nodes, after the step of detecting.

8. The Infiniband system of claim 7, further comprising a plurality of IB switches connecting at least two nodes.

9. The Infiniband system of claim 7, wherein each node includes a two-level ARP cache, the two level ARP cache has a first level and a second level, the first level includes a plurality of IP addresses and corresponding IP over IB GUIDs of at least one of the other nodes, and the second level includes the IP over IB GUIDs and corresponding IB addresses of at least one of the other nodes.

10. Executing data instructions, by a processor, embodied on a physical non-transitory computer-readable storage medium comprising a computer program product for implementing redundancy for Infiniband (IB) networks, the physical computer-readable storage medium comprising:

computer code for detecting a failure at a first source port of a source node having a plurality of source ports;

computer code for selecting a new source port;

computer code for determining in a first level of an address resolution protocol (ARP) cache a corresponding IP over IB global unique identifier (GUID) of a destination node to the IP address of the destination node;

computer code for locating a corresponding IB address to the IP over IB GUID of the destination node in a second level of the ARP cache;

computer code for sending an ARP announce message to one or more other nodes in communication with the source node by identifying the one or more other nodes in communication with the source node from a global ARP cache, wherein the ARP announce message includes an IP address of the source node and IB address of the new source port of the source node;

computer code for re-balancing host traffic across the plurality of IB nodes; and

computer code for identifying from a plurality of source ports of the source node the new source port of the source node with which to receive traffic from the one or more other nodes, after the step of detecting.

11. The physical non-transitory computer-readable storage medium of claim 10, wherein the global ARP cache is configured to include a first level and a second level, the first level includes a plurality of IP addresses and corresponding IP over IB GUIDs of at least one of the other nodes, and the second level includes the IP over IB GUIDs and corresponding IB addresses of at least one of the other nodes.

12. The physical non-transitory computer-readable storage medium of claim 11, further comprising computer code for updating the global ARP cache to invalidate references to an address handle associated with the first source port in all entries in the global ARP cache.

13. The physical non-transitory computer-readable storage medium of claim 10, further comprising computer code for identifying one or more nodes that communicate with the source node and notifying the one or more nodes of the address of the new source port.

14. The physical non-transitory computer-readable storage medium of claim 13, further comprising computer code for multicasting the address of the new source port.

15. The physical non-transitory computer-readable storage medium of claim 10, wherein:

the computer code for rebalancing comprises computer code for identifying one or more nodes that communicate with the source node and unicasting the address of the new source port to a destination node; and

the computer code for sending the ARP announce message comprises computer code for identifying the one or more nodes in communication with the source node from a global ARP cache.