Efficient algorithmic forwarding in fat-tree networks

• US 10,284,465 B2
• Filed: 12/28/2015
• Issued: 05/07/2019
• Est. Priority Date: 12/28/2015
• Status: Active Grant

• Current Assignee: Mellanox Technologies Limited (NVIDIA Corporation)
• Original Assignee: Mellanox Technologies TLV Ltd. (NVIDIA Corporation)
• Inventors: Haramaty, Zachy, Zahavi, Eitan, Rabenstein, Itamar
• Primary Examiner(s): Renner, Brandon M
• Assistant Examiner(s): Vogel, Jay L
• Application Number:
  US14/979,667
• Publication Number:
  US 20170187614A1
• Time in Patent Office: 1,226 Days
• CPC Class Codes: H04L 12/44 Star or tree networks
• CPC Class Codes: H04L 12/4625 Single bridge functionality, e.g. connection of two networks over a single bridge
• CPC Class Codes: H04L 45/48 Routing tree calculation
• CPC Class Codes: H04L 45/74 Address processing for routing
• CPC Class Codes: H04L 49/3045 Virtual queuing

Abstract

A switch includes multiple physical ports and forwarding circuitry. The physical ports are configured to receive and send packets over a network. The forwarding circuitry is configured to assign first port numbers to the physical ports, and second port numbers to temporary ports defined in addition to the physical ports, to receive a packet having a destination address via a physical port, to select, based on the destination address, an egress port number for the packet from among the first and second port numbers, to forward the packet to a physical port corresponding to the egress port number if the egress port number is one of the first port numbers, and, if the egress port number is one of the second port numbers, to map a temporary port associated with the egress port number to a mapped physical port and to forward the packet to the mapped physical port.

Claims

1. A switch, comprising:

multiple physical ports, which are configured to receive and send packets over a packet network, the physical ports comprising an up-number of physical ports via which the switch connects to parent switches and a down-number of physical ports via which the switch connects to child switches or end-nodes, wherein a number of the child switches or end-nodes is larger than a number of the parent switches; and

forwarding circuitry, which is configured to;

compare between the down-number and the up-number, and when the down-number is larger than the up-number, define one or more nonphysical temporary ports in addition to the physical ports, wherein a number of the nonphysical temporary ports equals a difference calculated as the down-number minus the up-number;

assign respective first port numbers to the physical ports, and assign respective second port numbers, different from the first port numbers, to the nonphysical temporary ports;

receive a packet having a destination address via a physical port of the switch and select, based on a comparison between a subset of bits defining the destination address, and bits defining an identifier of the switch, an intermediate port for the packet from among both the physical ports and the nonphysical temporary ports; and

forward the received packet to a physical port corresponding to the intermediate port if the intermediate port is one of the physical ports, and, if the intermediate port is one of the nonphysical temporary ports, map the intermediate port to a mapped physical port, based on the first and second port numbers, and forward the received packet to the mapped physical port.

2. The switch according to claim 1, wherein the switch connects to a first number of parent switches that is equal to or smaller than the up-number, and further connects to a second number of child switches or end-nodes that is equal to or smaller than the down-number, in a Fat-Tree network using the physical ports, and wherein the forwarding circuitry is configured to assign the second port numbers based on a difference between the first number and the second number.

3. The switch according to claim 2, wherein the switch resides in a given level of the Fat-Tree network, and wherein the forwarding circuitry is configured to select the intermediate port based at least on the given level.

4. The switch according to claim 1, wherein the forwarding circuitry is configured to select the intermediate port by applying a bit-group extraction operation to the destination address.

5. The switch according to claim 1, wherein in response to receiving an indication that sending packets via the physical port to which the intermediate port is mapped fails, the forwarding circuitry is configured to map the intermediate port to an alternative, operative physical port.

6. The switch according to claim 1, wherein the physical ports are connected to the network via output interfaces of the switch having respective interface numbers, wherein the interface numbers are an order permutation of the first port numbers, and wherein the forwarding circuitry is configured to map the intermediate port to a physical port that connects to an output interface having an interface number equal to a first port number associated with the mapped physical port.

7. The switch according to claim 1, wherein the switch further comprises a fallback forwarding database (FDB), wherein the forwarding circuitry is configured to select the intermediate port by applying to the destination address a bit-group extraction operation, and in response to detecting that a result of the bit-group extraction operation is invalid, to select the intermediate port using the fallback FDB.

8. The switch according to claim 1, wherein the forwarding circuitry is configured to select the intermediate port by extracting a bit-group comprising one or more bits of the destination address.

9. A method, comprising:

in a switch that comprises multiple physical ports that receive and send packets over a packet network, wherein the physical ports comprising an up-number of physical ports via which the switch connects to parent switches and a down-number of physical ports via which the switch connects to child switches or end-nodes, wherein a number of the child switches or end-nodes is larger than a number of the parent switches,

comparing between the down-number and the up-number, and when the down-number is larger than the up-number, defining one or more nonphysical temporary ports in addition to the physical ports, wherein a number of the nonphysical temporary ports equals a difference calculated as the down-number minus the up-number;

assigning respective first port numbers to the physical ports, and assigning respective second port numbers, different from the first port numbers, to the nonphysical temporary ports;

receiving a packet having a destination address via a physical port of the switch, and selecting, based on a comparison between a subset of bits defining the destination address, and bits defining an identifier of the switch, an intermediate port for the packet from among both the physical ports and the nonphysical temporary ports; and

forwarding the received packet to a physical port corresponding to the intermediate port if the intermediate port is one of the physical ports, and, if the intermediate port is one of the nonphysical temporary ports, mapping intermediate port to a mapped physical port, based on the first and second port numbers, and forwarding the received packet to the mapped physical port.

10. The method according to claim 9, wherein the switch connects to a first number of parent switches that is equal to or smaller than the up-number, and further connects to a second number of child switches or end-nodes that is equal to or smaller than the down-number, in a Fat-Tree network using the physical ports, and wherein assigning the second port numbers comprises setting the second port numbers based on a difference between the first number and the second number.

11. The method according to claim 10, wherein the switch resides in a given level of the Fat-Tree network, and wherein selecting the intermediate port comprises choosing the intermediate port based at least on the given level.

12. The method according to claim 9, wherein selecting the intermediate port comprises choosing the intermediate port by applying a bit-group extraction operation to the destination address.

13. The method according to claim 9, and comprising, in response to receiving an indication that sending packets via the physical port to which the intermediate port is mapped fails, mapping the intermediate port to an alternative, operative physical port.

14. The method according to claim 9, wherein the physical ports are connected to the network via output interfaces of the switch having respective interface numbers, wherein the interface numbers are an order permutation of the first port numbers, and wherein mapping the intermediate port comprises mapping the intermediate port to a physical port that connects to an output interface having an interface number equal to a first port number associated with the mapped physical port.

15. The method according to claim 9, wherein the switch further comprises a fallback forwarding database (FDB), wherein selecting the intermediate port comprises applying to the destination address a bit-group extraction operation, and, in response to detecting that a result of the bit-group extraction operation is invalid, selecting the intermediate port using the fallback FDB.

16. The method to claim 9, wherein selecting the intermediate port comprises extracting a bit-group comprising one or more bits of the destination address.

17. A switch, comprising:

multiple physical ports, which are configured to receive and send packets over a packet network, the physical ports comprising an up-number of physical ports via which the switch connects to parent switches and a down-number of physical ports via which the switch connects to child switches or end-nodes, wherein a number of the child switches or end-nodes is larger than or equal to a number of the parent switches; and

forwarding circuitry, which is configured to;

calculate a number of temporary ports as a difference of the down-number minus the up-number;

compare between the down-number and the up-number, and when the down-number is larger than the up-number, define one or more nonphysical temporary ports in addition to the physical ports;

assign respective first port numbers to the physical ports, and when the number of temporary ports is nonzero assign respective second port numbers, different from the first port numbers, to the nonphysical temporary ports;

receive a packet having a destination address via a physical port of the switch and select, based on a comparison between a subset of bits defining the destination address, and bits defining an identifier of the switch, an intermediate port for the packet from among the physical ports or when the number of temporary ports is nonzero from among both the physical ports and the nonphysical temporary ports; and

forward the received packet to a physical port corresponding to the intermediate port if the intermediate port is one of the physical ports, and, when the number of temporary ports is nonzero and the intermediate port is one of the nonphysical temporary ports, map the intermediate port to a mapped physical port, based on the first and second port numbers, and forward the received packet to the mapped physical port.

18. A method, comprising:

in a switch that comprises multiple physical ports that receive and send packets over a packet network, wherein the physical ports comprising an up-number of physical ports via which the switch connects to parent switches and a down-number of physical ports via which the switch connects to child switches or end-nodes, wherein a number of the child switches or end-nodes is larger than or equal to a number of the parent switches,

calculating a number of temporary ports as a difference of the down-number minus the up-number;

comparing between the down-number and the up-number, and when the down-number is larger than the up-number, defining one or more nonphysical temporary ports in addition to the physical ports;

assigning respective first port numbers to the physical ports, and when the number of temporary ports is nonzero assigning respective second port numbers, different from the first port numbers, to the nonphysical temporary ports;

receiving a packet having a destination address via a physical port of the switch, and selecting, based on a comparison between a subset of bits defining the destination address, and bits defining an identifier of the switch, an intermediate port for the packet from among the physical ports or when the number of temporary ports in nonzero from among both the physical ports and the nonphysical temporary ports; and

forwarding the received packet to a physical port corresponding to the intermediate port if the intermediate port is one of the physical ports, and, when the number of temporary ports is nonzero and the intermediate port is one of the nonphysical temporary ports, mapping the intermediate port to a mapped physical port, based on the first and second port numbers, and forwarding the received packet to the mapped physical port.