Multipath selection in an ethernet fabric in a modular network element

• US 10,674,241 B2
• Filed: 04/23/2018
• Issued: 06/02/2020
• Est. Priority Date: 04/23/2018
• Status: Active Grant

• Current Assignee: Ciena Corporation
• Original Assignee: Ciena Corporation
• Inventors: Rivaud, Daniel, Duncan, Ian, Mayenburg, Anthony J., Tierney, James, Shearman, Simon J. E.
• Primary Examiner(s): Cosme, Natasha W
• Application Number:
  US15/959,820
• Publication Number:
  US 20190327542A1
• Time in Patent Office: 771 Days
• Field of Search: 370392
• CPC Class Codes: H04L 12/40013 Details regarding a bus controller
• CPC Class Codes: H04L 12/403 with centralised control, e.g. polling
• CPC Class Codes: H04L 45/38 Flow based routing
• CPC Class Codes: H04L 45/66 Layer 2 routing, e.g. in Ethernet based MAN's
• CPC Class Codes: H04L 47/12 Avoiding congestion; Recovering from congestion
• CPC Class Codes: H04L 49/15 Interconnection of switching modules
• CPC Class Codes: H04L 49/254 Centralised controller, i.e. arbitration or scheduling
• CPC Class Codes: H04L 49/30 Peripheral units, e.g. input or output ports
• CPC Class Codes: H04L 49/351 for local area network [LAN], e.g. Ethernet switches
• CPC Class Codes: H04L 49/40 Constructional details, e.g. power supply, mechanical construction or backplane
• CPC Class Codes: H04Q 11/0407 using a stored programme control

Abstract

Systems and methods of Ethernet path selection in a modular network element including one or more ingress line modules, a plurality of switch modules in a chassis, and one or more egress line modules, wherein the one or more ingress line modules and the one or more egress line modules are located separate from one another and connected to the chassis via cabling. The method includes distributing one or more Ethernet flows from the one or more ingress line modules to the one or more egress line modules via the plurality of switch modules; receiving fabric state information at the one or more ingress line modules from the core chassis out-of-band via the cabling; and, responsive to congestion on a path through the plurality of switch modules, selecting a new path by an ingress line module for an Ethernet flow.

Claims

1. A modular network element configured for Ethernet path selection, the modular network element comprising:

one or more ingress line modules;

one or more switch modules in a chassis; and

one or more egress line modules, wherein the one or more ingress line modules and the one or more egress line modules are located separate from the chassis and connected to the chassis via cabling,

wherein one or more Ethernet flows are distributed from the one or more ingress line modules to the one or more egress line modules via the plurality of switch modules,

wherein the one or more ingress line modules receive fabric state information from the chassis out-of-band via the cabling,

wherein, responsive to congestion on a path through the plurality of switch modules, a new path is selected by an ingress line module for an Ethernet flow,

wherein, prior to switching the Ethernet flow to the new path, a gap is created in the Ethernet flow through buffering such that the gap is no larger than a path delay difference between a current path and the new path, and wherein a size of the gap is set to a latency of the current path minus a latency of the new path plus a margin.

2. The modular network element of claim 1, wherein a Time Division Multiplexing (TDM) flow is fragmented and sent over a plurality of paths through the plurality of switch modules.

3. The modular network element of claim 1, wherein timing is distributed from the chassis out-of-band via the cabling, wherein the timing is determined at the chassis using a Time Division Multiplexing (TDM) flow which is spread over the plurality of switch modules.

4. The modular network element of claim 3, wherein the chassis utilizes a TDM packet header to estimate relative path latency differences.

5. The modular network element of claim 1, wherein a path selection is broadcast by each ingress line module to all other line modules and the chassis for each to maintain a global path table.

6. The modular network element of claim 1, wherein the Ethernet flow comprises an elephant flow and each flowburst of the elephant flow is eligible to take a different path if its interburst gap is larger than a difference in latency between a current path and the new path.

7. A modular network element configured for Ethernet path selection, the modular network element comprising:

one or more ingress line modules;

one or more switch modules in a chassis; and

one or more egress line modules, wherein the one or more ingress line modules and the one or more egress line modules are located separate from the chassis and connected to the chassis via cabling,

wherein one or more Ethernet flows are distributed from the one or more ingress line modules to the one or more egress line modules via the plurality of switch modules,

wherein the one or more ingress line modules receive fabric state information from the chassis out-of-band via the cabling,

wherein, responsive to congestion on a path through the plurality of switch modules, a new path is selected by an ingress line module for an Ethernet flow, and

wherein timing is distributed from the chassis out-of-band via the cabling, wherein the timing is determined at the chassis using a Time Division Multiplexing (TDM) flow which is spread over the plurality of switch modules, and wherein the chassis utilizes a TDM packet header to estimate relative path latency differences.

8. The modular network element of claim 7, wherein, prior to switching the Ethernet flow to the new path, a gap is created in the Ethernet flow through buffering such that the gap is no larger than a path delay difference between a current path and the new path.

9. The modular network element of claim 8, wherein a size of the gap is set to a latency of the current path minus a latency of the new path plus a margin.

10. The modular network element of claim 7, wherein a Time Division Multiplexing (TDM) flow is fragmented and sent over a plurality of paths through the plurality of switch modules.

11. The modular network element of claim 7, wherein a path selection is broadcast by each ingress line module to all other line modules and the chassis for each to maintain a global path table.

12. The modular network element of claim 7, wherein the Ethernet flow comprises an elephant flow and each flowburst of the elephant flow is eligible to take a different path if its interburst gap is larger than a difference in latency between a current path and the new path.

13. A modular network element configured for Ethernet path selection, the modular network element comprising:

one or more ingress line modules;

one or more switch modules in a chassis; and

one or more egress line modules, wherein the one or more ingress line modules and the one or more egress line modules are located separate from the chassis and connected to the chassis via cabling,

wherein one or more Ethernet flows are distributed from the one or more ingress line modules to the one or more egress line modules via the plurality of switch modules,

wherein the one or more ingress line modules receive fabric state information from the chassis out-of-band via the cabling,

wherein, responsive to congestion on a path through the plurality of switch modules, a new path is selected by an ingress line module for an Ethernet flow, and

wherein the Ethernet flow comprises an elephant flow and each flowburst of the elephant flow is eligible to take a different path if its interburst gap is larger than a difference in latency between a current path and the new path.

14. The modular network element of claim 13, wherein, prior to switching the Ethernet flow to the new path, a gap is created in the Ethernet flow through buffering such that the gap is no larger than a path delay difference between a current path and the new path.

15. The modular network element of claim 14, wherein a size of the gap is set to a latency of the current path minus a latency of the new path plus a margin.

16. The modular network element of claim 13, wherein a Time Division Multiplexing (TDM) flow is fragmented and sent over a plurality of paths through the plurality of switch modules.

17. The modular network element of claim 13, wherein timing is distributed from the chassis out-of-band via the cabling, wherein the timing is determined at the chassis using a Time Division Multiplexing (TDM) flow which is spread over the plurality of switch modules.

18. The modular network element of claim 17, wherein the chassis utilizes a TDM packet header to estimate relative path latency differences.

19. The modular network element of claim 13, wherein a path selection is broadcast by each ingress line module to all other line modules and the chassis for each to maintain a global path table.