Methods and apparatus for network congestion control

• US 7,596,627 B2
• Filed: 12/18/2001
• Issued: 09/29/2009
• Est. Priority Date: 12/18/2001
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Hoffman, Robert L., Cometto, Maurilio, Morandin, Guglielmo M., Kloth, Raymond J.
• Primary Examiner(s): JEAN GILLES, JUDE
• Application Number:
  US10/026,583
• Publication Number:
  US 20030115355A1
• Time in Patent Office: 2,842 Days
• Field of Search: 370230-236, 370/403, 370/351, 370/354, 709/223, 709/219, 709/234, 709/235, 709/241, 709/238, 709/230, 709/232, 710/20, 714/748, 714/749
• US Class Current: 709/235
• CPC Class Codes: H04L 47/12 Avoiding congestion; Recovering from congestion
• CPC Class Codes: H04L 47/17 Interaction among intermediate nodes, e.g. hop by hop
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/266 Stopping or restarting the source, e.g. X-on or X-off
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: Y02D 30/50 in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

Methods and apparatus are provided for controlling congestion in a network such as a fibre channel network. Techniques are provided for characterizing traffic flow at a congested network node. The congested network node can generate various instructions such as quench messages to control traffic flow towards the congested network node. The quench messages can optionally include information about the characteristics of the congestion. The instructions are distributed to other nodes in the network. The other network nodes can interpret the instructions and control traffic flow towards the congested node.

Claims

1. A method comprising:

receiving a frame having a source identifier field corresponding to a source node and a destination identifier field corresponding to a destination node, the frame having been transmitted to a fibre channel network switch through a plurality of switches including a first intermediate switch between the network switch and the source node;

characterizing traffic flow at the network switch, wherein characterizing traffic flow comprises determining an amount of congestion control needed in a fibre channel fabric, wherein if a moderate amount of congestion control is needed, a first instruction is generated and if a significant amount of congestion control is needed, a second instruction is generated; and

wherein the first instruction, having a source identifier field corresponding to the destination node and a destination identifier field corresponding to the source node, reduces transmissions only at the first intermediate switch and the second instruction reduces transmissions at a plurality of switches including the first intermediate switch.

2. The method of claim 1, wherein the first intermediate switch is an edge switch coupled to the source node.

3. The method of claim 2, wherein the first instruction is sent to the first intermediate switch and comprises an edge quench frame.

4. The method of claim 3, wherein the edge quench frame includes network switch congestion information.

5. The method of claim 4, wherein the edge quench frame includes network switch queue level information that indicates whether an optimal queue level has been exceeded.

6. The method of claim 5, wherein the edge quench frame directs the first intermediate switch to control the allowed rate for transmitting from the source node and the destination node by half.

7. The method of claim 6, wherein the first intermediate switch and the network switch are connected using fibre channel.

8. The method of claim 1, wherein the frame was transmitted through a second intermediate switch between the first intermediate switch and the network switch.

9. The method of claim 8, further comprising:

sending the second instruction from the network to the second intermediate switch to control traffic from the source node to the destination node.

10. The method of claim 9, wherein the second instruction sent to the second intermediate switch comprises the path quench frame.

11. The method of claim 10, wherein the path quench frame has a source identifier field corresponding to the destination node and a destination identifier field corresponding to the source node.

12. The method of claim 11, wherein the path quench frame includes network switch congestion information.

13. The method of claim 12, wherein the path quench frame includes network switch queue level information.

14. The method of claim 13, wherein the path quench frame directs the first and second intermediate switches to reduce the allowed rate for transmitting from the source node and the destination node to 0 bps.

15. The method of claim 1, wherein characterizing traffic flow comprises checking the network switch queue level.

16. The method of claim 1, wherein path quench frames are transmitted when the queue level exceeds a high threshold.

17. The method of claim 16, wherein edge quench frames are transmitted when the queue level is between a high threshold and a low threshold.

18. The method of claim 17, wherein the edge quench and path quench frames include a buffer level indicator.

19. An apparatus, comprising:

means for receiving a frame having a source identifier field corresponding to a source node and a destination identifier field corresponding to a destination node, the frame having been transmitted to a fibre channel network switch through a plurality of switches including a first intermediate switch between the network switch and the source node;

means for characterizing traffic flow at the network switch, wherein characterizing traffic flow comprises determining an amount of congestion control needed in a fibre channel fabric, wherein if a moderate amount of congestion control is needed, a first instruction is generated and if a significant amount of congestion control is needed, a second instruction is generated; and

wherein the first instruction, having a source identifier field corresponding to the destination node and a destination identifier field corresponding to the source node, reduces transmissions at the first intermediate switch and the second instruction reduces transmissions at a plurality of switches including the first intermediate switch.

20. The apparatus of claim 19, wherein the first intermediate switch is an edge switch coupled to the source node.

21. The apparatus of claim 20, wherein the first instruction is sent to the first intermediate switch and comprises an edge quench frame.

22. The apparatus of claim 21, wherein the edge quench frame has a source identifier field corresponding to the destination node and a destination identifier field corresponding to the source node.

23. A computer readable medium having computer code embodied therein, the computer readable medium comprising:

computer code for receiving a frame having a source identifier field corresponding to a source node and a destination identifier field corresponding to a destination node, the frame having been transmitted to a fibre channel network switch through a plurality of switches including a first intermediate switch between the network switch and the source node;

computer code for characterizing traffic flow at the network switch, wherein characterizing traffic flow comprises determining an amount of congestion control needed in a fibre channel fabric, wherein if a moderate amount of congestion control is needed, a first instruction is generated and if a significant amount of congestion control is needed, a second instruction is generated; and

wherein the first instruction, having a source identifier field corresponding to the destination node and a destination identifier field corresponding to the source node, reduces transmissions at the first intermediate switch and the second instruction reduces transmissions at a plurality of switches including the first intermediate switch.

24. The computer readable medium of claim 23, wherein the first intermediate switch is an edge switch coupled to the source node.

25. The computer readable medium of claim 24, wherein the first instruction is sent to the first intermediate switch and comprises an edge quench frame.

26. A system, comprising:

an interface operable to receive a fibre channel frame from a source node, the frame transmitted through a plurality of fibre channel switches including an edge switch connected to the source node;

a processor operable to characterize traffic flow and determine buffers levels at the interface, wherein buffer levels exceeding a high threshold triggers the generation of a path quench frame that is sent to the plurality of fibre channel switches including the edge switch to limit traffic flow to the interface and wherein buffer levels between a low threshold and a high threshold triggers the generation of an edge quench frame that is sent to the edge switch to reduce traffic flow to the interface from the edge switch,

wherein the edge quench frame has a source identifier field corresponding to the system and a destination identifier field corresponding to the source node.

27. The system of claim 26, wherein the path quench frame instructs the plurality of fibre channel switches including the edge switch to cease transmission of any fibre channel frames to the interface.

28. The system of claim 27, wherein the edge quench frame instructs the edge switch to reduce transmission of fibre channel frames to the interface.