Graceful port shutdown protocol for fibre channel interfaces

• US 7,593,324 B2
• Filed: 10/25/2004
• Issued: 09/22/2009
• Est. Priority Date: 10/25/2004
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Rajagopalan, Ranganathan, Gupta, Shashank, Jain, Praveen, Jain, Sachin, Janakiraman, Ramsundar
• Primary Examiner(s): Jung; Min
• Application Number:
  US10/974,368
• Publication Number:
  US 20060087963A1
• Time in Patent Office: 1,793 Days
• Field of Search: 370/216, 370/217, 370/225, 370/227, 370/228, 714 1- 4, 714/24, 709223-226
• US Class Current: 370/227
• CPC Class Codes: H04L 49/357 Fibre channel switches
• CPC Class Codes: H04L 49/552 by ensuring the integrity of packets received through redundant connections

Abstract

A port shutdown protocol coordinates among various components involved in the process of administratively bringing down a link at both ends of a link connecting two switches. Execution of the protocol avoids or reduces frame drops and/or reordering. In this protocol, peer switches perform various actions when bringing down an ISL in a synchronized manner. In one implementation, this protocol uses the Exchange Peer Protocol (EPP) as the underlying transport to carry the port shutdown protocol frames.

Claims

1. A method of gracefully shutting down an inter-switch link between a first switch and a second switch on a Fibre Channel network, the method comprising:

(a) determining that the inter-switch link is to be shut-down;

(b) modifying forwarding parameters in the first switch to ensure that no further frames are forwarded from the first switch onto the inter-switch link and sending one or more communications to the second switch;

(c) sending a communication to the second switch informing it that the link is to be shut down;

(d) modifying forwarding parameters in the second switch to ensure that no frames are forwarded from the second switch onto the inter-switch link;

(e) ensuring that no frames remain queued in the first switch for transmission on the inter-switch link;

(f) receiving confirmation from the second switch that it is prepared for the inter-switch link to shut down; and

(g) shutting down the inter-switch link.

2. The method of claim 1, further comprising aborting and/or completing at least one pending change for the inter-switch link.

3. The method of claim 2, wherein the aborting and/or completing is performed prior to modifying said forwarding parameters.

4. The method of claim 1, wherein sending one or more communications between the switches to ensure that both switches will participate in a graceful shut down protocol comprises communicating in an EPP protocol.

5. The method of claim 1, wherein modifying said forwarding parameters comprises updating a forwarding table on said switch.

6. The method of claim 5, wherein modifying said forwarding parameters comprises informing other switches on a network fabric with said switch, but not on the inter-switch link, that said inter-switch link will shut down in order to cause said other switches to update their forwarding tables.

7. The method of claim 1, wherein ensuring that no frames remain queued on the switch comprises waiting for a defined period of time for any queued frames to drain onto the inter-switch link.

8. The method of claim 1, wherein ensuring that no frames remain queued on the switch comprises deterministically confirming that there are no queued packets in the switch for transmission on the inter-switch link.

16. The computer program product of claim 1, wherein the instructions for modifying the forwarding parameters comprises instructions for updating a forwarding table on said switch.

17. The computer program product of claim 16, wherein the instructions for modifying said forwarding parameters further comprises instructions for informing other switches on a network fabric including said switch, but not via the inter-switch link, that said inter-switch link will shut down in order to cause said other switches to update their forwarding tables.

9. A storage area network comprising:

a first Fibre Channel switch;

a second Fibre Channel switch; and

an inter-switch link coupling the first and second Fibre Channel switches,

wherein the first Fibre Channel switch comprises logic for

(a) determining that the inter-switch link is to be shut-down;

(b) modifying forwarding parameters in the first switch to ensure that no further frames are forwarded from the first switch onto the inter-switch link and sending one or more communications to the second switch;

(c) sending a communication to the second switch informing it that the link is to be shut down;

(d) ensuring that no frames remain queued in the first switch for transmission on the inter-switch link;

(e) receiving confirmation from the second switch that it is prepared for the inter-switch link to shut down; and

(f) shutting down the inter-switch link,

wherein the second Fibre Channel switch comprises logic for

(a) modifying forwarding parameters in the second switch to ensure that no frames are forwarded from second switch onto the inter-switch link;

(b) ensuring that no frames remain queued in the second switch for transmission on the inter-switch link; and

(c) sending a confirmation to the first switch that the second switch is prepared for the inter-switch link to shut down.

10. A Fibre Channel switch, comprising:

means for determining that an inter-switch link with a second Fibre Channel switch is to be shut down;

means for modifying forwarding parameters to ensure that no further frames are forwarded from the switch onto the inter-switch link and sending one or more communications to the second Fibre Channel switch;

means for sending a communication to the second switch informing it that the inter-switch link is to be shut down, wherein the communication comprises an indication that forwarding parameters in the second Fibre Channel switch be modified to ensure that no frames are forwarded from the second Fibre Channel switch onto the inter-switch link;

means for ensuring that no frames remain queued on the switch for transmission on the inter- switch link;

means for receiving confirmation from the second Fibre Channel switch that it is prepared for the inter-switch link to shut down; and

means for shutting down the inter-switch link.

11. A computer program product comprising a tangible storage medium on which is provided instructions for gracefully shutting down an inter-switch link between a first switch and a second switch on a Fibre Channel network, the instructions comprising:

determining that the inter-switch link is to be shut down;

modifying forwarding parameters to ensure that no further frames are forwarded from the first switch onto the link and sending one or more communications to the second switch;

sending a communication to the second switch informing it that the link is to be shut down, wherein the communication comprises an indication that forwarding parameters in the second switch be modified to ensure that no frames are forwarded from the second switch onto the inter-switch link;

ensuring that no frames remain queued on the first switch for transmission on the inter- switch link;

receiving confirmation from the second switch that it is prepared for the inter-switch link to shut down; and

shutting down the inter-switch link.

12. The computer program product of claim 11, further comprising instructions for aborting and/or completing at least one pending change for the inter-switch link.

13. The computer program product of claim 12, wherein the aborting and/or completing is performed prior to modifying said forwarding parameters.

14. The computer program product of claim 11, wherein the instructions for sending a communication to the second switch comprises instructions for sending a communication in an EPP protocol.

15. The computer program product of claim 11, wherein the instructions for sending a communication to the second switch comprises instructions for sending a communication in a protocol other than EPP.

18. The computer program product of claim 11, wherein the instructions for ensuring that no frames remain queued on the switch comprises instructions for waiting for a defined period of time for any queued frames to drain onto the inter-switch link.

19. The computer program product of claim 11, wherein the instructions for ensuring that no frames remain queued on the switch comprises deterministically confirming that there are no queued packets in the switch for transmission on the inter-switch link.

20. The computer program product of claim 11, further comprising instructions for bringing down the inter-switch link after ensuring that no frames remain queued on the switch for transmission on the inter-switch link.

21. A Fibre Channel switch, comprising:

a port for connecting to an inter-switch link with a second Fibre Channel switch; and

at least one processor configured to do the following;

determining that the inter-switch link is to be shut down;

modifying forwarding parameters to ensure that no further frames are forwarded from the switch onto the inter-switch link and sending one or more communications to the second Fibre Channel switch;

sending a communication to the second switch informing it that the inter-switch link is to be shut down, wherein the communication comprises an indication that forwarding parameters in the second Fibre Channel switch be modified to ensure that no frames are forwarded from the second Fibre Channel switch onto the inter-switch link;

ensuring that no frames remain queued on the switch for transmission on the inter-switch link;

receiving confirmation from the second Fibre Channel switch that it is prepared for the inter-switch link to shut down; and

shutting down the inter-switch link.

22. The Fibre Channel switch of claim 21, wherein the at least one processor is further configured to abort and/or complete at least one pending change for the inter-switch link.

23. The Fibre Channel switch of claim 22, wherein the at least one processor is further configured to abort and/or complete the at least one pending change prior to modifying the forwarding parameters.

24. The Fibre Channel switch of claim 21, wherein modifying said forwarding parameters comprises updating a forwarding table on said switch.

25. The Fibre Channel switch of claim 24, wherein modifying said forwarding parameters further comprises informing other switches on a network fabric including said switch, but not via the inter-switch link, that said inter-switch link will shut down in order to cause said other switches to update their forwarding tables.

26. The Fibre Channel switch of claim 21, wherein ensuring that no frames remain queued on the switch comprises waiting for a defined period of time for any queued frames to drain onto the inter-switch link.

27. The Fibre Channel switch of claim 21, wherein the at least one processor is further configured to shut down the inter-switch link after ensuring that no frames remain queued on the switch for transmission on the inter-switch link.

28. The Fibre Channel switch of claim 21, wherein sending a communication to the second switch comprises communicating using an EPP protocol.

29. The Fibre Channel switch of claim 21, wherein sending a communication to the second switch comprises communicating using a protocol other than EPP.

30. A line card operable for use in a Fibre Channel switch, the line card comprising:

an interface for communicating with a Fibre Channel switch;

a port for connecting to an inter-switch link with a second Fibre Channel switch; and

at least one processor configured to do the following;

determine that the inter-switch link is to be shut down;

modify forwarding parameters to ensure that no further frames are forwarded from the switch onto the inter-switch link and sending one or more communications to the second Fibre Channel switch;

send a communication to the second switch informing it that the inter-switch link is to be shut down, wherein the communication comprises an indication that forwarding parameters in the second Fibre Channel switch be modified to ensure that no frames are forwarded from the second Fibre Channel switch onto the inter-switch link;

ensure that no frames remain queued on the switch for transmission on the inter- switch link;

receive confirmation from the second Fibre Channel switch that it is prepared for the inter-switch link to shut down; and

shut down the inter-switch link.

31. The line card of claim 30, wherein the at least one processor is further configured to abort and/or complete at least one pending change for the inter-switch link.

32. The line card of claim 30, wherein modifying the forwarding parameters comprises updating a forwarding table on said switch.

33. The line card of claim 32, wherein modifying said forwarding parameters further comprises informing other switches on a network fabric including said switch, but not via the inter-switch link, that said inter-switch link will shut down in order to cause said other switches to update their forwarding tables.

34. The line card of claim 30, wherein ensuring that no frames remain queued on the switch comprises waiting for a defined period of time for any queued frames to drain onto the inter-switch link.

35. The line card of claim 30, wherein the at least one processor is further configured to shut down the inter-switch link after ensuring that no frames remain queued on the switch for transmission on the inter-switch link.

36. The line card of claim 30 wherein sending a communication to the second switch comprises communicating using an EPP protocol.

37. The line card of claim 30, wherein sending a communication to the second switch comprises communicating using a protocol other than EPP.