Ranking of gateways in cluster

• US 10,560,320 B2
• Filed: 06/29/2016
• Issued: 02/11/2020
• Est. Priority Date: 06/29/2016
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Shakimov, Amre, Ganichev, Igor, Thakkar, Pankaj, Atteka, Ansis
• Primary Examiner(s): Rahman, S M A
• Assistant Examiner(s): Siddiqi, Emad
• Application Number:
  US15/196,530
• Publication Number:
  US 20180006880A1
• Time in Patent Office: 1,322 Days
• Field of Search: 709222
• CPC Class Codes: H04L 41/0661 by reconfiguring faulty entities
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 41/0806 for initial configuration or provisioning, e.g. plug-and-play
• CPC Class Codes: H04L 41/0816 the condition being an adaptation, e.g. in response to network events
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 69/325 in the network layer [OSI layer 3], e.g. X.25 H04L69/16 takes precedence
• CPC Class Codes: H04L 69/40 for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection management of faults, events, alarms or notifications in data switching networks H04L41/06

Abstract

Some embodiments provide a method for managing a set of forwarding elements. The method receives configuration information for a set of gateways specifying (i) multiple gateways for implementing logical router ports and (ii) a ranking order of the gateways in the set. The method configures a first gateway in the ranking order as a master gateway for the set of gateways. Upon receiving a first notification that the first gateway is not operational, the method configures a second gateway in the ranking order as the master gateway for the set of gateways. Upon receiving a second, subsequent notification that the first gateway has resumed operation, the method maintains the second gateway in the ranking order as the master gateway for the set of gateways and configures the first gateway in the ranking order as a first standby gateway.

Claims

1. For a logical network comprising a logical router implemented across a plurality of host computers that execute a plurality of managed forwarding elements (MFEs), a method for managing a set of gateways that are different than the plurality of MFEs and that implement a particular logical port of the logical router through which data messages are sent from the logical network to a particular network external to the logical network, the method comprising:

at a central controller,

receiving configuration data specifying a ranking order of the gateways in the set of gateways;

configuring the plurality of MFEs to use a first gateway as a master gateway to send data message traffic through the particular logical port to the external network, wherein the first gateway is first in the specified ranking order;

upon receiving a first notification that the first gateway is not operational, configuring the plurality of MFEs to use a second gateway as the master gateway to send data message traffic through the particular logical port to the external network, wherein the second gateway is second in the specified ranking order; and

upon receiving a second, subsequent notification that the first gateway has resumed operation, maintaining the second gateway as the master gateway in order to avoid disrupting data message traffic from the logical network to the external network.

2. The method of claim 1, wherein configuring the plurality of MFEs that implement the logical network comprises configuring the plurality of MFEs to use the master gateway to send data message traffic to the external network.

3. The method of claim 2, wherein the logical network further comprises a plurality of logical switches that connect to the logical router through logical ports other than the particular logical port, wherein the particular logical port is an uplink port through which data messages are sent to and received from the external network.

4. The method of claim 3, wherein the uplink port logically connects to another logical router.

5. The method of claim 3, wherein the uplink port logically connects to a set of physical routers external to the logical network.

6. The method of claim 1, wherein the set of gateways implements a plurality of logical uplink ports of a plurality of logical routers.

7. The method of claim 1, wherein the received configuration data is a first configuration data comprising a first ordered list that specifies, in order, (i) the first gateway, (ii) the second gateway, and (ii) a third gateway.

8. The method of claim 7, wherein the second and third gateways operate as first and second standby gateways when the first gateway is the master.

9. The method of claim 7 further comprising

defining a second configuration data comprising a second ordered list that specifies, in order, (i) the second gateway and (ii) at least the third gateway, and does not include the first gateway;

and

using the second configuration data to configure the plurality of MFEs to use the second gateway as the master gateway.

10. The method of claim 9, wherein maintaining the second gateway as the master gateway comprises defining a third configuration data comprising a third ordered list that specifies, in order, (i) the second gateway, (ii) the first gateway, and (iii) at least the third gateway.

11. The method of claim 1 further comprising distributing an ordered list of the set of gateways to a set of controllers that manage the set of gateways.

12. The method of claim 11 wherein configuring the plurality of MFEs comprises communicating configuration data comprising the ordered list to local controllers that execute on the plurality of host computers and that manage each of the MFEs in the plurality of MFEs.

13. The method of claim 12, wherein a particular local controller receives the ordered list and configures its corresponding MFE to forward data messages, for the particular logical port implemented by the gateways, based on the ordered list.

14. The method of claim 13, wherein the data messages are forwarded according to a bundle flow that specifies the first gateway in the ordered list as a first choice and the second gateway in the ordered list as a next choice to use only if the first gateway in the ordered list is unavailable.

15. A non-transitory machine readable medium storing a central controller program which when executed by at least one processing unit manages a set of gateways in a logical network comprising a logical router implemented across a plurality of host computers that execute a plurality of managed forwarding elements (MFEs), the gateways, that are different than the plurality of MFEs, implementing a particular logical port of the logical router through which data messages are sent from the logical network to a particular network external to the logical network, the central controller program comprising sets of instructions for:

receiving configuration data specifying a ranking order of the gateways in the set of gateways;

configuring the plurality of MFEs to use a first gateway as a master gateway to send data message traffic through the particular logical port to the external network, wherein the first gateway is first in the specified ranking order;

upon receiving a first notification that the first gateway is not operational, configuring the plurality of MFEs to use a second gateway as the master gateway to send data message traffic through the particular logical port to the external network, wherein the second gateway is second in the specified ranking order; and

upon receiving a second, subsequent notification that the first gateway has resumed operation, maintaining the second gateway as the master gateway in order to avoid disrupting data message traffic from the logical network to the external network.

16. The non-transitory machine readable medium of claim 15, wherein the logical network further comprises a plurality of logical switches that connect to the logical router through logical ports other than the particular logical port, wherein the particular logical port is an uplink port through which data messages are sent to and received from the external network.

17. The non-transitory machine readable medium of claim 15, wherein the received configuration data is a first configuration data comprising a first ordered list that specifies, in order, (i) the first gateway, (ii) the second gateway, and (ii) a third gateway.

18. The non-transitory machine readable medium of claim 17, further comprising a set of instructions for:

defining a second configuration data comprising a second ordered list that specifies, in order, (i) the second gateway and (ii) at least the third gateway, and does not include the first gateway; and

using the second configuration data to configure the plurality of MFEs to use the second gateway as the master gateway.

19. The non-transitory machine readable medium of claim 18, wherein the set of instructions for maintaining the second gateway as the master gateway comprises a set of instructions for defining a third configuration data comprising a third ordered list that specifies, in order, (i) the second gateway, (ii) the first gateway, and (iii) at least the third gateway.

20. The non-transitory machine readable medium of claim 15 further comprising distributing an ordered list of the set of gateways to a set of controllers that manage the set of gateways, wherein the set of instructions for configuring the plurality of MFEs comprises a set of instructions for communicating configuration data comprising the ordered list to local controllers that execute on the plurality of host computers and that manage each of the MFEs in the plurality of MFEs.

21. The non-transitory machine readable medium of claim 20, wherein a particular local controller receives the ordered list and configures its corresponding MFE to forward data messages, for the particular logical port implemented by the gateways, based on the ordered list, wherein the data messages are forwarded according to a bundle flow that specifies the first gateway in the ordered list as a first choice and the second gateway in the ordered list as a next choice to use only if the first gateway in the ordered list is unavailable.