Implementing fixed points in network state updates using generation numbers

• US 9,602,422 B2
• Filed: 06/26/2014
• Issued: 03/21/2017
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Yip, Alexander, Hinrichs, Timothy L., Padmanabhan, Amar, Gude, Natasha, Ganichev, Igor, Chalvadi, Anuprem
• Primary Examiner(s): BOUTAH, ALINA A
• Application Number:
  US14/316,789
• Publication Number:
  US 20150319031A1
• Time in Patent Office: 999 Days
• Field of Search: 709/223, 370/254
• US Class Current: 1/1
• CPC Class Codes: H04L 41/042 comprising distributed management centres cooperatively managing the network
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 41/0873 Checking configuration conflicts between network elements
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/56 implementing delay-aware scheduling
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Some embodiments provide a novel network control system that provides publications for managing different slices (e.g., logical and/or physical entities) of a network. The publications are published from publisher controllers in the network control system to subscriber controllers. The network control system uses publications with generation numbers and buffered subscribers to implement the fixed points in order to help maintain a consistent network state. The information published with a publication is useful for resolving conflicts in the network control system when multiple publisher controllers provide conflicting inputs to a subscriber controller.

Claims

1. A machine-readable medium storing a program executable by at least one processing unit of a particular publisher controller in a network control system, the network control system comprising a plurality of controllers that manage a plurality of forwarding elements in order to implement a plurality of logical datapath sets, the plurality of controllers comprising a plurality of publisher controllers, the program comprising sets of instructions for:

identifying a first set of publications that the particular publisher controller is responsible for publishing, the publications including network state data;

publishing the first set of publications with a first generation number to a set of subscriber controllers of the plurality of controllers;

detecting a change in an allocation of publication responsibilities of at least one publisher controller of the plurality of publisher controllers;

determining a second generation number based on the changed allocation; and

publishing, with the second generation number, a second set of publications for which the particular publisher controller is responsible based on the changed allocation.

2. The machine-readable medium of claim 1, wherein the first and second sets of publications comprise state data relating to a set of logical datapath sets of the plurality of logical datapath sets.

3. The machine-readable medium of claim 1, wherein the first and second sets of publications comprise state data relating to a set of forwarding elements of the plurality of forwarding elements.

4. The machine-readable medium of claim 1, wherein the program further comprises a set of instructions for notifying other controllers of the plurality of controllers about the second generation number.

5. The machine-readable medium of claim 4, wherein the set of instructions for notifying other controllers of the plurality of controllers comprises a set of instructions for updating a centralized database with the second generation number.

6. The machine-readable medium of claim 1, wherein the set of instructions for detecting the change in the allocation comprises a set of instructions for detecting that a publisher controller of the plurality of publisher controllers has failed.

7. The machine-readable medium of claim 1, wherein the set of instructions for detecting the change in the allocation comprises a set of instructions for detecting that a publisher controller of the plurality of publisher controllers that was previously responsible for a particular publication is no longer responsible for the particular publication.

8. The machine-readable medium of claim 1, wherein when the change in the allocation does not affect the particular publisher controller, the second set of publications comprises the same publications as the first set of publications.

9. For a subscriber controller of a network control system that manages a plurality of forwarding elements in order to implement a plurality of logical datapath sets, a method comprising:

receiving a first publication comprising network state data, the first publication having a first generation number from a first publisher controller;

receiving a second publication comprising network state data, the second publication having a second generation number from a second publisher controller;

when the first generation number is more current than the second generation number, storing the first publication;

when the second generation number is more current than the first generation number, storing the second publication; and

computing a set of outputs using the stored publication for implementing the plurality of logical datapath sets.

10. The method of claim 9, wherein the network state data of the publications is related to a set of forwarding elements of the plurality of forwarding elements.

11. The method of claim 10, wherein computing the set of outputs comprises computing forwarding rules for the set of forwarding elements based on the network state data.

12. The method of claim 9, wherein the network state data of the publications is related to a set of logical datapath sets of the plurality of logical datapath sets.

13. The method of claim 12, wherein computing the set of outputs comprises computing physical forwarding state data for the set of logical datapath sets based on the network state data.

14. The method of claim 9, wherein the first generation number is more current than the second generation number when the first generation number is higher than the second generation number.

15. The method of claim 9 further comprising removing the second publication when the stored first publication is the same as the received second publication.

16. For a particular publisher controller in a network control system comprising a plurality of controllers that manage a plurality of forwarding elements in order to implement a plurality of logical datapath sets, the plurality of controllers comprising a plurality of publisher controllers, a method comprising:

identifying a first set of publications that the particular publisher controller is responsible for publishing, the publication including network state data;

publishing the first set of publications with a first generation number to a set of subscriber controllers of the plurality of controllers;

detecting a change in an allocation of publication responsibilities of at least one publisher controller of the plurality of publisher controllers;

determining a second generation number based on the changed allocation; and

publishing, with the second generation number, a second set of publications for which the particular publisher controller is responsible based on the changed allocation.

17. The method of claim 16, wherein the first and second sets of publications comprise state data relating to a set of logical datapath sets of the plurality of logical datapath sets.

18. The method of claim 16, wherein the first and second sets of publications comprise state data relating to a set of forwarding elements of the plurality of forwarding elements.

19. The method of claim 16 further comprising notifying other controllers of the plurality of controllers about the second generation number.

20. The method of claim 19, wherein notifying the other controllers of the plurality of controllers comprises updating a centralized database with the second generation number.