Buffered subscriber tables for maintaining a consistent network state

• US 10,164,894 B2
• Filed: 06/26/2014
• Issued: 12/25/2018
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Yip, Alexander, Hinrichs, Timothy L., Padmanabhan, Amar, Gude, Natasha, Ganichev, Igor, Chalvadi, Anuprem
• Primary Examiner(s): Chacko, Joe
• Application Number:
  US14/316,786
• Publication Number:
  US 20150319062A1
• Time in Patent Office: 1,643 Days
• CPC Class Codes: H04L 41/042 comprising distributed management centres cooperatively managing the network
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 41/0873 Checking configuration conflicts between network elements
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/56 implementing delay-aware scheduling
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Some embodiments provide a novel network control system that provides publications for managing different slices (e.g., logical and/or physical entities) of a network. The publications are published from publisher controllers in the network control system to subscriber controllers. The network control system uses publications with generation numbers and buffered subscribers to implement the fixed points in order to help maintain a consistent network state. Buffered subscribers buffer the inputs received from a publisher in case the publisher becomes unavailable. Rather than deleting all of the output state that is based on the published inputs, the buffered subscriber allows the subscriber to maintain the network state until an explicit change to the state is received at the subscriber from a publisher (e.g., a restarted publisher, a backup publisher, etc.).

Claims

1. A non-transitory machine-readable medium storing a program executable by at least one processing unit of a subscriber controller in a network control system, the program for the subscriber controller comprising sets of instructions for:

receiving a first set of inputs from a first publisher controller that publishes a particular publication including network state data comprising metadata for resolving conflicts in the network state, wherein metadata in a publication comprises an identification of the publication;

detecting a disconnection between the subscriber controller and the first publisher controller; and

while the subscriber controller and the first publisher controller are disconnected;

maintaining the first set of inputs received from the first publisher controller in a buffered input table to ensure that the network state data is not lost;

receiving a second set of inputs of the particular publication from a second publisher controller that publishes the particular publication, the second set of inputs including network state data comprising metadata for resolving conflicts in the network state; and

in the buffered input table, replacing the first set of inputs with the second set of inputs based on a comparison of the metadata received from the first and second publisher controllers, wherein a conflict occurs when the network state data received from the first and second publishers comprises identification of a same publication.

2. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for maintaining the first set of inputs comprises a set of instructions for generating outputs based on the first set of inputs for propagation of network state data.

3. The non-transitory machine-readable medium of claim 2, wherein the generated outputs comprise a set of forwarding rules for the plurality of forwarding elements in the network control system.

4. The non-transitory machine-readable medium of claim 2, wherein the first and second sets of inputs comprise a set of logical forwarding data that describes a set of logical datapath sets and the generated outputs comprise a set of physical forwarding data for implementing the set of logical datapath sets on the plurality of forwarding elements.

5. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for detecting the disconnection comprises a set of instructions for determining that the first publisher controller has failed.

6. The non-transitory machine-readable medium of claim 1, wherein the set of instructions for detecting the disconnection comprises a set of instructions for determining that the first publisher controller is no longer responsible for publishing the particular publication.

7. The non-transitory machine-readable medium of claim 6, wherein the set of instructions for determining that the first publisher controller is no longer responsible for publishing the particular publication comprises sets of instructions for:

receiving a list of publications for which the first publisher controller is responsible; and

determining that the particular publication is no longer on the list of publications.

8. The non-transitory machine-readable medium of claim 1, wherein the first and second publisher controllers are master controllers and the subscriber controller is a standby controller.

9. The non-transitory machine-readable medium of claim 1, wherein the first and second publisher controllers are physical controllers and the subscriber controller is a logical controller.

10. For a subscriber controller in a network control system that comprises a plurality of controllers, a method comprising:

receiving, at the subscriber controller, a first set of inputs of a particular publication from a first publisher controller that publishes the particular publication, the particular publication comprising network state data comprising metadata for resolving conflicts in the network state, wherein metadata in a publication comprises an identification of the publication;

detecting a disconnection between the subscriber controller and the first publisher controller; and

while the subscriber controller and the first publisher controller are disconnected;

maintaining the first set of inputs received from the first publisher controller in a buffered input table to ensure that the network state data is not lost;

receiving a second set of inputs of the particular publication from a second publisher controller that publishes the particular publication, the second set of inputs including network state data comprising metadata for resolving conflicts in the network state; and

in the buffered input table, replacing the first set of inputs with the second set of inputs based on a comparison of the metadata received from the first and second publisher controllers, wherein a conflict occurs when the network state data received from the first and second publishers comprises identification of a same publication.

11. The method of claim 10, wherein maintaining the first set of inputs comprises generating outputs based on the first set of inputs for propagation of network state data.

12. The method of claim 11, wherein the generated outputs comprise a set of forwarding rules for the plurality of forwarding elements in the network control system.

13. The method of claim 11, wherein the first and second sets of inputs comprise a set of logical forwarding data that describes a set of logical datapath sets and the generated outputs comprise a set of physical forwarding data for implementing the set of logical datapath sets on the plurality of forwarding elements.

14. The method of claim 10, wherein detecting the disconnection comprises determining that the first publisher controller has failed.

15. The method of claim 10, wherein detecting the disconnection comprises determining that the first publisher controller is no longer responsible for publishing the particular publication.

16. The method of claim 15, wherein determining that the first publisher controller is no longer responsible for publishing the particular publication comprises:

receiving a list of publications for which the first publisher controller is responsible; and

determining that the particular publication is no longer on the list of publications.

17. The method of claim 10, wherein the first and second publisher controllers are master controllers and the subscriber controller is a standby controller.

18. The method of claim 10, wherein the first and second publisher controllers are physical controllers and the subscriber controller is a logical controller.