Storing network state at a network controller

• US 9,602,312 B2
• Filed: 06/30/2014
• Issued: 03/21/2017
• Est. Priority Date: 07/08/2013
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Koponen, Teemu, Davie, Bruce, Stribling, Jeremy
• Primary Examiner(s): PHUNKULH, BOB A
• Application Number:
  US14/320,614
• Publication Number:
  US 20150009835A1
• Time in Patent Office: 995 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
• CPC Class Codes: H04L 41/0661 by reconfiguring faulty entities
• CPC Class Codes: H04L 41/0695 the faulty arrangement being the maintenance, administration or management system
• CPC Class Codes: H04L 41/0816 the condition being an adaptation, e.g. in response to network events
• CPC Class Codes: H04L 41/0873 Checking configuration conflicts between network elements
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/28 Restricting access to network management systems or functions, e.g. using authorisation function to access network configuration
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 45/02 Topology update or discovery
• CPC Class Codes: H04L 45/036 Updating the topology between route computation elements, e.g. between OpenFlow controllers
• CPC Class Codes: H04L 45/04 Interdomain routing, e.g. hierarchical routing
• CPC Class Codes: H04L 45/64 using an overlay routing layer
• CPC Class Codes: H04L 63/0263 Rule management
• CPC Class Codes: H04L 63/20 for managing network security; network security policies in general filtering policies H04L63/0227

Abstract

Some embodiments provide a network controller for managing a logical network that spans several physical domains. The network controller is located at a particular one of the several physical domains. The network controller includes a first storage for storing network state information that is local to the particular physical domain. The network controller includes a second storage for storing a first type of global network state information for the logical network. The network controller includes a third storage for storing a second type of global network state information for the logical network. The network controller includes an interface for communicating with other network controllers located at the other physical domains in the several physical domains spanned by the logical network. The interface is for sharing the first and second types of global network state information.

Claims

1. For a first network controller located at a first physical domain that manages a logical network spanning a plurality of physical domains including the first physical domain, a method comprising:

storing state information for the logical network in at least two storages;

determining that communication is no longer available with a second network controller at a second of the physical domains spanned by the logical network;

in response to the determination, modifying a first one of the storages to be read-only while leaving a second one of the storages as writeable while communication with the second network controller is not available;

while communication with the second network controller is not available;

receiving input to modify the network state information in the second storage;

modifying the network state information in the second storage based on the input; and

storing the modification to the network state in a local queue of network state updates;

determining that communication with the second network controller has been restored; and

based on the determination that communication has been restored, transmitting the network state updates stored in the local queue to the second network controller.

2. The method of claim 1 further comprising:

while communication with the second network controller is not available;

receiving input to modify the network state information in the first storage; and

returning an error message indicating that the network state information cannot be modified.

3. The method of claim 1, wherein the first network controller also stores network state information for a plurality of additional logical networks in the first and second storages.

4. The method of claim 1, wherein the first network controller manages a first set of forwarding elements at the first physical domain and the second network controller manages a second set of forwarding elements at the second physical domain.

5. The method of claim 4, wherein the forwarding elements at the first and second physical domains implement the logical network as well as a plurality of additional logical networks.

6. The method of claim 1, wherein the first storage stores network state information that is local to the particular physical domain.

7. The method of claim 1, wherein the second storage stores global network state information for the logical network that cannot be reconciled between physical domains after a period of disconnection.

8. For a first network controller located at a first domain that manages a logical network spanning a plurality of physical domains including the first domain, a method comprising:

storing state information for the logical network in at least two storages;

determining that communication is no longer available with a second network controller at a second of the physical domains spanned by the logical network;

in response to the determination, modifying a first one of the storages to be read-only while leaving a second one of the storages as writeable while communication with the second network controller is not available; and

while communication with the second network controller is not available;

receiving input to modify the network state information in the second storage;

modifying the network state information in the second storage based on the input;

storing the modification to the network state in a local queue of network state updates;

receiving a second input to modify the network state information in the second storage;

determining that the local queue is full; and

returning an error message indicating that the network state information cannot be modified.

9. The method of claim 8 further comprising:

determining that communication with the second network controller has been restored; and

transmitting the network state updates stored in the local queue to the second network controller.

10. The method of claim 8, wherein the first network controller manages a first set of forwarding elements at the first physical domain and the second network controller manages a second set of forwarding elements at the second physical domain.

11. The method of claim 10, wherein the forwarding elements at the first and second physical domains implement the logical network as well as a plurality of additional logical networks.

12. The method of claim 8, wherein the first network controller also stores network state information for a plurality of additional logical networks in the first and second storages.

13. The method of claim 8, wherein the first storage stores network state information that is local to the particular physical domain.

14. The method of claim 8, wherein the second storage stores global network state information for the logical network that cannot be reconciled between physical domains after a period of disconnection.

15. A non-transitory machine readable medium storing a program for a first network controller located at a first domain that manages a logical network spanning a plurality of physical domains including the first domain, the program for execution by at least one processing unit, the program comprising sets of instructions for:

storing a first type of state information for the logical network in a first storage and a second type of state information for the logical network in a second storage;

determining that communication is no longer available with a second network controller at a second of the physical domains spanned by the logical network; and

in response to the determination, modifying the first storage so that the first type of state information is read-only while leaving the second storage as writeable so that the second type of state information is modifiable, while communication with the second network controller is not available;

while communication with the second network controller is not available;

receiving input to modify the network state information in the second storage;

modifying the network state information in the second storage based on the input; and

storing the modification to the network state in a local queue of network state updates;

determining that communication with the second network controller has been restored; and

based on the determination that communication has been restored, transmitting the network state updates stored in the local queue to the second network controller.

16. The non-transitory machine readable medium of claim 15, wherein the program further comprises sets of instructions for:

while communication with the second network controller is not available;

receiving input to modify the network state information in the first storage; and

returning an error message indicating that the network state information cannot be modified.

17. The non-transitory machine readable medium of claim 15, wherein the first network controller manages a first set of forwarding elements at the first physical domain and the second network controller manages a second set of forwarding elements at the second physical domain.

18. The non-transitory machine readable medium of claim 17, wherein the forwarding elements at the first and second physical domains implement the logical network as well as a plurality of additional logical networks.

19. The non-transitory machine readable medium of claim 15, wherein the first network controller also stores network state information for a plurality of additional logical networks in the first and second storages.

20. The non-transitory machine readable medium of claim 15, wherein the first storage stores network state information that is local to the particular physical domain.

21. The non-transitory machine readable medium of claim 15, wherein the second storage stores global network state information for the logical network that cannot be reconciled between physical domains after a period of disconnection.