Secondary storage architecture for a network control system that utilizes a primary network information base

• US 8,880,468 B2
• Filed: 07/06/2011
• Issued: 11/04/2014
• Est. Priority Date: 07/06/2010
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Koponen, Teemu, Casado, Martin, Stribling, Jeremy, Gude, Natasha
• Primary Examiner(s): Uddin, Mohammed R
• Application Number:
  US13/177,537
• Publication Number:
  US 20130060737A1
• Time in Patent Office: 1,217 Days
• Field of Search: 707/634, 707/688, 707/795, 777/999.105
• US Class Current: 707/634
• CPC Class Codes: G06F 11/07 Responding to the occurrence of a fault, e.g. fault tolerance
• CPC Class Codes: G06F 15/17312 Routing techniques specific to parallel machines, e.g. wormhole, store and forward, shortest path problem congestion routing on a LAN H04L45/00
• CPC Class Codes: H04L 12/4633 Interconnection of networks using encapsulation techniques, e.g. tunneling
• CPC Class Codes: H04L 2101/622 Layer-2 addresses, e.g. medium access control [MAC] addresses
• CPC Class Codes: H04L 41/0816 the condition being an adaptation, e.g. in response to network events
• CPC Class Codes: H04L 41/0853 by actively collecting configuration information or by backing up configuration information
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/122 of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV]
• CPC Class Codes: H04L 45/00 Routing or path finding of packets in data switching networks routing or path finding in wireless networks H04W40/00
• CPC Class Codes: H04L 45/02 Topology update or discovery
• CPC Class Codes: H04L 45/036 Updating the topology between route computation elements, e.g. between OpenFlow controllers
• CPC Class Codes: H04L 45/586 of virtual routers
• CPC Class Codes: H04L 45/76 Routing in software-defined topologies, e.g. routing between virtual machines
• CPC Class Codes: H04L 47/783 Distributed allocation of resources, e.g. bandwidth brokers
• CPC Class Codes: H04L 49/00 Packet switching elements
• CPC Class Codes: H04L 49/1546 using pipelined operation
• CPC Class Codes: H04L 49/3063 Pipelined operation
• CPC Class Codes: H04L 49/70 : Virtual switches
• CPC Class Codes: H04L 61/5007 : Internet protocol [IP] addresses

Abstract

Some embodiments provide a system for managing several switching elements. The system includes a network information base (NIB) data structure for serving as a primary storage structure for storing data for managing the several switching elements. The system includes a secondary storage structure for storing a copy of a set of data stored in the primary storage structure for managing the several the switching elements.

Claims

1. A controller computer that executes a controller instance for execution by at least one processing unit, the controller instance for managing a plurality of switching elements that forward data packets in a network, the controller instance comprising:

a set of applications for generating data to implement a plurality of logical datapath sets, for a plurality of different users, on the plurality of switching elements;

a network information base (NIB) data structure for serving as a primary storage structure for storing the generated data; and

a plurality of secondary storage structures, each secondary storage structure for (i) storing at least a subset of the data stored in the primary storage structure and (ii) providing a different interface for supplying and retrieving data to and from the secondary storage structure,

wherein at least a portion of the data stored in at least one of the primary and secondary storage structures is supplied as physical control plane data to at least one particular switching element of the plurality of switching elements in order for the particular switching element to implement a particular logical datapath set for a particular user, and

wherein the controller computer comprises a memory storage device for storing the NIB data structure.

2. The controller computer of claim 1, wherein at least one of the secondary storage structures stores the subset of data in order to improve the resiliency of the controller instance in an event that the NIB data structure'"'"'s operation fails.

3. The controller computer of claim 2, wherein the memory storage device for storing the NIB data structure is a volatile memory and the NIB operation fails when the controller computer on which the NIB data structure is stored fails or turns off.

4. The controller computer of claim 3, wherein the memory storage device is a first memory storage device, the controller computer further comprising a second memory storage device for storing at least one secondary storage structure of the plurality of secondary storage structures, wherein the second memory storage device is a non-volatile memory.

5. The controller computer of claim 1, wherein the plurality of secondary storage structures comprises a particular secondary storage structure for accessing the subset of the data faster than accessing the data stored in the NIB data structure.

6. The controller computer of claim 5, wherein the particular secondary storage structure is a distributed hash table.

7. The controller computer of claim 1, wherein the plurality of secondary storage structures comprises a particular secondary storage structure for (i) processing a plurality of queries on the subset of the data and (ii) undoing a set of the plurality of queries on the subset of the data.

8. The controller computer of claim 7, wherein the particular secondary storage structure is a transactional database.

9. The controller computer of claim 1, wherein each user of the plurality of users is a tenant in a multi-tenant server hosting system.

10. For a controller, a method for managing a plurality of switching elements that forward network data in a network, the method comprising:

generating data to implement a plurality of logical datapath sets, for a plurality of different users, on the plurality of switching elements;

at a network information base (NIB) data structure for serving as a primary storage structure, storing the generated data; and

at a plurality of secondary storage structures, storing a plurality of different subsets of the generated data stored in the primary storage structure, wherein each secondary storage structure provides a different interface for supplying and retrieving data to and from the secondary storage structure, wherein at least a portion of the data stored in at least one of the primary and secondary storage structures is supplied as physical control plane data to at least one particular switching element of the plurality of switching elements in order for the particular switching element to implement a particular logical datapath set for a particular user.

11. The method of claim 10, wherein at least one of the plurality of secondary storage structures stores a subset of the generated data in order to improve the resiliency of the system in an event that the NIB data structure'"'"'s operation fails.

12. The method of claim 11, wherein the NIB data structure is stored in a volatile memory and the NIB operation fails when a machine on which the NIB data structure is stored fails or turns off.

13. The method of claim 12, wherein at least one of the plurality of secondary storage structures is stored in a non-volatile memory.

14. The method of claim 10, wherein the plurality of secondary storage structures comprises a particular storage structure for accessing a subset of the generated data faster than accessing the generated data stored in the NIB data structure.

15. The method of claim 14, wherein the particular storage structure is a distributed hash table.

16. The method of claim 10 further comprising processing a plurality of queries on a subset of the generated data.

17. The method of claim 16 further comprising undoing a set of the plurality of queries on the subset of the generated data.

18. The method of claim 16, wherein at least one of the plurality of secondary storage structures is a transactional database.

19. A network control system for managing a plurality of switching elements for forwarding data between a plurality of hosts, the network control system comprising:

a plurality of controller instances, each controller instance for managing a set of switching elements of the plurality of switching elements, each controller instance comprising;

a set of applications for generating data to implement a plurality of logical datapath sets, for plurality of different users, on the set of switching elements;

a primary storage structure for storing data for managing the set of switching elements; and

a plurality of secondary storage structures, each secondary storage structure for providing a different secondary storage operation for the controller instance in order to supplement primary storage operations of the primary storage structure for the controller instance, wherein at least one secondary storage structure is for storing at least a subset of the data stored in the primary storage structure, wherein a portion of the data stored in at least one of the primary and secondary storage structures is supplied as physical control plane data to at least one particular switching element of the set of switching elements in order for the particular switching element to implement a particular logical datapath set for a particular user.

20. The network control system of claim 19, wherein the secondary storage operation that a particular secondary storage structure of the plurality of secondary storage structures provides comprises backing up the data stored in the primary storage structure.

21. The network control system of claim 19, wherein the secondary storage operation that at least two of the secondary storage structures provides comprises backing up the data stored in the primary storage structure.

22. The network control system of claim 19, wherein the secondary storage operation that a particular secondary storage structure of the plurality of secondary storage structures provides comprises facilitating communication between the controller instance and another controller instance that manages another set of switching elements.

23. The network control system of claim 19, wherein the secondary storage operation that a particular secondary storage structure of the plurality of secondary storage structures provides comprises storing data that is not stored in the primary storage structure.

24. The network control system of claim 19, wherein at least one storage device for storing the primary storage structure is a volatile memory.

25. The network control system of claim 19, wherein at least one storage device for storing a secondary storage structure of the plurality of secondary storage structures is a non-volatile memory.

26. The network control system of claim 19, wherein a set of storage devices for storing the primary and secondary storage structures comprises a random access memory and a hard disk.