Maintaining quality of service in shared forwarding elements managed by a network control system

• US 9,231,882 B2
• Filed: 01/31/2013
• Issued: 01/05/2016
• Est. Priority Date: 10/25/2011
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Fulton, Bryan J., Koponen, Teemu, Thakkar, Pankaj
• Primary Examiner(s): Avellino, Joseph E
• Assistant Examiner(s): McLeod, Marshall
• Application Number:
  US13/756,496
• Publication Number:
  US 20130212235A1
• Time in Patent Office: 1,069 Days
• Field of Search: 709/220, 709/223, 709/227
• US Class Current: 1/1
• CPC Class Codes: G05B 11/01 electric
• CPC Class Codes: G06F 15/177 Initialisation or configuration control processor initialisation G06F9/4405
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: H04L 12/4633 Interconnection of networks using encapsulation techniques, e.g. tunneling
• CPC Class Codes: H04L 41/0226 Mapping or translating multiple network management protocols
• CPC Class Codes: H04L 41/042 comprising distributed management centres cooperatively managing the network
• CPC Class Codes: H04L 41/0806 for initial configuration or provisioning, e.g. plug-and-play
• CPC Class Codes: H04L 41/20 Network management software packages
• CPC Class Codes: H04L 41/50 Network service management, e.g. ensuring proper service fulfilment according to agreements
• CPC Class Codes: H04L 45/38 Flow based routing
• CPC Class Codes: H04L 45/42 Centralised routing
• CPC Class Codes: H04L 45/66 Layer 2 routing, e.g. in Ethernet based MAN's
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/50 Queue scheduling
• CPC Class Codes: H04L 47/825 Involving tunnels, e.g. MPLS
• CPC Class Codes: H04L 49/254 Centralised controller, i.e. arbitration or scheduling

Abstract

A non-transitory machine readable medium storing a program that manages a plurality managed forwarding elements that forward data through a network is described. The program receives user inputs that define forwarding performance constraints of a set of managed forwarding elements. Based on the inputs, the program generates a set of universal flow entries for configuring the set of managed forwarding elements to apply the forwarding performance constraints to data traffic that the managed forwarding elements forward. The set of universal flow entries is for subsequent conversion into a set of customized flow entries for the managed forwarding elements.

Claims

1. A non-transitory machine readable medium of a controller computer storing a program which when executed by at least one processing unit of the controller computer manages a plurality of managed forwarding elements that forward data through a network, the program comprising sets of instructions for:

receiving inputs that define forwarding performance constraints of a set of managed forwarding elements;

based on the inputs, generating a set of universal flow entries for configuring the set of managed forwarding elements to apply the forwarding performance constraints to data traffic forwarded by the managed forwarding elements; and

from the controller computer, sending the generated set of universal flow entries to a controller that manages a managed forwarding element wherein the controller (1) directs the managed forwarding element to create a set of network constructs for applying the forwarding performance constraints based on the set of universal flow entries and (2) converts the set of universal flow entries into a set of customized flow entries for the managed forwarding element based on information about the created set of network constructs received from the managed forwarding element.

2. The machine readable medium of claim 1, wherein the controller is a first controller and the managed forwarding element is a first managed forwarding element, wherein the first controller and the first managed forwarding element operate on a first device while a second controller and a second managed forwarding element managed by the second controller operate on a second different device.

3. The machine readable medium of claim 1, wherein the set of customized flow entries comprises an identifier for a network construct that the managed forwarding element creates and uses to apply the forwarding performance constraints to the data that the managed forwarding element forwards.

4. The machine readable medium of claim 2, wherein the first and second devices are different host machines of a hosting system.

5. The machine readable medium of claim 1, wherein the set of network constructs comprises a queue in which to accumulate data that the managed forwarding element receives.

6. The machine readable medium of claim 5, wherein the set of instructions for generating the set of universal flow entries comprises sets of instructions for:

converting the inputs to logical control plane data;

converting the logical control plane data into logical forwarding plane data; and

converting the logical forwarding plane data into the universal flow entries, wherein the queue is a physical queue, wherein the logical control plane data specifies a logical queue to be mapped to the physical queue, wherein the controller maps the logical queue to the physical queue.

7. The machine readable medium of claim 1, wherein the managed forwarding forward element forwards data based on the customized flow entries for the managed forwarding element.

8. The machine readable medium of claim 1, wherein the forwarding performance constraints set an amount of data that a managed forwarding element can forward during a period of time.

9. A non-transitory machine readable medium storing a controller application which when executed by at least one processing unit of a host machine configures a first managed forwarding element that operates on the host machine to establish a tunnel between the first managed forwarding element and a second managed forwarding element, the program comprising sets of instructions for:

receiving a set of universal flow entries from a controller computer for configuring the first managed forwarding element to apply forwarding performance constraints to data that the first managed forwarding element forwards, the universal flow entries generated by the controller computer based on a set of inputs;

based on the set of universal flow entries, directing the first managed forwarding element to create a network construct on the first managed forwarding element, the network construct for applying the forwarding performance constraints;

from the first managed forwarding element, receiving information about the network construct created by the first managed forwarding element; and

based on the received information, converting the set of universal flow entries to a set of customized flow entries for the first managed forwarding element.

10. The machine readable medium of claim 9, wherein the controller application is within the first managed forwarding element.

11. The machine readable medium of claim 9, wherein the controller application further comprises a set of instructions for sending the customized flow entries to the first managed forwarding element, wherein the first managed forwarding element forwards data based on the customized flow entries.

12. The machine readable medium of claim 9, wherein the network construct comprises a queue in which the first managed forwarding element accumulates data in order to apply the forwarding performance constraints.

13. A method for a controller computer that manages managed forwarding elements in a network, the method comprising:

receiving inputs that define forwarding performance constraints of a set of managed forwarding elements;

based on the inputs, generating, by a processor of the controller computer, a set of universal flow entries for configuring the set of managed forwarding elements to apply the forwarding performance constraints to data traffic forwarded by the managed forwarding elements; and

sending the generated set of universal flow entries to a controller that manages a managed forwarding element, wherein the controller (1) directs the managed forwarding element to create a set of network constructs for applying the forwarding performance constraints based on the set of universal flow entries and (2) converts the set of universal flow entries into a set of customized flow entries for the managed forwarding element based on information about the created set of network constructs received from the managed forwarding element.

14. The method of claim 13, wherein the controller is a first controller and the managed forwarding element is a first managed forwarding element, wherein the first controller and the first managed forwarding element operate on a first device while a second controller and a second managed forwarding element managed by the second controller operate on a second different device.

15. The method of claim 13, wherein the set of customized flow entries comprises an identifier for a network construct that the managed forwarding element creates and uses to apply the forwarding performance constraints to the data that the managed forwarding element forwards.

16. The method of claim 15, wherein the first and second devices are different host machines of a hosting system.

17. The method of claim 13, wherein the set of network constructs comprises a queue in which to accumulate data that the managed forwarding element receives.

18. The method of claim 17, wherein generating the set of universal flow entries comprises:

converting the inputs to logical control plane data;

converting the logical control plane data into logical forwarding plane data; and

converting the logical forwarding plane data into the universal flow entries,

wherein the queue is a physical queue, wherein the logical control plane data specifies a logical queue to be mapped to the physical queue, wherein the controller maps the logical queue to the physical queue.

19. The method of claim 13, wherein the managed forwarding element forwards data based on the customized flow entries for the managed forwarding element.

20. The method of claim 13, wherein the forwarding performance constraints set an amount of data that a managed forwarding element can forward during a period of time.