Managed forwarding element executing in public cloud data compute node with different internal and external network addresses

• US 10,484,302 B2
• Filed: 08/31/2016
• Issued: 11/19/2019
• Est. Priority Date: 08/27/2016
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Hira, Mukesh, Shah, Saurabh, Wang, Su, Yu, Jia
• Primary Examiner(s): Shah, Saumit
• Application Number:
  US15/253,833
• Publication Number:
  US 20180062933A1
• Time in Patent Office: 1,175 Days
• Field of Search: None
• CPC Class Codes: G06F 11/008 Reliability or availability analysis
• CPC Class Codes: G06F 11/07 Responding to the occurrence of a fault, e.g. fault tolerance
• CPC Class Codes: G06F 11/0709 in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
• CPC Class Codes: G06F 11/0793 Remedial or corrective actions recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/1482 by means of middleware or OS functionality
• CPC Class Codes: G06F 11/2035 without idle spare hardware
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 15/177 Initialisation or configuration control processor initialisation G06F9/4405
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 12/4633 Interconnection of networks using encapsulation techniques, e.g. tunneling
• CPC Class Codes: H04L 12/4641 Virtual LANs, VLANs, e.g. virtual private networks [VPN] LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
• CPC Class Codes: H04L 2209/24 Key scheduling, i.e. generating round keys or sub-keys for block encryption
• CPC Class Codes: H04L 2212/00 Encapsulation of packets
• CPC Class Codes: H04L 41/044 comprising hierarchical management structures
• CPC Class Codes: H04L 41/0806 : for initial configuration or provisioning, e.g. plug-and-play
• CPC Class Codes: H04L 41/0895 : Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/12 : Discovery or management of network topologies
• CPC Class Codes: H04L 41/20 : Network management software packages
• CPC Class Codes: H04L 41/40 : using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 45/38 : Flow based routing
• CPC Class Codes: H04L 45/72 : Routing based on the source address
• CPC Class Codes: H04L 45/74 : Address processing for routing
• CPC Class Codes: H04L 47/125 : by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/32 : by discarding or delaying data units, e.g. packets or frames
• CPC Class Codes: H04L 49/15 : Interconnection of switching modules
• CPC Class Codes: H04L 49/25 : Routing or path finding in a switch fabric
• CPC Class Codes: H04L 49/70 : Virtual switches
• CPC Class Codes: H04L 61/2514 : between local and global IP addresses
• CPC Class Codes: H04L 61/2521 : Translation architectures other than single NAT servers
• CPC Class Codes: H04L 61/2539 : Hiding addresses; Keeping addresses anonymous
• CPC Class Codes: H04L 61/256 : NAT traversal
• CPC Class Codes: H04L 61/2592 : using tunnelling or encapsulation
• CPC Class Codes: H04L 61/5014 : using dynamic host configuration protocol [DHCP] or bootstrap protocol [BOOTP]
• CPC Class Codes: H04L 63/0209 : Architectural arrangements, e.g. perimeter networks or demilitarized zones
• CPC Class Codes: H04L 63/0236 : Filtering by address, protocol, port number or service, e.g. IP-address or URL
• CPC Class Codes: H04L 63/0263 : Rule management
• CPC Class Codes: H04L 63/0272 : Virtual private networks
• CPC Class Codes: H04L 63/029 : Firewall traversal, e.g. tunnelling or, creating pinholes
• CPC Class Codes: H04L 63/0428 : wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/062 : for key distribution, e.g. centrally by trusted party cryptographic mechanisms or cryptographic arrangements for key distribution involving a central third party H04L9/0819
• CPC Class Codes: H04L 63/20 : for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 9/0819 : Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) network architectures or network communication protocols for key distribution in a packet data network H04L63/062
• CPC Class Codes: H04L 9/3213 : using tickets or tokens, e.g. Kerberos network architectures or network communication protocols for entities authentication using tickets in a packet data network H04L63/0807

Abstract

Some embodiments provide a method for a network controller that manages a logical network implemented in a datacenter comprising forwarding elements to which the network controller does not have access. The method identifies a data compute node (DCN), that operates on a host machine in the datacenter, to attach to the logical network. The DCN has a network interface with a first network address provided by a management system of the datacenter, and executes (i) a workload application and (ii) a managed forwarding element (MFE). The method distributes configuration data for configuring the MFE to receive data packets sent from the workload application on the DCN and perform network security and forwarding processing on the data packets. The data packets sent by the workload application have a second network address as a source address when received by the MFE and are encapsulated by the MFE using the first network address.

Claims

1. A method for a network controller that manages a logical network implemented in a datacenter comprising forwarding elements to which the network controller does not have access, the method comprising:

identifying a data compute node, that operates on a host machine in the datacenter, to attach to the logical network, the data compute node having a network interface with a first network address provided by a management system of the datacenter, wherein the data compute node executes (i) a workload application and (ii) a managed forwarding element, wherein the host machine executes a forwarding element, to which the network controller does not have access, outside of the data compute node; and

distributing configuration data for configuring the managed forwarding element to receive data packets sent from the workload application on the data compute node and perform network security and forwarding processing on the data packets, wherein the data packets sent by the workload application have a second network address as a source address when received by the managed forwarding element and are encapsulated by the managed forwarding element using the first network address provided by the management system of the datacenter before being transmitted from the data compute node to the forwarding element executing on the host machine to which the network controller does not have access.

2. The method of claim 1, wherein the second network address is mapped to a logical port of a logical switch to which the data compute node is logically attached, wherein the logical switch is one of a plurality of logical forwarding elements of the logical network.

3. The method of claim 1, wherein the managed forwarding element is a flow-based software forwarding element.

4. The method of claim 1, wherein the managed forwarding element comprises a first bridge that connects via an internal port to the workload application and a second bridge that connects to the network interface of the data compute node, wherein the first bridge is configured to perform network security processing and logical forwarding on data packets sent to and from the workload application.

5. The method of claim 4, wherein the logical forwarding comprises:

applying forwarding rules for at least one logical switch to identify a logical egress port for each data packet; and

applying forwarding rules for a logical router.

6. The method of claim 1, wherein the managed forwarding element comprises a first bridge that connects via an internal port to the workload application and a second bridge that connects to the network interface of the data compute node, wherein the first bridge is configured to receive a data packet from the workload application, identify a logical egress port for the data packet, encapsulate the data packet and send the encapsulated data packet to a virtual tunnel endpoint (VTEP) of the second bridge.

7. The method of claim 6, wherein the data packet is received from the workload application via a first network stack associated with the second network address, wherein the first network address is used as the source network address for an encapsulation header applied by the first bridge, wherein the encapsulated data packet is sent to the VTEP of the second bridge via a second network stack associated with the first network address.

8. The method of claim 6, wherein the second bridge is configured to send incoming packets encapsulated with the first network address as a destination address to an overlay port of the first bridge via the VTEP, wherein the first bridge is configured to decapsulate the incoming packets received via the overlay port.

9. The method of claim 8, wherein the incoming packets encapsulated with the first network address as a destination address are received by the data compute node from the forwarding element executing on the host machine to which the network controller does not have access.

10. The method of claim 1, wherein the workload application is a first workload application and the data compute node is a first data compute node, wherein data packets sent by the workload application to a second workload application executing on a second data compute node in the datacenter are encapsulated and transmitted out of the data compute node network interface to the forwarding element executing on the host machine to which the network controller does not have access, wherein the forwarding element executing on the host machine to which the network controller does not have access is controlled by the datacenter management system, wherein the forwarding element controlled by the datacenter management system encapsulates the outgoing data packets a second time using a third network address associated with a physical network interface of a host machine on which the data compute node operates.

11. The method of claim 1, wherein the network controller is a first network controller and the data compute node is a first data compute node, wherein identifying the first data compute node comprises receiving an attachment request from a second network controller operating on a second data compute node in the datacenter.

12. The method of claim 11, wherein the attachment request is forwarded by the second network controller after receiving an attachment request from the first data compute node.

13. The method of claim 11, wherein distributing the configuration data comprises distributing the configuration data to the second network controller, wherein the second network controller distributes the configuration data to the second data compute node.

14. A non-transitory machine readable medium storing a program which when executed by at least one processing unit implements a network controller that manages a logical network implemented in a datacenter comprising forwarding elements to which the network controller does not have access, the program comprising sets of instructions for:

identifying a data compute node, that operates on a host machine in the datacenter, to attach to the logical network, the data compute node having a network interface with a first network address provided by a management system of the datacenter, wherein the data compute node executes (i) a workload application and (ii) a managed forwarding element, wherein the host machine executes a forwarding element, to which the network controller does not have access, outside of the data compute node; and

distributing configuration data for configuring the managed forwarding element to receive data packets sent from the workload application on the data compute node and perform network security and forwarding processing on the data packets, wherein the data packets sent by the workload application have a second network address as a source address when received by the managed forwarding element and are encapsulated by the managed forwarding element using the first network address provided by the management system of the datacenter before being transmitted from the data compute node to the forwarding element executing on the host machine to which the network controller does not have access.

15. The non-transitory machine readable medium of claim 14, wherein the managed forwarding element comprises a first bridge that connects via an internal port to the workload application and a second bridge that connects to the network interface of the data compute node.

16. The non-transitory machine readable medium of claim 15, wherein the first bridge is configured to perform network security processing and logical forwarding on data packets sent to and from the workload application, wherein the network security processing comprises application of distributed firewall rules and the logical forwarding comprises applying forwarding rules for at least one logical switch to identify a logical egress port for each data packet.

17. The non-transitory machine readable medium of claim 15, wherein the first bridge is configured to receive a data packet from the workload application, identify a logical egress port for the data packet, encapsulate the data packet and send the encapsulated data packet to a virtual tunnel endpoint (VTEP) of the second bridge.

18. The non-transitory machine readable medium of claim 17, wherein the data packet is received from the workload application via a first network stack associated with the second network address, wherein the encapsulated data packet is sent to the VTEP of the second bridge via a second network stack associated with the first network address, wherein the first network address is used as the source network address for an encapsulation header applied by the first bridge.

19. The non-transitory machine readable medium of claim 17, wherein the second bridge is configured to send incoming packets encapsulated with the first network address as a destination address to an overlay port of the first bridge via the VTEP, wherein the first bridge is configured to decapsulate the incoming packets received via the overlay port.

20. The non-transitory machine readable medium of claim 14, wherein the workload application is a first workload application and the data compute node is a first data compute node, wherein data packets sent by the workload application to a second workload application executing on a second data compute node in the datacenter are encapsulated and transmitted out of the data compute node network interface to the forwarding element executing on the host machine to which the network controller does not have access, wherein the forwarding element executing on the host machine to which the network controller does not have access is controlled by the datacenter management system, wherein the forwarding element controlled by the datacenter management system encapsulates the outgoing data packets a second time using a third network address associated with a physical network interface of a host machine on which the data compute node operates.

21. The non-transitory machine readable medium of claim 14, wherein the network controller is a first network controller and the data compute node is a first data compute node, wherein the set of instructions for identifying the first data compute node comprises a set of instructions for receiving an attachment request from a second network controller operating on a second data compute node in the datacenter, wherein the attachment request is forwarded by the second network controller after receiving an attachment request from the first data compute node.