Ingress ECMP in virtual distributed routing environment

• US 9,413,644 B2
• Filed: 03/27/2014
• Issued: 08/09/2016
• Est. Priority Date: 03/27/2014
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Agarwal, Vivek, Chandrashekhar, Ganesan, Subramaniyam, Rahul Korivi, Singh, Ram Dular, Wang, Howard
• Primary Examiner(s): Pham, Chi H
• Assistant Examiner(s): Boakye, Alexander O
• Application Number:
  US14/227,959
• Publication Number:
  US 20150281048A1
• Time in Patent Office: 866 Days
• Field of Search: 370/236, 370/235, 370/237, 370/238, 370/397, 370/399, 370/409, 370/252, 370/395.1, 709/226, 709/245, 709/220
• US Class Current: 1/1
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/122 of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV]
• CPC Class Codes: H04L 45/24 Multipath
• CPC Class Codes: H04L 45/44 Distributed routing
• CPC Class Codes: H04L 45/586 of virtual routers
• CPC Class Codes: H04L 45/64 using an overlay routing layer
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 61/103 across network layers, e.g. resolution of network layer into physical layer addresses or address resolution protocol [ARP]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 61/5061 Pools of addresses

Abstract

A logical routing element (LRE) having multiple designated instances for routing packets from physical hosts (PH) to a logical network is provided. A PH in a network segment with multiple designated instances can choose among the multiple designated instances for sending network traffic to other network nodes in the logical network according to a load balancing algorithm. Each logical interface (LIF) of an LRE is defined to be addressable by multiple identifiers or addresses, and each LIF identifier or address is assigned to a different designated instance.

Claims

1. A method of operating a logical network over a network virtualization infrastructure that comprises a plurality of host machines, the method comprising:

defining a logical routing element (LRE) for routing data packets between different segments of the logical network, wherein each host machine operates a set of virtual machines (VMs) and a local instance of the LRE as a managed physical routing element (MPRE) for routing packets from the set of VMs locally at the host machine, the LRE comprising a plurality of logical interfaces (LIFs), each LIF for interfacing with a different segment of the logical network, wherein a particular LIF is addressable by a plurality of different LIF addresses;

assigning each LIF address of the particular LIF to a different host machine in the plurality of host machines; and

advertising the plurality of LIF addresses of the particular LIF as a plurality of next-hops to an external router for sending packets to be routed by the LRE.

2. The method of claim 1, wherein at least one of the network segments comprises network nodes in a plurality of different IP subnets.

3. The method of claim 1, wherein the plurality of different LIF addresses for addressing the particular LIF comprises addresses in different IP subnets.

4. The method of claim 1, wherein the particular LIF is for interfacing a particular network segment, wherein the particular network segment is an overlay encapsulation network.

5. The method of claim 4, wherein the overlay encapsulation network comprises a plurality of different IP subnets.

6. The method of claim 4, wherein the overlay encapsulation network is VXLAN.

7. A method comprising:

connecting a physical router to a logical network, the logical network comprising a plurality of network segments and a logical routing element (LRE) for routing data packets between the plurality of network segments, the LRE comprising a plurality of logical interfaces (LIF), each LIF for interfacing a network segment, wherein the physical router is a network node of a particular network segment that interfaces the LRE at a particular LIF but does not operate the LRE; and

receiving, at the physical router, a plurality of different addresses for addressing the particular LIF; and

selecting one address of the received plurality of different addresses as destination for sending a data packet to the particular LIF to be routed by the LRE.

8. The method of claim 7, wherein selecting one address of the plurality of different addresses comprises performing an Equal Cost Multi-path Routing (ECMP) algorithm.

9. The method of claim 7, wherein the logical network is implemented over a plurality of host machines, wherein each host machine is operating a local instance of the LRE as a managed physical routing element (MPRE).

10. The method of claim 9, wherein the selected address corresponds to a particular host machine, wherein said routing of the data packet is performed by the MPRE in the particular host machine.

11. The method of claim 7, wherein at least one of the network segments comprises network nodes in a plurality of different IP subnets.

12. The method of claim 7, wherein the received plurality of addresses for addressing the particular LIF comprises addresses in different IP subnets.

13. The method of claim 7, wherein particular network segment is an overlay encapsulation network.

14. A system comprising:

a plurality of host machines, each host machine operating a set of virtual machines (VMs) and an instance of a logical routing element (LRE) for routing data packets between different network segments of a logical network, wherein the LRE comprises a plurality of logical interfaces (LIF), each LIF for interfacing a network segment of the logical network, wherein a particular LIF is associated with a plurality of network layer addresses, wherein each network layer address of the particular LIF is assigned to a different host machine in a set of host machines; and

a physical router that uses the LRE for routing by sending data packets to a host machine that is assigned one of the plurality of network layer addresses of the particular LIF.

15. The system of claim 14, wherein the physical router is a network node in a particular network segment that interfaces the particular LIF.

16. The system of claim 14, wherein the physical router balances traffic load between different host machines in the set of host machines by selecting a host machine from the set of host machine as a recipient of data packets.

17. The system of claim 14, wherein the instance of the LRE operating in a host machine is acting as a managed physical routing element (MPRE) of the host machine, wherein the MPRE routes packet from VMs of the host machine locally at the host machine.

18. The system of claim 14, wherein at least one of the network segments comprises network nodes in a plurality of different IP subnets.

19. The system of claim 18, wherein the at least one network segment is an overlay encapsulation network.

20. The system of claim 14, wherein the plurality of network layer addresses of the particular LIF includes IP addresses in different IP subnets.

21. A computing device serving as a host machine in a logical network, the computing device comprising:

a set of processing units; and

a non-transitory machine readable medium storing a program for execution by at least one of the processing units, the program comprising sets of instructions for;

executing a plurality of virtual machines that are in a plurality of different segments of the logical network;

operating an instance of a logical routing element (LRE) as a managed physical routing element (MPRE) for routing data packets between different segments of the logical network, the LRE comprising a plurality of logical interfaces, each logical interface for receiving data packets from a different segments of the logical network, wherein a particular logical interface is associated with a plurality of network layer addresses; and

making the MPRE addressable by one of the plurality of network layer addresses associated with the particular logical interface of the LRE.

22. The computing device of claim 21, wherein the computer program further comprises a set of instructions for receiving the plurality of network layer addresses.

23. The computing device of claim 22, wherein the computer program further comprises a set of instructions for determining whether the MPRE is a designated instance for one of the received plurality of network layer addresses.