Distributed load balancer in a virtual machine environment

• US 8,676,980 B2
• Filed: 03/22/2011
• Issued: 03/18/2014
• Est. Priority Date: 03/22/2011
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Kreeger, Lawrence, Ganesan, Elango, Freed, Michael, Dabir, Geetha
• Primary Examiner(s): Bruckart, Benjamin R
• Assistant Examiner(s): CELANI, NICHOLAS P
• Application Number:
  US13/065,428
• Publication Number:
  US 20120246637A1
• Time in Patent Office: 1,092 Days
• Field of Search: 709/226
• US Class Current: 709/226
• CPC Class Codes: H04L 45/38 Flow based routing
• CPC Class Codes: H04L 45/54 Organization of routing tables
• CPC Class Codes: H04L 49/70 Virtual switches
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/1038 Load balancing arrangements to avoid a single path through a load balancer
• CPC Class Codes: H04L 67/2885 Hierarchically arranged intermediate devices, e.g. for hierarchical caching

Abstract

In one embodiment, a method includes receiving a request packet at a flow director in communication with a plurality of servers, each server comprising a virtual load balancer module and one or more virtual machines and forwarding the request packet to one of the virtual load balancer modules at one of the servers. The virtual load balancer module is configured to select one of the virtual machines to receive the request packet and transmit a response packet. The response packet is transmitted without passing through the flow director. An apparatus for load balancing in a virtual machine environment is also disclosed.

Claims

1. A method comprising:

receiving a request packet at a flow director in communication with a plurality of servers, each server comprising a virtual load balancer module and one or more virtual machines, the flow director operable to distribute flows to the virtual load balancer modules; and

forwarding the request packet to one of the virtual load balancer modules, the virtual load balancer module configured to select one of the virtual machines to receive the request packet and transmit a response packet;

wherein the virtual load balancers are configured to distribute request packets across a plurality of virtual machines;

wherein the response packet is transmitted without passing through the flow director and wherein the virtual load balancer modules comprise a fast path portion and at least one of the virtual load balancer modules comprises a slow path portion, said fast path portion and said slow path portion located at the server in communication with the flow director, said slow path portion configured to perform load balancing to select one of the virtual machines and said fast path portion configured to create an entry in a flow table to identify the selected virtual machine; and

wherein the flow director is configured to identify new flows and select one of the virtual load balancer modules to process said new flow, and respond to requests from the virtual load balancer modules to direct packets for a flow to a specified virtual load balancer module, wherein the specified virtual load balancer module may be a different module than was initially selected by the flow director.

2. The method of claim 1 further comprising performing a look up in a table at the flow director for a flow associated with the request packet and wherein forwarding the request packet to one of the virtual load balancer modules comprises selecting one of the virtual load balancer modules to distribute flows over the virtual load balancer modules, if said flow is not found in the look up table.

3. The method of claim 1 further comprising performing a look up in a table at the flow director for a flow associated with the request packet and finding an entry for said flow in the look up table, said entry comprising an identifier for one of

the virtual load balancer modules and wherein forwarding the request packet to one of the virtual load balancer modules comprises forwarding the request packet to the virtual load balancer module identified in said entry.

4. The method of claim 1 wherein said fast path portion is located at a network interface card at the server.

5. The method of claim 1 wherein said fast path portion is located at a virtual switch at the server.

6. The method of claim 1 wherein said slow path portion comprises a slow path virtual machine.

7. The method of claim 1 further comprising creating an entry in a flow table at the virtual load balancer module based on the selected virtual machine and forwarding said entry to the flow director.

8. The method of claim 7 further comprising removing said entry from a flow table at the flow director after a connection has been released when said entry has been in the flow table for a specified period of time.

9. The method of claim 1 wherein the virtual machine selected by the virtual load balancer module is located at a different server than the virtual load balancer module.

10. The method of claim 1 wherein the flow director is located at a switch in communication with said plurality of servers.

11. The method of claim 1 wherein the flow director is located at another server in communication with said plurality of servers.

12. An apparatus comprising:

an ingress interface for receiving a request packet;

an egress interface in communication with a plurality of servers, each server comprising a virtual load balancer module and one or more virtual machines, wherein the virtual load balancers are configured to distribute request packets across a plurality of virtual machines;

a flow director configured to forward the request packet to one of the virtual load balancer modules, the virtual load balancer module configured to select one of the virtual machines to receive the request packet; and

a flow table for use in looking up a flow associated with the request packet;

wherein the apparatus is configured such that a response packet is transmitted without passing through the flow director and wherein at least one of the virtual load balancer modules comprises a fast path portion and a slow path portion located at the server, said slow path portion configured to perform load balancing to select one of the virtual machines and said fast path portion configured to create an entry in a flow table to identify the selected virtual machine; and

wherein the flow director is configured to identify new flows and select one of the virtual load balancer modules to process said new flow, and respond to requests from the virtual load balancer modules to direct packets for a flow to a specified virtual load balancer module, wherein the specified virtual load balancer module may be a different module than was initially selected by the flow director.

13. The apparatus of claim 12 further comprising a processor for performing a look up in a table at the flow director for a flow associated with the request packet.

14. An apparatus comprising:

an interface for receiving request packets from a flow director in communication with a plurality of servers comprising a plurality of virtual machines;

one or more of said plurality of virtual machines; and

a virtual load balancer module configured to load balance said request packets across said plurality of virtual machines and transmit load balancing information to the flow director, the virtual load balancer module comprising a fast path portion located in a path between said ingress interface and said one or more virtual machines and a slow path portion, said slow path portion configured to perform load balancing to select said one of said plurality of virtual machines and said fast path portion configured to create an entry in a flow table to identify the selected virtual machine;

wherein the flow director is configured to identify new flows and select one of the virtual load balancer modules to process said new flow, and respond to requests from the virtual load balancer modules to direct packets for a flow to a specified virtual load balancer module, wherein the specified virtual load balancer module may be a different module than was initially selected by the flow director.

15. The apparatus of claim 14 wherein said fast path portion is located at a network interface card at the apparatus.

16. The apparatus of claim 14 wherein said slow path portion comprises a slow path virtual machine.

17. The apparatus of claim 14 wherein the fast path portion is operable to perform network address translation.

18. The apparatus of claim 14 wherein the slow path portion is configured to perform load balancing.