DISTRIBUTED MULTI-LEVEL STATELESS LOAD BALANCING

• US 20150189009A1
• Filed: 12/30/2013
• Published: 07/02/2015
• Est. Priority Date: 12/30/2013
• Status: Abandoned Application

• Current Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Original Assignee: Alcatel-Lucent Canada Incorporated (Nokia Corporation)
• Inventors: van Bemmel, Jeroen
• Application Number:
  US14/143,499
• Publication Number:
  US 20150189009A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70

Abstract

A capability is provided for performing distributed multi-level stateless load balancing. The stateless load balancing may be performed for load balancing of connections of a stateful-connection protocol (e.g., Transmission Control Protocol (TCP) connections, Stream Control Transmission Protocol (SCTP) connections, or the like). The stateless load balancing may be distributed across multiple hierarchical levels. The multiple hierarchical levels may be distributed across multiple network locations, geographic locations, or the like.

Claims

1. An apparatus, comprising:

a processor and a memory communicatively connected to the processor, the processor configured to;

receive an initial connection packet of a stateful-connection protocol at a first load balancer configured to perform load balancing across a set of processing elements, the initial connection packet of the stateful-connection protocol configured to request establishment of a stateful connection; and

perform a load balancing operation at the first load balancer to control forwarding of the initial connection packet of the stateful-connection protocol toward a set of second load balancers configured to perform load balancing across respective subsets of processing elements of the set of processing elements.

2. The apparatus of claim 1, wherein, to perform the load balancing operation to control forwarding of the initial connection packet of the stateful-connection protocol toward the set of second load balancers, the processor is configured to:

select one of the second load balancers in the set of second load balancers; and

forward the initial connection packet toward the selected one of the second load balancers.

3. The apparatus of claim 2, wherein the processor is configured to select the one of the second load balancers based on at least one of a round-robin selection scheme, a calculation associated with the one of the second load balancers, or status information associated with the one of the second load balancers.

4. The apparatus of claim 2, wherein the processor is configured to:

prior to forwarding the initial connection packet toward the selected one of the second load balancers, modify the initial connection packet to include an identifier of the first load balancer.

5. The apparatus of claim 2, wherein the processor is configured to:

receive, from the selected second load balancer, an initial connection response packet generated by one of the processing elements based on the initial connection packet.

6. The apparatus of claim 5, wherein the initial connection packet is received from a client, wherein the processor is configured to:

propagate the initial connection response packet toward the client.

7. The apparatus of claim 5, wherein the initial connection response packet comprises an identifier of the one of the processing elements.

8. The apparatus of claim 7, wherein the initial connection packet is received from a client, wherein the processor is configured to:

receive, from the client, a subsequent packet of the stateful-connection protocol, the subsequent packet associated with a connection established between the client and the one of the processing elements based on the initial connection packet, wherein the subsequent packet comprises the identifier of the one of the processing elements; and

forward the subsequent packet toward the one of the processing elements, based on the identifier of the one of the processing elements, independent of the set of second load balancers.

9. The apparatus of claim 5, wherein the initial connection response packet comprises status information for the one of the processing elements.

10. The apparatus of claim 9, wherein the processor is configured to:

update aggregate status information for the selected second load balancer based on the status information for the one of the processing elements.

11. The apparatus of claim 1, wherein, to perform the load balancing operation to control forwarding of the initial connection packet of the stateful-connection protocol toward the set of second load balancers, the processor is configured to:

initiate a query to obtain a set of addresses of the respective second load balancers in the set of second load balancers and status information associated with the respective second load balancers in the set of second load balancers;

select one of the second load balancers in the set of second load balancers based on the status information associated with the second load balancers in the set of second load balancers; and

forward the initial connection packet of the stateful-connection protocol toward the selected one of the second load balancers based on the address of the selected one of the second load balancers.

12. The apparatus of claim 1, wherein, to perform the load balancing operation to control forwarding of the initial connection packet of the stateful-connection protocol toward the set of second load balancers, the processor is configured to:

broadcast the initial connection packet of the stateful-connection protocol toward each of the second load balancers in the set of second load balancers based on a broadcast address assigned for the second load balancers in the set of second load balancers.

13. The apparatus of claim 1, wherein, to perform the load balancing operation to control forwarding of the initial connection packet of the stateful-connection protocol toward the set of second load balancers, the processor is configured to:

multicast the initial connection packet of the stateful-connection protocol toward a multicast group including two or more of the second load balancers in the set of second load balancers based on a forged multicast address assigned for the second load balancers in the multicast group.

14. The apparatus of claim 1, wherein, to perform the load balancing operation to control forwarding of the initial connection packet of the stateful-connection protocol toward the set of second load balancers, the processor is configured to:

forward the initial connection packet of the stateful-connection protocol toward two or more of the second load balancers in the set of second load balancers;

receive two or more initial connection response packets of the stateful-connection protocol responsive to forwarding of the initial connection packet of the stateful-connection protocol toward the two or more of the second load balancers; and

forward one of the initial connection response packets that is received first without forwarding any other of the initial connection response packets.

15. The apparatus of claim 1, wherein, to perform the load balancing operation to control forwarding of the initial connection packet of the stateful-connection protocol toward the set of second load balancers, the processor is configured to:

forward the initial connection packet of the stateful-connection protocol toward a first one of the second load balancers in the set of second load balancers; and

forward the initial connection packet of the stateful-connection protocol toward a second one of the second load balancers in the set of second load balancers based on a determination that a successful response to the initial connection packet of the stateful-connection protocol is not received responsive to forwarding of the initial connection packet of the stateful-connection protocol toward the first one of the second load balancers in the set of second load balancers.

16. The apparatus of claim 1, wherein the processor is configured to:

determine, based on status information associated with at least one of the processing elements in the set of processing elements, whether to modify the set of processing elements.

17. The apparatus of claim 1, wherein the processor is configured to:

based on a determination to terminate a given processing element from the set of processing elements;

prevent forwarding of subsequent packets of the stateful-connection protocol toward the given processing element;

monitor a number of open sockets of the given processing element; and

initiate termination of the given processing element based on a determination that the number of open sockets of the given processing element is indicative that the given processing element is idle.

18. The apparatus of claim 1, wherein one of:

the first load balancer is associated with a network device of a communication network and the second load balancers are associated with respective elements of one or more datacenters;

the first load balancer is associated with a network device of a datacenter network and the second load balancers are associated with respective racks of the datacenter network;

the first load balancer is associated with a rack of a datacenter network and the second load balancers are associated with respective servers of the rack;

or

the first load balancer is associated with a server of a datacenter network and the second load balancers are associated with respective processors of the server.

19. A method, comprising:

using a processor and a memory for;

receiving an initial connection packet of a stateful-connection protocol at a first load balancer configured to perform load balancing across a set of processing elements, the initial connection packet of the stateful-connection protocol configured to request establishment of a stateful connection; and

performing a load balancing operation at the first load balancer to control forwarding of the initial connection packet of the stateful-connection protocol toward a set of second load balancers configured to perform load balancing across respective subsets of processing elements of the set of processing elements.

20. A computer-readable storage medium storing instructions which, when executed by a computer, cause the computer to perform a method, the method comprising:

receiving an initial connection packet of a stateful-connection protocol at a first load balancer configured to perform load balancing across a set of processing elements, the initial connection packet of the stateful-connection protocol configured to request establishment of a stateful connection; and

performing a load balancing operation at the first load balancer to control forwarding of the initial connection packet of the stateful-connection protocol toward a set of second load balancers configured to perform load balancing across respective subsets of processing elements of the set of processing elements.