Dynamic HTTP load balancing

• US 8,380,832 B2
• Filed: 07/13/2012
• Issued: 02/19/2013
• Est. Priority Date: 07/24/2001
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: DeLima, Roberto, Lanzen, Craig A.
• Primary Examiner(s): WINDER, PATRICE L
• Application Number:
  US13/548,781
• Publication Number:
  US 20120284387A1
• Time in Patent Office: 221 Days
• Field of Search: 709220-222, 709/226
• US Class Current: 709/222
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/0823 characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for optimising operational conditions of wireless networks H04W24/02
• CPC Class Codes: H04L 41/0846 based on copy from other elements
• CPC Class Codes: H04L 41/0856 by backing up or archiving configuration information
• CPC Class Codes: H04L 41/0869 Validating the configuration within one network element
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

The invention is a method and apparatus for facilitating facilitates load balancing in a server farm. In accordance with various aspects of the invention, all of the information about each server necessary for a load balancing program to define and execute a load balancing algorithm is stored at a predetermined URL for each server. The load balancer can query the predefined URL, which returns the necessary information. The load balancer then dynamically configures the load balancing algorithm in accordance with the returned information.

Claims

1. A method for configuring a load balancer to dispatch client requests to servers in a cluster, the method comprising the steps of:

a load balancer detecting that a set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers, and in response,

the load balancer individually polling, via one or more networks, each of a plurality of other servers that are not currently in the cluster to obtain respective configuration files containing parameter data to configure a load balancing algorithm in the load balancer to add the plurality of other servers to the cluster; and

the load balancer configuring the load balancing algorithm to add the plurality of other servers to the cluster based on the respective parameter data obtained from the configuration files for the plurality of other servers.

2. The method of claim 1 wherein the load balancer detects that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based on a volume of requests to the servers in the cluster.

3. The method of claim 1 wherein the load balancer detects that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based on response time of the servers in the cluster.

4. The method of claim 1 wherein the load balancer detects that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based in part on deactivation of one or more of the servers in the cluster.

5. The method of claim 1 wherein the parameter data for each of the plurality of other servers identifies one or more applications installed in the respective other server, and the load balancer configures the load balancing algorithm to dispatch client requests to each of the plurality of other servers based on identities of applications installed in the respective other server.

6. The method of claim 5 wherein the parameter data for a first one of the plurality of other servers identifies a first application but not a second application installed in the first other server, and the parameter data for a second one of the plurality of other servers identifies the second application but not the first application installed in the second other server, and based on the parameter data for the first and second other servers, the load balancing algorithm dispatches requests for the first application to the first other server but not the second other server and dispatches requests for the second application to the second other server but not the first other server.

7. The method of claim 1 wherein the parameter data for each of the plurality of other servers identifies a first address of health information for a first one of the other servers, and a second address of health information for a second one of the other servers, and based on the parameter data for the first and second other servers, the load balancer configures the load balancing algorithm to check the health of the first and second other servers at the first and second addresses, respectively.

8. The method of claim 1 further comprising the prior steps of:

making an electronic record that the plurality of other servers are candidates to add to the cluster and including in the electronic record respective network addresses of the plurality of other servers; and

the load balancer identifying the plurality of other servers and the addresses of the plurality of other servers from the electronic record to determine which servers to poll and the respective addresses of the servers to poll in the step of the load balancer individually polling each of the plurality of other servers.

9. The method of claim 8 wherein the electronic record is made at the load balancer.

10. A computer program product for configuring a load balancing algorithm to dispatch client requests to servers in a cluster, the computer program product comprising:

one or more computer-readable non-transitory storage devices and program instructions stored on at least one of the one or more storage devices, the program instructions comprising;

program instructions to detect that a set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers, and in response,

individually poll, via one or more networks, each of a plurality of other servers that are not currently in the cluster to obtain respective configuration files containing parameter data to configure a load balancing algorithm to add the plurality of other servers to the cluster; and

configure the load balancing algorithm to add the plurality of other servers to the cluster based on the respective parameter data obtained from the configuration files for the plurality of other servers.

11. The computer program product of claim 10 wherein the program instructions detect that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based on a volume of requests to the servers in the cluster.

12. The computer program product of claim 10 wherein the program instructions detect that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based on response time of the servers in the cluster.

13. The computer program product of claim 10 wherein the program instructions detect that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based in part on deactivation of one or more of the servers in the cluster.

14. The computer program product of claim 10 wherein the parameter data for each of the plurality of other servers identifies one or more applications installed in the respective other server, and the program instructions configure the load balancing algorithm to dispatch client requests to each of the plurality of other servers based on identities of applications installed in the respective other server.

15. The computer program product of claim 14 wherein the parameter data for a first one of the plurality of other servers identifies a first application but not a second application installed in the first other server, and the parameter data for a second one of the plurality of other servers identifies the second application but not the first application installed in the second other server, and based on the parameter data for the first and second other servers, the load balancing algorithm dispatches requests for the first application to the first other server but not the second other server and dispatches requests for the second application to the second other server but not the first other server.

16. The computer program product of claim 10 wherein the parameter data for each of the plurality of other servers identifies a first address of health information for a first one of the other servers, and a second address of health information for a second one of the other servers, and based on the parameter data for the first and second other servers, the program instructions configure the load balancing algorithm to check the health of the first and second other servers at the first and second addresses, respectively.

17. The computer program product of claim 10 further comprising:

program instructions, stored on at least one of the one or more storage devices, to make an electronic record that the plurality of other servers are candidates to add to the cluster and including in the electronic record respective network addresses of the plurality of other servers; and

program instructions, stored on at least one of the one or more storage devices, to identify the plurality of other servers and the addresses of the plurality of other servers from the electronic record to determine which servers to poll and the respective addresses of the servers to poll by the program instructions that individually poll each of the plurality of other servers.

18. The computer program product of claim 10 wherein the program instructions are installed in a load balancer.

27. The computer system of claim 10 wherein the program instructions are installed in a load balancer.

19. A computer system for configuring a load balancing algorithm to dispatch client requests to servers in a cluster, the computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable non-transitory storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the program instructions comprising;

program instructions to detect that a set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers, and in response,

individually poll, via one or more networks, each of a plurality of other servers that are not currently in the cluster to obtain respective configuration files containing parameter data to configure a load balancing algorithm to add the plurality of other servers to the cluster; and

configure the load balancing algorithm to add the plurality of other servers to the cluster based on the respective parameter data obtained from the configuration files for the plurality of other servers.

20. The computer system of claim 19 wherein the program instructions detect that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based on a volume of requests to the servers in the cluster.

21. The computer system of claim 19 wherein the program instructions detect that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based on response time of the servers in the cluster.

22. The computer system of claim 19 wherein the program instructions detect that the set of servers currently in the cluster is insufficient to satisfy current demand for one or more applications executing in the set of servers based in part on deactivation of one or more of the servers in the cluster.

23. The computer system of claim 19 wherein the parameter data for each of the plurality of other servers identifies one or more applications installed in the respective other server, and the program instructions configure the load balancing algorithm to dispatch client requests to each of the plurality of other servers based on identities of applications installed in the respective other server.

24. The computer system of claim 23 wherein the parameter data for a first one of the plurality of other servers identifies a first application but not a second application installed in the first other server, and the parameter data for a second one of the plurality of other servers identifies the second application but not the first application installed in the second other server, and based on the parameter data for the first and second other servers, the load balancing algorithm dispatches requests for the first application to the first other server but not the second other server and dispatches requests for the second application to the second other server but not the first other server.

25. The computer system of claim 19 wherein the parameter data for each of the plurality of other servers identifies a first address of health information for a first one of the other servers, and a second address of health information for a second one of the other servers, and based on the parameter data for the first and second other servers, the program instructions configure the load balancing algorithm to check the health of the first and second other servers at the first and second addresses, respectively.

26. The computer system of claim 19 further comprising:

program instructions, stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to make an electronic record that the plurality of other servers are candidates to add to the cluster and including in the electronic record respective network addresses of the plurality of other servers; and

program instructions, stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, to identify the plurality of other servers and the addresses of the plurality of other servers from the electronic record to determine which servers to poll and the respective addresses of the servers to poll by the program instructions that individually poll each of the plurality of other servers.