Balancing the loads of servers in a server farm based on an angle between two vectors

• US 8,645,545 B2
• Filed: 11/24/2010
• Issued: 02/04/2014
• Est. Priority Date: 11/24/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ganapathi, Pramod, Palasamudram, Darshan S.
• Primary Examiner(s): Dailey, Thomas
• Assistant Examiner(s): Golabbakhsh, Ebrahim
• Application Number:
  US12/954,058
• Publication Number:
  US 20120131163A1
• Time in Patent Office: 1,168 Days
• Field of Search: 709/223, 709/226, 709/228
• US Class Current: 709/226
• CPC Class Codes: H04L 67/1004 Server selection for load balancing
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer

Abstract

A system and computer program product for balancing the loads of servers in a server farm. A vector, referred to herein as the “DesiredVector,” is computed to hold the load factors for each of the servers. Upon receipt of a client request, a vector, referred to herein as the “ActiveConnections,” is modified for each scenario where the new client request is considered to be serviced by a different server. The ActiveConnections vector holds the current number of client requests being serviced by each of the servers. Angles made by each of the different ActiveConnections vectors with the DesiredVector are computed. Upon identifying the ActiveConnections vector that produces the smallest angle with the DesiredVector, the client request is directed to the server which corresponds to the identified ActiveConnections vector. In this manner, the best possible distribution of requests among the servers is made for every client connection.

Claims

1. A computer program product embodied in a computer readable storage device for balancing the loads of servers, the computer program product comprising the programming instructions for:

receiving a load factor for each server in a server farm;

computing a first vector to hold said load factor for each server in said server farm;

receiving a client request;

computing a plurality of second vectors, wherein each of said plurality of second vectors holds a number of client requests to be serviced by each server in said server farm taking into consideration said received client request, wherein each of said plurality of second vectors is computed by modifying a third vector to attribute said client request being serviced by a different server in said server farm, wherein said third vector holds a current number of client requests being serviced by each server in said server farm;

computing an angle made by each of said plurality of second vectors with said first vector;

identifying one of said plurality of second vectors which makes a smallest angle with said first vector; and

directing said client request to a server in said server farm that corresponds to said identified second vector.

2. The computer program product as recited in claim 1 further comprising the programming instructions for:

updating said third vector to indicate forwarding of said client request to said server in said server farm.

3. The computer program product as recited in claim 1 further comprising the programming instructions for:

initializing said third vector to be a zero vector prior to receipt of a first client request.

4. The computer program product as recited in claim 1, wherein each position in said first vector corresponds to said load factor for a particular server in said server farm, wherein each position in said third vector corresponds to a number of requests currently being serviced by said particular server in said server farm.

5. The computer program product as recited in claim 1, wherein each position in each of said plurality of second vectors corresponds to a number of client requests to be serviced by a particular server in said server farm taking into consideration said received client request.

6. The computer program product as recited in claim 1, wherein said angle made by each of said plurality of second vectors with said first vector is computed by the formula:

cos−

1((A·

V)/(|A∥

B|)),

wherein A is equal to said first vector and B is equal to one of said plurality of second vectors.

7. The computer program product as recited in claim 1, wherein said load factor is a positive integer ranging from 1 to 100.

8. A system, comprising:

a memory unit for storing a computer program for balancing the loads of servers; and

a processor coupled to said memory unit, wherein said processor, responsive to said computer program, comprises;

circuitry for receiving a load factor for each server in a server farm;

circuitry for computing a first vector to hold said load factor for each server in said server farm;

circuitry for receiving a client request;

circuitry for computing a plurality of second vectors, wherein each of said plurality of second vectors holds a number of client requests to be serviced by each server in said server farm taking into consideration said received client request, wherein each of said plurality of second vectors is computed by modifying a third vector to attribute said client request being serviced by a different server in said server farm, wherein said third vector holds a current number of client requests being serviced by each server in said server farm;

circuitry for computing an angle made by each of said plurality of second vectors with said first vector;

circuitry for identifying one of said plurality of second vectors which makes a smallest angle with said first vector; and

circuitry for directing said client request to a server in said server farm that corresponds to said identified second vector.

9. The system as recited in claim 8, wherein said processor further comprises:

circuitry for updating said third vector to indicate forwarding of said client request to said server in said server farm.

10. The system as recited in claim 8, wherein said processor further comprises:

circuitry for initializing said third vector to be a zero vector prior to receipt of a first client request.

11. The system as recited in claim 8, wherein each position in said first vector corresponds to said load factor for a particular server in said server farm, wherein each position in said third vector corresponds to a number of requests currently being serviced by said particular server in said server farm.

12. The system as recited in claim 8, wherein each position in each of said plurality of second vectors corresponds to a number of client requests to be serviced by a particular server in said server farm taking into consideration said received client request.

13. The system as recited in claim 8, wherein said angle made by each of said plurality of second vectors with said first vector is computed by the formula:

cos−

1((A·

B)/(|A∥

B|))

wherein A is equal to said first vector and B is equal to one of said plurality of second vectors.

14. The system as recited in claim 8, wherein said load factor is a positive integer ranging from 1 to 100.