Client server networks

• US 7,519,710 B2
• Filed: 09/18/2002
• Issued: 04/14/2009
• Est. Priority Date: 09/18/2001
• Status: Expired due to Fees

• Current Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Original Assignee: Ericsson AB (Telefonaktiebolaget LM Ericsson)
• Inventors: Martin, Stephen Ian
• Primary Examiner(s): Najjar; Saleh
• Assistant Examiner(s): Henry; Marie Georges
• Application Number:
  US10/490,040
• Publication Number:
  US 20050038891A1
• Time in Patent Office: 2,400 Days
• Field of Search: 709/223, 709/224, 709/225, 709/226, 709/228, 709/229, 708/802, 708/236, 708/230
• US Class Current: 709/226
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A client node in a network communicates with a server system having a plurality of servers. The client has a distributor which periodically measures server activity, assesses relative loading of the servers, and adjusts the request distribution as well as the server loadings in accordance with the loading assessment.

Claims

1. A method of distributing requests from a client node to servers of a server system having a plurality of servers, the method comprising periodically repeating the steps of:

a) measuring server activity of each server to obtain measured server activities;

b) assessing relative loadings of the plurality of servers from the measured server activities;

c) adjusting a distribution of requests to individual servers of the plurality of servers in accordance with the assessing of the relative loadings by adjusting a proportion of the requests assigned to each server as a function of the measured server activities, a mean activity across the plurality of servers, and an existing proportion of the requests assigned to the respective server;

d) the measuring step being performed by counting a number of the server requests sent to each of the plurality of servers, and counting a number of the server responses received from each server over a sample period; and

e) configuring the sample period to be an aggregate number of requests sent to the plurality of servers.

2. The method according to claim 1, wherein the sample period is a period of time.

3. The method according to claim 1, wherein the assessing step is performed by comparing the server requests and responses for each of the plurality of servers over the sample period.

4. The method according to claim 1, wherein the measuring step is performed by calculating a response time of each server.

5. The method according to claim 4, wherein the assessing step is performed by comparing a distribution of the server response times for each of the plurality of servers.

6. The method according to claim 1, wherein the measuring step is performed by counting a number of requests for each server which have not received a response.

7. The method according to claim 6, wherein the assessing step is performed by comparing the number of requests without responses over an aggregate number of requests to all the plurality of servers.

8. The method according to claim 1, wherein the adjusting step is performed by combining distribution data from previous sample periods to calculate adjustments to distributions for a next sample period.

9. The method according to claim 1, wherein the adjusting step is performed by combining data from previous sample periods according to a decay formula.

10. The method according to claim 3, wherein the relative loadings are compared by comparing, for each server, a ratio (R_q−

R_s) / (R_q+R_s) where R_q is the number of requests sent to the server, and R_sis the number of responses returned from the server.

11. The method according to claim 3, wherein the relative loadings are compared by comparing, for each server, a ratio (R_s−

R_q) / (R_q+R_s) where R_q is the number of requests sent to the server, and R_s is the number of responses returned from the server.

12. A system for distributing requests from a client node to servers of a server system having a plurality of servers, comprising:

a) a distributor at the client node, the distributor including means for measuring server activity of each server to obtain measured server activities;

b) means for assessing relative loading of the plurality of servers from the measured server activities;

c) means for adjusting a distribution of requests to individual servers of the plurality of servers in accordance with the assessing of the relative loadings by adjusting a proportion of the requests assigned to each server as a function of the measured server activities, a mean activity across the plurality of servers, and an existing proportion of the requests assigned to the respective server;

d) the activity measuring means comprising a counter for counting a number of requests for each server which have not received a response; and

e) the relative loading assessing means comprising a comparator for comparing the number of requests without responses over an aggregate number of requests to all the plurality of servers.

13. The system according to claim 12, wherein the means for measuring server activity comprises a counter for counting a number of the server requests sent to each of the plurality of servers, and for counting a number of the server responses received from each server over a sample period.

14. The system according to claim 13, wherein the relative loading assessing means comprises means for comparing the server requests and responses for each of the plurality of servers over the sample period.

15. The system according to claim 12, wherein the activity measuring means comprises calculating means for calculating a response time of each server.

16. The system according to claim 15, wherein the relative loading assessing means comprises means for comparing a distribution of the server response times for each of the plurality of servers.

17. The system according to claim 13, wherein the request distribution adjusting means comprises a combiner for combining distribution data from previous sample periods to calculate adjustments to distributions for a next sample period.

18. The system according to claim 14, wherein the means for comparing the server requests and responses compares, for each server, a ratio (R_q−

R_s) / (R_q+R_s) where R_q is the number of requests sent to the server, and R_s is the number of responses returned from the server.

19. The system according to claim 14, wherein the means for comparing the server requests and responses compares, for each server, the ratio (R_s−

R_q) / (R_q+R_s) where R_q is the number of requests sent to the server, and R_s is the number of responses returned from the server.