Technique for adaptively distributing web server requests

• US 7,231,445 B1
• Filed: 11/16/2000
• Issued: 06/12/2007
• Est. Priority Date: 11/16/2000
• Status: Expired due to Fees

• Current Assignee: Avaya Incorporated
• Original Assignee: Nortel Networks Limited (Nortel Networks Corporation)
• Inventors: Felske, Kent E., Doray, Bernard J., Montuno, Delfin Y., Ouellette, Michel, Aweya, James
• Primary Examiner(s): Etienne, Ario
• Assistant Examiner(s): Osman, Ramy M
• Application Number:
  US09/713,319
• Time in Patent Office: 2,399 Days
• Field of Search: 705/105, 705/203, 705223-227, 709/200, 709/218, 709/217, 709221-225, 709/227, 709/228, 709/201, 714/105, 718/105, 718/106
• US Class Current: 709/226
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 50/18 Legal services
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1019 Random or heuristic server selection

Abstract

A technique for adaptively distributing a web server request in a system having a plurality of web servers is disclosed. In one embodiment, the technique is realized by first generating a web server request distribution function for each of the plurality of web servers based upon performance measures of each of the plurality of web servers, wherein each of the plurality of web servers is assigned a respective probability range based upon each respective web server request distribution function. A random probability number is then generated for a web server request. The particular probability range encompassing the random probability number is then determined so as to identify the corresponding web server to which the web server request is to be distributed.

Claims

1. A method for adaptively distributing a web server request in a system having a plurality of web servers, the method comprising the steps of:

generating a web server request rejection probability based upon performance measures of each of the plurality of web servers;

admitting a web server request if the web server request rejection probability is less than or equal to a predetermined web server request rejection probability threshold, wherein the web server request is admitted before the web server request is sent or transmitted to a web server;

generating a web server request distribution function for each of the plurality of web servers based upon performance measures of each of the plurality of web servers, each of the plurality of web servers being assigned a respective probability range based upon each respective web server request distribution function, wherein the web server request distribution function for each of the plurality of web servers is based on recursive filtering functions of the performance measures of each of the plurality of web servers, and wherein the recursive filtering functions of the performance measures of each of the plurality of web servers comprises;

2. The method as defined in claim 1, wherein the random probability number has a value ranging from 0 to 1.

3. The method as defined in claim 1, wherein the performance measures of each of the plurality of web servers are weighted.

4. The method as defined in claim 3, wherein the performance measures of each of the plurality of web servers comprise at least one of a web server processor utilization, a web server queue length, a web server memory utilization, a web server response time, a number of web server sessions, and a number of web server connections.

5. The method of claim 1 further comprising the step of rejecting the web server request if the web server request rejection probability is more than a predetermined web server request rejection probability threshold.

6. The method of claim 5 further comprising the step of queuing the rejected web server request if there is room in an admission control queue.

7. The method of claim 1 wherein the performance measures are provided by each of the plurality of web servers.

8. The method of claim 1 wherein the web server request distribution function for each of the plurality of web servers based upon performance measures of each the plurality of web servers, comprises:

9. The method of claim 1 wherein the web server request rejection probability is defined as p_r(n)=1−

p_a(n) at sampling interval nΔ

t, n=1, 2, . . . , wherein p_a(n) is probability of accepting the web server request and t is time.

10. The method of claim 1 wherein the web server request is admitted for processing before a web server to which the request is to be delivered to is identified or determined.

11. An apparatus for adaptively distributing a web server request in a system having a plurality of web servers, the apparatus comprising:

a web server request rejection probability generator for generating a web server request rejection probability based upon performance measures of each of the plurality of web servers;

admission control logic for admitting a web server request if the web server request rejection probability is less than or equal to a predetermined web server request rejection probability threshold, wherein the web server request is admitted before the web server request is sent or transmitted to a web server;

a web server request distribution function generator for generating a web server request distribution function for each of the plurality of web servers based upon performance measures of each of the plurality of web servers, each of the plurality of web servers being assigned a respective probability range based upon each respective web server request distribution function, wherein the web server request distribution function for each of the plurality of web servers is based on recursive filtering functions of the performance measures of each of the plurality of web servers, and wherein the recursive filtering functions of the performance measures of each of the plurality of web servers comprises;

12. The apparatus as defined in claim 11, wherein the random probability number has a value ranging from 0 to 1.

13. The apparatus as defined in claim 11, wherein the performance measures of each of the plurality of web servers are weighted.

14. The apparatus as defined in claim 13, wherein the performance measures of each of the plurality of web servers comprise at least one of a web server processor utilization, a web server queue length, a web server memory utilization, a web server response time, a number of web server sessions, and a number of web server connections.

15. The apparatus as defined in claim 11, wherein the web server request distribution function for each of the plurality of web servers is based on recursive filtering functions of the performance measures of each of the plurality of web servers.

16. The apparatus as defined in claim 11, wherein the web server request distribution function for each of the plurality of web servers is based on tracking functions of the performance measures of each of the plurality of web servers.

17. The apparatus of claim 11 wherein the web server request is admitted for processing before being delivered to a web server.

18. An article of manufacture for adaptively distributing a web server request in a system having a plurality of web servers, the article of manufacture comprising:

at least one processor readable medium; and

instructions stored on the at least one medium;

wherein the instructions are configured to be readable from the at least one medium by at least one processor and thereby cause the at least one processor to operate so as to;

generate a web server request rejection probability based upon performance measures of each of the plurality of web servers;

admit a web server request if the web server request rejection probability is less than or equal to a predetermined web server request rejection probability threshold, wherein the web server request is admitted before the web server request is sent or transmitted to a web server;

generate a web server request distribution function for each of the plurality of web servers based upon performance measures of each of the plurality of web servers, each of the plurality of web servers being assigned a respective probability range based upon each respective web server request distribution function, wherein the web server request distribution function for each of the plurality of web servers is based on recursive filtering functions of the performance measures of each of the plurality of web servers, and wherein the recursive filtering functions of the performance measures of each of the plurality of web servers comprises;

19. The article of manufacture as defined in claim 18, wherein the random probability number has a value ranging from 0 to 1.

20. The article of manufacture as defined in claim 18, wherein the performance measures of each of the plurality of web servers are weighted.

21. The article of manufacture as defined in claim 20, wherein the performance measures of each of the plurality of web servers comprise at least one of a web server processor utilization, a web server queue length, a web server memory utilization, a web server response time, a number of web server sessions, and a number of web server connections.

22. The article of manufacture as defined in claim 18, wherein the web server request distribution function for each of the plurality of web servers is based on recursive filtering functions of the performance measures of each of the plurality of web servers.

23. The article of manufacture as defined in claim 18, wherein the web server request distribution function for each of the plurality of web servers is based on tracking functions of the performance measures of each of the plurality of web servers.

24. A method for adaptively distributing a web server request in a system having a plurality of web servers, the method comprising the steps of:

generating a web server request rejection probability based upon performance measures of each of the plurality of web servers;

admitting a web server request if the web server request rejection probability is less than or equal to a predetermined web server request rejection probability threshold, wherein the web server request is admitted before the web server request is sent or transmitted to a web server;

generating a web server request distribution function for each of the plurality of web servers based upon performance measures of each of the plurality of web servers, each of the plurality of web servers being assigned a respective probability range based upon each respective web server request distribution function, wherein the web server request distribution function for each of the plurality of web servers is based on tracking functions of the performance measures of each of the plurality of web servers, and wherein the tracking functions of the performance measures of each of the plurality of web servers comprises;

25. An apparatus for adaptively distributing a web server request in a system having a plurality of web servers, the apparatus comprising:

a web server request rejection probability generator for generating a web server request rejection probability based upon performance measures of each of the plurality of web servers;

admission control logic for admitting a web server request if the web server request rejection probability is less than or equal to a predetermined web server request rejection probability threshold, wherein the web server request is admitted before the web server request is sent or transmitted to a web server;

a web server request distribution function generator for generating a web server request distribution function for each of the plurality of web servers based upon performance measures of each of the plurality of web servers, each of the plurality of web servers being assigned a respective probability range based upon each respective web server request distribution function, wherein the web server request distribution function for each of the plurality of web servers is based on tracking functions of the performance measures of each of the plurality of web servers, and wherein the tracking functions of the performance measures of each of the plurality of web servers comprises;