Load control device and method thereof for controlling requests sent to a server

• US 8,667,120 B2
• Filed: 04/25/2007
• Issued: 03/04/2014
• Est. Priority Date: 04/26/2006
• Status: Active Grant

• Current Assignee: Nippon Telegraph and Telephone Corporation
• Original Assignee: Nippon Telegraph and Telephone Corporation
• Inventors: Ishida, Osamu, Kurebayashi, Ryosuke, Ota, Satoru, Hayashi, Tsunemasa, Obana, Kazuaki
• Primary Examiner(s): Patel, Haresh N
• Application Number:
  US12/298,574
• Publication Number:
  US 20090077233A1
• Time in Patent Office: 2,505 Days
• Field of Search: 709217-228, 709/203
• US Class Current: 709/224
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 43/0894 Packet rate
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/193 at the transport layer, e.g. TCP related
• CPC Class Codes: H04L 47/27 Evaluation or update of window size, e.g. using information derived from acknowledged [ACK] packets
• CPC Class Codes: H04L 47/39 Credit based
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/165 Combined use of TCP and UDP protocols; selection criteria therefor

Abstract

The number of response-waiting requests which are already sent to a server (4) but to which a response is not yet returned from the server (4) is limited. To limit this number, received requests are temporarily accumulated in a buffer if the number of response-waiting requests has reached a threshold and, until the number of response-waiting requests falls below the threshold, requests are not sent from the buffer. The execution status of the server (4) is monitored, and the threshold is increased when the response time from the server (4) to a request is within an allowable range, and the threshold is decreased when the response time exceeds the allowable range. In addition, TCP connections between a load control device (3) and clients (1-1, . . . , 1-n) are aggregated so that the number of simultaneous connections of TCP connections between the server (4) and the load control device (3) becomes equal to or smaller than the threshold of the number of response-waiting requests.

Claims

1. A load control device, provided between one or more clients and a server, for sending a request, received from one of said clients, to said server and for sending a response, returned from said server in response to the request, to said client, said load control device comprising:

a processing device to cause a limiting portion to limit the number of response-waiting requests which are already sent to said server but to which responses are not yet returned from said server,

the limiting portion comprising;

a buffer;

a request receiving portion that receives a request from said client, and stores the received request in said buffer;

a request sending portion that gets one request from said buffer if the number of response-waiting requests is smaller than a threshold, increments the number of response-waiting requests by one, and sends the one request to said server;

a response receiving portion that receives a response from said server; and

a response sending portion that sends the received response to said client, and decrements the number of response-waiting requests by one;

a monitoring portion that monitors an execution status of said server;

a measuring portion that measures a throughput for each threshold of the number of response-waiting requests based on a monitor result of said monitoring portion, said throughput being the number of requests processed by said server per unit time; and

a threshold increasing and decreasing portion that increases the threshold if a throughput for a current threshold is higher than throughput for a threshold lower than the current threshold and decreases the threshold if a throughput for the current threshold is lower than a throughput for a threshold lower than the current threshold.

2. The load control device according to claim 1 wherein the threshold is a value larger than 1.

3. The load control device according to claim 1, further comprising

an aggregating portion that aggregates TCP connections between itself and clients so that the number of simultaneous connections of TCP connections between said server and itself becomes equal to or smaller than the threshold of the number of response-waiting requests.

4. The load control device according to claim 1 wherein said buffer comprises a priority control portion that performs a priority control of requests based on identification information on a client sending a request.

5. The load control device according to claim 1 wherein said buffer comprises a priority control portion that performs a priority control of requests based on whether or not a particular pattern is included in a particular position or range in a request.

6. The load control device according to claim 1 wherein said buffer comprises a priority control portion that performs a priority control of requests based on whether or not a particular variable in a request is larger than a pre-set threshold.

7. The load control device according to claim 1 wherein said buffer comprises a priority control portion that performs a priority control of requests based on whether or not a request is encrypted.

8. The load control device according to claim 1 wherein said buffer comprises a notifying portion that notifies a busy message to a request accumulated for a predetermined time or longer.

9. The load control device according to claim 1 wherein said server is a Web server and said buffer comprises a priority control portion that performs a priority control of requests based on a display priority of a page display of a request.

10. The load control device according to claim 1 wherein a request is sent from a client to said load control device via a TCP connection and

said buffer comprises a priority control portion that performs a priority control of requests based on whether or not another TCP connection is established between said client and said load control device, the number of TCP connections, or whether or not the request is a first request of a TCP connection.

11. The load control device according to claim 1, further comprising:

a storing portion that, when a response contains a URL of a page component to be automatically acquired by a browser, temporarily stores a set of identification information on a response-sending destination and the URL wherein

said buffer comprises a priority control portion that performs a priority control of requests based on whether or not a set of identification information on a request sending-source and a URL matches said set of identification information on the response-sending destination and the URL that is temporarily stored.

12. The load control device according to claim 1, further comprising a priority control portion that performs a priority control of requests based on a progress status of a session to which a request belongs.

13. The load control device according to claim 1, further comprising:

a caching portion that caches session identification information on a session, to which a request processed by said server belongs, for a fixed period of time; and

a priority control portion that performs a priority control of requests based on whether or not a request has the identification information on a session that is cached.

14. The load control device according to claim 1 wherein said buffer comprises a priority control portion that performs a priority control of requests based on a degree of suspicion of unauthorized access of traffic sent from a client.

15. A non-transitory recording medium which has recorded thereon a program that is installed in a general-purpose information processing device and that causes said general-purpose information processing device to implement a function equivalent to a function of the load control device according to one of claims 1, 2 and 3-14 and which is readable by said general-purpose information processing device.

16. A load control method for execution by a load control device, provided between one or more clients and a server, for sending a request, received from one of said clients, to said server and for sending a response, returned from said server in response to the request, to said client, said load control method comprising:

limiting the number of response-waiting requests which are already sent to said server but to which responses are not yet returned from said server, wherein

the limiting comprises;

receiving a request from said client;

storing the received request in a buffer;

getting one request from said buffer if the number of response-waiting requests is smaller than a threshold, and incrementing the number of response-waiting requests by one;

sending the one request to said server;

receiving a response from said server;

sending the received response to said client and decrementing the number of response-waiting requests by one;

monitoring an execution status of said server;

measuring throughput for each threshold of the number of response-waiting requests based on a monitor result of said monitoring, said throughput being the number of requests processed by said server per unit time; and

increasing the threshold if a throughput for a current threshold is higher than a throughput for a threshold lower than the current threshold and decreasing the threshold if a throughput for the current threshold is lower than a throughput for a threshold lower than the current threshold.

17. The load control method according to claim 16 wherein the threshold is a value larger than 1.

18. The load control method according to claim 16, further comprising:

aggregating TCP connections between itself and clients so that the number of simultaneous connections of TCP connections between said server and itself becomes equal to or smaller than the threshold of the number of response-waiting requests.

19. A load control device, provided between clients and a server, for sending a request, received from one of said clients, to said server and for sending a response, returned from said server in response to the request, to said client, said load control device comprising:

a processing device to cause a limiting portion to limit the number of response-waiting requests which are already sent to said server but to which responses are not yet returned from said server,

the limiting portion comprising;

a buffer in which requests received by the load control device are temporarily accumulated if the number of response-waiting requests has reached a threshold; and

a transmitting portion that does not send a request from said buffer until the number of response-waiting requests falls below the threshold;

a monitoring portion that monitors an execution status of said server;

a measuring portion that measures a throughput for each threshold of the number of response-waiting requests based on a monitor result of said monitoring portion, said throughput being the number of requests processed by said server per unit time;

a threshold increasing and decreasing portion that increases the threshold if a throughput for a current threshold is higher than a throughput for a threshold lower than the current threshold and decreases the threshold if a throughput for the current threshold is lower than a throughput for a threshold lower than the current threshold; and

a determining portion that determines whether or not the number of response-waiting requests has reached the threshold, and if the number of response-waiting requests has reached the threshold, determines whether or not the threshold is to be increased or decreased.

20. A load control method for execution by a load control device, provided between clients and a server, for sending a request, received from one of said clients, to said server and for sending a response, returned from said server in response to the request, to said clients, said load control method comprising:

a limiting step of limiting the number of response-waiting requests which are already sent to said server but to which responses are not yet returned from said server, wherein

the limiting step comprises;

a step of temporarily accumulating requests received the load control device in a buffer if the number of response-waiting requests has reached a threshold; and

a step of not sending a request from said buffer to said server until the number of response-waiting requests falls below the threshold;

a monitoring step of monitoring an execution status of said server;

a step of measuring throughput for each threshold of the number of response-waiting requests based on a monitor result of said monitoring step, said throughput being the number of requests processed by said server per unit time;

a step of increasing the threshold if a throughput for a current threshold is higher than a throughput for a threshold lower than the current threshold and decreasing the threshold if a throughput for the current threshold is lower than a throughput for a threshold lower than the current threshold;

a step of determining whether or not the number of response-waiting requests has reached the threshold; and

a step of determining whether or not the threshold is to be increased or decreased if the number of response-waiting requests has reached the threshold.