PROXY SERVER, HIERARCHICAL NETWORK SYSTEM, AND DISTRIBUTED WORKLOAD MANAGEMENT METHOD
First Claim
1. A proxy server, comprising:
- a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and
a request dispatcher configured to dispatch said requests of the corresponding service level in accordance with said dispatch rate determined by said rate controller.
0 Assignments
0 Petitions
Accused Products
Abstract
A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.
5 Citations
10 Claims
-
1. A proxy server, comprising:
-
a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch said requests of the corresponding service level in accordance with said dispatch rate determined by said rate controller. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A hierarchical network system, comprising:
-
at least one proxy server, comprising;
a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and
a request dispatcher configured to dispatch said requests of the corresponding service level in accordance with said dispatch rate determined by said rate controller; andan application server configured to serve said at least one proxy server, comprising; a resource detector configured to periodically detect a current usage of resources of said application server and a current request arrival rate; a maximum rate calculator configured to, based on said detected current resource usage, said current request arrival rate and a target usage of the resource, calculate a maximum admitted rate of requests for a next management cycle; and a rate distributor configured to distribute the maximum admitted rate for each proxy server as its predetermined rate based on a predetermined policy. - View Dependent Claims (7, 8, 9, 10)
-
Specification