Proxy server, hierarchical network system, and distributed workload management method

• US 9,071,540 B2
• Filed: 08/23/2012
• Issued: 06/30/2015
• Est. Priority Date: 03/30/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wang, Wen Jie, Wu, Hai Shan, Yang, Bo, Zhao, Yi Xin
• Primary Examiner(s): Tran, Philip B
• Application Number:
  US13/592,932
• Publication Number:
  US 20120317283A1
• Time in Patent Office: 1,041 Days
• Field of Search: 709/223, 709/224
• US Class Current: 1/1
• CPC Class Codes: H04L 47/22 Traffic shaping
• CPC Class Codes: H04L 47/2425 for supporting services specification, e.g. SLA
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.

Claims

1. A hierarchical network system, comprising:

at least one proxy server, comprising;

a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and

a request dispatcher configured to dispatch said requests of the corresponding service level in accordance with said dispatch rate determined by said rate controller; and

an application server configured to serve said at least one proxy server, comprising;

a resource detector configured to periodically detect a current usage of resources of said application server and a current request arrival rate;

a maximum rate calculator configured to, based on said detected current resource usage, said current request arrival rate and a target usage of the resource, calculate a maximum admitted rate of requests for a next management cycle; and

a rate distributor configured to distribute the maximum admitted rate for each proxy server as its predetermined rate based on a predetermined policy.

2. The hierarchical network system according to claim 1, wherein said predetermined policy is to evenly allocate said maximum admitted rate to said proxy server.

3. The hierarchical network system according to claim 1, wherein said resource comprises at least one of CPU usage, memory usage, I/O, and bandwidth.

4. The hierarchical network system according to claim 3, wherein when said resource is CPU usage, said maximum rate calculator adopts proportional-integral controller technologies to calculate said maximum allowable rate.

5. The hierarchical network system according to claim 1, wherein the calculation period of said proxy server is in synchronization with said management cycle of the application server.