System and method for adaptive admission control and resource management for service time guarantees

• US 7,472,159 B2
• Filed: 05/15/2003
• Issued: 12/30/2008
• Est. Priority Date: 05/15/2003
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dillenberger, Donna N., Sahu, Sambit, Pradhan, Prashant, Tewari, Renu, Freimuth, Douglas Morgan
• Primary Examiner(s): Abdullahi; Salad
• Assistant Examiner(s): SALL, EL HADJI MALICK
• Application Number:
  US10/439,791
• Publication Number:
  US 20040230675A1
• Time in Patent Office: 2,056 Days
• Field of Search: 709/203, 709/207, 709/217, 709/223, 709/224, 370/440, 370/395.4
• US Class Current: 709/203
• CPC Class Codes: H04L 47/11 Identifying congestion
• CPC Class Codes: H04L 47/15 in relation to multipoint traffic arrangements for broadcast or multicast in data networks H04L12/18
• CPC Class Codes: H04L 47/2433 Allocation of priorities to traffic types
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/745 Reaction in network
• CPC Class Codes: H04L 47/748 Negotiation of resources, e.g. modification of a request
• CPC Class Codes: H04L 47/805 QOS or priority aware
• CPC Class Codes: H04L 47/821 Prioritising resource allocation or reservation requests
• CPC Class Codes: H04L 47/822 Collecting or measuring resource availability data
• CPC Class Codes: H04L 47/826 Involving periods of time
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method and system architecture to manage system resources in such a way as to provide service time guarantees to various classes of work using the system. In the case that the system resources are not sufficient to provide the specified service time guarantees, a method and system architecture is provided to limit work into the system such that the guarantees are satisfied and the revenue derived from the system is maximized.

Claims

1. A system for providing computer server servicing at a plurality of server resources of client requests for a plurality of request classes each having different response time guarantees comprising:

a computer processing unit (CPU) for executing a resource management component, a monitoring component, an adaptation engine, and a server resource scheduler;

the resource management component comprising a component for accepting and dynamically scheduling client requests and allocating system resources for request handling based on request classes, a predetermined scheduling policy and received adjustment input, said resource management component comprising a classifier for classifying incoming client requests into each of said plurality of request classes, a plurality of class-based accept queues for queuing said incoming client requests, and an accept queue scheduler for determining the order in which queued client requests are provided for servicing based on said classes, the predetermined policy and the adjustment input;

the monitoring component comprising a component for monitoring the handling of requests in different request classes, for monitoring resource usage and for providing request handling and resource usage feedback results to an adaptation engine;

the adaptation engine comprising an engine for evaluating the request handling and resource usage feedback results of said monitoring and for generating adjustment input to said resource management component to adjust the allocating of system resources for each class based on the evaluating of request handling and resource usage feedback results and response time guarantees; and

the server resource scheduler comprising a scheduler for allocating resources to service queued client requests provided from said accept queue scheduler, wherein the server resource scheduler is a hierarchical start-time fair queuing scheduler.

2. The system of claim 1 wherein the accept queue scheduler is a weighted fair queuing scheduler.

3. The system of claim 1 wherein said monitoring component comprises at least one timer for determining the time for a queued request to be removed from its accept queue.

4. The system of claim 1 wherein said accept queue scheduler dynamically alters said order based on said adjustment input.

5. A method for providing computer server servicing at a plurality of server resources of client requests for a plurality of request classes each having different response time guarantees comprising the steps of:

accepting and dynamically scheduling client requests and allocating system resources for request handling based on request classes, a predetermined scheduling policy and received adjustment input by the steps of classifying incoming client requests into each of said plurality of request classes, queuing classified incoming client request into a plurality of class-based accept queues, and determining the order in which queued client requests are provided for servicing based on said classes, the predetermined policy and adjustment input;

monitoring the handling of requests in different request classed and server resource usage and for providing request handling and resource usage feedback results for evaluation;

evaluating the request handling and resource usage feedback results of said monitoring; and

generating adjustment input for the dynamically scheduling to adjust resource allocations for each class based on said evaluating of request handling and resource usage feedback results and the response time guarantees,

wherein the allocating is performed by a hierarchical start-time fair queuing scheduler.

6. The method of claim 5 wherein the determining the order is performed by a weighted fair queue scheduler.

7. The method of claim 5 wherein said monitoring comprises determining the time for a queued request to be removed from its accept queue.

8. The method of claim 5 wherein said determining the order further comprises dynamically altering said order based on said adjustment input.

9. A program storage device readable by machine storing a program of instructions executable by the machine to perform method steps for providing computer server servicing at a plurality of server resources of client requests for a plurality of request classes each having different response time guarantees, said method comprising the steps of:

accepting and dynamically scheduling client requests and allocating system resources for request handling based on request classes, a predetermined scheduling policy and received adjustment input by the steps of classifying incoming client requests into each of said plurality of request classes, queuing classified incoming client request into a plurality of class-based accept queues, and determining the order in which queued client requests are provided for servicing based on said classes, the predetermined policy and adjustment input;

monitoring the handling of requests in different request classed and server resource usage and for providing request handling and resource usage feedback results for evaluation;

evaluating the request handling and resource usage feedback results of said monitoring; and

generating adjustment input for said dynamically scheduling to adjust the allocating of system resources for each class based on said evaluating of request handling and resource usage feedback results and the response time guarantees,

wherein the allocating is performed by a hierarchical start-time fair queuing scheduler.