System and Method for Providing Throttling, Prioritization and Traffic Shaping During Request Processing via a Budget Service

• US 20090219940A1
• Filed: 08/08/2008
• Published: 09/03/2009
• Est. Priority Date: 02/29/2008
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Jansson, Andreas E.
• Granted Patent: US 7,895,353 B2
• Time in Patent Office: Days
• US Class Current: 370/401
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2425 for supporting services specification, e.g. SLA
• CPC Class Codes: H04L 47/2433 Allocation of priorities to traffic types
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements

Abstract

A network gateway application is described that provides throttling, prioritization and traffic shaping for incoming requests from client applications. A request is received by a plug-in manager component of the gateway application. The plug-in manager can then invoke the budget service in order to determine a current available budget for the request. The budget can be computed according to a service level agreement for the service provider, application or network node. The requests can be of high or low priority. If the budget is greater than a specified priority threshold value, the low priority requests can be denied, while the high priority requests can be processed as long as there is some available budget left. If the budget for the request has reached the restricted level, the request can be denied and optionally enqueued to a traffic shaping queue to be processed at a later time.

Claims

1. A method for providing traffic throttling via a budget service, said method comprising:

receiving one or more incoming requests from an application;

invoking a budget service that determines a budget for said incoming requests and receiving the budget from the budget service;

determining a priority for each of said incoming requests, the priority being based on a service level agreement;

processing all incoming requests if the budget is over a guarantee threshold;

rejecting the incoming request of low priority if the budget is under said guarantee threshold; and

processing the incoming requests of high priority unless the budget is below an available limit.

2. The method of claim 1, further comprising:

rejecting the incoming requests of high priority if the budget is under the available limit.

3. The method of claim 1 wherein processing each request further includes:

decreasing the budget after allowing the processing of the request.

4. The method of claim 1 wherein invoking the budget service and receiving the budget further includes:

determining the budget for each of;

a service provider associated with the incoming request, the application that transmitted said incoming request and one or more network nodes.

5. The method of claim 1, further comprising:

maintaining a stateful network tier and a stateless access tier wherein the incoming request is first received at the access tier and wherein the budget service is invoked within the network tier.

6. The method of claim 1 wherein the budget service tracks historical data such that the budget is compensated for lost request traffic that was not processed during a network failure.

7. The method of claim 1 wherein invoking the budget service further includes:

transmitting a service provider identifier, an application identifier and a node identifier to the budget service; and

receiving a budget for each of the service provider, the application and the node from the budget service.

8. The method of claim 1 wherein determining a priority of each incoming request further includes:

assigning said incoming requests into a plurality of queues, each queue being of different priority, length and weight; and

selecting, by a dispatcher, requests from the plurality of queues in order of priority.

9. The method of claim 1 wherein rejecting the incoming request further includes:

enqueuing the incoming request to a traffic shaping queue in order to be processed at a later time.

10. The method of claim 1 wherein the incoming requests are initiated by a service provider application that provides telecommunication services to clients via a network gateway.

11. A system that provides a network gateway for throttling request traffic, said system comprising:

a client application that initiates a request and transmits the request to the network gateway;

a plug-in manager that receives the request and selects an appropriate plug-in for said request; and

a budget service that is invoked by the plug-in manager and returns a current available budget for the request to the plug-in manager in response to the invocation, wherein the plug-in manager allows or denies processing of the request based on the budget returned by the budget service.

12. The system of claim 11 wherein the request is designated as being either a high priority or low priority request.

13. The system of claim 12 wherein the budget further includes a specified priority value such that only requests that have been designated as being high priority are allowed to be processed once the budget reaches said priority value.

14. The system of claim 11 wherein once the request is processed, the current available budget is decreased.

15. The system of claim 11, further comprising:

a stateless access tier that receives and forwards the request; and

a stateful network tier that receives the request from the access tier and performs the throttling of the request, said network tier having the plug-in manager deployed thereon.

16. The system of claim 11, further comprising:

a service level agreement associated with the request, said service level agreement specifying a request limit that is used to compute the current available budget.

17. The system of claim 16 wherein the service level agreement is associated with at least one of:

a service provider, an application and a network node.

18. The system of claim 11 wherein if the request is denied processing, said request is assigned to a traffic shaping queue to be processed at a later point in time.

19. The system of claim 11 wherein the budget service tracks historical data such that the budget is compensated for lost request traffic that was not processed during a network failure.

20. A computer-readable medium carrying one or more sequences of instructions for throttling request traffic, which instructions, when executed by one or more processors, cause the one or more processors to carry out the steps of:

receiving one or more incoming requests from an application;

invoking a budget service that determines a budget for said incoming requests and receiving the budget from the budget service;

determining a priority for each of said incoming requests, the priority being based on a service level agreement;

processing all incoming requests if the budget is over a guarantee threshold;

rejecting the incoming request of low priority if the budget is under said guarantee threshold; and

processing the incoming requests of high priority unless the budget is below an available limit.