System and method for providing differentiated service by using category/resource scheduling

• US 20070061464A1
• Filed: 05/17/2006
• Published: 03/15/2007
• Est. Priority Date: 09/12/2005
• Status: Abandoned Application

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Cheng, Po-Wen, Lin, Ying-Dar, Feng, Ruo-Hua, Tien, Ching-Ming, Lee, Tzuo-Chun, Yang, Shu-Fen, Lai, Yuan-Cheng
• Application Number:
  US11/434,932
• Publication Number:
  US 20070061464A1
• Time in Patent Office: Days
• US Class Current: 709/226
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers

Abstract

A system for providing differentiated service by using category/resource scheduling and the method thereof are provided. The system and the method are mainly used in the Internet environment, and apply computer executable programs executed at relay points or in a servo system to schedule the processes of external requests according to classified categories of and resources consumed by the external requests when the servo system receives the external requests from the Internet. The time points when individual external requests are released to the servo system to be processed are determined by the category weight corresponding to each external request, the proportion of resource consumed by each external request, and the capacity of available resources in the servo system.

Claims

1. A system for providing differentiated service by using category/resource scheduling, which is applicable for scheduling external requests by utilizing computer executable programs, according to the category classifications, resource categories, and resource consumption proportions, and the available resource proportions of various sources in a servo system, to provide differentiated service when the servo system receives the external requests from the Internet, comprising:

a scheduler, including a main scheduler and one or more sub-schedulers, wherein;

the main scheduler has a resource counter pointer and one or more resource counters corresponding to the number of the resources of the servo system; and

the one or more sub-schedulers correspond to various resource counters, and each of the sub-schedulers has a category counter pointer and category counters corresponding to various category classifications; and

one or more request queues, corresponding to individual sub-schedulers, and each of the request queues has category queues corresponding to individual category classifications;

wherein when there are external requests in the request queues have not been processed yet, the main scheduler selects and drives the sub-scheduler and the request queue with the highest available resource proportion to process the external request of the current category classification, sends processable current external request to the servo system to be processed, and adjusts the resource counters, the category counters, and the corresponding category queues according to the resource consumption proportion, and repeatedly performs this procedure in round cycles.

2. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the system further comprises an explorer for pre-establishing category classifications, resource classifications, and resource consumption proportions of all external requests, and in the meantime calculating individual available resource proportions of the servo system, after the explorer completes the establishment and the calculation, the system initializes and generates the resource counters in the main scheduler, the category counters in the sub-schedulers, and the category queues of the request queues.

3. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the system further comprises a classifier for analyzing individual external requests to obtain corresponding category classifications and resource consumption proportions, and registering the external requests in the corresponding category queues in the corresponding request queues accordingly.

4. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the system further comprises adding individual resource consumption proportions corresponding to the external requests to individual resource counters according to the resource consumption proportions corresponding to the external requests, when the servo system completes the process of the external requests and generates responses.

5. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the category counter pointer is circularly moved with a deficit round robin scheduling algorithm.

6. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the system registers the external requests in the category queues corresponding to the category classifications in the request queue of resource with the highest resource consumption proportion.

7. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the system processes only one external request at a time.

8. The system for providing differentiated service by using category/resource scheduling as claimed in claim 2, wherein the explorer further comprises:

a service category policy table for recording the category classifications of the external requests; and

a request resource table for recording the resource consumption proportions of the external requests.

9. The system for providing differentiated service by using category/resource scheduling as claimed in claim 3, wherein the classifier determines the category classifications by analyzing a network layer content of the external requests.

10. The system for providing differentiated service by using category/resource scheduling as claimed in claim 3, wherein the classifier determines the category classifications by analyzing an application layer content of the external requests.

11. The system for providing differentiated service by using category/resource scheduling as claimed in claim 1, wherein the system is executed at Internet nodes linked to the servo system.

12. The system for providing differentiated service by using category/resource scheduling as claimed in claim 11, wherein the Internet node is a gateway, a router, a proxy server, or a load-balanced server.

13. A method for providing differentiated service by using category/resource scheduling, which is applicable for scheduling external requests by utilizing computer executable programs, according to the category classifications, resource categories, and resource consumption proportions, and the available resource proportions of various sources in a servo system, to provide differentiated service when the servo system receives the external requests from the Internet, comprising:

p1 (a) initializing and generating the resource counters of a main scheduler, the category counters of sub-schedulers, and the category queues of a request queue;

(b) selecting and driving the sub-scheduler and the request queue with the highest available resource proportion to process the external request of the current category classification; and

(c) sending the processable current external request to the servo system to be processed, adjusting the resource counters, the category counters, and the corresponding category queues according to the resource consumption proportions;

wherein when there are external request have not been processed yet, Step (b) and Step (c) are performed in a round cycle.

14. The method for providing differentiated service by using category/resource scheduling as claimed in claim 13, where in the Step (a) further comprises:

generating the resource counters at a number corresponding to the number of the resources of the servo system in the main scheduler;

initializing the available resources proportions in individual resource counters, and generating a resource counter pointer;

generating the sub-schedulers corresponding to individual resource counters, and generating the category counters and category counter pointers corresponding to individual category classifications in individual sub-schedulers;

synchronically initializing the available category proportions of individual category counters in individual sub-schedulers according to the category weights of individual category classifications; and

generating the request queues corresponding to individual sub-schedulers, and generating the category queues corresponding to individual category classifications in individual request queues.

15. The method for providing differentiated service by using category/resource scheduling as claimed in claim 14, wherein the category counter pointer is circularly moved with a deficit round robin scheduling algorithm.

16. The method for providing differentiated service by using category/resource scheduling as claimed in claim 13, wherein the Step (b) processes only one external request at a time.

17. The method for providing differentiated service by using category/resource scheduling as claimed in claim 13, wherein the Step (c) registers the external requests in the category queues corresponding to category classifications in the request queue of resource with the highest resource consumption proportion.

18. The method for providing differentiated service by using category/resource scheduling as claimed in claim 13, wherein the Step (c) further comprises:

(c-1) moving the resource counter pointer to the corresponding resource counter, and in the meantime moving the category counter pointers in individual sub-schedulers to the category counters of the current category classification;

(c-2) confirming whether external requests still exist in the category queues of the current category classification in the request queue;

(c-3) confirming whether the available resource proportions in individual resource counters are all greater than the resource consumption proportions;

(c-4) confirming whether the available category proportions in the category counters of the current category classification in individual sub-schedulers are all greater than individual resource consumption proportions; and

(c-5) allowing to send the corresponding external requests to the servo system to be processed, and deducting individual resource consumption proportions corresponding to the external requests from individual resource counters and the category counters of the current category classification in individual sub-schedulers.

19. The method for providing differentiated service by using category/resource scheduling as claimed in claim 18, wherein when the answers to Step (c-2), Step (c-3), and Step (c-4) are No, it comprises further performing the following step:

moving the category counter pointers in individual sub-schedulers to the category counters of the next category classification when other category classifications have not been determined to still exist.

20. The method for providing differentiated service by using category/resource scheduling as claimed in claim 18, wherein when the answers to Step (c-2), Step (c-3), and Step (c-4) are No, it further comprises performing the following step:

moving the resource counter pointer to the resource counter corresponding to the next resource, and in the meantime moving the category counter pointers in individual sub-schedulers back to the category counters of the first category classification when no category classifications have not been determined to exist.

21. The method for providing differentiated service by using category/resource scheduling as claimed in claim 13, wherein the method further comprises the Step (d) of pre-establishing the category classifications, resource classification, and resource consumption proportions of all external requests in the servo system through the explorer, and in the meantime calculating individual available resource proportions in the servo system.

22. The method for providing differentiated service by using category/resource scheduling as claimed in claim 21, wherein the Step (d) further comprises:

exploring the servo system and receiving individual responses for the external requests from the servo system with the explorer;

analyzing individual external requests to obtain the corresponding category classifications, and providing predetermined category weights and then recording them in the service category policy table;

sending individual external requests to obtain proportions that the individual external requests consume the servo system resources, and recording the resource classifications of the individual external requests in the request resource table;

full loading the servo system by repeatedly sending a same external request, and calculating the capacity of individual available resources of the servo system according to the sending times and the corresponding resource consumption proportions; and

converting individual resource consumption proportions corresponding to individual external requests according to the capacity of individual available resources of the servo system, and recording the individual resource consumption proportions in the request resource table.

23. The method for providing differentiated service by using category/resource scheduling as claimed in claim 25, wherein the step of analyzing individual external requests to obtain corresponding category classifications mainly refers to determining the category classification by analyzing a network layer content of the external requests.

24. The method for providing differentiated service by using category/resource scheduling as claimed in claim 25, wherein the step of analyzing individual external requests to obtain corresponding category classifications mainly refers to determining the category classification by analyzing an application layer content of the external requests.

25. The method for providing differentiated service by using category/resource scheduling as claimed in claim 16, wherein the method further comprises Step (e) of continuously analyzing individual external requests through the classifier to obtain the corresponding category classifications and the resource consumptions proportions, and registering the external requests in the corresponding category queues of the corresponding request queues accordingly.

26. The method for providing differentiated service by using category/resource scheduling as claimed in claim 28, wherein the Step (e) refers to determining the category classifications according to the comparison with the service category policy table and determining the resource consumption proportions according to the comparison with the request resource table.

27. The method for providing differentiated service by using category/resource scheduling as claimed in claim 16, wherein the method further comprises the step of immediately performing Step (e) when the external requests are generated.

28. The method for providing differentiated service by using category/resource scheduling as claimed in claim 16, wherein the method further comprises Step (f) of adjusting the resource counters according to the resource consumption proportions corresponding to the external requests when the servo system completes the processes of the external requests and generates responses.

29. The method for providing differentiated service by using category/resource scheduling as claimed in claim 26, wherein the Step (f) further comprises:

determining whether or not the servo system has completed the processes of the external requests and generated responses; and

adding individual resource consumption proportions corresponding to the external requests to individual resource counters.

30. The method for providing differentiated service by using category/resource scheduling as claimed in claim 16, wherein the method regards a situation that all category classifications have completed the process for an external request as a round cycle, and the method further comprises the step of adding corresponding available category proportions to individual category counters in individual sub-schedulers according to the category weights of individual category classifications every time a new round cycle is started.