SCHEDULING AND EXECUTION OF TASKS

• US 20150199216A1
• Filed: 01/08/2015
• Published: 07/16/2015
• Est. Priority Date: 01/10/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cao, Zhao, Shi, Ju Wei, Wang, Chen, Wang, Lan Jun, Wang, Yu, Zou, Jia
• Granted Patent: US 9,495,206 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources

Abstract

An apparatus for scheduling includes a receiving unit, configured to receive a task of a job; a configuration unit, configured to configure resource amounts for the task in at least two resource dimensions respectively, wherein each of the resource dimensions represents a resource available for configuring; and an interface unit, configured to distribute the task along with information about the resource amounts configured for the task in the resource dimensions.

Claims

1. An apparatus for scheduling, comprising:

a receiving unit, configured to receive a task of a job;

a configuration unit, configured to configure resource amounts for the task in at least two resource dimensions respectively, wherein each of the resource dimensions represents a resource available for configuring; and

an interface unit, configured to distribute the task along with information about the resource amounts configured for the task in the resource dimensions.

2. The apparatus according to claim 1, further comprising:

an estimation unit, configured to estimate the resources amounts to be consumed by the task in the at least two resource dimensions,

wherein the configuration unit configures the resource amounts for the task in at least two resource dimensions respectively according to result of the estimating.

3. The apparatus according to claim 2, wherein the estimation unit estimates the resources amounts to be consumed by the task in the at least two resource dimensions according to historical information.

4. The apparatus according to claim 2, wherein the estimation unit estimates the resources amounts to be consumed by the task in the at least two resource dimensions according to sampled information.

5. The apparatus according to claim 1, further comprising:

a candidate unit, configured to select tasks respectively from a plurality of jobs as candidate tasks to be distributed at the interface unit.

6. The apparatus according to claim 5, further comprising:

a generation unit, configured to generate a scheme for distributing the candidate tasks at the interface unit according to the resource amounts configured for each of the candidate tasks in the resource dimensions.

7. The apparatus according to claim 6, further comprising:

a decision unit, configured to estimate a gain of a scheme assumed to be generated by the generation unit after a predetermined lag with respect to a scheme currently generated by the generation unit, and instruct the generation unit not to generate a scheme until the predetermined lag elapses in the cast that the gain estimated is superior to the cost of the predetermined lag.

8. The apparatus according to claim 1, wherein the apparatus of scheduling is included in a Map device of a MapReduce device.

9. The apparatus according to claim 1, wherein the apparatus of scheduling is included in a Reduce device of a MapReduce device.

10. A method of scheduling, comprising:

receiving a task of job;

configuring resource amounts for the task in at least two resource dimensions respectively, wherein each of the resource dimensions represents a resource available for configuring; and

distributing the task along with information about the resource amounts configured for the task in the resource dimensions.

11. The method according to claim 10, further comprising:

estimating the resources amounts to be consumed by the task in the at least two resource dimensions;

wherein configuring resource amounts for the task in at least two resource dimensions respectively comprises configuring the resource amounts for the task in at least two resource dimensions respectively according to result of the estimating.

12. The method according to claim 11, wherein estimating the resources amounts to be consumed by the task in the at least two resource dimensions comprises:

estimating the resources amounts to be consumed by the task in the at least two resource dimensions according to historical information.

13. The method according to claim 11, wherein estimating the resources amounts to be consumed by the task in the at least two resource dimensions comprises:

estimating the resources amounts to be consumed by the task in the at least two resource dimensions according to sampled information.

14. The method according to claim 10, further comprising:

selecting tasks respectively from a plurality of jobs as candidate tasks to be distributed.

15. The method according to claim 14, further comprising:

generating a scheme for distributing the candidate tasks according to the resource amounts configured for each of the candidate tasks in the resource dimensions.

16. The method according to claim 15, further comprising:

estimating a gain of a scheme assumed to be generated after a predetermined lag with respect to a scheme currently generated, and not generating a scheme until the predetermined lag elapses in the case that the gain estimated is superior to the cost of the predetermined lag.

17. The method according to claim 10, wherein the method of scheduling is included in a Map process of a MapReduce process.

18. The method according to claim 10, wherein the method of scheduling is included in a Reduce process of a MapReduce process.

19. A method for execution, comprising:

receiving a task along with information about resource amounts configured for the task in at least two resource dimensions respectively;

assigning resources to the task in the at least two resource dimensions according to the information respectively; and

executing the task by using the assigned resources.