Cooperative batch scheduling in multitenancy system based on estimated execution time and generating a load distribution chart

• US 9,032,406 B2
• Filed: 07/01/2010
• Issued: 05/12/2015
• Est. Priority Date: 07/01/2010
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Eberlein, Peter
• Primary Examiner(s): An, Meng
• Assistant Examiner(s): GHAFFARI, ABU Z
• Application Number:
  US12/828,308
• Publication Number:
  US 20120005597A1
• Time in Patent Office: 1,776 Days
• Field of Search: 718/101, 718/102, 718/105, 715/751
• US Class Current: 718/102
• CPC Class Codes: G06F 11/323 Visualisation of programs or trace data
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 3/126 Job scheduling, e.g. queuing, determine appropriate device
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues

Abstract

Systems and methods for cooperative batch scheduling in multitenancy computing systems are described. A number of batch requests are received in the computing system, where each batch request includes a job reference, and a start time when the execution of the referenced job to be launched. Duration of execution is estimated for each job referenced by the requests. The estimation is based on predefined criteria that include a product of median execution times for at least one recurring operation. An anonymous load chart is created based on the start times and the estimated duration of execution of each job referenced by the plurality of batch requests. The anonymous load chart may take into account the available capacity of the computing system. The anonymous load chart is exposed to a number of isolated users of the computing system for cooperative batch scheduling.

Claims

1. A non-transitory computer readable storage medium storing instructions, which when executed by a computer, cause the computer to:

receive a plurality of job requests at a shared computer system from one or more of a plurality of isolated tenants of the shared computer system, wherein each job request of the plurality of job requests includes a reference to a corresponding job of a plurality of jobs and a start time for beginning an execution of the referenced job;

for each job of the plurality of jobs referenced by the plurality of job requests, estimate, by the shared computer system, a duration of execution of the job based on a type of the job, wherein estimating the duration of execution of a job comprises;

identifying a plurality of objects of a specific type to be processed during the execution of the job,

assigning a median duration for processing an object of the specific type, wherein assigning the median duration comprises;

estimating the median duration in accordance with an expected capacity of the shared computer system during the execution of the job, and

adding, to the duration of execution of the job, a result of a multiplication between the median duration and a cardinality of the plurality of objects;

create a distribution over a future period of time of load levels of the shared computer system resulting from the start times and the estimated durations of execution of the plurality of jobs referenced by the plurality of job requests; and

expose a load chart of the distribution of the load levels of the shared computer system to at least one of the plurality of isolated tenants of the shared computer system to enable collaborative job scheduling between the isolated tenants for the future period of time.

2. The computer readable storage medium of claim 1 further comprising instructions, which when executed by the computer cause the computer to:

receive an additional job request from one of the plurality of isolated tenants at the shared computer system after the creation of the distribution, wherein the additional job request includes a reference to an additional job and a start time for an execution of the additional job;

estimate a duration of execution of the additional job referenced by the additional job request; and

update the load levels of the shared computer system in the distribution in accordance with the start time for the execution of the additional job and the estimated duration of execution of the additional job.

3. The computer readable storage medium of claim 1 further comprising instructions, which when executed by the computer cause the computer to:

after creating the distribution, receive an additional job request from one of the plurality of isolated tenants at the shared computer system, wherein the additional job request includes a reference to an additional job and a time period for an execution of the additional job;

estimate a duration of execution of the additional job referenced by the additional job request;

assign a start time for the execution of the additional job based on;

the time period for the execution of the additional job,

the estimated duration of execution of the additional job, and

the distribution over the future period of time of the load levels of the shared computer system; and

update the load levels of the shared computer system in the distribution in accordance with the start time for the execution of the additional job and the estimated duration of execution of the additional job.

4. The computer readable storage medium of claim 1 further comprising instructions, which when executed by the computer cause the computer to:

update the median duration for processing an object of the specific type with the actual duration for processing the object of the plurality of objects of the specific type, after the job is completed.

5. The computer readable storage medium of claim 1, wherein creating the distribution comprises:

estimating an expected load level of the shared computer system based on a system capacity for the future time period per a timeslot, wherein the duration of the future time period and the timeslot are one or more of predefined and dynamically selected.

6. The computer readable storage medium of claim 1, wherein exposing the load chart to the at least one of the plurality of isolated tenants comprises:

rendering a graphical user interface (GUI) including the distribution over the future period of time of the load levels on at least one display device corresponding to the at least one of the plurality of isolated tenants.

7. The computer readable storage medium of claim 1 further comprising instructions, which when executed by the computer cause the computer to:

associate one or more of a plurality of colors and a plurality of fill patterns with a plurality of load levels to illustrate the distribution of the load levels in the load chart.

8. A computerized method for enabling collaborative batch scheduling in a multitenancy computer application environment for a plurality of isolated tenants, the method comprising:

receiving, from one or more of the plurality of isolated tenants of the multitenancy application environment, a plurality of requests for execution of a plurality of corresponding batches in the multitenancy application environment, wherein each request of the plurality of requests includes a job type of a corresponding batch and a start time for beginning an execution of the corresponding batch;

for each of the plurality of requests, estimating a duration of execution of the corresponding batch based on the job type, wherein estimating the duration of execution of a batch comprises;

identifying a plurality of similar objects to be processed during the execution of the batch,

assigning a median duration for processing an object of the plurality of similar objects, wherein assigning the median duration comprises,

estimating the median duration in accordance with an expected capacity of the multitenancy application environment during the execution of the batch, and

including a result of a multiplication between the median duration and the number of the similar objects in the duration of the execution of the batch;

creating a distribution over a future period of time of load levels of the multitenancy application environment resulting from the start times and the estimated duration of execution of each batch of the plurality of batches; and

exposing a load chart of the distribution of the load levels of the multitenancy application environment to at least one of the plurality of isolated tenants of the multitenancy application environment for collaborative batch scheduling between the isolated tenants for the future period of time.

9. The method of claim 8 further comprising:

after creating the distribution, receiving, from one of the plurality of isolated tenants, an additional request for execution of an additional batch in the multitenancy application environment, wherein the additional request includes a job type and a start time for an execution of the additional batch;

estimating a duration of execution of the additional batch; and

updating the load levels of the multitenancy application environment in the distribution in accordance with the start time for the execution of the additional batch and the estimated duration of execution of the additional batch.

10. The method of claim 8 further comprising:

after creating the distribution, receiving, from one of the plurality of isolated tenants, an additional request for execution of an additional batch in the multitenancy application environment, wherein the additional request includes a job type and a time period for an execution of the additional batch;

estimating a duration of execution of the additional batch;

assigning a start time for the execution of the additional batch based on the time period for the execution of the additional batch, the estimated duration of execution of the additional batch and the distribution over the future period of time of the load levels of the multitenancy application environment; and

updating the load levels of the multitenancy application environment in the distribution in accordance with the start time for the execution of the additional batch and the estimated duration of execution of the additional batch.

11. The method of claim 8 further comprising:

updating the median duration for processing an object of the plurality of similar objects with the actual duration the plurality of similar objects were processed.

12. The method of claim 8, wherein creating the distribution comprises:

estimating an expected load level of the multitenancy application environment based on a system capacity for the future period per a timeslot, wherein the future period and the timeslot are one or more of predefined and dynamically selected.

13. A computer system for enabling collaborative batch scheduling in a shared resources environment for a plurality of isolated clients, the system comprising:

a computer memory to store program code; and

a processor to execute the program code to;

estimate a duration of an execution of each of a first plurality of batch jobs based on a corresponding job type and a corresponding execution start time, wherein estimating the duration of the execution of each of the first plurality of batch jobs comprises;

dividing a batch job of the first plurality of batch jobs to a plurality of recurring operations,

assigning a median duration for processing a single instance of an operation of the plurality of recurring operations, wherein assigning the median duration comprises;

estimating the median duration in accordance with a forecasted capacity of the shared resources during the execution of the batch job, and

adding, to the duration of the execution of each of the first plurality of batch jobs, a result of multiplication between the median duration and a number of recurrences of the operation in the batch job; and

generate a report for a resource consumption of the shared resources environment for a predefined future period, the resource consumption resulting from the estimated duration of the execution of the first plurality of batch jobs and the corresponding start times, wherein the report is accessible by at least one of the plurality of isolated clients of the shared resources environment.

14. The computer system of claim 13 further comprising:

estimate a duration of an execution of at least one of a second plurality of batch jobs based on a job type; and

update the report for the resource consumption of the shared resources environment for the predefined future period based on the estimated duration of the execution of the at least one of the second plurality of batch jobs and at least one corresponding start time.

15. The system of claim 13 further comprising:

updating the median duration for processing a single instance of the recurring operations with an actual duration for processing of at least one instance of the plurality of recurring operations.