Optimizing job execution in parallel processing with improved job scheduling using job currency hints

• US 10,459,760 B2
• Filed: 07/08/2016
• Issued: 10/29/2019
• Est. Priority Date: 07/08/2016
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Scheuer, Tobias
• Primary Examiner(s): Nguyen, Van H
• Application Number:
  US15/206,186
• Publication Number:
  US 20180011737A1
• Time in Patent Office: 1,208 Days
• Field of Search: None
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues

Abstract

Scheduling jobs from an application based on a job concurrency hint. The job concurrency hint providing an indication of the number and/or size of the jobs that can be handled by the job scheduler. The scheduling of the jobs based on the job concurrency hint including selecting the number and/or size of the jobs to pass to the job scheduler for execution by a thread in a core of a processor.

Claims

1. A method comprising:

obtaining, at an application from a job scheduler of at least one system comprising a programmable processor and prior to sending one or more application jobs to the job scheduler, a job concurrency hint, the job concurrency hint comprising a statistical prediction based on a plurality of job graphs, each of the plurality of job graphs corresponding to a previously processed application job, each of the plurality of job graphs comprising at least one of an elapsed time, a waiting time, and an overhead time for the corresponding previously processed application job, the job concurrency hint adjusted to increase elapsed time as compared to waiting and overhead times, the adjusted job concurrency hint corresponding to a number and a type of application jobs corresponding to fewer and longer application jobs;

selecting, based on the job concurrency hint, one or more application jobs to send to the job scheduler; and

,

sending the selected application jobs to the job scheduler for processing by the processor.

2. The method of claim 1, wherein the job concurrency hint includes an indication of the number of application jobs and their job types currently in the job scheduler of the processor.

3. The method of claim 2, wherein the job types include an indication of the length of the application job in the job scheduler.

4. The method of claim 1, wherein the selecting is based on the job type of the application jobs.

5. The method of claim 1, further comprising:

monitoring, prior to obtaining the job concurrency hint, the execution of application source code to detect when the application source code identifies application jobs to send to the job scheduler.

6. The method of claim 1, wherein the selecting includes at least:

selecting application jobs to send to the scheduler to balance the load on the processor.

7. The method of claim 1, wherein the selecting is further based on historical data associated with a load on the processor.

8. The method of claim 7, wherein the historical data includes correlations between one or more previous job concurrency hints and a number and/or type of application jobs sent to the job scheduler by the application.

9. The method of claim 7, wherein the historical data includes load information for the processor.

10. A system comprising:

a processor; and

,

a memory configured to store computer executable instructions, which, when executed by the processor, cause the processor to perform operations, the operations comprising;

obtaining, at an application from a job scheduler of at least one system comprising a programmable processor and prior to sending one or more application jobs to the job scheduler, a job concurrency hint, the job concurrency hint comprising a statistical prediction based on a plurality of job graphs, each of the plurality of job graphs corresponding to a previously processed application job, each of the plurality of job graphs comprising at least one of an elapsed time, a waiting time, and an overhead time for the corresponding previously processed application job, the job concurrency hint adjusted to increase elapsed time as compared to waiting and overhead times, the adjusted job concurrency hint corresponding to a number and a type of application jobs corresponding to fewer and longer application jobs;

selecting, based on the job concurrency hint, one or more application jobs to send to the job scheduler; and

,

sending the selected application jobs to the job scheduler for processing by the processor.

11. The system of claim 10, wherein the job concurrency hint includes an indication of the number of application jobs and their job types currently in the job scheduler of the processor.

12. The system of claim 11, wherein the job types include an indication of the length of the application job in the job scheduler.

13. The system of claim 10, wherein the selecting is based on the job type of the application jobs.

14. The system of claim 10, wherein the operations further comprise, at least:

monitoring, prior to obtaining the job concurrency hint, the execution of application source code to detect when the application source code identifies application jobs to send to the job scheduler.

15. The system of claim 10, wherein the selecting includes at least:

selecting application jobs to send to the scheduler to balance the load on the processor.

16. The system of claim 10, wherein the selecting is further based on historical data associated with a load on the processor.

17. The system of claim 16, wherein the historical data includes correlations between one or more previous job concurrency hints and a number and/or type of application jobs sent to the job scheduler by the application.

18. The system of claim 16, wherein the historical data includes load information for the processor.