Optimization of job scheduling in a computing environment

• US 9,471,382 B2
• Filed: 10/23/2013
• Issued: 10/18/2016
• Est. Priority Date: 10/23/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Frankhauser, Michael, Halberstadt, Benjamin, Hecker, Roger K.
• Primary Examiner(s): Lewis, Cheryl
• Application Number:
  US14/061,017
• Publication Number:
  US 20150112945A1
• Time in Patent Office: 1,091 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06Q 10/0631 Resource planning, allocation, distributing or scheduling for enterprises or organisations

Abstract

Optimizing job scheduling in a data processing system includes determining a time factor associated with a report, determining one or more jobs that contribute to the report, and narrowing execution frequency of the one or more jobs based on the time factor of the report. The time factor provides information about timing details for data included in the report. The jobs are executed in a computing environment according to a time schedule.

Claims

1. A system for optimizing job scheduling in a data processing system, the system comprising:

a computer processor, comprising;

a logic unit for determining a time factor associated with a report, wherein the time factor provides information about timing details for data included in the report;

a logic unit for determining jobs that contribute to the report, the jobs executed in a computing environment according to a time schedule, wherein the determining the jobs that contribute to the report includes collecting timeline-related metadata from the jobs and generating one or more data lineage graphs, each of data lineage graphs includes information identifying relationships between the report and the jobs that are utilized to generate the report; and

a logic unit for narrowing execution frequency of at least one of the jobs based on the time factor of the report.

2. The system of claim 1 wherein the jobs are executed to move or aggregate data from a first database to a second database.

3. The system of claim 1 wherein the time factor associated with the report is determined by analyzing information stored in a data model used to generate the report.

4. The system of claim 1 wherein the time factor associated with the report is determined by examining a formal definition associated with the report.

5. The system of claim 1 wherein the time factor associated with the report is determined by contained fields and queries for the report.

6. The system of claim 1, wherein the time factor associated with the report is determined by examining frequency and timing of invocations of the report by system calls.

7. The system of claim 1, wherein the jobs comprise extract-transform-load (ETL) jobs.

8. The system of claim 1, wherein the data lineage graphs indicate locations from which data is extracted or loaded into a data warehouse by the jobs and indicate a manner in which output from the jobs is fed into a data model in a data mart.