Real-time monitoring of job resource consumption and prediction of resource deficiency based on future availability

• US 8,621,477 B2
• Filed: 10/29/2010
• Issued: 12/31/2013
• Est. Priority Date: 10/29/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ferdous, Rashed, Meyer, Arthur J. III, Sosa, Carlos P.
• Primary Examiner(s): Al Kawsar, Abdullah
• Assistant Examiner(s): WU, BENJAMIN C
• Application Number:
  US12/915,140
• Publication Number:
  US 20120110582A1
• Time in Patent Office: 1,159 Days
• Field of Search: None
• US Class Current: 718/104
• CPC Class Codes: G06F 11/004 Error avoidance G06F11/07 and subgroups take precedence
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3442 for planning or managing the needed capacity
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 2209/503 Resource availability
• CPC Class Codes: G06F 2209/508 Monitor
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G06F 9/505 considering the load

Abstract

Techniques used to enhance the execution of long-running or complex software application instances and jobs on computing systems are disclosed herein. In one embodiment, a real time, self-predicting job resource monitor is employed to predict inadequate system resources on the computing system and failure of a job execution on the computing system. This monitor may not only determine if inadequate resources exist prior to execution of the job, but may also detect in real time if inadequate resources will be encountered during the execution of the job for cases where resource availability has unexpectedly decreased. If a resource deficiency is predicted on the executing computer system, the system may pause the job and automatically take corrective action or alert a user. The job may resume after the resource deficiency is met. Additional embodiments also integrate this resource monitoring capability with the adaptive selection of a computer system or application execution environment based on resource capability predictions and benchmarks.

Claims

1. A system for providing real time job resource monitoring of a computer system, comprising:

one or more processors;

a resource estimator executing on the one or more processors configured for analyzing input data of a job provided to the computer system and for estimating a total resource requirement representing adequate levels of processing resources in the computer system needed for successful execution of the job, the resource estimator further configured for obtaining a series of application performance benchmarks against the computer system, for determining a resource consumption rate of the job based on the application performance benchmarks, and for estimating a total amount of time required to execute the job on the computer system;

a resource monitor executing on the one or more processors configured for monitoring adequate processing resources of the computer system throughout execution of the job within the computer system, by;

measuring cumulative resource consumption for the job and available resource levels in the computer system;

factoring remaining execution time from the total amount of time required to execute the job on the computer system;

estimating future resource requirements of the execution of the job based on the remaining execution time, the total resource requirements of the job and the cumulative resource consumption for the job; and

comparing the future resource requirements of the execution of the job with the available resource levels in the computer system that are projected to exist in the future to predict any resource deficiency; and

a resource manager executing on the one or more processors configured for implementing one or more corrective actions to prevent failure of the job execution on the computer system responsive to prediction of a resource deficiency, wherein the resource monitor is further configured for monitoring adequate processing resources of the computer system at a predefined interval throughout execution of the job within the computer system, the predetermined interval correlating to one or both of the input data'"'"'s size and the total resource requirements of the job.

2. The system of claim 1, wherein the resource manager is configured for pausing the job to prevent failure of the job execution on the computer system responsive to prediction of the resource deficiency.

3. The system of claim 1, wherein the resource manager is configured for alerting a user of the resource deficiency to prevent failure of the job execution on the computer system responsive to prediction of the resource deficiency.

4. The system of claim 1, further comprising a scheduler configured for automatically selecting the computer system from a plurality of computer systems for execution of the job based on the input data and the total resource requirements of the job.

5. The system of claim 4, wherein the scheduler is further configured for factoring currently executing or scheduled jobs on the computer system and resource usage thresholds to select the computer system.