Job-centric scheduling in a grid environment

• US 7,861,246 B2
• Filed: 06/17/2004
• Issued: 12/28/2010
• Est. Priority Date: 06/17/2004
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: Platform Computing Corporation
• Inventors: Lam, Jason, Lu, Bingfeng, Zhong, Jinsong
• Primary Examiner(s): Lee; Thomas
• Assistant Examiner(s): To; Jennifer N
• Application Number:
  US10/871,286
• Publication Number:
  US 20050283782A1
• Time in Patent Office: 2,385 Days
• Field of Search: 718100-108, 709201-203, 709223-226
• US Class Current: 718/102
• CPC Class Codes: G06F 9/5072 Grid computing

Abstract

Systems and methods for scheduling jobs in a networked computing grid having job service components for creating jobs having certain resource requirements are described. One embodiment includes resource manager components communicatively linked with the job service components, each resource manager component being configured to manage a plurality of resources. Such a system further includes information components communicatively linked with the job service components and the resource manager components, the information components being configured to aggregate resource data obtained from the resource manager components. The jobs include a scheduling mechanism for querying the information components for resource data, comparing the resource data against the resource requirements and independently scheduling the job to the resource manager components. A resource reservation is also provided for reserving resources for the jobs.

Claims

1. A system for scheduling jobs in a networked computing grid having one or more job service components for creating one or more jobs comprising executable program code and having certain resource requirements for completing an electronic task, comprising:

a plurality of resource manager components deployed in at least one cluster in the networked computing grid and communicatively linked with the one or more job service components deployed in at least one cluster in the networked computing grid, each resource manager component being configured to manage a plurality of resources provided by a plurality of host machines associated with the networked computing grid; and

one or more information components deployed in at least one cluster in the networked computing grid and communicatively linked with the one or more job service components and the plurality of resource manager components, the one or more information components being configured to aggregate resource data obtained from the plurality of resource manager components;

wherein the one or more jobs are created by corresponding ones of the one or more job service components to further include a scheduling mechanism in their program code for querying the one or more information components for resource data, comparing the resource data against the resource requirements and independently scheduling the one or more jobs to one or more of the plurality of resource manager components.

2. The system of claim 1 further comprising a plurality of resource manager adapter components deployed in at least one cluster in the networked computing grid and associated with the plurality of resource manager components, the resource manager adapter components being provided to enable communication between the one or more jobs and the plurality of resource manager components.

3. The system of claim 1 further comprising a metascheduler component deployed in at least one cluster in the networked computing grid and communicatively linked with the one or more job service components and the one or more information components, the metascheduler component being configured to provide scheduling suggestions to the one or more jobs.

4. The system of claim 1 further comprising a reservation service component deployed in at least one cluster in the networked computing grid, the reservation service component being configured to receive a reservation request from the one or more jobs and reserve resources according to the reservation request.

5. The system of claim 1 further comprising a persistent service component deployed in at least one cluster in the networked computing grid and an associated database deployed in at least one cluster in the networked computing grid, the persistent service component being configured to download job data to the associated database and recover job data from the associated database.

6. A method for scheduling a job in a networked computing grid, the job comprising executable program code and having certain resource requirements for completing an electronic task, the method comprising:

providing a plurality of resources within the networked computing grid;

providing one or more resource manager components for managing one or more of the plurality of resources;

providing one or more information components in communication with the one or more resource manager components, the one or more information components being operable to aggregate resource data obtained from the one or more resource manager components;

enabling the job in its program code to schedule itself to one or more of the plurality of resources, wherein enabling the job comprises enabling the job to query the one or more information components and evaluate whether one or more of the plurality of resources is compatible with the resource requirements of the job; and

scheduling the job via its program code to the one or more of the plurality of resources based on the evaluation.

7. The method of claim 6 wherein the resource data is obtained by configuring the one or more information components to extract resource data from the one or more resource manager components.

8. The method of claim 6 wherein the resource data is obtained by configuring the one or more resource manager components to submit resource data to the one or more information components.

9. The method of claim 6 wherein the resource data is obtained by configuring the one or more information components to extract resource data from the one or more resource manager components and configuring the one or more resource manager components to submit resource data to the one or more information components.

10. The method of claim 6 wherein the job evaluates whether one or more of the plurality of resources is compatible according to a scheduling algorithm.

11. The method of claim 6 further comprising providing a plurality of resource manager adapter components associated with the one or more resource manager components, the resource manager adapter components enabling communication between the job and the plurality of one or more resource manager components.

12. The method of claim 11 wherein one of the resource manager adapter components and one of the associated resource manager components are deployed into a first cluster, wherein the job originates from a second cluster different than the first cluster, and wherein enabling the job comprises enabling the job to communicate with the one of the resource manager components through the one of the resource manager adapter components.

13. The method of claim 11 further comprising providing a metascheduler component, wherein enabling the job comprises enabling the job to query the metascheduler component for scheduling suggestions.

14. The method of claim 11 further comprising providing a reservation service component, wherein enabling the job comprises enabling the job to query the reservation service component to reserve one or more of the plurality of resources.

15. A method for scheduling a job comprising executable program code and having certain resource requirements for completing an electronic task within a networked computing grid having a plurality of resources, the method comprising:

providing a plurality of resource manager components for managing the plurality of resources associated with the networked computing grid;

aggregating resource data obtained from the resource manager components;

enabling the job in its program code to query the resource data to evaluate whether one or more of the plurality of resources is compatible with the resource requirements of the job; and

scheduling the job via its program code to one or more of the plurality of resources determined to be compatible with the resource requirements of the job via communication between the job and one or more of the plurality of resource manager components associated with the one or more of the plurality of resources determined to be compatible.

16. The method of claim 15 further comprising enabling communication between the job and the one or more of the plurality of resource manager components by providing a plurality of resource manager adapter components communicatively linked with the plurality of resource manager components.

17. The method of claim 15 further comprising providing a metascheduler component, and enabling the job to query the metascheduler for scheduling suggestions.

18. The method of claim 15 further comprising providing a reservation service component, and enabling the job to query the reservation service component to reserve one or more of the plurality of resources within the networked computing grid.