System and method for supporting fault tolerant job management in a cloud platform environment

• US 9,497,145 B2
• Filed: 09/03/2014
• Issued: 11/15/2016
• Est. Priority Date: 09/20/2013
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Mares, Martin, Islam, Nazrul, Kasso, Chris
• Primary Examiner(s): PATEL, KAMINI B
• Application Number:
  US14/476,568
• Publication Number:
  US 20150089274A1
• Time in Patent Office: 804 Days
• Field of Search: 714/16
• US Class Current: 1/1
• CPC Class Codes: G06F 11/0709 in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/2007 using redundant communication media
• CPC Class Codes: G06F 11/2023 Failover techniques
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: H04L 41/50 Network service management, e.g. ensuring proper service fulfilment according to agreements
• CPC Class Codes: H04L 41/5041 characterised by the time relationship between creation and deployment of a service
• CPC Class Codes: H04L 41/5045 Making service definitions prior to deployment
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/55 Push-based network services

Abstract

In accordance with an embodiment, described herein is a system and method for supporting fault tolerant job management for use with a cloud computing environment. In accordance with an embodiment, the system comprises a job manager that manages the execution of jobs within the cloud environment including their job states, and a job manager service that provides an application program interface which receives administrative commands to be processed within the cloud environment as jobs. The job manager supports fault tolerant job processing including associating the jobs with checkpoints, recognizing a failover command for the jobs, and associating the jobs with work units of the administrative commands, and storing a state for each job upon processing each work unit of the command.

Claims

1. A system for supporting fault tolerant job management in a cloud computing environment, comprising:

a computer, including a cloud environment executing thereon;

one or more service management engines;

wherein each service management engine corresponds to a service type and supports provisioning of an enterprise application as a service instance of the service type on one or more clusters of the cloud environment by generating administrative commands;

a job manager that manages the execution of jobs within the cloud environment including their job states;

a job manager service that provides an application program interface which receives the administrative commands to be processed within the cloud environment as jobs;

wherein the job manager is configured to register and assign identifications to the jobs and is further configured to save or purge results of execution of the administrative commands in accordance with a retention policy; and

wherein the job manager supports fault tolerant job processing including

associating the jobs with checkpoints,

recognizing a failover command for the jobs, and

associating the jobs with work units of the administrative commands, and

storing a state for each job upon processing each work unit of the command.

2. The system of claim 1, wherein upon failover of one or more pending jobs, the job manager automatically attempts to execute all of those pending jobs with a stored checkpoint that had been abnormally terminated.

3. The system of claim 1, wherein each of the checkpoints indicate job attribute and status of the job at the time of creating the checkpoint, and are deleted if and when the job is completed.

4. The system of claim 1, wherein the failover command allows particular jobs to be reverted.

5. The system of claim 1, wherein each job unit executes and store checkpoints after each unit execution, and wherein if a failed job is reverted, job execution continues from the checkpoint associated with the last failed work unit.

6. A method for supporting fault tolerant job management in a cloud computing environment, comprising:

providing, at a computer, a cloud environment;

providing one or more service management engines,

wherein each service management engine corresponds to a service type and supports provisioning of an enterprise application as a service instance of the service type on one or more clusters of the cloud environment by generating administrative commands;

providing a job manager that manages the execution of jobs within the cloud environment including their job states;

providing a job manager service that provides an application program interface which receives the administrative commands to be processed within the cloud environment as jobs;

wherein the job manager is configured to register and assign identifications to the jobs and is further configured to save or purge results of execution of the administrative commands in accordance with a retention policy; and

wherein the job manager supports fault tolerant job processing including

associating the jobs with checkpoints,

recognizing a failover command for the jobs, and

associating the jobs with work units of the administrative commands, and storing a state for each job upon processing each work unit of the command.

7. The method of claim 6, wherein upon failover of one or more pending jobs, the job manager automatically attempts to execute all of those pending jobs with a stored checkpoint that had been abnormally terminated.

8. The method of claim 6, wherein each of the checkpoints indicate job attribute and status of the job at the time of creating the checkpoint, and are deleted if and when the job is completed.

9. The method of claim 6, wherein the failover command allows particular jobs to be reverted.

10. The method of claim 6, wherein each job unit executes and store checkpoints after each unit execution, and wherein if a failed job is reverted, job execution continues from the checkpoint associated with the last failed work unit.

11. A non-transitory computer readable storage medium, including instructions stored thereon which when read and executed by one or more computers cause the one or more computers to perform the steps comprising:

providing, at a computer, a cloud environment;

providing one or more service management engines,

wherein each service management engine corresponds to a service type and supports provisioning of an enterprise application as a service instance of the service type on one or more clusters of the cloud environment by generating administrative commands;

providing a job manager that manages the execution of jobs within the cloud environment including their job states;

providing a job manager service that provides an application program interface which receives the administrative commands to be processed within the cloud environment as jobs;

wherein the job manager is configured to register and assign identifications to the jobs and is further configured to save or purge results of execution of the administrative commands in accordance with a retention policy; and

wherein the job manager supports fault tolerant job processing including

associating the jobs with checkpoints,

recognizing a failover command for the jobs, and

associating the jobs with work units of the administrative commands, and storing a state for each job upon processing each work unit of the command.

12. The non-transitory computer readable storage medium of claim 11, wherein upon failover of one or more pending jobs, the job manager automatically attempts to execute all of those pending jobs with a stored checkpoint that had been abnormally terminated.

13. The non-transitory computer readable storage medium of claim 11, wherein each of the checkpoints indicate job attribute and status of the job at the time of creating the checkpoint, and are deleted if and when the job is completed.

14. The non-transitory computer readable storage medium of claim 11, wherein the failover command allows particular jobs to be reverted.

15. The non-transitory computer readable storage medium of claim 11, wherein each job unit executes and store checkpoints after each unit execution, and wherein if a failed job is reverted, job execution continues from the checkpoint associated with the last failed work unit.