Remotely managing execution of jobs in a cluster computing framework
First Claim
1. A device, comprising:
- one or more memories; and
one or more processors, communicatively coupled to the one or more memories, to;
receive a request to execute a plurality of jobs;
determine criteria for each of the plurality of jobs,the criteria for each of the plurality of jobs including;
job execution criteria,job posting criteria,job validation criteria, andjob retry criteria;
store first information associated with the plurality of jobs in a repository,the first information associated with the plurality of jobs including the criteria for each of the plurality of jobs;
provide a particular job, of the plurality of jobs, to a first cluster computing framework for execution,the device being remote from the first cluster computing framework;
receive, after providing the particular job, a request for one or more additional jobs to be executed in parallel with the particular job;
determine, based on receiving the request for the one or more additional jobs to be executed in parallel with the particular job, modified criteria for the particular job,the modified criteria for the particular job indicating that the particular job is to be executed in parallel with the one or more additional jobs;
provide the modified criteria for the particular job and a request to retry execution of the particular job to the first cluster computing framework,the modified criteria for the particular job including;
a modified job execution criteria,a modified job posting criteria,a modified job validation criteria, anda modified job retry criteria;
receive, from the first cluster computing framework, second information indicating whether execution of the particular job is complete; and
perform, when the second information indicates that the execution of the particular job failed, a disaster recovery technique,the disaster recovery technique including at least one of;
a provision of a first instruction to the first cluster computing framework to re-route the particular job to another functional cluster of the first cluster computing framework, ora provision of a second instruction to a second cluster computing framework to execute the particular job.
1 Assignment
0 Petitions
Accused Products
Abstract
A device, that provides serverless computing, receives a request to execute multiple jobs, and determines criteria for each of the plurality of jobs, wherein the criteria for each of the multiple jobs includes at least one of job posting criteria, job validation criteria, job retry criteria, or a disaster recovery criteria. The device stores information associated with the multiple jobs in a repository, wherein the information associated with the multiple jobs includes the criteria for each of the multiple jobs. The device provides a particular job, of the multiple jobs, to a cluster computing framework for execution, determines modified criteria for the particular job, and provides the modified criteria for the particular job to the cluster computing framework. The device receives, from the cluster computing framework, information indicating that execution of the particular job is complete, and validates a success of completion of the execution of the particular job.
-
Citations
20 Claims
-
1. A device, comprising:
-
one or more memories; and one or more processors, communicatively coupled to the one or more memories, to; receive a request to execute a plurality of jobs; determine criteria for each of the plurality of jobs, the criteria for each of the plurality of jobs including; job execution criteria, job posting criteria, job validation criteria, and job retry criteria; store first information associated with the plurality of jobs in a repository, the first information associated with the plurality of jobs including the criteria for each of the plurality of jobs; provide a particular job, of the plurality of jobs, to a first cluster computing framework for execution, the device being remote from the first cluster computing framework; receive, after providing the particular job, a request for one or more additional jobs to be executed in parallel with the particular job; determine, based on receiving the request for the one or more additional jobs to be executed in parallel with the particular job, modified criteria for the particular job, the modified criteria for the particular job indicating that the particular job is to be executed in parallel with the one or more additional jobs; provide the modified criteria for the particular job and a request to retry execution of the particular job to the first cluster computing framework, the modified criteria for the particular job including; a modified job execution criteria, a modified job posting criteria, a modified job validation criteria, and a modified job retry criteria; receive, from the first cluster computing framework, second information indicating whether execution of the particular job is complete; and perform, when the second information indicates that the execution of the particular job failed, a disaster recovery technique, the disaster recovery technique including at least one of; a provision of a first instruction to the first cluster computing framework to re-route the particular job to another functional cluster of the first cluster computing framework, or a provision of a second instruction to a second cluster computing framework to execute the particular job. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method, comprising:
-
receiving, by a device and from a client device, a request to execute a plurality of jobs; determining, by the device, criteria for each of the plurality of jobs, the criteria for each of the plurality of jobs including; job execution criteria, job posting criteria, job validation criteria, and job retry criteria; storing, by the device, first information associated with the plurality of jobs in a repository, the first information associated with the plurality of jobs including the criteria for each of the plurality of jobs; posting, by the device, a particular job, of the plurality of jobs, to a first cluster computing framework for execution; receiving, by the device and after posting the particular job, a request for one or more additional jobs to be executed in parallel with the particular job; determining, by the device and based on receiving the request for the one or more additional jobs to be executed in parallel with the particular job, modified criteria for the particular job, the modified criteria for the particular job indicating that the particular job is to be executed in parallel with the one or more additional jobs, and the modified criteria for the particular job including; a modified job execution criteria, a modified job posting criteria, a modified job validation criteria, and a modified job retry criteria; providing, by the device, the modified criteria for the particular job and a request to retry execution of the particular job to the first cluster computing framework; receiving, by the device and from the first cluster computing framework, second information indicating whether execution of the particular job failed; and performing, by the device, a disaster recovery technique for the particular job when the second information indicates that the execution of the particular job failed, performing the disaster recovery technique including at least one of; instructing the first cluster computing framework to re-route the particular job to another functional cluster of the first cluster computing framework, or instructing a second cluster computing framework to execute the particular job. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer-readable medium storing instructions, the instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to; receive a request to execute a plurality of jobs; determine criteria for each of the plurality of jobs, the criteria for each of the plurality of jobs including; job execution criteria, job posting criteria, job validation criteria, and job retry criteria; store first information associated with the plurality of jobs in a repository, the first information associated with the plurality of jobs including; information associated with a first cluster computing framework, information indicating names of the plurality of jobs, and the criteria for each of the plurality of jobs; provide a particular job, of the plurality of jobs, to the first cluster computing framework for execution; receive, after providing the particular job, a request for one or more additional jobs to be executed in parallel with the particular job; determine, based on receiving the request for the one or more additional jobs to be executed in parallel with the particular job, modified criteria for the particular job, the modified criteria for the particular job indicating that the particular job is to be executed in parallel with the one or more additional jobs, and the modified criteria for the particular job including; a modified job execution criteria, a modified job posting criteria, a modified job validation criteria, and a modified job retry criteria; provide the modified criteria for the particular job and a request to retry execution of the particular job to the first cluster computing framework; receive, from the first cluster computing framework, second information indicating whether execution of the particular job is complete or failed; and perform one or more actions when the second information indicates that the execution of the particular job failed, the one or more actions including; a provision of a first instruction to the first cluster computing framework to re-route the particular job to another functional cluster of the first cluster computing framework, or a provision of a second instruction to a second cluster computing framework to execute the particular job. - View Dependent Claims (16, 17, 18, 19, 20)
Specification