Batch process monitoring and alerting based on selection of buffer times
First Claim
Patent Images
1. A method of monitoring batch processes, comprising:
- determining, by one or more processors, a baseline execution duration corresponding to a batch process comprising a computation executed on a first data set, wherein the baseline execution duration comprises a time duration based on an execution duration of the computation of the batch process executed on the first data set;
executing, by the one or more processors, the computation of the batch process on a second data set after executing the batch process on the first data set;
determining, by the one or more processors, a current execution duration corresponding to the computation of the batch process on the second data set;
predetermining, by the one or more processors, a plurality of potential buffer times, each of the plurality of potential buffer times associated with an execution time range;
selecting, by the one or more processors, from the predetermined plurality of potential buffer times a buffer time based on the baseline execution duration being within the execution time range associated with the selected buffer time; and
generating, by the one or more processors, an alert in response to the current execution duration being greater than a sum of the baseline execution duration plus the buffer time.
1 Assignment
0 Petitions
Accused Products
Abstract
A system monitors a batch process performed locally or remotely by reading output logs of the batch process during and after execution of the batch process. The system determines a baseline execution duration for the batch process based on previous runs of the batch process on a set of data. Subsequent runs of the batch process are monitored by reading an output log file while the batch process is executing. A buffer time, corresponding to a time range, is added to the baseline execution duration to produce an alert threshold. The system generates alerts and sends the alerts to a messaging system in response to the current execution duration exceeding the alert time.
6 Citations
16 Claims
-
1. A method of monitoring batch processes, comprising:
-
determining, by one or more processors, a baseline execution duration corresponding to a batch process comprising a computation executed on a first data set, wherein the baseline execution duration comprises a time duration based on an execution duration of the computation of the batch process executed on the first data set; executing, by the one or more processors, the computation of the batch process on a second data set after executing the batch process on the first data set; determining, by the one or more processors, a current execution duration corresponding to the computation of the batch process on the second data set; predetermining, by the one or more processors, a plurality of potential buffer times, each of the plurality of potential buffer times associated with an execution time range; selecting, by the one or more processors, from the predetermined plurality of potential buffer times a buffer time based on the baseline execution duration being within the execution time range associated with the selected buffer time; and generating, by the one or more processors, an alert in response to the current execution duration being greater than a sum of the baseline execution duration plus the buffer time. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for monitoring a batch process, the system comprising:
-
a batch executor configured to; execute a batch process on a first data set, wherein the batch process comprises a computation; in response to executing the batch process on the first data set, create a first computer-readable record comprising data related to an execution duration of the computation of the batch process; execute the computation of the batch process on a second data set after executing the batch process on the first data set; and create, during execution of the batch process on the second data set, a second computer-readable record comprising data related to an execution duration of the computation of the batch process executing on the second data set; and a monitoring device, coupled to the batch executor, configured to; determine a baseline execution duration based on the first computer-readable record, wherein the baseline execution duration comprises a time duration based on the execution duration of the computation of the batch process executed on the first data set; determine, during execution of the batch process on the second data set, a current execution duration based on the second computer-readable record; predetermine a plurality of potential buffer times, each of the plurality of potential buffer times associated with an execution time range; select from the predetermined plurality of potential buffer times a buffer time from a plurality of different buffer times based on the baseline execution duration being within the execution time range associated with the selected buffer time; and generate an alert in response to the current execution duration being greater than a sum of the baseline execution duration plus the buffer duration. - View Dependent Claims (9, 10, 11)
-
-
12. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the steps of:
-
determining, by one or more processors, a baseline execution duration corresponding to a batch process comprising a computation executed on a first data set, wherein the baseline execution duration comprises a time duration based on an execution duration of the computation of the batch process executed on the first data set; executing, by the one or more processors, the computation of the batch process on a second data set after executing the batch process on the first data set; determining, by the one or more processors, a current execution duration corresponding to the computation of the batch process on the second data set; predetermining, by the one or more processors, a plurality of potential buffer times, each of the plurality of potential buffer times associated with an execution time range; selecting, by the one or more processors, from the predetermined plurality of potential buffer times a buffer time based on the baseline execution duration being within the execution time range associated with the selected buffer time; and generating, by the one or more processors, an alert in response to the current execution duration being greater than a sum of the baseline execution duration plus the buffer time. - View Dependent Claims (13, 14, 15, 16)
-
Specification