Distributed neuromorphic processing performance accountability
First Claim
1. An apparatus comprising a processor and a storage to store instructions that, when executed by the processor, cause the processor to perform operations comprising:
- receive, at a portal, and from a remote device via a network, a request to repeat an earlier performance, described in a first instance log of multiple instance logs stored in one or more federated areas, of a first job flow defined in a first job flow definition of multiple job flow definitions stored in the one or more federated areas, or to provide objects to the remote device to enable the remote device to repeat the earlier performance, wherein;
the portal is provided on the network to control access by the remote device to the one or more federated areas via the network;
the one or more federated areas are maintained within one or more storage devices to store at least the multiple job flow definitions and the multiple instance logs; and
the request specifies a first instance log identifier of the first instance log;
use the first instance log identifier to retrieve the first instance log from among the multiple instance logs stored in the one or more federated areas, wherein the first instance log comprises a first job flow identifier of the first job flow definition, a task routine identifier for each task routine used to perform a task specified in the first job flow definition, and a data object identifier for each data object associated with the earlier performance of the first job flow;
analyze the first job flow definition to determine whether performances of the first job flow comprise use of a neural network;
in response to a determination that performances of the first job flow do comprise use of the neural network, analyze an object associated with the first job flow to determine whether the neural network was trained to perform an analytical function using a training data set derived from at least one performance of a second job flow defined by a second job flow definition stored in the one or more federated areas, wherein;
the object associated with the first job flow comprises at least one of the first job flow definition, the first instance log, or a task routine executed during the earlier performance of the first job flow; and
performances of the second job flow comprise performances of the analytical function in a manner that does not use any neural network; and
in response to the request comprising a request to repeat the earlier performance, in response to a determination that performances of the first job flow do comprise use of the neural network, and in response to a determination that the neural network was trained using the training data set derived from at least one performance of the second job flow, the processor is caused to perform operations comprising;
repeat the earlier performance of the first job flow with one or more data sets associated with the earlier performance of the first job flow, wherein the repetition of the earlier performance of the first job flow comprises execution, by the processor, of each task routine identified by a task routine identifier in the first instance log;
perform the second job flow with the one or more data sets associated with the earlier performance of the first job flow, wherein the performance of the second job flow comprises execution, by the processor, of a most recent version of a task routine to perform each task identified by a flow task identifier in the second job flow definition;
analyze an output of the repetition of the earlier performance of the first job flow relative to a corresponding output of the performance of the second job flow to determine a degree of accuracy of the first job flow in performing the analytical function relative to a predetermined threshold of accuracy to determine whether the second job flow is to be used in place of the first job flow to perform the analytical function; and
transmit at least the output of the repetition of the earlier performance of the first job flow and an indication of the degree of accuracy or the results of the comparison to the requesting device.
1 Assignment
0 Petitions
Accused Products
Abstract
An apparatus includes a processor to: receive a request to repeat an earlier performance of a first job flow described in a job flow definition; analyze the job flow definition to determine whether the first job flow uses a neural network; in response to a determination that the first job flow uses a neural network, analyze an object associated with the first job flow to determine whether the neural network was trained using training data from a second job flow that does not use a neural network; and in response to a determination that such training data was so used, repeat the earlier performance of the first job flow, perform the second job flow with the same input data values as used in the repeated performance of the first job flow, and analyze corresponding output data values of both performances to determine a degree of accuracy of the neural network.
-
Citations
30 Claims
-
1. An apparatus comprising a processor and a storage to store instructions that, when executed by the processor, cause the processor to perform operations comprising:
-
receive, at a portal, and from a remote device via a network, a request to repeat an earlier performance, described in a first instance log of multiple instance logs stored in one or more federated areas, of a first job flow defined in a first job flow definition of multiple job flow definitions stored in the one or more federated areas, or to provide objects to the remote device to enable the remote device to repeat the earlier performance, wherein; the portal is provided on the network to control access by the remote device to the one or more federated areas via the network; the one or more federated areas are maintained within one or more storage devices to store at least the multiple job flow definitions and the multiple instance logs; and the request specifies a first instance log identifier of the first instance log; use the first instance log identifier to retrieve the first instance log from among the multiple instance logs stored in the one or more federated areas, wherein the first instance log comprises a first job flow identifier of the first job flow definition, a task routine identifier for each task routine used to perform a task specified in the first job flow definition, and a data object identifier for each data object associated with the earlier performance of the first job flow; analyze the first job flow definition to determine whether performances of the first job flow comprise use of a neural network; in response to a determination that performances of the first job flow do comprise use of the neural network, analyze an object associated with the first job flow to determine whether the neural network was trained to perform an analytical function using a training data set derived from at least one performance of a second job flow defined by a second job flow definition stored in the one or more federated areas, wherein; the object associated with the first job flow comprises at least one of the first job flow definition, the first instance log, or a task routine executed during the earlier performance of the first job flow; and performances of the second job flow comprise performances of the analytical function in a manner that does not use any neural network; and in response to the request comprising a request to repeat the earlier performance, in response to a determination that performances of the first job flow do comprise use of the neural network, and in response to a determination that the neural network was trained using the training data set derived from at least one performance of the second job flow, the processor is caused to perform operations comprising; repeat the earlier performance of the first job flow with one or more data sets associated with the earlier performance of the first job flow, wherein the repetition of the earlier performance of the first job flow comprises execution, by the processor, of each task routine identified by a task routine identifier in the first instance log; perform the second job flow with the one or more data sets associated with the earlier performance of the first job flow, wherein the performance of the second job flow comprises execution, by the processor, of a most recent version of a task routine to perform each task identified by a flow task identifier in the second job flow definition; analyze an output of the repetition of the earlier performance of the first job flow relative to a corresponding output of the performance of the second job flow to determine a degree of accuracy of the first job flow in performing the analytical function relative to a predetermined threshold of accuracy to determine whether the second job flow is to be used in place of the first job flow to perform the analytical function; and transmit at least the output of the repetition of the earlier performance of the first job flow and an indication of the degree of accuracy or the results of the comparison to the requesting device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, the computer-program product including instructions operable to cause a processor to perform operations comprising:
-
receive, at a portal, and from a remote device via a network, a request to repeat an earlier performance, described in a first instance log of multiple instance logs stored in one or more federated areas, of a first job flow defined in a first job flow definition of multiple job flow definitions stored in the one or more federated areas, or to provide objects to the remote device to enable the remote device to repeat the earlier performance, wherein; the portal is provided on the network to control access by the remote device to the one or more federated areas via the network; the one or more federated areas are maintained within one or more storage devices to store at least the multiple job flow definitions and the multiple instance logs; and the request specifies a first instance log identifier of the first instance log; use the first instance log identifier to retrieve the first instance log from among the multiple instance logs stored in the one or more federated areas, wherein the first instance log comprises a first job flow identifier of the first job flow definition, a task routine identifier for each task routine used to perform a task specified in the first job flow definition, and a data object identifier for each data object associated with the earlier performance of the first job flow; analyze the first job flow definition to determine whether performances of the first job flow comprise use of a neural network; in response to a determination that performances of the first job flow do comprise use of the neural network, analyze an object associated with the first job flow to determine whether the neural network was trained to perform an analytical function using a training data set derived from at least one performance of a second job flow defined by a second job flow definition stored in the one or more federated areas, wherein; the object associated with the first job flow comprises at least one of the first job flow definition, the first instance log, or a task routine executed during the earlier performance of the first job flow; and performances of the second job flow comprise performances of the analytical function in a manner that does not use any neural network; and in response to the request comprising a request to repeat the earlier performance, in response to a determination that performances of the first job flow do comprise use of the neural network, and in response to a determination that the neural network was trained using the training data set derived from at least one performance of the second job flow, the processor is caused to perform operations comprising; repeat the earlier performance of the first job flow with one or more data sets associated with the earlier performance of the first job flow, wherein the repetition of the earlier performance of the first job flow comprises execution, by the processor, of each task routine identified by a task routine identifier in the first instance log; perform the second job flow with the one or more data sets associated with the earlier performance of the first job flow, wherein the performance of the second job flow comprises execution, by the processor, of a most recent version of a task routine to perform each task identified by a flow task identifier in the second job flow definition; analyze an output of the repetition of the earlier performance of the first job flow relative to a corresponding output of the performance of the second job flow to determine a degree of accuracy of the first job flow in performing the analytical function relative to a predetermined threshold of accuracy to determine whether the second job flow is to be used in place of the first job flow to perform the analytical function; and transmit at least the output of the repetition of the earlier performance of the first job flow and an indication of the degree of accuracy or the results of the comparison to the requesting device. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A computer-implemented method comprising:
-
receiving, by a processor at a portal, and from a remote device via a network, a request to repeat an earlier performance, described in a first instance log of multiple instance logs stored in one or more federated areas, of a first job flow defined in a first job flow definition of multiple job flow definitions stored in the one or more federated areas, or to provide objects to the remote device to enable the remote device to repeat the earlier performance, wherein; the portal is provided on the network to control access by the remote device to the one or more federated areas via the network; the one or more federated areas are maintained within one or more storage devices to store at least the multiple job flow definitions and the multiple instance logs; and the request specifies a first instance log identifier of the first instance log; using the first instance log identifier to retrieve the first instance log from among the multiple instance logs stored in the one or more federated areas, wherein the first instance log comprises a first job flow identifier of the first job flow definition, a task routine identifier for each task routine used to perform a task specified in the first job flow definition, and a data object identifier for each data object associated with the earlier performance of the first job flow; analyzing, by the processor, the first job flow definition to determine whether performances of the first job flow comprise use of a neural network; in response to a determination that performances of the first job flow do comprise use of the neural network, analyzing, by the processor, an object associated with the first job flow to determine whether the neural network was trained to perform an analytical function using a training data set derived from at least one performance of a second job flow defined by a second job flow definition stored in the one or more federated areas, wherein; the object associated with the first job flow comprises at least one of the first job flow definition, the first instance log, or a task routine executed during the earlier performance of the first job flow; and performances of the second job flow comprise performances of the analytical function in a manner that does not use any neural network;
orin response to the request comprising a request to repeat the earlier performance, in response to a determination that performances of the first job flow do comprise use of the neural network, and in response to a determination that the neural network was trained using the training data set derived from at least one performance of the second job flow, performing operations comprising; repeating, by the processor, the earlier performance of the first job flow with one or more data sets associated with the earlier performance of the first job flow, wherein the repetition of the earlier performance of the first job flow comprises execution, by the processor, of each task routine identified by a task routine identifier in the first instance log; performing, by the processor, the second job flow with the one or more data sets associated with the earlier performance of the first job flow, wherein the performance of the second job flow comprises execution, by the processor, of a most recent version of a task routine to perform each task identified by a flow task identifier in the second job flow definition; analyzing, by the processor, an output of the repetition of the earlier performance of the first job flow relative to a corresponding output of the performance of the second job flow to determine a degree of accuracy of the first job flow in performing the analytical function relative to a predetermined threshold of accuracy to determine whether the second job flow is to be used in place of the first job flow to perform the analytical function; and transmitting, from the processor, at least the output of the repetition of the earlier performance of the first job flow and an indication of the degree of accuracy or the results of the comparison to the requesting device. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30)
-
Specification