WEIGHT BENEFIT EVALUATOR FOR TRAINING DATA
First Claim
1. A method to determine whether to apply a set of weights to training data in a machine learning environment, the method comprising:
- applying, by a device, test inputs to a first function to generate test data, wherein the first function is based on the training data, the training data includes training inputs and training labels, and the test data includes the test inputs and test labels;
applying, by the device, the test inputs to a second function to generate weighted test data, wherein the second function is based on weighted training data, the weighted training data is based on the set of weights, and the weighted test data includes the test inputs and weighted test labels;
determining, by the device, a third function based on target data, wherein the target data is based on a target function, the target data includes the training inputs, and the target data includes target labels different from the training labels;
applying, by the device, the test inputs to the third function to generate artificial test data, wherein the artificial test data includes the test inputs and artificial test labels;
determining, by the device, a fourth function based on the set of weights and the target data;
applying, by the device, the test inputs to the fourth function to generate artificial weighted test data, wherein the artificial weighted test data includes the test inputs and artificial weighted test labels;
determining, by the device, an evaluation value based on the test data, the weighted test data, the artificial test data, and the artificial weighted test data;
determining, by the device, the weight benefit based on the evaluation value, wherein the weight benefit is associated with a benefit to apply the set of weights to the training data; and
determining, by the device, whether to apply the set of weights to the training data based on the weight benefit.
0 Assignments
0 Petitions
Accused Products
Abstract
Technologies are generally described for methods and systems effective to determine a weight benefit associated with application of weights to training data in a machine learning environment. In an example, a device may determine a first function based on the training data, where the training data includes training inputs and training labels. The device may determine a second function based on weighted training data, which is based on application of weights to the training data. The device may determine a third function based on target data, where the target data is generated based on a target function. The target data may include target labels different from the training labels. The device may determine a fourth function based on weighted target data, which is a result of application of weights to the target data. The device may determine the weight benefit based on the first, second, third, and fourth functions.
-
Citations
20 Claims
-
1. A method to determine whether to apply a set of weights to training data in a machine learning environment, the method comprising:
-
applying, by a device, test inputs to a first function to generate test data, wherein the first function is based on the training data, the training data includes training inputs and training labels, and the test data includes the test inputs and test labels; applying, by the device, the test inputs to a second function to generate weighted test data, wherein the second function is based on weighted training data, the weighted training data is based on the set of weights, and the weighted test data includes the test inputs and weighted test labels; determining, by the device, a third function based on target data, wherein the target data is based on a target function, the target data includes the training inputs, and the target data includes target labels different from the training labels; applying, by the device, the test inputs to the third function to generate artificial test data, wherein the artificial test data includes the test inputs and artificial test labels; determining, by the device, a fourth function based on the set of weights and the target data; applying, by the device, the test inputs to the fourth function to generate artificial weighted test data, wherein the artificial weighted test data includes the test inputs and artificial weighted test labels; determining, by the device, an evaluation value based on the test data, the weighted test data, the artificial test data, and the artificial weighted test data; determining, by the device, the weight benefit based on the evaluation value, wherein the weight benefit is associated with a benefit to apply the set of weights to the training data; and determining, by the device, whether to apply the set of weights to the training data based on the weight benefit. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system effective to whether to apply a set of weights to training data in a machine learning environment, the system comprising:
-
a memory configured to; store the training data, wherein the training data includes training inputs and training labels; store the set of weights; and store a set of test inputs; a machine learning module configured to be in communication with the memory, the machine learning module being configured to; apply the test inputs to a first function to generate test data, wherein the first function is based on the training data, the training data includes training inputs and training labels, and the test data includes the test inputs and test labels; apply the test inputs to a second function to generate weighted test data, wherein the second function is based on weighted training data, the weighted training data is based on the set of weights, and the weighted test data includes the test inputs and weighted test labels; determine a third function based on the target data based on target data, wherein the target data is based on a target function, the target data includes the training inputs, and the target data includes target labels different from the training labels; apply the test inputs to the third function to generate artificial test data, wherein the artificial test data includes the test inputs and artificial test labels; determine a fourth function based on the set of weights and the target data; apply the test inputs to the fourth function to generate artificial weighted test data, wherein the artificial weighted test data includes the test inputs and artificial weighted test labels; an evaluation module configured to be in communication with the machine learning module and the memory, the evaluation module being configured to; determine an evaluation value based on the test data, the weighted test data, the artificial test data, and the artificial weighted test data; and determine the weight benefit based on the evaluation value, wherein the weight benefit is associated with a benefit to apply the set of weights to the training data; and a processing module configured to be in communication with the evaluation module, the machine learning module, and the memory, the processing module being configured to determine whether to apply the set of weights to the training data based on the weight benefit. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A method to determine whether to deploy a first function or a second function in a machine learning environment, the method comprising:
-
applying, by a device, test inputs to a first function to generate test data, wherein the first function is based on the training data, the training data includes training inputs and training labels, and the test data includes the test inputs and test labels; applying, by the device, the test inputs to a second function to generate weighted test data, wherein the second function is based on weighted training data, the weighted training data is based on the set of weights, and the weighted test data includes the test inputs and weighted test labels; determining, by the device, a third function based on target data, wherein the target data is based on a target function, the target data includes the training inputs, and the target data includes target labels different from the training labels; applying, by the device, the test inputs to the third function to generate artificial test data, wherein the artificial test data includes the test inputs and artificial test labels; determining, by the device, a fourth function based on the set of weights and the target data; applying, by the device, the test inputs to the fourth function to generate artificial weighted test data, wherein the artificial weighted test data includes the test inputs and artificial weighted test labels; determining, by the device, an evaluation value based on the third and fourth functions; comparing, by the device, the evaluation value with an expected value between the first function and the second function; determining, by the device, a count based on the comparison of the evaluation value with the expected value; comparing, by the evaluation module of the device, the count with a threshold; and determining, by the device, whether to deploy the first function or the second function in the machine learning environment based on the comparison of the count with the threshold. - View Dependent Claims (17, 18, 19, 20)
-
Specification