Systems and methods for detecting data drift for data used in machine learning models
First Claim
1. A system for detecting data drift, the system comprising:
- one or more memory units for storing instructions; and
one or more processors configured to execute the instructions to perform operations comprising;
receiving model training data;
generating a predictive model;
receiving model input data;
generating predicted data using the predictive model, based on the model input data;
receiving event data,detecting data drift based on a comparison of a data profile of the predicted data to a data profile of the event data; and
correcting the model based on the determined drift.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for detecting data drift is disclosed. The system may be configured to perform a method, the method including receiving model training data and generating a predictive model. Generating the predictive model may include model training or hyperparameter tuning. The method may include receiving model input data and generating predicted data using the predictive model, based on the model input data. The method may include receiving event data and detecting data drift based on the predicted data and the event data. The method may include receiving current data and detecting data drift based on the data profile of the current data. The method may include model training and detecting data drift based on a difference in a trained model parameter from a baseline model parameter. The method may include hyperparameter tuning and detecting data drift based on a difference in a tuned hyperparameter from a baseline hyperparameter. The method may include correcting the model based on the detected data drift.
137 Citations
19 Claims
-
1. A system for detecting data drift, the system comprising:
-
one or more memory units for storing instructions; and one or more processors configured to execute the instructions to perform operations comprising; receiving model training data; generating a predictive model; receiving model input data; generating predicted data using the predictive model, based on the model input data; receiving event data, detecting data drift based on a comparison of a data profile of the predicted data to a data profile of the event data; and correcting the model based on the determined drift. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method for detecting data drift, the method comprising:
-
receiving model training data; generating a predictive model; receiving model input data; generating predicted data using the predictive model, based on the model input data; receiving event data, detecting data drift based on a comparison of a data profile of the predicted data to a data profile of the event data; and correcting the model based on the determined drift.
-
-
19. A system for updating a model, the system comprising one or more memory units for storing instructions;
- and
one or more processors configured to execute the instructions to perform operations comprising; receiving a modeling request associated with a user; providing a predictive model based on the modeling request; generating predicted data using the model, the predicted data being of a data category; receiving event data, the event data being of the same data category as the predicted data; detecting data drift based on at least one of; a comparison of a data profile of a predicted data to the data profile of the event data;
ora comparison of a predicted data covariance matrix to an event data covariance matrix; updating the predictive model based on the detected data drift; and transmitting a notification that the predictive model has been updated.
- and
Specification