Method to use a receiver operator characteristics curve for model comparison in machine condition monitoring
First Claim
1. A computer implemented method of evaluating a monitoring model of a power plant system or a magnetic resonance imaging system, comprising:
- obtaining a first set of test data from the system through at least one monitoring sensor, the first set of test data including a first plurality of negative data points;
designating at least one of the first plurality of negative data points as a first positive data point; and
performing a first receiver operating characteristics (ROC) analysis on the first set of test data to obtain a first receiver operating characteristics analysis curve to be used as at least a portion of the monitoring model for the first set of test data;
selecting an evaluation criteria for the model wherein the evaluation criteria is based on the first ROC;
evaluating the monitoring model of the power plant system or magnetic resonance imaging system based upon the selected evaluation criteria from the first receiver operating characteristic analysis curve; and
monitoring operating condition of the power plant system or magnetic resonance imaging system using the evaluated monitoring model.
4 Assignments
0 Petitions
Accused Products
Abstract
A method to use a receiver operator characteristics curve for model comparison in machine condition monitoring. The method and systems of using this method may be used to evaluate different monitoring models. These models may be used to monitor a variety of different systems such as power plant systems or magnetic resonance imaging systems. The methods use training data and designate one or more points in the data as a false negative, thereby permitting a receiver operator characteristics analysis to be performed. Multiple receiver operator characteristics analyses may be performed either on different models or on different points within a single model, thereby permitting the receiver operator characteristics analyses to be used to select a beneficial model for monitoring a particular system.
39 Citations
15 Claims
-
1. A computer implemented method of evaluating a monitoring model of a power plant system or a magnetic resonance imaging system, comprising:
-
obtaining a first set of test data from the system through at least one monitoring sensor, the first set of test data including a first plurality of negative data points; designating at least one of the first plurality of negative data points as a first positive data point; and performing a first receiver operating characteristics (ROC) analysis on the first set of test data to obtain a first receiver operating characteristics analysis curve to be used as at least a portion of the monitoring model for the first set of test data; selecting an evaluation criteria for the model wherein the evaluation criteria is based on the first ROC; evaluating the monitoring model of the power plant system or magnetic resonance imaging system based upon the selected evaluation criteria from the first receiver operating characteristic analysis curve; and monitoring operating condition of the power plant system or magnetic resonance imaging system using the evaluated monitoring model. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A machine-readable storage medium having stored thereon, computer-executable instructions which when executed by a computer perform a method to evaluate a monitoring model of a power plant system or a magnetic resonance imaging system, the method comprising:
-
obtaining a first set of test data from the system through at least one monitoring sensor, the first set of test data including a first plurality of negative data points; designating at least one of the first plurality of negative data points as a first positive data point; and performing a first receiver operating characteristics (ROC) analysis on the first set of test data to obtain a first receiver operating characteristics analysis curve to be used as at least a portion of the monitoring model for the first set of test data; selecting an evaluation criteria for the model based on the first ROC; evaluating the monitoring model of the power plant system or magnetic resonance imaging system based upon selected evaluation criteria from the first receiver operating characteristic analysis curve; and monitoring operating condition of the power plant system or magnetic resonance imaging system using the evaluated monitoring model. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A computing system for evaluating a monitoring model of a power plant system or a magnetic resonance imaging system, comprising:
-
means for obtaining a first set of test data from the system through at least one monitoring sensor, the first set of test data including a first plurality of negative data points; a first determinator for designating at least one of the first plurality of negative data points as a first positive data point; and means for performing a first receiver operating characteristics (ROC) analysis on the set of test data to obtain a first receiver operating characteristics analysis curve to be used as at least a portion of the monitoring model for the first set of test data; means for selecting an evaluation criteria for the model based on the first ROC; means for evaluating the monitoring model of the power plant system or magnetic resonance imaging system based upon selected evaluation criteria from the first receiver operating analysis characteristic curve; and means for monitoring operating condition of the power plant system or magnetic resonance imaging system using the evaluated monitoring model. - View Dependent Claims (12, 13, 14, 15)
-
Specification