System and method for training of state-classifiers
First Claim
1. A system, comprising:
- a set of sensors configured to provide a set of multimodal signals indicating physiological responses of an operator, of a vehicle or device, to stimuli in a first time period;
a processing circuit configured to train one or more state-classifiers to map the set of multimodal signals to a set of cognitive states; and
a display configured to depict operation of the vehicle or device by the operator in the first time period;
a data storage circuit coupled to the processing circuit and configured to store the one or more state-classifiers;
a second processing circuit coupled to the data storage and configured to determine a cognitive state of an operator using the one or more state-classifiers and the set of multimodal signals as input to the one or more state-classifiers;
a third processing circuit configured to perform an action specified in a settings file, stored in the data storage, in response to the determined cognitive state of the operator satisfying a set of criteria specified in the settings file;
wherein the action specified in the settings file includes at least one of a set of actions including adjusting operation of the vehicle or device, providing an alert to the operator, and sending an alert message; and
wherein the processing circuit is further configured to, in response to user input selecting one of the set of cognitive states and a portion of the first time period, perform the training of the one or more state-classifiers using the set of multimodal signals sampled in the portion of the time period as input to the one or more state-classifiers and the selected one of the set of cognitive states as a target result to be mapped to by the one or more state-classifiers.
1 Assignment
0 Petitions
Accused Products
Abstract
Method and systems are disclosed for training state-classifiers for classification of cognitive state. A set of multimodal signals indicating physiological responses of an operator are sampled over a time period. A depiction of operation by the operator during the time period is displayed. In response to user input selecting a cognitive state for a portion of the time period, the one or more state-classifiers are trained. In training the state-classifiers, the set of multimodal signals sampled in the portion of the time period are used as input to the one or more state-classifiers and the selected one of the set of cognitive states is used as a target result to be indicated by the one or more state-classifiers.
56 Citations
20 Claims
-
1. A system, comprising:
-
a set of sensors configured to provide a set of multimodal signals indicating physiological responses of an operator, of a vehicle or device, to stimuli in a first time period; a processing circuit configured to train one or more state-classifiers to map the set of multimodal signals to a set of cognitive states; and a display configured to depict operation of the vehicle or device by the operator in the first time period; a data storage circuit coupled to the processing circuit and configured to store the one or more state-classifiers; a second processing circuit coupled to the data storage and configured to determine a cognitive state of an operator using the one or more state-classifiers and the set of multimodal signals as input to the one or more state-classifiers; a third processing circuit configured to perform an action specified in a settings file, stored in the data storage, in response to the determined cognitive state of the operator satisfying a set of criteria specified in the settings file; wherein the action specified in the settings file includes at least one of a set of actions including adjusting operation of the vehicle or device, providing an alert to the operator, and sending an alert message; and wherein the processing circuit is further configured to, in response to user input selecting one of the set of cognitive states and a portion of the first time period, perform the training of the one or more state-classifiers using the set of multimodal signals sampled in the portion of the time period as input to the one or more state-classifiers and the selected one of the set of cognitive states as a target result to be mapped to by the one or more state-classifiers. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method, comprising:
-
sampling a set of multimodal signals indicating physiological responses of an operator of a vehicle or device over a time period; retrieving one or more state-classifiers from a data storage, wherein the one or more state-classifiers are configured to map the set of multimodal signals to a set of cognitive states; determining respective probabilities of the operator being in the set of cognitive states using the sampled set of multimodal signals as input to the one or more state-classifiers; and in response to the determined respective probabilities satisfying a set of criteria stored in a settings file performing one or more of a set of actions including adjusting operation of the vehicle or device, providing an alert to the operator, or sending an alert message. - View Dependent Claims (9, 10, 11, 12)
-
-
13. A method, comprising:
-
providing a simulation environment including visual, audible, or tactile stimuli, or a combination thereof, configured to induce a target cognitive state in an operator;
sampling a set of multimodal signals indicating physiological responses of the operator of a vehicle or device over a lime period;retrieving one or more state-classifiers from a data storage, wherein the one or more state-classifiers are configured to map the set of multimodal signals to a set of cognitive states, the set of cognitive states including the target state; determining respective probabilities of the operator being in the set of cognitive states using the sampled set of multimodal signals as input to the one or more state-classifiers; and in response to the determined probabilities satisfying a set of criteria specified in a settings file, performing one or more of a set of actions, the set of actions including adjusting the visual, audible, or tactile stimuli provided to the operator by the simulation environment and providing an alert to a trainer or supervisor. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification