SYSTEMS AND METHODS TO DETERMINE USER STATE

• US 20160007899A1
• Filed: 03/13/2014
• Published: 01/14/2016
• Est. Priority Date: 03/13/2013
• Status: Active Grant

• Current Assignee: Aptima Inc.
• Original Assignee: Aptima Inc.
• Inventors: Geyer, Alexandra, Durkee, Kevin, Pappada, Scott, Ortiz, Andres, DePriest, William, Feeney, John, Sullivan, Seamus, Wiggins, Sterling
• Granted Patent: US 10,265,008 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/316 Modalities, i.e. specific diagnostic methods
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/7203 for noise prevention, reduction or removal
• CPC Class Codes: A61B 5/7246 using correlation, e.g. template matching or determination of similarity
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: G09B 23/28 for medicine
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment

Abstract

Computer based systems and methods for estimating a user state are disclosed. In some embodiments, the methods comprise inputting a first input at an intermittent interval and a second input at a frequent interval into a user state estimation model to estimate the user state. In some embodiments, the first inputs are enhanced by injecting a noise input to create a plurality of enhanced first inputs whereby the plurality of enhance first inputs correspond to the plurality of second inputs at the frequent interval. In some embodiments, the first input comprises a self-reported input and the second inputs comprise a physiological input, a performance input or a situational input. In some embodiments, a machine learning algorithm creates the state estimation model. In some embodiments, the state estimation model estimates a future user state. In some embodiments, a computer based system for estimating a user state is provided.

Claims

1. A computer based method to estimate a state, the method comprising:

receiving a plurality of first inputs at an intermittent interval;

receiving a plurality of second inputs at a frequent interval;

injecting a noise input into the plurality of first inputs at the frequent interval to create a plurality of enhanced first inputs whereby the plurality of enhance first inputs correspond to the plurality of second inputs at the frequent interval;

inputting the enhanced first inputs and the plurality of second inputs into a state estimation model whereby a state can be estimated based on the plurality of second inputs; and

estimating the state based on the plurality of second inputs.

2. The computer based method of claim 1 wherein the noise input comprises physiological correlate for a user state.

3. The computer based method of claim 2 wherein the physiological correlate for a user state comprises a ratio of electroencephalogram (EEG) measures comprising a Frontal Midline Theta data over a Parietal Midline Alpha for the user state of a user workload.

4. The computer based method of claim 1 wherein the state estimation model comprises a relational database containing a weighted relationship of the plurality of second inputs to the plurality of first inputs.

5. The computer based method of claim 4 wherein the plurality of second inputs comprise a plurality of physiological inputs of a user and the plurality of second inputs comprise a plurality of state inputs of the user.

6. The computer based method of claim 1 further comprising inputting the enhanced first inputs and the plurality of second inputs into a machine learning model to create the state estimation model.

7. The computer based method of claim 6 wherein the machine learning model comprises an artificial neural network.

8. The computer based method of claim 7 wherein the artificial neural network is configured to find a mathematical relationship between a physiological feature and a state measurement.

9. The computer based method of claim 1 wherein the plurality of first inputs comprises a self-reported data of the state of a user.

10. The computer based method of claim 1 wherein the plurality of first inputs comprises at least one self-reported user state rating.

11. The computer based method of claim 1 wherein the state estimate is made in a scale of 0-100.

12. The computer based method of claim 1 wherein the plurality of second inputs comprises at least one selected from a group comprising:

a physiological measure;

a performance measure; and

a situational measure.

13. The computer based method of claim 1 wherein the frequent interval is about a continuous interval.

14. The computer based method of claim 1 further comprising receiving a baseline input as one of the plurality of first inputs.

15. The computer based method of claim 1 further comprising:

receiving a plurality of enhanced actual first inputs and a plurality of actual second inputs;

retraining the state estimation model with the plurality of enhance actual first inputs and the plurality of actual second inputs to create a retrained state estimation model; and

estimating the state based on the plurality of execution inputs.

16. The computer based method of claim 14 wherein the retraining comprises inputting a plurality of enhanced actual first inputs and a plurality of actual second inputs into a machine learning model to create the retrained state estimation model.

18. The computer based method of claim 16 further comprising:

injecting a noise input into the plurality of first inputs at the frequent interval to create a plurality of enhanced first inputs whereby the plurality of enhance first inputs correspond to the plurality of second inputs at the frequent interval; and

inputting the enhanced first inputs and the plurality of second inputs into the state estimation model whereby the state can be estimated based on the plurality of second inputs.

19. The method of claim 16 further comprising modifying a user interface based on the future state of the user.

20. The method of claim 18 wherein the step of modifying the user interface based on the future state of the user comprises:

eliminating an unnecessary information set from a user display; and

displaying a necessary information set based on the future state of the user.

17. A computer based method to estimate a state of a user, the method comprising:

receiving a plurality of first inputs at an intermittent interval;

receiving a plurality of second inputs at a frequent interval;

inputting the plurality of first inputs and the plurality of second inputs into a state estimation model whereby a state can be estimated based on the plurality of second inputs; and

estimating a future state of a user at a future time utilizing the state estimation model.

21. A computer based system for estimating a user state, the computer based system comprising:

a processor;

a non-transitory computer readable medium having a computer readable program code embodied therein, said computer readable program code configured to be executed to implement a method comprising;

receiving a plurality of first inputs at an intermittent interval;

receiving a plurality of second inputs at a frequent interval;

injecting a noise input into the plurality of first inputs at the frequent interval to create a plurality of enhanced first inputs whereby the plurality of enhance first inputs correspond to the plurality of second inputs at the frequent interval;

inputting the enhanced first inputs and the plurality of second inputs into a state estimation model whereby a state can be estimated based on the plurality of second inputs; and

estimating the state based on the plurality of second inputs.