Rapid serial visual presentation triage prioritization based on user state assessment

• US 20070236488A1
• Filed: 01/21/2006
• Published: 10/11/2007
• Est. Priority Date: 01/21/2006
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Mathan, Santosh, Whitlow, Stephen, Dorneich, Michael, Ververs, Patricia
• Granted Patent: US 8,374,687 B2
• Time in Patent Office: Days
• US Class Current: 345/418
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

A method and system are provided that prioritize the output of an image triage that is based on rapid serial visual presentation. User responses and estimates of the effectiveness with which each image is likely to have been processed by a user are employed for post triage image prioritization of potential targets. Images associated with a user response, processed during optimal user states, are assigned the highest priority for post triage examination, as targets are likely. Images without a user response that are processed during optimal user states are assigned the lowest priority, as these are unlikely to contain targets. Images with a user response that are processed during suboptimal states are assigned a medium priority, as these are likely to contain a high number of false positives. Images without a user response, processed during suboptimal user states are flagged for reprocessing as these may contain targets that the user may not have detected.

Claims

1. A method for prioritizing an output of an image triage, comprising:

monitoring a physical state or cognitive state of a user;

assigning a first priority to a set of one or more images associated with an optimal user state when a user response is detected;

assigning a second priority to a set of one or more images associated with a suboptimal user state when a user response is detected; and

assigning a third priority to a set of one or more images associated with an optimal user state when a user response is not detected.

2. The method of claim 1, further comprising reexamining a set of one or more images associated with a suboptimal user state when a user response is not detected.

3. The method of claim 1, wherein the image triage comprises a rapid serial visual presentation.

4. The method of claim 1, wherein the physical state or cognitive state of the user is monitored by one or more sensors.

5. The method of claim 4, wherein the physical state of the user comprises one or more of head orientation, eye blinks, eye position, eye scan patterns, or body posture.

6. The method of claim 4, wherein the cognitive state of the user comprises one or more of attention levels, or working memory load.

7. The method of claim 1, wherein the first priority is higher than the second priority, and the second priority is higher than the third priority.

8. The method of claim 1, wherein the user response is an evoked response potential.

9. The method of claim 8, wherein the evoked response potential is detected by one or more techniques comprising a linear projection, a nonlinear matched filter, or a wavelet-based time frequency distribution.

10. A computer readable medium having instructions stored thereon for a method for prioritizing an output of an image triage, the method comprising:

monitoring a physical state or cognitive state of a user;

classifying the state of the user as optimal or suboptimal;

monitoring for a response of a user; and

assigning a priority to a set of one or more images based on the user state and whether a user response is detected.

11. The medium of claim 10, wherein the method further comprises reexamining a set of one or more images associated with a suboptimal user state when a user response is not detected.

12. The medium of claim 10, wherein the response of the user comprises an evoked response potential.

13. The medium of claim 12, wherein the evoked response potential is detected by one or more techniques comprising a linear projection, a nonlinear matched filter, or a wavelet-based time frequency distribution.

14. An image triage system, comprising:

a display module;

a detection module in operative communication with the display module;

a sensor module in operative communication with the display module and the detection module;

a signal processing module in operative communication with the sensor module and the detection module; and

a user sensitive prioritization system in operative communication with the detection module and the sensor module;

wherein the user sensitive prioritization system assigns various priorities to sets of one or more images associated with optimal or suboptimal user states when an evoked response potential is detected or not detected in a user.

15. The system of claim 14, wherein the display module comprises a rapid serial visual presentation display, and an image database.

16. The system of claim 14, wherein the detection module comprises an evoked response potential feature detection system.

17. The system of claim 16, wherein the evoked response potential feature detection system comprises a linear projection, a nonlinear matched filter, a wavelet-based time frequency distribution, or combinations thereof.

18. The system of claim 14, wherein the detection module comprises a feature fusion system.

19. The system of claim 14, wherein the detection module comprises a cognitive classification system.

20. The system of claim 14, wherein the sensor module comprises one or more of a working memory sensor, a user attention sensor, an eye activity sensor, or a head orientation sensor.

21. The system of claim 14, wherein the signal processing module comprises one or more signal drift correction filters, bandpass filters, linear ocular filters, or components to provide power spectral density estimates.

22. The system of claim 14, further comprising an output storage device for post triage examination of images.

23. The system of claim 14, further comprising one or more of a user sensitive pacing system, or a user alert system, which are in communication with the sensor module and the display module.

24. An image triage system, comprising:

means for managing images that are shown to a user;

means for monitoring a physical state or cognitive state of the user;

means for detecting evoked response potentials in the user; and

means for assigning various priorities to sets of one or more images associated with optimal or suboptimal user states when an evoked response potential is detected or not detected in the user.

25. The system of claim 24, further comprising means for processing signals prior to evoked response potential feature extraction and classification.

26. The system of claim 24, further comprising means for reexamining a set of one or more images associated with a suboptimal user state when an evoked response potential is not detected.

27. The system of claim 24, wherein the physical state or cognitive state of the user is monitored by one or more sensors.

28. The system of claim 27, wherein the one or more sensors comprise a head tracker, a body worn gyroscope, an eye tracker, an eye electrode, a cardiac sensor, an electroencephalogram sensor, or a functional magnetic resonance imaging sensor.

29. The system of claim 28, wherein the electroencephalogram sensor monitors a user response comprising an evoked response potential.