Graphical display and user-interface for high-speed triage of potential items of interest in imagery
First Claim
1. A computer program product for processing imagery, the computer program product comprising:
- a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions by one or more processors, the one or more processors perform operations of;
receiving at least one image of a scene in a visible spectrum from a sensor;
processing the at least one image to identify a plurality of potential objects of interest (OI) in the at least one image based on saliency or motion of the plurality of potential OI;
assigning a confidence score to each of the plurality of potential OI by displaying the plurality of potential OI to a user at a high seed using raid serial visual presentation (RSVP) while measuring the user'"'"'s electroencephalographic (EEG) response to the RSVP, with the confidence scores being based on the user'"'"'s EEG response to the RSVP;
altering, based on user selection, a minimum confidence score threshold for the plurality of potential OI;
presenting a full frame of the at least one image of the scene at a reduced resolution, the full frame having a location of the plurality of potential OI superimposed over the full frame such that the plurality of potential OI remain at the reduced resolution within the full frame;
presenting a plurality of potential OI that exceed the minimum confidence score as a series of chips on a threat chip display (TCD), the chips being presented at full resolution, where each chip is a region extracted from the at least one image that corresponds to a potential OI; and
designating, via the TCD, any one of the chips as an actual OI.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention relates to a surveillance system and, more particularly, to a graphical display and user interface system that provides high-speed triage of potential items of interest in imagery. The system receives at least one image of a scene from a sensor. The image is pre-processed to identify a plurality of potential objects of interest (OI) in the image. The potential OI are presented to the user as a series of chips on a threat chip display (TCD), where each chip is a region extracted from the image that corresponds to a potential OI. Finally, the system allows the user to designate, via the TCD, any one of the chips as an actual OI.
24 Citations
32 Claims
-
1. A computer program product for processing imagery, the computer program product comprising:
a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions by one or more processors, the one or more processors perform operations of; receiving at least one image of a scene in a visible spectrum from a sensor; processing the at least one image to identify a plurality of potential objects of interest (OI) in the at least one image based on saliency or motion of the plurality of potential OI; assigning a confidence score to each of the plurality of potential OI by displaying the plurality of potential OI to a user at a high seed using raid serial visual presentation (RSVP) while measuring the user'"'"'s electroencephalographic (EEG) response to the RSVP, with the confidence scores being based on the user'"'"'s EEG response to the RSVP; altering, based on user selection, a minimum confidence score threshold for the plurality of potential OI; presenting a full frame of the at least one image of the scene at a reduced resolution, the full frame having a location of the plurality of potential OI superimposed over the full frame such that the plurality of potential OI remain at the reduced resolution within the full frame; presenting a plurality of potential OI that exceed the minimum confidence score as a series of chips on a threat chip display (TCD), the chips being presented at full resolution, where each chip is a region extracted from the at least one image that corresponds to a potential OI; and designating, via the TCD, any one of the chips as an actual OI. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
13. A system for processing imagery, the system comprising:
one or more processors and a memory, the memory being a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions, the one or more processors perform operations of; receiving at least one image of a scene in a visible spectrum from a sensor; processing the at least one image to identify a plurality of potential objects of interest (OI) in the at least one image based on saliency or motion of the plurality of potential OI; assigning a confidence score to each of the plurality of potential OI by displaying the plurality of potential OI to a user at a high seed using rapid serial visual presentation (RSVP) while measuring the user'"'"'s a electroencephalographic (EEG) response to the RSVP, with the confidence scores being based on the user'"'"'s EEG response to the RSVP; a altering, based on user selection, a minimum confidence score threshold for the plurality of potential OI; presenting a full frame of the at least one image of the scene at a reduced resolution, the full frame having a location of the plurality of potential OI superimposed over the full frame such that the plurality of potential OI remain at the reduced resolution within the full frame; presenting a plurality of potential OI that exceed the minimum confidence score as a series of chips on a threat chip display (TCD), the chips being presented at full resolution, where each chip is a region extracted from the at least one image that corresponds to a potential OI; and designating, via the TCD, any one of the chips as an actual OI. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
24. A computer implemented method for processing imagery, the method comprising an act of:
causing one or more processers to execute instructions encoded on a non-transitory computer-readable medium, such that upon execution, the one or more processors perform operations of; receiving at least one image of a scene in a visible spectrum from a sensor; processing the at least one image to identify a plurality of potential objects of interest (OI) in the at least one image based on saliency or motion of the plurality of potential OI; assigning a confidence score to each of the plurality of potential OI by displaying the plurality of potential OI to a user at a high speed using rapid serial visual presentation (RSVP) while measuring the user'"'"'s electroencephalographic (EEG) response to the RSVP, with the confidence scores being based on the user'"'"'s EEG response to the RSVP; altering, based on user selection, a minimum confidence score threshold for the plurality of potential OI; presenting a full frame of the at least one image of the scene at a reduced resolution, the full frame having a location of the plurality of potential OI superimposed over the full frame such that the plurality of potential OI remain at the reduced resolution within the full frame; presenting a plurality of potential OI that exceed the minimum confidence score as a series of chips on a threat chip display (TCD), the chips being presented at full resolution, where each chip is a region extracted from the at least one image that corresponds to a potential OI; and designating, via the TCD, any one of the chips as an actual OI. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32)
Specification