Analysis, Labeling and Exploitation of Sensor Data in Real Time

• US 20140301662A1
• Filed: 03/17/2014
• Published: 10/09/2014
• Est. Priority Date: 03/17/2013
• Status: Abandoned Application

• Current Assignee: PFG Ip, LLC
• Original Assignee: ISC8 Incorporated
• Inventors: Justice, James, Ludwig, David, Villacorta, Virgilio, Azzazy, Medhat, Le, Hoang
• Application Number:
  US14/215,222
• Publication Number:
  US 20140301662A1
• Time in Patent Office: Days
• US Class Current: 382/278
• CPC Class Codes: G06T 2207/10036 Multispectral image; Hyperspectral image
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30212 Military
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

A method for processing sensor data representative of a scene of interest. A plurality of sensor data outputs representative of the scene is selected from the group consisting of visible, VNIR, SWIR, MWIR, LWIR, far infrared, multi-spectral data, hyper-spectral data, SAR data, and 3-D LIDAR sensor data. The data is input to a plurality of graphics processing elements that are configured to independently execute separate image processing filter operations selected from the group consisting of spatial filtering, temporal filtering, spatio-temporal filtering, and template matching. A cross-correlation operation is performed on the filter outputs based on predetermined filter output characteristics which may then be used to annotate the scene with regions of interest (ROI) for display to a user.

Claims

1. A method for processing sensor data representative of a scene of interest comprising the steps of:

inputting a plurality of sensor data outputs representative of a scene of interest selected from the group consisting of visible, VNIR, SWIR, MWIR, LWIR, far infrared, multi-spectral data, hyper-spectral data, SAR data, and 3-D LIDAR sensor data to a plurality of graphics processing elements,

the plurality of elements configured to independently execute a plurality of separate image processing filter operations selected from the group consisting of spatial filtering, temporal filtering, spatia-temporal filtering, and template matching,

concurrently executing the filter operations on the sensor data in each of a plurality of the elements to define a plurality of image filter outputs,

performing a cross-correlation operation on the filter outputs based on a predetermined set of filter output characteristics, and,

prioritizing one or more regions of interest (ROI) in the scene based on the cross-correlation operation.

2. The method of claim 1 wherein at least one of the image processing filter operations is selected from the group consisting of motion, intensity, color, flicker and orientation filter operations.

3. The method of claim 1 further comprising the step of annotating at least one of the regions in the scene.

4. The method of claim 3 further comprising the step of outputting at least one of the annotated scenes to a display.

5. A method for processing sensor data representative of a scene of interest comprising the steps of:

inputting a plurality of separate sensor data outputs representative of a scene of interest to a plurality of graphics processing elements,

the plurality of elements configured to independently execute a plurality of separate image processing filter operations,

concurrently executing the plurality of filter operations on the sensor data in each of a plurality of the elements to define a plurality of separate image filter outputs,

performing a cross-correlation operation on the filter outputs based on a predetermined set of filter output characteristics, and,

prioritizing one or more regions of interest (ROT) in the scene based on the cross-correlation operation.