VIDEO PROCESSING SYSTEM GENERATING CORRECTED GEOSPATIAL METADATA FOR A PLURALITY OF GEOREFERENCED VIDEO FEEDS AND RELATED METHODS

• US 20110145257A1
• Filed: 12/10/2009
• Published: 06/16/2011
• Est. Priority Date: 12/10/2009
• Status: Active Grant

• Current Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Heminghous, John, Dunkel, Christopher T., Bakir, Tariq, Peterson, Aric, McDonald, Robert
• Granted Patent: US 8,933,961 B2
• Time in Patent Office: Days
• US Class Current: 707/743
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A video processing system may include a video ingest module for receiving a plurality of georeferenced video feeds each including a sequence of video frames and initial geospatial metadata associated therewith, and each georeferenced video feed having a respective different geospatial accuracy level associated therewith. The system may further include a video processor coupled to the video ingest module and configured to perform image registration among the plurality of georeferenced video feeds, and generate corrected geospatial metadata for at least one of the georeferenced video feeds based upon the initial geospatial metadata, the image registration and the different geospatial accuracy levels.

Claims

1. A video processing system comprising:

a video ingest module for receiving a plurality of georeferenced video feeds each comprising a sequence of video frames and initial geospatial metadata associated therewith, and each georeferenced video feed having a respective different geospatial accuracy level associated therewith; and

a video processor coupled to said video ingest module and configured to

perform image registration among the plurality of georeferenced video feeds, and

generate corrected geospatial metadata for at least one of the georeferenced video feeds based upon the initial geospatial metadata, the image registration and the different geospatial accuracy levels.

2. The video processing system of claim 1 further comprising a display coupled to said video processor;

and wherein said video processor is also configured to display the sequence of video frames of the at least one georeferenced video feed on said display and with the corrected geospatial metadata associated therewith.

3. The video processing system of claim 1 further comprising at least one geospatial database coupled to said video processor for storing the corrected geospatial metadata.

4. The video processing system of claim 1 further comprising at least one geospatial database coupled to said video processor for storing the sequence of video images for each video feed.

5. The video processing system of claim 1 further comprising at least one geospatial database coupled to said video processor for storing at least one geospatially referenced landmark;

and wherein said video processor is further configured to generate the corrected geospatial metadata based upon the at least one geospatially referenced landmark.

6. The video processing system of claim 1 wherein said video processor generates the corrected geospatial metadata based upon an average of the initial geospatial metadata weighted based upon the respective geospatial accuracy levels.

7. The video processing system of claim 1 wherein said video processor generates the corrected geospatial metadata every N number of video frames, where N is greater than 1.

8. The video processing system of claim 1 wherein at least one of the video feeds has missing geospatial metadata;

and wherein said video processor is further configured to fill in the missing geospatial metadata based upon the initial geospatial metadata, the image registration and the different geospatial accuracy levels.

9. The video processing system of claim 1 wherein each of the georeferenced video feeds comprises a live video feed.

10. A video processing system comprising:

a video ingest module for receiving a plurality of georeferenced video feeds each comprising a sequence of video frames and initial geospatial metadata associated therewith, and each georeferenced video feed having a respective different geospatial accuracy level associated therewith;

a display;

at least one geospatial database for storing at least one geospatially referenced landmark; and

a video processor coupled to said video ingest module, said display, and said at least one geospatial database and configured to

perform image registration among the plurality of georeferenced video feeds,

generate corrected geospatial metadata for at least one of the georeferenced video feeds based upon the initial geospatial metadata, the image registration the different geospatial accuracy levels, and the at least one geospatially referenced landmark, and

display the sequence of video frames of the at least one georeferenced video feed on said display and with the corrected geospatial metadata associated therewith.

11. The video processing system of claim 10 wherein said at least one geospatial database is also for storing the corrected geospatial metadata and the sequence of video images for each video feed.

12. The video processing system of claim 10 wherein said video processor generates the corrected geospatial metadata based upon an average of the initial geospatial metadata weighted based upon the respective geospatial accuracy levels.

13. The video processing system of claim 10 wherein said video processor generates the corrected geospatial metadata every N number of video frames, where N is greater than 1.

14. A video processor for processing a plurality of georeferenced video feeds each comprising a sequence of video frames and initial geospatial metadata associated therewith, and each georeferenced video feed having a respective different geospatial accuracy level associated therewith, the video processor comprising:

an image registration module configured to perform image registration among the plurality of georeferenced video feeds; and

a metadata correction module configured to generate corrected geospatial metadata for at least one of the georeferenced video feeds based upon the initial geospatial metadata, the image registration and the different geospatial accuracy levels.

15. The video processor of claim 14 wherein said metadata correction module generates the corrected geospatial metadata based upon an average of the initial geospatial metadata weighted based upon the respective geospatial accuracy levels.

16. The video processor of claim 14 wherein said metadata correction module is also configured to display the sequence of video frames of the at least one georeferenced video feed on said display with the corrected geospatial metadata associated therewith.

17. A video processing method comprising:

receiving a plurality of georeferenced video feeds each comprising a sequence of video frames and initial geospatial metadata associated therewith, and each georeferenced video feed having a respective different geospatial accuracy level associated therewith;

performing image registration among the plurality of georeferenced video feeds; and

generating corrected geospatial metadata for at least one of the georeferenced video feeds based upon the initial geospatial metadata, the image registration and the different geospatial accuracy levels.

18. The method of claim 17 further comprising displaying the sequence of video frames of the at least one georeferenced video feed on a display and with the corrected geospatial metadata associated therewith.

19. The method of claim 17 wherein generating further comprises generating the corrected geospatial metadata also based upon the at least one geospatially referenced landmark.

20. The method of claim 17 wherein generating comprises generating the corrected geospatial metadata based upon an average of the initial geospatial metadata weighted based upon the respective geospatial accuracy levels.