Video processing system providing correlation between objects in different georeferenced video feeds and related methods

• US 8,717,436 B2
• Filed: 12/10/2009
• Issued: 05/06/2014
• Est. Priority Date: 12/10/2009
• Status: Active Grant

• Current Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Heminghous, John, Dunkel, Christopher T., McDonald, Robert, Bakir, Tariq, Peterson, Aric
• Primary Examiner(s): KHAN, USMAN A
• Application Number:
  US12/634,782
• Publication Number:
  US 20110141312A1
• Time in Patent Office: 1,608 Days
• Field of Search: 348/143, 348/231.5
• US Class Current: 348/143
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata

Abstract

A video processing system which may include a first video input configured to receive a first georeferenced video feed from a first video source, and a second video input configured to receive a second georeferenced video feed from a second video source, where the second georeferenced video feed overlaps the first georeferenced video feed. The system may further include a video processor coupled to the first and second video inputs. The video processor may include an annotation module configured to generate an annotation for an object in the first georeferenced video feed, and a geospatial correlation module configured to geospatially correlate the annotation to the object in the second georeferenced video feed overlapping the first georeferenced video feed.

Claims

1. A video processing system comprising:

a first video input configured to receive a first georeferenced video feed from a first video source corresponding to a first perspective of a scene from a first location;

a second video input configured to receive a second georeferenced video feed from a second video source corresponding to a second perspective of the scene from a second location different than the first location and defining a different viewing angle with respect to the first georeferenced video feed, the second georeferenced video feed overlapping the first georeferenced video feed and being separate from the first video feed; and

a video processor coupled to said first and second video inputs and comprising

an annotation module configured to generate an annotation for an object in the first georeferenced video feed, and

a geospatial correlation module configured to geospatially translate the annotation to the object in the second georeferenced video feed overlapping the first georeferenced video feed so that annotations made in the first perspective are translated to the second perspective.

2. The video processing system of claim 1 further comprising a metadata generation module configured to generate geospatial metadata for at least one of the first and second georeferenced video feeds.

3. The video processing system of claim 1 wherein said geospatial correlation module comprises a coordinate transformation module configured to transform geospatial coordinates for the annotation in the first georeferenced video feed to pixel coordinates in the second georeferenced video feed.

4. The video processing system of claim 3 wherein the first and second video sources have respective first and second source models associated therewith;

and wherein said transformation module performs affine transformations using the first and second source models.

5. The video processing system of claim 4 wherein the first and second source models have respective first and second corner points associated therewith;

and wherein said transformation module performs affine transformations using the first and second corner points.

6. The video processing system of claim 1 wherein said geospatial correlation module comprises a velocity model module configured to generate velocity models of the object in the first and second georeferenced video feeds for tracking the object therebetween.

7. The video processing system of claim 1 further comprising a metadata storage device configured to store metadata associated with the first and second georeferenced video feeds.

8. The video processing system of claim 1 further comprising an archival storage device configured to store the first and second georeferenced video feeds.

9. The video processing system of claim 1 wherein at least one of the first and second video sources comprises a video camera.

10. A video processing system comprising:

a first video input configured to receive a first georeferenced video feed from a first video source corresponding to a first perspective of a scene from a first location;

a second video input configured to receive a second georeferenced video feed from a second video source corresponding to a second perspective of the scene from a second location different than the first location and a defining a different viewing angle with respect to the first georeferenced video feed, the second georeferenced video feed overlapping the first georeferenced video feed and being separate from the first video feed; and

a video processor coupled to said first and second video inputs and comprising

an annotation module configured to generate an annotation for an object in the first georeferenced video feed, and

a geospatial correlation module configured to geospatially translate the annotation to the object in the second georeferenced video feed overlapping the first georeferenced video feed and comprising

a coordinate transformation module configured to transform geospatial coordinates for the annotation in the first georeferenced video feed to pixel coordinates in the second georeferenced video feed so that annotations made in the first perspective are translated to the second perspective, and

a velocity model module configured to generate velocity models of the object in the first and second georeferenced video feeds for tracking the object therebetween.

11. The video processing system of claim 10 further comprising a metadata generation module configured to generate geospatial metadata for at least one of the first and second georeferenced video feeds.

12. The video processing system of claim 10 wherein the first and second video sources have respective first and second source models associated therewith;

and wherein said coordinate transformation module performs affine transformations using the first and second source models.

13. A video processor for processing a first georeferenced video feed from a first video source corresponding to a first perspective of a scene from a first location and a second georeferenced video feed from a second video source corresponding to a second perspective of the scene from a second location different than the first location and defining a different viewing angle with respect to the first georeferenced video feed, the second georeferenced video feed overlapping the first georeferenced video feed and being separate from the first video feed, and the video processor comprising:

a non-transitory annotation module configured to generate an annotation for an object in the first georeferenced video feed; and

a non-transitory geospatial correlation module configured to geospatially translate the annotation to the object in the second georeferenced video feed overlapping the first georeferenced video feed so that annotations made in the first perspective are translated to the second perspective.

14. The video processor of claim 13 further comprising a metadata generation module configured to generate geospatial metadata for at least one of the first and second georeferenced video feeds.

15. The video processor of claim 13 wherein said geospatial correlation module comprises a coordinate transformation module configured to transform geospatial coordinates for the annotation in the first georeferenced video feed to pixel coordinates in the second georeferenced video feed.

16. A video processing method comprising:

providing a first georeferenced video feed from a first video source corresponding to a first perspective of a scene from a first location;

providing a second georeferenced video feed from a second video source corresponding to a second perspective of the scene from a second location different than the first location and defining a different viewing angle with respect to the first georeferenced video feed, the second georeferenced video feed overlapping the first georeferenced video feed and being separate from the first video feed;

generating an annotation for an object in the first georeferenced video feed using a non-transitory annotation module; and

geospatially correlating the annotation to the object in the second georeferenced video feed overlapping the first georeferenced video feed using a non-transitory geospatial correlation module so that annotations made in the first perspective are translated to the second perspective.

17. The method of claim 16 further comprising generating geospatial metadata for at least one of the first and second georeferenced video feeds using a metadata generation module.

18. The method of claim 16 wherein geospatially correlating further comprises transforming geospatial coordinates for the annotation in the first georeferenced video feed to pixel coordinates in the second georeferenced video feed.

19. The method of claim 16 wherein the first and second video sources have respective first and second source models associated therewith;

and wherein transforming further comprises performing affine transformations using the first and second source models.