SYSTEM AND METHOD TO COMBINE MULTIPLE VIDEO STREAMS
First Claim
1. An apparatus comprising:
- a plurality of optical sensors;
a plurality of sensor processing modules, each sensor processing module to calculate metadata for a video frame received from at least one of the plurality of optical sensors; and
an aggregation system to serialize video data and metadata received from the plurality of sensor processing modules.
4 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for combining multiple video streams are provided. Video feeds are received from multiple optical sensors, and homography information and/or corner metadata is calculated for each frame from each video stream. This data is used to mosaic the separate frames into a single video frame. Local translation of each image may also be used to synchronize the video frames. The optical sensors can be provided by an airborne platform, such as a manned or unmanned surveillance vehicle. Image data can be requested from a ground operator, and transmitted from the airborne platform to the user in real time or at a later time. Various data arrangements may be used by an aggregation system to serialize and/or multiplex image data received from multiple sensor modules. Fixed-size record arrangement and variable-size record arrangement systems are provided.
-
Citations
35 Claims
-
1. An apparatus comprising:
-
a plurality of optical sensors;
a plurality of sensor processing modules, each sensor processing module to calculate metadata for a video frame received from at least one of the plurality of optical sensors; and
an aggregation system to serialize video data and metadata received from the plurality of sensor processing modules. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 33)
-
-
11. A method of generating a video stream, comprising:
-
receiving a plurality of video frames generated by a plurality of optical sensors;
using a plurality of sensor processing modules, calculating metadata for each video frame received from at least one of the plurality of optical sensors; and
serializing the video frames and metadata received from the plurality of sensor processing modules. - View Dependent Claims (12, 13)
-
-
14. A method of combining multiple video streams, comprising:
-
receiving a plurality of video frames, each video frame corresponding to image data obtained concurrently by one of a plurality of optical sensors;
calculating mosaic estimation metadata for each of the plurality of video frames; and
creating a composite video frame from the plurality of video frames and mosaic estimation metadata. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 34)
-
-
25. A method of aggregating video streams, comprising:
-
assigning a channel to each of a plurality of video sources;
for each video source, encoding video data from the video source into a series of packets;
encoding each packet with metadata describing the video data encoded in the packet, the metadata containing image transformation information; and
receiving packets from the plurality of video sources, wherein each video source transmits a packet to the channel assigned to the video source. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32, 35)
-
Specification