Method of visually synchronizing differing camera feeds with common subject
First Claim
Patent Images
1. A device for use with a first video feed and a second video feed, the device comprising:
- a receiver operable to receive the first video feed, to receive the second video feed, to generate a first output video based on the first video feed, and to generate a second output video based on the second video feed; and
a processor and a synchronizer coupled to the receiver, the processor and the synchronizer configured to;
detect a first discontinuity between sequential frames of the first video feed;
detect a second discontinuity between sequential frames of the first video feed;
detect a third discontinuity between sequential frames of the second video feed;
detect a fourth discontinuity between sequential frames of the second video feed;
insert a synchronization point in the first output video based on the first discontinuity and a synchronization point in the second output video based on the third discontinuity;
align the second output video with the first output video by matching the synchronization point based on the first discontinuity with the synchronization point based on the third discontinuity;
insert a synchronization point in the first output video based on the second discontinuity and a synchronization point in the second output video based on the fourth discontinuity; and
adjust the alignment of the first output video and the second output video by further aligning the second output video with the first output video to match the synchronization point based on the second discontinuity with the synchronization point based on the fourth discontinuity.
3 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the present invention provide a system and method to automatically generate synchronization points based on a common characteristic given a plurality of random video feeds. The common characteristic can be based on changes in motion, audio, image, etc between the feeds. A feedback process attempts to time align the synchronized video outputs based on discontinuities in the feeds. Once the video feeds are time aligned, the aligned content can be used for recreating a multi-view video montage or feeding it into a 3-D correlation program.
92 Citations
21 Claims
-
1. A device for use with a first video feed and a second video feed, the device comprising:
-
a receiver operable to receive the first video feed, to receive the second video feed, to generate a first output video based on the first video feed, and to generate a second output video based on the second video feed; and a processor and a synchronizer coupled to the receiver, the processor and the synchronizer configured to; detect a first discontinuity between sequential frames of the first video feed; detect a second discontinuity between sequential frames of the first video feed; detect a third discontinuity between sequential frames of the second video feed; detect a fourth discontinuity between sequential frames of the second video feed; insert a synchronization point in the first output video based on the first discontinuity and a synchronization point in the second output video based on the third discontinuity; align the second output video with the first output video by matching the synchronization point based on the first discontinuity with the synchronization point based on the third discontinuity; insert a synchronization point in the first output video based on the second discontinuity and a synchronization point in the second output video based on the fourth discontinuity; and adjust the alignment of the first output video and the second output video by further aligning the second output video with the first output video to match the synchronization point based on the second discontinuity with the synchronization point based on the fourth discontinuity. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of using a first video feed and a second video feed, comprising:
-
receiving, via a receiver, the first video feed and the second video feed; generating, via the receiver, a first output video based on the first video feed and a second output video based on the second video feed; detecting a first discontinuity between sequential frames of the first video feed; detecting a second discontinuity between sequential frames of the first video feed; detecting a third discontinuity between sequential frames of the second video feed; detecting a fourth discontinuity between sequential frames of the second video feed; inserting a synchronization point in the first output video based on the first discontinuity and in the second output video based on the third discontinuity; aligning the second output video with the first output video by matching the synchronization point based on the first discontinuity with the synchronization point based on the third discontinuity; inserting a synchronization point in the first output video generating a based on the second discontinuity and in the second output video based on the fourth discontinuity; and adjusting the alignment of the first output video and the second output video by further aligning the second output video with the first output video to match the synchronization point based on the second discontinuity with the synchronization point based on the fourth discontinuity. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A system comprising:
-
a computing device; one or more processors; and one or more computer-readable storage memory devices comprising instructions that are executable by the one or more processors to cause the computing device to perform operations comprising; receiving, via a receiver, a first video feed and a second video feed; generating, via the receiver, a first output video based on the first video feed and a second output video based on the second video feed; detecting a first discontinuity between sequential frames of the first video feed; detecting a second discontinuity between sequential frames of the first video feed; detecting a third discontinuity between sequential frames of the second video feed; detecting a fourth discontinuity between sequential frames of the second video feed; inserting a synchronization point in the first output video based on the first discontinuity and in the second output video based on the third discontinuity; aligning the second output video with the first output video by matching the synchronization point based on the first discontinuity with the synchronization point based on the third discontinuity; inserting a synchronization point in the first output video based on the second discontinuity and in the second output video based on the fourth discontinuity; and adjusting the alignment of the first output video and the second output video by further aligning the second output video with first output video to match the synchronization point based on the second discontinuity with the synchronization point based on the fourth discontinuity. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification