Simulated video with extra viewpoints and enhanced resolution for traffic cameras
First Claim
Patent Images
1. A method to be executed at least in part in a computing device for generating an enhanced simulated video from a camera feed, the method comprising:
- setting up a plurality of cameras in different directions at a location for a predetermined period of time to capture stored images of vehicles at a plurality of angles that are indexed;
receiving an original video input from a single-direction camera;
generating a stream of vehicle video patches;
matching vehicles in the vehicle video patches to corresponding the stored images of vehicles employing a moving window with normalized cross-correlation, wherein the stored images of the vehicles are based on at least one from a set of;
a make, a model, and a color of each vehicle;
retrieving images of a different angle corresponding to the stored images of the vehicles;
fusing the retrieved images into a simulated video displaying the vehicles moving in another direction;
generating the simulated video at a different frame rate than a frame rate of the original video input to reduce a blurriness and a dullness of the original video input; and
rendering the simulated video.
2 Assignments
0 Petitions
Accused Products
Abstract
Simulated high resolution, multi-view video based on video input from low resolution, single-direction cameras is provided. Video received from traffic cameras, security cameras, monitoring cameras, and comparable ones is fused with patches from a database of pre-captured images and/or temporally shifted video to create higher quality video, as well as multiple viewpoints for the same camera.
18 Citations
19 Claims
-
1. A method to be executed at least in part in a computing device for generating an enhanced simulated video from a camera feed, the method comprising:
-
setting up a plurality of cameras in different directions at a location for a predetermined period of time to capture stored images of vehicles at a plurality of angles that are indexed; receiving an original video input from a single-direction camera; generating a stream of vehicle video patches; matching vehicles in the vehicle video patches to corresponding the stored images of vehicles employing a moving window with normalized cross-correlation, wherein the stored images of the vehicles are based on at least one from a set of;
a make, a model, and a color of each vehicle;retrieving images of a different angle corresponding to the stored images of the vehicles; fusing the retrieved images into a simulated video displaying the vehicles moving in another direction; generating the simulated video at a different frame rate than a frame rate of the original video input to reduce a blurriness and a dullness of the original video input; and rendering the simulated video. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for generating an enhanced simulated video from a camera feed, the system comprising:
-
at least one single-directional camera; a server coupled to the at least one single-directional camera, the server executing a video processing application, wherein the video processing application is configured to; set up a plurality of cameras in different directions at a location for a predetermined period of time to capture stored images of a vehicle at a plurality of angles that are indexed; receive an original video input from the single-direction camera; generate a stream of vehicle video patches; buffer a predefined number of video frames; capture images of a first group of vehicles in frames where the vehicles appear near the camera, wherein the images of the vehicles correspond to at least one of;
a make, a model, and a color of each vehicle;superimpose the images over frames where the first group of vehicles appear away from the camera; match a second group of vehicles in the vehicle video patches to corresponding the stored images of vehicles employing a moving window with normalized cross-correlation; retrieve images of a different angle corresponding to the stored images of the vehicles; fuse the superimposed images into a first simulated video with enhanced resolution; fuse the retrieved images into a simulated second video displaying the second group of vehicles moving in another direction; and render the simulated videos. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A computer-readable memory device with instructions stored thereon for generating an enhanced simulated video from a camera feed, the instructions comprising:
-
receiving an original video input from a single-direction camera; generating a stream of vehicle video patches; buffering a predefined number of frames; matching the buffered frames employing a moving window with normalized cross-correlation such that images of vehicles farther away from the camera are enhanced, wherein more than one stored image of the vehicles are based on at least one of;
a make, a model, and a color of each vehicle;fusing the matched frames into the simulated video; and generating the simulated video at a different frame rate than a frame rate of the original video input to reduce a blurriness and a dullness of the original video input. - View Dependent Claims (18, 19)
-
Specification