GENERATIVE MODELS FOR CONSTRUCTING PANORAMAS FROM AN IMAGE SEQUENCE
First Claim
1. A method for automatically creating a panoramic view of a scene, comprising using a computing device to perform steps for:
- receiving a video sequence of a scene captured from a moving camera;
zero padding borders of each image frame of the video sequence to increase extents of each image frame;
setting a preferred number sprites to be identified within the zero padded video sequence;
setting a preferred number of layers into which each frame of the zero padded video sequence is to be decomposed, said layers including at least a background layer and a front layer, said front layer passing the entire contents of each zero padded image frame to be probabilistically considered for contributions to the background layer via a generative model;
using the generative model to automatically decompose the zero padded video sequence into the preferred number of sprites and the preferred number of layers, said layers including the background layer; and
wherein the background layer decomposed from the zero padded video sequence provides a static panoramic view of the scene relative to the original image frames of the video sequence.
1 Assignment
0 Petitions
Accused Products
Abstract
A simplified general model and an associated estimation algorithm is provided for modeling visual data such as a video sequence. Specifically, images or frames in a video sequence are represented as collections of flat moving objects that change their appearance and shape over time, and can occlude each other over time. A statistical generative model is defined for generating such visual data where parameters such as appearance bit maps and noise, shape bit-maps and variability in shape, etc., are known. Further, when unknown, these parameters are estimated from visual data without prior pre-processing by using a maximization algorithm. By parameter estimation and inference in the model, visual data is segmented into components which facilitates sophisticated applications in video or image editing, such as, for example, object removal or insertion, tracking and visual surveillance, video browsing, photo organization, video compositing, etc.
-
Citations
20 Claims
-
1. A method for automatically creating a panoramic view of a scene, comprising using a computing device to perform steps for:
-
receiving a video sequence of a scene captured from a moving camera; zero padding borders of each image frame of the video sequence to increase extents of each image frame; setting a preferred number sprites to be identified within the zero padded video sequence; setting a preferred number of layers into which each frame of the zero padded video sequence is to be decomposed, said layers including at least a background layer and a front layer, said front layer passing the entire contents of each zero padded image frame to be probabilistically considered for contributions to the background layer via a generative model; using the generative model to automatically decompose the zero padded video sequence into the preferred number of sprites and the preferred number of layers, said layers including the background layer; and wherein the background layer decomposed from the zero padded video sequence provides a static panoramic view of the scene relative to the original image frames of the video sequence. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer-implemented process for constructing a panoramic view of a scene background from an image sequence captured from a moving camera, comprising using a computing device to:
-
receive an image sequence of a scene captured from a moving camera; zero pad borders of each image frame of the image sequence to increase extents of each image frame, and wherein increasing the amount of zero padding will increase extents of a background layer; set a preferred number of layers into which each frame of the image sequence is to be decomposed, said layers including at least the background layer and a front layer, said front layer passing the entire contents of each zero padded image frame to be probabilistically considered for contributions to the background layer via a generative model; and use the generative model to automatically decompose the zero padded image sequence into the preferred number of layers, said layers including the background layer, said background layer providing a static panoramic view of the scene relative to the frames of the original image sequence. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
-
16. A computer-readable storage device having computer executable instructions stored thereon for automatically constructing a panoramic view of a scene background from an image sequence, comprising computer executable instructions for:
-
receiving a video sequence of a scene captured from a moving camera; zero padding borders of each image frame of the video sequence to increase extents of each image frame; setting a preferred number sprites to be identified within the zero padded video sequence; setting a preferred number of layers into which each frame of the zero padded video sequence is to be decomposed, said layers including at least a background layer and a front layer, said front layer passing the entire contents of each zero padded image frame to be probabilistically considered for contributions to the background layer via a probabilistic generative model; using the generative model to automatically decompose the zero padded video sequence into the preferred number of sprites and the preferred number of layers, said layers including the background layer; and wherein the background layer decomposed from the zero padded video sequence provides a static panoramic view of the scene relative to the original image frames of the video sequence. - View Dependent Claims (17, 18, 19, 20)
-
Specification