Video scene background maintenance using statistical pixel modeling
First Claim
Patent Images
1. A method of video scene background maintenance for a sequence of video frames, comprising the steps of:
- aligning the video frames;
building a statistical model for each pixel of the aligned video frames, comprising the steps of;
building a time series of chromatic data for each pixel;
determining zero or more candidate states for each pixel based on the time series for the pixel; and
computing statistical quantities for the states based on the time series; and
choosing a background state for each pixel of the aligned video frames.
9 Assignments
0 Petitions
Accused Products
Abstract
A method for video background scene maintenance uses statistical pixel modeling. A background statistical model is built based on the input video. A background image may be built based on the background statistical model, or video segmentation into foreground and background may be carried out based on the background statistical model.
-
Citations
33 Claims
-
1. A method of video scene background maintenance for a sequence of video frames, comprising the steps of:
-
aligning the video frames; building a statistical model for each pixel of the aligned video frames, comprising the steps of; building a time series of chromatic data for each pixel; determining zero or more candidate states for each pixel based on the time series for the pixel; and computing statistical quantities for the states based on the time series; and choosing a background state for each pixel of the aligned video frames. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A method of video scene background maintenance for a sequence of video frames, comprising the steps of:
-
aligning the video frames; building a statistical model for each pixel of the aligned video frames; and choosing a background state for each pixel of the aligned video frames, comprising the choosing a background state for each pixel of the aligned video frames, comprising the steps of; choosing an initial guess for a background state of each pixel, comprising the steps of; determining if the pixel has only a single state; if so, setting the background state to that single state and labeling the pixel uncontroversial; and if not, choosing one of multiple states of the pixel as the background state for the pixel and labeling the pixel controversial, comprising the steps of; determining if a state transition between a pair of contiguous states for the pixel is slow or sudden; if there is a sudden transition between the pair of contiguous states, performing the steps of; computing variances of chromatic values in small windows to each side of the transition; and determining the state on the side of the window having the higher variance to be not background and removing it from consideration as a background state; and if there is a slow transition between the pair of contiguous states, performing the steps of; computing the mean of the data between the two states; and determining the state that is closest to the mean of the data between the two states to be not background and removing it from consideration as a background state; and iteratively propagating the initial guesses spatially to neighboring pixels. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A method of video scene background maintenance for a sequence of video frames, comprising the steps of:
-
aligning the video frames; building a statistical model for each pixel of the aligned video frames; and choosing a background state for each pixel of the aligned video frames, comprising the steps of; choosing an initial guess for a background state of each pixel, comprising the steps of; determining if the pixel has only a single state; if so, setting the background state to that single state and labeling the pixel uncontroversial; and if not, choosing one of multiple states of the pixel as the background state for the pixel and labeling the pixel controversial; and iteratively propagating the initial guesses spatially to neighboring pixels, comprising the steps of; iteratively propagating the initial guesses spatially, resulting in iteratively spatially propagated guesses; and iteratively propagating the iteratively spatially propagated guesses temporally, comprising the steps of; selecting a first spatial neighborhood of pixels around a given pixel; comparing the iteratively spatially propagated guess corresponding to the given pixel to each of the iteratively spatially propagated guesses corresponding to the pixels in the first spatial neighborhood; and if the iteratively spatially propagated guess corresponding to the given pixel does not temporally overlap any of the iteratively spatially propagated guesses corresponding to the pixels in the first spatial neighborhood, labeling the given pixel temporally controversial, and otherwise labeling the given pixel temporally uncontroversial. - View Dependent Claims (27, 28, 29, 30, 31, 32, 33)
-
Specification