Method and apparatus for estimating feature values in a region of a sequence of images
First Claim
1. A method for estimating values of features of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions of the video sequence, the method comprising the steps of:
- generating a histogram for each image region over the a plurality of image frames in the sequence;
calculating at each image region a mode value as indicated by the histogram;
replacing each image region by its mode value to produce an image of the estimated feature values of the sequence of images; and
excluding, from the histogram generating step, regions of the plurality of images in which there is a prior indication that the features are obscured.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus are disclosed that estimate the brightness or other feature values of unchanging or slowly changing regions of an image in a sequence of video images even when the regions is obscured by objects over large portions of the video sequence. The apparatus and method generate a histogram for each image region position over a plurality of image frames in the sequence. The mode, or most frequently occurring value, of the image region as indicated by the histogram is selected as representing the unchanging portion of the image. The mode values of all of the regions are then assembled to form a composite image of the unchanging or slowly changing feature values. According to one method, the histogram is generated using a recursive filter. In order to process images that exhibit some motion from frame to frame, the images in the video sequence may be aligned before generating the histogram. If the camera produces artifacts such as variations in the image caused by an automatic gain control (AGC) function, each image in the sequence of video images may be filtered either temporally or spatially before performing the histogramming operation to remove these artifacts. To reduce processing time, the image processing may be spaced in time such that only every nth image is processed. Alternatively, each region of an image sequence may be processed at random irregular intervals in order to obtain the histogram. In one embodiment of the invention, the histogram is applied over relatively small groups of frames in order to generate a noise reduced image.
-
Citations
21 Claims
-
1. A method for estimating values of features of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions of the video sequence, the method comprising the steps of:
-
generating a histogram for each image region over the a plurality of image frames in the sequence;
calculating at each image region a mode value as indicated by the histogram;
replacing each image region by its mode value to produce an image of the estimated feature values of the sequence of images; and
excluding, from the histogram generating step, regions of the plurality of images in which there is a prior indication that the features are obscured. - View Dependent Claims (2, 6, 7, 8, 9)
-
-
3. A method for estimating values of features of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions of the video sequence, the method comprising the step of:
-
generating a histogram for each image region over the plurality of image frames in the sequence by recursively filtering each image region over the plurality of image frames to generate the histogram;
calculating at each image region a mode value indicated be the histogram; and
replacing each image region by its mode values to produce an image of the estimated feature values of the sequence of images. - View Dependent Claims (4, 5)
-
-
10. A method for estimating values of features of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions of the video sequence, the method comprising the steps of:
-
aligning each image frame in the video sequence to a previously processed image frame of the plurality of video image frames;
filtering each image frame In the video sequence to normalize values of the features In the plurality of video image frames in the video sequence;
generating a histogram for each image region over the a plurality of image frames in the sequence, including, for each region In each image frame in the video sequence, the steps of;
determining the feature values for the region in the image frame;
determining if the features in the region are obscured;
if the features in the region are not obscured in the image frame, incrementing cells of a histogram corresponding to the determined feature values;
calculating, at each image region, a mode value as indicated by the histogram;
replacing each image region by its mode value to produce an image of the estimated feature values of the sequence of images. - View Dependent Claims (11, 12)
-
-
13. Apparatus which estimates values of features of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions of the video sequence, the apparatus comprising:
-
a source of input images;
a histogram memory to store a histogram for each image region over the plurality of image frames in the sequence;
a histogram processor which;
recursively filters the input images to generate the histogram for each image region over the plurality of image frames in the sequence; and
calculates a mode value at each image region, as indicated by the histogram to provide an image of the estimated feature values of the sequence of images. - View Dependent Claims (14, 15, 16)
-
-
17. A carrier including computer instructions that cause a computer to estimate feature values of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions or the video sequence, the computer instructions causing the computer to perform the steps of:
-
generating a histogram for each image region over the plurality of video image frames in the video sequence;
exduding, from the histogram generating step, regions of the plurality of images in which there is a prior indication that the features are obscured;
calculating at each image region a mode value as indicated by the histogram; and
replacing each image region by its mode value to produce an image of the estimated feature values of the sequence of images. - View Dependent Claims (18)
-
-
19. A carrier including a computer instructions that cause a computer to estimate values of features of one or more image regions in a video sequence including a plurality of video image frames when the one or more of the features are obscured by objects over portions of the video sequence, the computer instructions causing the computer to perform the steps of:
-
generating a histogram for each image region over the plurality of image frames in the sequence by recursively filtering each image region over the plurality of image frames to generate the histogram;
calculating at each image region a mode value as indicated by the histogram; and
replacing each image region by its mode value to produce an image of the estimated feature values of the sequence of images. - View Dependent Claims (20, 21)
-
Specification