Spatial and temporal filtering mechanism for digital motion video signals
First Claim
1. A method for filtering at least a portion of a digital video signal, the method comprising:
- calculating a pixel variance for a block of source pixels from a current frame of the motion video image;
applying a heavy spatial filter to the block of source pixels to form a block of spatially filtered pixels representing current subject matter of the current frame when the pixel variance is less than a first pixel variance threshold;
applying a light spatial filter to the block of source pixels to form the block of spatially filtered pixels when the pixel variance is less than a second pixel variance threshold;
calculating a pixel error between the block of spatially filtered pixels and a block of pixels of a previous frame of the digital video signal;
applying a heavy temporal filter to the block of spatially filtered pixels when the pixel error is less than a first pixel error threshold; and
applying a light temporal filter to the block of spatially filtered pixels when the pixel error is less than a second pixel error threshold.
3 Assignments
0 Petitions
Accused Products
Abstract
Frames of a digital video signal are spatially filtered to remove impulse and other noise from the video signal. The spatially filtered frame is temporally filtered to further remove noise from the digital video signal. The spatial filter is adaptive, heavily filtering portions of low detail in the represented subject matter while lightly filtering or not filtering portions of moderate to high detail in the represented subject matter. As a result, clarity and detail in the subject matter of the digital video signal are preserved. The temporal filter is similarly adaptive and determines if and to what degree the subject matter of portions of the spatially filtered frame correlate with corresponding portions of a previous frame. By previously spatially filtering the frame, determinations regarding the correlation of the current frame with corresponding portions of the previous, which is also spatially and temporally filtered, are more accurate. Accordingly, temporal filtering can be performed more aggressively without temporally blurring the digital video signal. The result of spatial and temporal filtering of the digital video signal is significant reduction in noise without degradation of the signal and improved compression of the digital video signal.
-
Citations
13 Claims
-
1. A method for filtering at least a portion of a digital video signal, the method comprising:
-
calculating a pixel variance for a block of source pixels from a current frame of the motion video image;
applying a heavy spatial filter to the block of source pixels to form a block of spatially filtered pixels representing current subject matter of the current frame when the pixel variance is less than a first pixel variance threshold;
applying a light spatial filter to the block of source pixels to form the block of spatially filtered pixels when the pixel variance is less than a second pixel variance threshold;
calculating a pixel error between the block of spatially filtered pixels and a block of pixels of a previous frame of the digital video signal;
applying a heavy temporal filter to the block of spatially filtered pixels when the pixel error is less than a first pixel error threshold; and
applying a light temporal filter to the block of spatially filtered pixels when the pixel error is less than a second pixel error threshold. - View Dependent Claims (2, 3, 11)
applying a five pixel median filter and a five pixel smoothing filter to the block of source pixels, and further wherein the step of applying a heavy spatial filter comprises applying a five pixel median filter and a nine pixel smoothing filter to the block of source pixels. -
3. The method of claim 1 wherein the calculated pixel error is an absolute pixel difference.
-
11. The method of claim 1, wherein the step of applying a heavy temporal filter includes applying a two-tap infinite impulse response filter in which the pixels of the previous frame are weighted by a factor of substantially equal to 0.75, and further wherein the step of applying a light temporal filter includes applying a two-tap infinite impulse response filter in which the pixels of the previous frame are weighted by a factor of substantially equal to 0.5.
-
-
4. A computer readable medium useful in association with a computer which includes
a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to filter a digital video signal by performing the steps of: -
calculating a pixel variance for a block of source pixels from a current frame of the motion video image;
applying a heavy spatial filter to the block of source pixels to form a block of spatially filtered pixels representing current subject matter of the current frame when the pixel variance is less than a first pixel variance threshold;
applying a light spatial filter to the block of source pixels to form the block of spatially filtered pixels when the pixel variance is less than a second pixel variance threshold;
calculating a pixel error between the block of spatially filtered pixels and a block of pixels of a previous frame of the digital video signal;
applying a heavy temporal filter to the block of spatially filtered pixels when the pixel error is less than a first pixel error threshold; and
applying a light temporal filter to the block of spatially filtered pixels when the pixel error is less than a second pixel error threshold. - View Dependent Claims (5, 6, 12)
applying a five pixel median filter and a five pixel smoothing filter to the block of source pixels, and further wherein the step of applying a heavy spatial filter comprises applying a five pixel median filter and a nine pixel smoothing filter to the block of source pixels. -
6. The computer readable medium of claim 4 wherein the calculated pixel error is an absolute pixel difference.
-
12. The computer readable medium of claim 4, wherein the step of applying a heavy temporal filter includes applying a two-tap infinite impulse response filter in which the pixels of the previous frame are weighted by a factor of substantially equal to 0.75, and further wherein the step of applying a light temporal filter includes applying a two-tap infinite impulse response filter in which the pixels of the previous frame are weighted by a factor of substantially equal to 0.5.
-
-
7. A computer system comprising:
-
a processor, a memory operatively coupled to the processor; and
a digital video signal filter which executes in the processor from the memory and which, when executed by the processor, causes the computer to filter a digital video signal by performing the steps of;
calculating a pixel variance for a block of source pixels from a current frame of the motion video image;
applying a heavy spatial filter to the block of source pixels to form a block of spatially filtered pixels representing current subject matter of the current frame when the pixel variance is less than a first pixel variance threshold;
applying a light spatial filter to the block of source of pixels to form the block of spatially filtered pixels when the pixel variance is less than a second pixel variance threshold;
calculating a pixel error between the block of spatially filtered pixels and a block of pixels of a previous frame of the digital video signal;
applying a heavy temporal filter to the block of spatially filtered pixels when the pixel error is less than a first pixel error threshold; and
applying a light temporal filter to the block of spatially filtered pixels when the pixel error is less than a second pixel error threshold. - View Dependent Claims (8, 9, 10, 13)
applying a five pixel median filter and a five pixel smoothing filter to the block of source pixels, and further wherein the step of applying a heavy spatial filter comprises applying a five pixel median filter and a nine pixel smoothing filter to the block of source pixels. -
9. The computer system of claim 7 wherein the calculated pixel error is an absolute pixel difference.
-
10. The computer system of claim 7 wherein the step of comparing comprises:
-
measuring a difference between the block of spatially filtered pixels and the block of pixels of the previous frame; and
determining whether the block of pixels of the previous frame represents the current subject matter by comparison of the measured difference to a predetermined threshold.
-
-
13. The computer system of claim 7, wherein the step of applying a heavy temporal filter includes applying a two-tap infinite impulse response filter in which the pixels of the previous frame are weighted by a factor of substantially equal to 0.75, and further wherein the step of applying a light temporal filter includes applying a two-tap infinite impulse response filter in which the pixels of the previous frame are weighted by a factor of substantially equal to 0.5.
-
Specification