Spatio-temporal noise filter for digital video

• US 20070098086A1
• Filed: 10/28/2005
• Published: 05/03/2007
• Est. Priority Date: 10/28/2005
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Bhaskaran, Vasudev
• Application Number:
  US11/261,042
• Publication Number:
  US 20070098086A1
• Time in Patent Office: Days
• US Class Current: 375/240.27
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20182 Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence

Abstract

A three-dimensional filter that addresses various types of noise is described. This filter uses both spatial and temporal characteristics of the video signal in the filtering process. Additionally, the filter is able to maintain edge fidelity within in images in the video signal.

Claims

1. A method for reducing noise in a digital video, the method comprising:

selecting a plurality of pixels, which span multiple video frames, and identifying a target pixel associated with the plurality of pixels;

sorting the plurality of pixels according to each pixel'"'"'s intensity distance from the target pixel;

assigning each pixel, within the sorted plurality of pixels, a weighted coefficient according to its relative intensity distance from the target pixel, wherein the values of the weighted coefficients decrease as the pixel intensity distances increase;

generating a filter according to the assigned weighted coefficients and pixel values of the plurality of pixels; and

applying the filter to the target pixel.

2. The method of claim 1 wherein the plurality of pixels is selected along a motion trajectory within the multiple video frames.

3. The method of claim 1 wherein the filter is generated using an alpha trimmed filter.

4. The method of claim 1 further comprising the step of reducing the number of pixels within the sorted plurality of pixels, prior to identifying a filtered value for the target pixel, according to a threshold resulting in the removal of a set of pixels having a relatively higher intensity distance from the target pixel.

5. The method of claim 4 wherein the sorted plurality of pixels is reduced to a number that is a factor of two.

6. The method of claim 1 wherein the weighted coefficients are a set of exponentially decaying values.

7. A medium or waveform containing program instructions adapted to direct the performance of the method of claim 1.

8. A spatio-temporal filter for reducing noise on a video signal, the filter comprising:

a pixel selector, coupled to receive the video signal, that selects a plurality of pixels spanning multiple frames within the video signal and associates the plurality of pixels with a target pixel;

a pixel sorting engine, coupled to receive the selected plurality of pixels, that sorts the plurality of pixels according to each pixel'"'"'s intensity distance from the target pixel; and

a filter, coupled to receive the sorted plurality of pixels, that assigns a weight coefficient for each of the pixels within the sorted plurality of pixels and generates a filter for the target pixel.

9. The filter of claim 8 further comprising a threshold application module, coupled to access the sorted plurality of pixels, that reduces the number of pixels within the sorted plurality of pixels according to each pixel'"'"'s intensity distance from the target pixel.

10. The filter of claim 9 wherein the threshold application module reduces the number of pixels within the sorted plurality of pixels to a number that is a power of two.

11. The filter of claim 8 wherein the plurality of pixels is selected according to a motion trajectory through the multiple frames within the video signal.

12. The filter of claim 11 wherein the target pixel is located in the center of a pixel block having a subset of pixels within the selected plurality of pixels.

13. A method for reducing noise within a digital video frame, the method comprising:

selecting a plurality of pixels, which span multiple video frames, and associating the target pixel with the plurality of pixels;

sorting the plurality of pixels according to a pixel characteristic relative to a target pixel;

assigning each pixel, within the sorted plurality of pixels, a weighted coefficient according to its relative importance to the target pixel;

generating a filter according to the assigned weighted coefficients and pixel values of the plurality of pixels; and

applying the filter to the target pixel.

14. The method of claim 13 wherein the pixel characteristic is pixel intensity distance from the target pixel.

15. The method of claim 13 wherein the plurality of pixels is selected along a motion trajectory through the multiple video frames.

16. The method of claim 15 wherein the plurality of pixels is selected according to at least one motion vector embedded within the video signal.

17. The method of claim 13 wherein the plurality of pixels are sorted into a one dimensional array of pixels.

18. The method of claim 13 further comprising the step of reducing the number of pixels within the sorted plurality of pixels, prior to generating the filter, according to a threshold resulting in the removal of a set of pixels that are less relevant to the target pixel.

19. The method of claim 18 wherein the number of pixels within the sorted plurality of pixels is a power of two after the threshold is applied.

20. A medium or waveform containing program instructions adapted to direct the performance of the method of claim 13.