Dynamic pre-filter control with subjective noise detector for video compression

• US 7,787,541 B2
• Filed: 10/05/2005
• Issued: 08/31/2010
• Est. Priority Date: 10/05/2005
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Osamoto, Akira, Koshiba, Osamu
• Primary Examiner(s): PERUNGAVOOR, SATHYANARAYA V
• Application Number:
  US11/244,264
• Publication Number:
  US 20070076803A1
• Time in Patent Office: 1,791 Days
• Field of Search: 375/240.29
• US Class Current: 375/240.29
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression

Abstract

Pre filtering is commonly used in video encoding to remove undesirable noise from video sources. Without a pre filter, the noise degrades the performance of a video encoder by wasting a number of bits to represent the noise itself, and by introducing encoding artifacts such as blocking and ringing noise. However, excess use of pre filtering will degrade subjective visual quality. This invention employs an automatic pre filter control using a subjective noise detector capable of measuring noise that strongly correlates to subjective video quality.

Claims

1. A computer-implemented method of filtering a digital video signal comprising the steps of:

applying a low pass filter with an adjustable cut-off frequency to the digital video signal;

encoding the output of the said filter;

generating a locally decoded video image as part of the encoding process;

applying a subjective noise detector to the locally generated video image wherein said detector consists of one or more noise filters, and calculates the sum of the absolute differences between the locally generated video image and the output of the said filters;

applying a pre filter controller to the output of the subjective noise detector wherein said controller compares the output of the subjective noise detector with a predetermined threshold with the difference being an error signal employed to adjust the cut-off frequency of the adjustable low pass filter.

2. The method of claim 1, wherein:

said adjustable low pass filter is comprised of a plurality of individual filters with differing cut-off frequencies.

3. The method of claim 1, wherein:

said pre filter controller maps the continuous error signal into control signals to select the appropriate discrete filter.

4. The method of claim 1, wherein:

said pre filter controller introduces a controlled amount of hysteresis into the mapping function to eliminate hunting near the threshold.

5. The method of claim 1, wherein:

said subjective noise detector consists of one or more noise filters wherein each filter is optimized to recognize a particular type of video artifact.

6. The method of claim 1, wherein:

Said subjective noise detector consists of one or more noise filters wherein each filter is optimized to recognize blocking noise, ringing noise or mosquito noise.

7. A digital video apparatus comprising:

A source of a digital video signal;

A digital signal processor connected to said source of a digital video signal programmed to perform filtering on the digital video signal by

applying a low pass filter with an adjustable cut-off frequency to the digital video signal;

encoding the output of the said filter;

generating a locally decoded video image as part of the encoding process;

applying a subjective noise detector to the locally generated video image wherein said detector consists of one or more noise filters, and calculates the sum of the absolute differences between the locally generated video image and the output of the said filters;

applying a pre filter controller to the output of the subjective noise decoder wherein said controller compares the output of the subjective noise detector with a predetermined threshold with the difference being an error signal employed to adjust the cut-off frequency of the adjustable low pass filter; and

an output device connected to the digital signal processor for outputting the filtered digital video signal.

8. The digital video apparatus of claim 7, wherein:

said digital signal processor is programmed to apply an adjustable low pass filter that is comprised of a plurality of individual filters with differing cut-off frequencies.

9. The digital video apparatus of claim 7, wherein:

said digital signal processor is programmed to map the continuous error signal into control signals to select the appropriate discrete filter.

10. The digital video apparatus of claim 7, wherein:

said digital signal processor is programmed to introduce a controlled amount of hysteresis into the mapping function to eliminate hunting near the threshold.

11. The digital video apparatus of claim 7, wherein:

said digital signal processor is programmed to apply said subjective noise detector consisting of one or more noise filters wherein each filter is optimized to recognize a particular type of video artifact.

12. The digital video apparatus of claim 7, wherein:

said digital signal processor is programmed to apply said subjective noise detector consisting of one or more noise filters wherein each filter is optimized to recognize blocking noise, ringing noise or mosquito noise.