METHOD AND APPARATUS FOR REMOVING IMAGE NOISE

• US 20110002552A1
• Filed: 11/26/2008
• Published: 01/06/2011
• Est. Priority Date: 11/30/2007
• Status: Active Grant

• Current Assignee: Trustees Of Columbia University In The City Of New York (Columbia University)
• Original Assignee: Kyoto University
• Inventors: Kobayashi, Akira, Yamamoto, Yutaka, Nagahara, Masaaki
• Granted Patent: US 8,611,680 B2
• Time in Patent Office: Days
• US Class Current: 382/233
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

An FFT analysis is performed to the image data of one frame which has been decoded, and a cutoff frequency on the assumption that the original signal has first-order attenuation characteristics is obtained each in the horizontal direction and in the vertical direction. A sampled-data H^∞ filter (digital filter) which has been previously designed in such a manner as to have different parameters corresponding to different cutoff frequencies is selected. By using this filter, a filtering process is performed to the image data which has been decoded both in the horizontal direction and in the vertical direction. Since the variety of the analog frequency characteristics of the original image is taken into account for every frame of image, the information that seems to be a noise yet actually exists in the original image is less likely to be removed, and a mosquito noise and block noise associated with a coding/decoding process can be efficiently removed.

Claims

1. A method for removing an image noise which is generated when image data which have been compression-encoded in a given format are decoded to reproduce an image, comprising:

a) a deduction step for examining a digital frequency response of image data which compose an image of a complete image or a frame of image and have been compression-encoded/decoded, to deduce analog frequency characteristics of the image before compression encoding;

b) a parameter setting step for changing a parameter of a below-mentioned digital filter in accordance with a deduction result by the deduction step; and

c) a processing step for performing a filtering process to the image data after they are decoded and before they are digital/analog converted by using a sampled-data H^∞

filter having a parameter calculated by solving a computational equation with H^∞

control under a predetermined condition or with a rigorous calculation which corresponds to the H^∞

control, the computational equation being obtained by approximately converting a conditional equation to a finite-dimensional discrete-time system, and the conditional equation being set to design the digital filter so as to reduce an error between an original analog image signal and an analog image signal obtained through an analog/digital conversion, coding/decoding, and digital/analog conversion.

2. The method for removing an image noise according to claim 1, wherein:

the filtering process in the processing step is performed to each of image data aligned in a horizontal direction and image data aligned in a vertical direction of an image of a complete image or a frame of image.

3. The method for removing an image noise according to claim 1, wherein:

in the deduction step, an image of a complete image or a frame of image is sectionalized into small areas in each of which the analog frequency characteristics in the image before compression encoding can be considered to be similar and the analog frequency characteristics are deduced for each of the small areas; and

in the parameter setting step, the parameter of the digital filter is changed for each of the small areas.

4. The method for removing an image noise according to claim 3, wherein:

in the deduction step, image data of an image of a complete image or a frame of image aligned in a horizontal direction or in a vertical direction are sequentially scanned, and a boundary of the small areas is defined where a variation of a value of the data is equal to or more than a predetermined threshold.

5. The method for removing an image noise according to claim 1, wherein:

in the deduction step, a cutoff frequency is calculated on an assumption that the analog frequency characteristics in the image before compression encoding are a lowpass filter having attenuation characteristics of a given order.

6. The method for removing an image noise according to claim 5, wherein the given order is a first order.

7. The method for removing an image noise according to claim 1, wherein:

in the processing step, the sampled-data H^∞

filter is combined with an ε

-separating nonlinear filter.

8. The method for removing an image noise according to claim 1, wherein a processing object is a still image which is compression-encoded in JPEG format.

9. The method for removing an image noise according to claim 1, wherein a processing object is a moving image which is compression-encoded in MPEG format.

19. The method for removing an image noise according to claim 3, wherein:

in the deduction step, a cutoff frequency is calculated on an assumption that the analog frequency characteristics in the image before compression encoding are a lowpass filter having attenuation characteristics of a given order.

10. An apparatus for removing an image noise which is generated when image data which have been compression-encoded in a given format are decoded to reproduce an image, comprising:

a) a deduction means for examining a digital frequency response of image data which compose an image of a complete image or a frame of image and have been compression-encoded/decoded, to deduce analog frequency characteristics of the image before compression encoding;

b) a parameter setting means for changing a parameter of a below-mentioned digital filter in accordance with a deduction result by the deduction means; and

c) a processing means for performing a filtering process to the image data after they are decoded and before they are digital/analog converted by using a sampled-data H^∞

filter having a parameter calculated by solving a computational equation with H^∞

control under a predetermined condition or with a rigorous calculation which corresponds to the H^∞

control, the computational equation being obtained by approximately converting a conditional equation to a finite-dimensional discrete-time system, and the conditional equation being set to design the digital filter so as to reduce an error between an original analog image signal and an analog image signal obtained through an analog/digital conversion, coding/decoding, and digital/analog conversion.

11. The apparatus for removing an image noise according to claim 10, wherein:

the processing means performs the filtering process to each of image data aligned in a horizontal direction and image data aligned in a vertical direction of an image of a complete image or a frame of image.

12. The apparatus for removing an image noise according to claim 10, wherein:

the deduction means sectionalizes an image of a complete image or a frame of image into small areas in each of which the analog frequency characteristics in the image before compression encoding can be considered to be similar and deduces the analog frequency characteristics for each of the small areas; and

the parameter setting means changes the parameter of the digital filter for each of the small areas.

13. The apparatus for removing an image noise according to claim 12, wherein:

the deduction means sequentially scans image data of an image of a complete image or a frame of image aligned in a horizontal direction or in a vertical direction, and a boundary of the small areas is defined where a variation of a value of the data is equal to or more than a predetermined threshold.

14. The apparatus for removing an image noise according to claim 10, wherein:

the deduction means calculates a cutoff frequency on an assumption that the analog frequency characteristics in the image before compression encoding are a lowpass filter having attenuation characteristics of a given order.

15. The apparatus for removing an image noise according to claim 14, wherein the given order is a first order.

16. The apparatus for removing an image noise according to claim 10, wherein:

the processing means combines the sampled-data H^∞

filter with an ε

-separating nonlinear filter.

17. The apparatus for removing an image noise according to claim 10, wherein a processing object is a still image which is compression-encoded in JPEG format.

18. The apparatus for removing an image noise according to claim 10, wherein a processing object is a moving image which is compression-encoded in MPEG format.

20. The apparatus for removing an image noise according to claim 12, wherein:

the deduction means calculates a cutoff frequency on an assumption that the analog frequency characteristics in the image before compression encoding are a lowpass filter having attenuation characteristics of a given order.