IMAGE PROCESSING APPARATUS AND METHOD FOR REDUCING EDGE-INDUCED ARTEFACTS

• US 20130022288A1
• Filed: 07/09/2012
• Published: 01/24/2013
• Est. Priority Date: 07/20/2011
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: SARTOR, Piergiorgio, MICHIELIN, Francesco
• Application Number:
  US13/544,507
• Publication Number:
  US 20130022288A1
• Time in Patent Office: Days
• US Class Current: 382/266
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20064 Wavelet transform [DWT]
• CPC Class Codes: G06T 5/10 using non-spatial domain filtering
• CPC Class Codes: G06T 5/70 Denoising; Smoothing

Abstract

The present invention relates to image processing. A wavelet decomposition unit (110) applies a wavelet decomposition on an image or video data signal and generates approximation and detail signals. A discontinuity detection unit (120) detects discontinuities like block boundaries and/or image contour lines in an evaluation signal selected from the approximation and detail signals. An artefact reduction unit (140) reduces edge-induced artefacts by equalizing pixel values in image areas identified by the detected discontinuities in one or more of the approximation and detail signals to obtain at least one corrected approximation or detail signal. The corrected approximation and detail signals support a reconstruction of the image data signal, wherein the reconstructed image shows reduced blocking and ringing artefacts.

Claims

1. An image processing unit (100) comprising

a wavelet decomposition unit (110) configured to apply a wavelet decomposition on an input data signal descriptive for an image, wherein at least one approximation and at least one detail signal are generated;

a discontinuity detection unit (120) configured to detect discontinuities in at least one evaluation signal selected from the approximation and detail signals, the discontinuities comprising image edges and block boundaries; and

an artefact reduction unit (140) configured to reduce edge-induced artefacts by equalizing pixel values in image areas identified by the detected discontinuities in at least one of the approximation and detail signals to obtain at least one corrected approximation or detail signal.

2. The image processing unit according to claim 1, further comprising

a wavelet composition unit (190) configured to combine the at least one corrected approximation or detail signal and further approximation and/or detail signals output by the wavelet decomposition unit (110) to generate an output data signal.

3. The image processing unit according to claim 1, wherein

the discontinuity detection unit (120) comprises a block detection unit (121) configured to identify block boundaries in a first evaluation signal of the at least one evaluation signals, wherein the first evaluation signal is a detail signal, the block detection unit (121) configured to scan for correlations between areas of high activity.

4. The image processing unit according to claim 3, wherein

the block detection unit (121) is configured to identify block boundaries within single macro-blocks independently from other macro-blocks.

5. The image processing unit according to claim 3, wherein

the artefact reduction unit (140) comprises a de-blocking unit (141) configured to equalize energy at the detected block boundaries with energy of neighbouring areas of at least one of the detail and approximation signals to obtain a de-blocked detail or approximation signal, wherein blocking artefacts in a vicinity to the detected block boundaries are reduced.

6. The image processing unit according to claim 5, wherein

the de-blocking unit (141) is configured to equalize the energy of a detected block boundary with the energy of two directly neighbouring areas that are arranged in directions perpendicular to the detected block boundary.

7. The image processing unit according to claim 1, wherein

the discontinuity detection unit (120) comprises an image edge detection unit (125) configured to detect image edges in a second evaluation signal of the at least one evaluation signal, the image edge detection unit (125) comprising a differentiator unit (126) configured to obtain a gradient map from the image and an adaptive threshold unit (127) configured to apply a position- and activity-dependent threshold to the gradient map to obtain a binary edge map of the image.

8. The image processing unit according to claim 7, wherein

the second evaluation signal is an approximation signal.

9. The image processing unit according to claim 7, wherein

the image edge detection unit (125) comprises a hysteresis unit (128) configured to evaluate edges in the binary edge map output by the threshold unit (127) by scanning entries in the gradient map adjoining to detected edges with a lowered threshold.

10. The image processing unit according to claim 7, wherein

the artefact reduction unit (140) comprises a de-ringing unit (145) configured to receive the binary edge map and to apply an equalization scheme equalizing energy in a first sub-area adjoining to a first side of an edge identified by the edge map using reference sub-areas arranged at the first side and adjoining to the first sub-area.

11. The image processing unit according to claim 10, wherein

the de-ringing unit (145) is configured to equalize energy in the first sub-area using reference sub-areas arranged at the first side, adjoining to both the first sub-area and the edge.

12. The image processing unit according to claim 10, wherein

the sub-areas correspond to blocks of 8×

8 pixel.

13. The image processing unit according to claim 1, wherein

the approximation and detail signals correspond to frequency bands of a wavelet package decomposition.

14. The image processing unit according to claim 1, wherein

the artefact reduction unit (140) is configured to determine an energy of an area by determining the sum of the absolute values of the pixel values of the respective area, the sum of the square values of the pixel values of the respective area, or the sum of the absolute differences of consecutive pixel pairs with or without mean values of neighbouring areas added.

15. A method of operating an image processing unit, the method comprising

decomposing, by a wavelet decomposition scheme, an input data signal descriptive for an image into at least one approximation and one detail signal,

detecting discontinuities in at least one evaluation signal selected from the approximation and detail signals, and

equalizing energy of areas identified by the detected discontinuities with energy of neighbouring areas to obtain at least one corrected detail or approximation signal.

16. The method of claim 15, further comprising

composing the at least one corrected approximation or detail signal and further approximation and/or detail signals obtained by the wavelet decomposition to generate an output data signal.

17. The method of claim 15, wherein

the approximation and detail signals correspond to frequency bands of a wavelet package decomposition.

18. A computer program comprising program code means for causing a computer to perform the steps of said method as claimed in claim 15 when the computer program is carried out on a computer.

19. A computer readable, non-transitory medium having instructions stored thereon which, when carried out on a computer, cause the computer to perform the method as claimed in claim 15.