De-Blocking Filtering Control

• US 20110194614A1
• Filed: 02/04/2011
• Published: 08/11/2011
• Est. Priority Date: 02/05/2010
• Status: Abandoned Application

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Norkin, Andrey, Andersson, Kenneth, Priddle, Clinton
• Application Number:
  US13/021,012
• Publication Number:
  US 20110194614A1
• Time in Patent Office: Days
• US Class Current: 375/240.24
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

First and second filter decision values are calculated for a pixel block in a video frame. The first filter decision value is representative of how smooth pixel values in a first line of pixels in the block and in a corresponding first line of pixels in a neighboring pixel block in the video frame are in a direction parallel to a filtering direction. The second filter decision value is representative of how close pixel values in a current line of pixels in the block approximate a flat line and how close pixel values in a corresponding current line of pixels in the neighboring block approximate a flat line. The two filter decision values are compared to respective thresholds and a strong de-blocking filter is selected for the current line if the filter decision values are below the thresholds, otherwise a weak de-blocking filter is selected to combat any blocking artifacts.

Claims

1. A filtering control method applicable to a block of multiple pixels in a video frame, each pixel having a respective pixel value, said method comprising:

calculating a first filter decision value for said block representative of how smooth pixel values in a first line of pixels in said block and in a corresponding first line of pixels in a neighboring block of multiple pixels in said video frame are in a direction parallel to a filtering direction;

calculating a second filter decision value for said block representative of how close pixel values in a current line of pixels in said block approximate a flat line and how close pixel values in a corresponding current line of pixels in said neighboring block approximate a flat line;

comparing said first filter decision value with a first threshold and said second filter decision value with a second threshold;

selecting a strong de-blocking filter to filter at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold and said second filter decision value is below said second threshold and otherwise selecting a weak de-blocking filter to filter at least one pixel value in said current line of pixels, wherein said strong de-blocking filter has a comparatively higher filtering strength as compared to said weak de-blocking filter.

2. The method according to claim 1, wherein calculating said second filter decision value comprises calculating said second filter decision value as

|p3_i−

p0_i|+|q0_i−

q3_i|

where p0_i denotes a pixel value of a pixel closest to, in said current line of pixels, a block boundary to said neighboring block, p3_i denotes a pixel value of a pixel third next closest to, in said current line of pixels, said block boundary, q0_i denotes a pixel value of a pixel in said neighboring block closest to, in said corresponding current line of pixels, said block boundary and q3_i denotes a pixel value of a pixel in said neighboring block third next closest to, in said corresponding current line of pixels, said block boundary.

3. The method according to claim 1, wherein calculating said first filter decision value comprises calculating said first filter decision value based on

|p2_j−

2p1_j+p0_j|+|q2_j−

2q1_j+q0_j|

where p0_j denotes a pixel value of a pixel closest to, in said first line of pixels in said block, a block boundary to said neighboring block, p1_j denotes a pixel value of a pixel next closest to, in said first line of pixels, said block boundary, p2_j denotes a pixel value of a pixel second next closest to, in said first line of pixels, said block boundary, q0_j denotes a pixel value of a pixel in said neighboring block closest to, in said corresponding first line of pixels in said neighboring block, said block boundary, q1_j denotes a pixel value of a pixel of said neighboring block next closest to, in said corresponding first line of pixels, said block boundary and q2_j denotes a pixel value of a pixel in said neighboring block second next closest to, in said corresponding first line of pixels, said block boundary.

4. The method according to claim 3, wherein calculating said first filter decision value comprises calculating said first filter decision value as

|p2₂−

2p1₂+p0₂|+|q2₂−

2q1₂+q0₂|+|p2₅−

2p1₅+p0₅|+|q2₅−

2q1₅+q0₅|

where p0₂ denotes said pixel value of said pixel closest to, in said first line of pixels, said block boundary, p1₂ denotes said pixel value of said pixel next closest to, in said first line of pixels, said block boundary, p2₂ denotes said pixel value of said pixel second next closest to, in said first line of pixels, said block boundary, q0₂ denotes said pixel value of said pixel in said neighboring block closest to, in said corresponding first line of pixels, said block boundary, q1_j denotes said pixel value of said pixel of said neighboring block next closest to, in said corresponding first line of pixels, said block boundary, q2₂ denotes said pixel value of said pixel in said neighboring block second next closest to, in said corresponding first line of pixels, said block boundary, p0₅ denotes a pixel value of a pixel closest to, in a second line of pixels in said block, said block boundary, p1₅ denotes a pixel value of a pixel next closest to, in said second line of pixels, said block boundary, p2₅ denotes a pixel value of a pixel second next closest to, in said second line of pixels, said block boundary, q0₅ denotes a pixel value of a pixel in said neighboring block closest to, in a corresponding second line of pixels in said neighboring block, said block boundary, q1₅ denotes a pixel value of a pixel of said neighboring block next closest to, in said corresponding second line of pixels, said block boundary and q2₅ denotes a pixel value of a pixel in said neighboring block second next closest to, in said corresponding first line of pixels, said block boundary.

5. The method according to claim 1, further comprising:

calculating a third filter decision value for said block representative of an absolute difference between a pixel value of a pixel closest to, in said current line of pixels, a block boundary to said neighboring block and a pixel value of a pixel in said neighboring block closest to, in said corresponding current line of pixels, said block boundary, wherein

comparing said first filter decision and said second filter decision comprises comparing said first filter decision value with said first threshold, said second filter decision value with said second threshold and said third filter decision value with a third threshold; and

selecting said strong de-blocking filter comprises selecting said strong de-blocking filter to filter said at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold, said second filter decision value is below said second threshold and said third filter decision value is below said third threshold and otherwise selecting said weak de-blocking filter to filter said at least one pixel value in said current line of pixels.

6. The method according to claim 5, further comprising determining said third threshold based on a quantization parameter selected for residual coding of said block.

7. The method according to claim 6, wherein determining said third threshold comprises determining said third threshold as a₁×

t_c, where t_c is a clipping threshold selected for said block based on said quantization parameter and a₁ is a multiplier selected to prevent selecting said strong de-blocking filter if strong filtering with said strong de-blocking filter modifies said pixel value of said pixel closest to, in said current line of pixels, said block boundary with a value that is larger than a value which weak filtering with said weak de-blocking filter and said clipping threshold will modify said pixel value of said pixel closest to, in said current line of pixels, said block boundary.

8. The method according to claim 6, wherein determining said third threshold comprises determining said third threshold as 2.5t_c, where t_c is a clipping threshold selected for said block based on said quantization parameter.

9. The method according to claim 1, further comprising determining said second threshold to be equal to half said first threshold.

10. The method according to claim 1, further comprising determining said first threshold and said second threshold based on a quantization parameter selected for residual coding of said block.

11. The method according to claim 1, further comprising:

calculating a block-specific decision value for said block representative of how smooth pixel values in said first line of pixels in said block and in said corresponding first line of pixels in said neighboring block of multiple pixels are in a direction parallel to said filtering direction and how smooth pixel values in a second line of pixels in said block and in a corresponding second line of pixels in said neighboring block of multiple pixels are in a direction parallel to said filtering direction; and

selecting to apply de-blocking filtering to said block if said block-specific decision value is below a block-specific threshold.

12. The method according to claim 11, further comprising:

determining said block-specific threshold based on a quantization parameter selected for residual coding of said block;

determining said first threshold to be equal to one fourth of said block-specific threshold; and

determining said second threshold to be equal to one eighth of said block-specific threshold.

13. The method according to claim 1, further comprising:

filtering pixel values in said current line of pixels with a weak de-blocking filter having filter taps [2 4 1 1]/8 if at least one of said first filter decision value is not below said first threshold and said second filter decision value is not below said second threshold, to thereby get a delta value; and

adding said delta value to a pixel value of a pixel closest to, in said current line of pixels, a block boundary to said neighboring block.

14. The method according to claim 1, further comprising:

calculating another second filter decision value for said block representative of how close pixel values in another current line of pixels in said block approximate a flat line and how close pixel values in another corresponding current line of pixels in said neighboring block approximate a flat line;

comparing said first filter decision value with said first threshold and said another second filter decision value with said second threshold; and

selecting said strong de-blocking filter to filter at least one pixel value in said another current line of pixels if said first filter decision value is below said first threshold and said another second filter decision value is below said second threshold and otherwise selecting said weak de-blocking filter to filter at least one pixel value in said another current line of pixels.

15. A filtering control device comprising:

a first decision value calculator configured to calculate a first filter decision value for a block of multiple pixels in a video frame, each pixel having a respective pixel value, said first filter decision value representative of how smooth pixel values in a first line of pixels in said block and in a corresponding first line of pixels in a neighboring block of multiple pixels in said video frame are in a direction parallel to a filtering direction;

a second decision value calculator configured to calculate a second filter decision value for said block representative of how close pixel values in a current line of pixels in said block approximate a flat line and how close pixel values in a corresponding current line of pixels in said neighboring block approximate a flat line;

a first threshold comparator configured to compare said first filter decision value calculated by said first decision value calculator to a first threshold;

a second threshold comparator configured to compare said second filter decision value calculated by said second decision value calculator to a second threshold; and

a filter selector configured to select a strong de-blocking filter to filter at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold, as determined by said first filter threshold comparator, and said second filter decision value is below said second threshold, as determined by said second threshold comparator, and to otherwise select a weak de-blocking filter to filter at least one pixel value in said current line of pixels, wherein said strong de-blocking filter has a comparatively higher filtering strength as compared to said weak de-blocking filter.

16. The device according to claim 15, wherein said second decision value calculator is configured to calculate said second filter decision value as

|p3_i−

p0_i|+|q0_i−

q3_i|

where p0_i denotes a pixel value of a pixel closest to, in said current line of pixels, a block boundary to said neighboring block, p3_i denotes a pixel value of a pixel third next closest to, in said current line of pixels, said block boundary, q0_i denotes a pixel value of a pixel in said neighboring block closest to, in said corresponding current line of pixels, said block boundary and q3_i denotes a pixel value of a pixel in said neighboring block third next closest to, in said corresponding current line of pixels, said block boundary.

17. The device according to claim 15, wherein said first decision value calculator is configured to calculate said first filter decision value based on

|p2_j−

2p1_j+p0_j|+|q2_j−

2q1_j+q0_j|

where p0_j denotes a pixel value of a pixel closest to, in said first line of pixels in said block, a block boundary to said neighboring block, p1_j denotes a pixel value of a pixel next closest to, in said first line of pixels, said block boundary, p2_j denotes a pixel value of a pixel second next closest to, in said first line of pixels, said block boundary, q0_j denotes a pixel value of a pixel in said neighboring block closest to, in said corresponding first line of pixels in said neighboring block, said block boundary, q1_j denotes a pixel value of a pixel of said neighboring block next closest to, in said corresponding first line of pixels, said block boundary and q2_j denotes a pixel value of a pixel in said neighboring block second next closest to, in said corresponding first line of pixels, said block boundary.

18. The device according to claim 17, wherein said first decision value calculator is configured to calculate said first filter decision value as

|p2₂−

2p1₂+p0₂|+|q2₂−

2q1₂+q0₂|+|p2₅−

2p1₅+p0₅|+|q2₅−

2q1₅+q0₅|

where p0₂ denotes said pixel value of said pixel closest to, in said first line of pixels, said block boundary, p1₂ denotes said pixel value of said pixel next closest to, in said first line of pixels, said block boundary, p2₂ denotes said pixel value of said pixel second next closest to, in said first line of pixels, said block boundary, q0₂ denotes said pixel value of said pixel in said neighboring block closest to, in said corresponding first line of pixels, said block boundary, q1_j denotes said pixel value of said pixel of said neighboring block next closest to, in said corresponding first line of pixels, said block boundary, q2₂ denotes said pixel value of said pixel in said neighboring block second next closest to, in said corresponding first line of pixels, said block boundary, p0₅ denotes a pixel value of a pixel closest to, in a second line of pixels in said block, said block boundary, p1₅ denotes a pixel value of a pixel next closest to, in said second line of pixels, said block boundary, p2₅ denotes a pixel value of a pixel second next closest to, in said second line of pixels, said block boundary, q0₅ denotes a pixel value of a pixel in said neighboring block closest to, in a corresponding second line of pixels in said neighboring block, said block boundary, q1₅ denotes a pixel value of a pixel of said neighboring block next closest to, in said corresponding second line of pixels, said block boundary and q2₅ denotes a pixel value of a pixel in said neighboring block second next closest to, in said corresponding first line of pixels, said block boundary.

19. The device according to claim 15, further comprising:

a third decision value calculator configured to calculate a third filter decision value for said block representative of an absolute difference between a pixel value of a pixel closest to, in said current line of pixels, a block boundary to said neighboring block and a pixel value of a pixel in said neighboring block closest to, in said corresponding current line of pixels, said block boundary; and

a third threshold comparator configured to compare said third filter decision value calculated by said third decision value calculator with a third threshold;

wherein said filter selector is configured to select said strong de-blocking filter to filter said at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold as determined by said first threshold value comparator, said second filter decision value is below said second threshold as determined by said second threshold value comparator and said third filter decision value is below said third threshold as determined by said third threshold value comparator, and to otherwise select said weak de-blocking filter to filter said at least one pixel value in said current line of pixels.

20. The device according to claim 19, further comprising a threshold determiner configured to determine said third threshold based on a quantization parameter selected for residual coding of said block.

21. The device according to claim 20, wherein said threshold determiner is configured to determine said third threshold as a₁×

t_c, where t_c is a clipping threshold selected for said block based on said quantization parameter and a₁ is a multiplier selected to prevent selecting said strong de-blocking filter if strong filtering with said strong de-blocking filter modifies said pixel value of said pixel closest to, in said current line of pixels, said block boundary with a value that is larger than a value which weak filtering with said weak de-blocking filter and said clipping threshold will modify said pixel value of said pixel closest to, in said current line of pixels, said block boundary.

22. The device according to claim 20, wherein said threshold determiner is configured to determine said third threshold as 2.5t_c, where t_c is a clipping threshold selected for said block based on said quantization parameter

23. The device according to claim 15, further comprising a threshold determiner configured to determine said second threshold to be equal to half said first threshold.

24. The device according to claim 15, further comprising a threshold determiner configured to determine said first threshold and said second threshold based on a quantization parameter selected for residual coding of said block.

25. The device according to claim 15, further comprising:

a block decision value calculator configured to calculate a block-specific decision value for said block representative of how smooth pixel values in said first line of pixels in said block and in said corresponding first line of pixels in said neighboring block of multiple pixels are in a direction parallel to said filtering direction and how smooth pixel values in a second line of pixels in said block and in a corresponding second line of pixels in said neighboring block of multiple pixels are in a direction parallel to said filtering direction;

a block threshold comparator configured to compare said block-specific decision value calculated by said block decision value calculator with a block-specific threshold; and

a filtering selector configured to select to apply de-blocking filtering to said block if said block-specific decision value is below said block-specific threshold as determined by said block threshold comparator.

26. The device according to claim 25, further comprising a threshold determiner configured to i) determine said block-specific threshold based on a quantization parameter selected for residual coding of said block, ii) determine said first threshold to be equal to one fourth of said block-specific threshold, and iii) determine said second threshold to be equal to one eighth of said block-specific threshold.

27. The device according to claim 15, further comprising:

a filtering device configured to filter pixel values in said current line of pixels with a weak de-blocking filter having filter taps [2 4 1 1]/8 if at least one of said first filter decision value is not below said first threshold as determined by said first threshold comparator and said second filter decision value is not below said second threshold as determined by said second threshold comparator, to thereby get a delta value; and

a value adder configured to add said delta value to a pixel value of a pixel closest to, in said current line of pixels, a block boundary to said neighboring block.

28. The device according to claim 15, wherein:

said second decision value calculator is configured to calculate another second filter decision value for said block representative of how close pixel values in another current line of pixels in said block approximate a flat line and how close pixel values in another corresponding current line of pixels in said neighboring block approximate a flat line;

said second threshold comparator is configured to compare said another second filter decision value calculated by said second decision value calculator to said second threshold; and

said filter selector is configured to select said strong de-blocking filter to filter at least one pixel value in said another current line of pixels if said first filter decision value is below said first threshold as determined by said first threshold comparator and said another second filter decision value is below said second threshold as determined by said second threshold comparator and otherwise select said weak de-blocking filter to filter at least one pixel value in said another current line of pixels.

29. The device according to claim 15, wherein said first filter decision value is representative of how close pixel values in said block approximate a plane and how close pixel values in a neighboring block of multiple pixels in said video frame approximate a plane;

30. An encoder comprising a filtering control device, the filtering control device comprising:

a first decision value calculator configured to calculate a first filter decision value for a block of multiple pixels in a video frame, each pixel having a respective pixel value, said first filter decision value representative of how smooth pixel values in a first line of pixels in said block and in a corresponding first line of pixels in a neighboring block of multiple pixels in said video frame are in a direction parallel to a filtering direction;

a second decision value calculator configured to calculate a second filter decision value for said block representative of how close pixel values in a current line of pixels in said block approximate a flat line and how close pixel values in a corresponding current line of pixels in said neighboring block approximate a flat line;

a first threshold comparator configured to compare said first filter decision value calculated by said first decision value calculator to a first threshold;

a second threshold comparator configured to compare said second filter decision value calculated by said second decision value calculator to a second threshold; and

a filter selector configured to select a strong de-blocking filter to filter at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold, as determined by said first filter threshold comparator, and said second filter decision value is below said second threshold, as determined by said second threshold comparator, and to otherwise select a weak de-blocking filter to filter at least one pixel value in said current line of pixels, wherein said strong de-blocking filter has a comparatively higher filtering strength as compared to said weak de-blocking filter.

31. A decoder comprising a filtering control device, the filtering control device comprising:

a first decision value calculator configured to calculate a first filter decision value for a block of multiple pixels in a video frame, each pixel having a respective pixel value, said first filter decision value representative of how smooth pixel values in a first line of pixels in said block and in a corresponding first line of pixels in a neighboring block of multiple pixels in said video frame are in a direction parallel to a filtering direction;

a second decision value calculator configured to calculate a second filter decision value for said block representative of how close pixel values in a current line of pixels in said block approximate a flat line and how close pixel values in a corresponding current line of pixels in said neighboring block approximate a flat line;

a first threshold comparator configured to compare said first filter decision value calculated by said first decision value calculator to a first threshold;

a second threshold comparator configured to compare said second filter decision value calculated by said second decision value calculator to a second threshold; and

a filter selector configured to select a strong de-blocking filter to filter at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold, as determined by said first filter threshold comparator, and said second filter decision value is below said second threshold, as determined by said second threshold comparator, and to otherwise select a weak de-blocking filter to filter at least one pixel value in said current line of pixels, wherein said strong de-blocking filter has a comparatively higher filtering strength as compared to said weak de-blocking filter.

32. A media terminal comprising:

a memory configured to store encoded video frames;

a decoder configured to decode said encoded video frames into decoded video frames, said decoder including a filtering control device, the filtering control device comprising;

a first decision value calculator configured to calculate a first filter decision value for a block of multiple pixels in a video frame, each pixel having a respective pixel value, said first filter decision value representative of how smooth pixel values in a first line of pixels in said block and in a corresponding first line of pixels in a neighboring block of multiple pixels in said video frame are in a direction parallel to a filtering direction;

a second decision value calculator configured to calculate a second filter decision value for said block representative of how close pixel values in a current line of pixels in said block approximate a flat line and how close pixel values in a corresponding current line of pixels in said neighboring block approximate a flat line;

a first threshold comparator configured to compare said first filter decision value calculated by said first decision value calculator to a first threshold;

a second threshold comparator configured to compare said second filter decision value calculated by said second decision value calculator to a second threshold; and

a filter selector configured to select a strong de-blocking filter to filter at least one pixel value in said current line of pixels if said first filter decision value is below said first threshold, as determined by said first filter threshold comparator, and said second filter decision value is below said second threshold, as determined by said second threshold comparator, and to otherwise select a weak de-blocking filter to filter at least one pixel value in said current line of pixels, wherein said strong de-blocking filter has a comparatively higher filtering strength as compared to said weak de-blocking filter.

a media player configured to render said decoded video frames into video data displayable on a display.