Method and associated device for filtering digital video images

• US 9,800,891 B2
• Filed: 01/19/2001
• Issued: 10/24/2017
• Est. Priority Date: 01/20/2000
• Status: Expired due to Fees

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Kalevo, Ossi, Aksu, Emre, Karczewicz, Marta
• Primary Examiner(s): Lee, Young
• Application Number:
  US97/660,35
• Time in Patent Office: 6,122 Days
• Field of Search: 37524024-24027, 37524029, 37524001, 37524008, 3484251-4252, 3484201, 348241, 348245-246, 348252, 348533, 348606-608, 348620, 348625, 348627-630, 382254-275
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

A method for reducing visual artifacts in a frame of a digital video signal, which is coded by blocks and then decoded, includes defining a block type is according to the coding method for a block selected according to a predetermined set of coding types. In the method filtering is performed to reduce visual artifacts due to a block boundary The filtering performed depends on block types of the frame in the environment of the block boundary.

Claims

1. A method, comprising:

decoding a first encoded image block, which has been encoded using a first type of prediction encoding method, and a second encoded image block, which has been encoded using a second type of prediction encoding method, in accordance with their respective prediction encoding methods to form a first decoded image block and a second decoded image block, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least;

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, a block boundary being formed between the first and second decoded image blocks, the first decoded image block being on a first side of the block boundary, the second decoded image block being on a second side of the block boundary;

providing information on the first and second prediction encoding methods to a block boundary filter; and

performing, by the block boundary filter, an adaptive block boundary filtering operation on the block boundary formed between the first decoded image block on the first side of the block boundary and the second decoded image block on the second side of the block boundary, the method further comprising;

determining, by the block boundary filter, a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary as a parameter of the adaptive block boundary filtering operation, based on the types of the first and the second prediction encoding methods.

2. A method according to claim 1, wherein the adaptive block boundary filtering operation performed on the block boundary by the block boundary filter is dependent at least in part on a region type of an image block on a first side of the block boundary and a region type of an image block on a second side of the block boundary.

3. A method according to claim 1, wherein the number of pixels selected for examination depends on a difference in pixel value between pixels across the block boundary.

4. A method according to claim 1, wherein the number of pixels selected for examination depends on the size of a quantization step used to quantize coefficients used in encoding the image blocks.

5. A method according to claim 1, comprising selecting certain pixels to be filtered and determining a new value for each pixel to be filtered on the basis of pixels that appear in a filtering window set around the pixel.

6. A method according to claim 5, wherein the new value of the pixel is the mean value of the pixels that appear in the filtering window.

7. A method according to claim 1, comprising selecting pixels to be filtered from the pixels selected for examination.

8. A method according to claim 1, wherein the first and second prediction encoding methods are of the same type.

9. A digital signal processor configured to perform a method for reducing visual artefacts due to block boundaries according to claim 1.

10. A block boundary filter configured to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, the block boundary filter being configured to receive information on the types of the first and second prediction encoding methods, and to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary as a parameter of the adaptive block boundary filtering operation, based on the types of the first and the second prediction encoding methods.

11. A block boundary filter according to claim 10, configured to perform said adaptive block boundary filtering operation on the block boundary in dependence at least in part on a region type of an image block on a first side of the block boundary and a region type of an image block on a second side of the block boundary.

12. A block boundary filter according to claim 10, further configured to select said number of pixels for examination in dependence on the difference in pixel value between pixels across the block boundary.

13. A block boundary filter according to claim 10, wherein the filter is configured to select a number of pixels for examination in dependence on the size of a quantization step used to quantize coefficients used in encoding the image blocks.

14. A block boundary filter according to claim 10, wherein the filter is configured to select certain pixels to be filtered and to determine a new value for each pixel to be filtered on the basis of pixels that appear in a filtering window set around the pixel.

15. A block boundary filter according to claim 14, wherein the filter is configured to calculate the new value for each pixel to be filtered as a mean value of the pixels that appear in the filtering window.

16. A block boundary filter according to claim 10, wherein the first and second prediction encoding methods are of the same type.

17. A video encoder comprising a coding block, a decoding block and a prediction block for prediction encoding a frame of a digital video signal by blocks, the video encoder comprising a block boundary filter for reducing visual artifacts due to a block boundary between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the block boundary filter is configured to receive information on the selected type of the first prediction encoding method and the selected type of the second prediction encoding method and to operate adaptively according to the block types of the frame in the environment of the block boundary to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the filtering operation, based on the selected types of the first and second prediction encoding method.

18. A video decoder comprising a decoding block and a prediction block for decoding a frame of a digital video signal by blocks, the video decoder comprising a block boundary filter for reducing visual artifacts due to a block boundary between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the block boundary filter is configured to receive information on the selected type of the first prediction encoding method and the selected type of the second prediction encoding method, and to operate adaptively according to the block types of the frame in the environment of the block boundary to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the filtering operation, based on the selected types of the first and second prediction encoding method.

19. A video codec comprising a coding block, a decoding block and a prediction block for prediction encoding a frame of a digital video signal by blocks, a block type being defined according to the prediction encoding method for a block selected according to a predetermined set of coding types, the video codec comprising a block boundary filter for reducing visual artifacts due to a block boundary between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the block boundary filter is configured to receive information on the selected type of the first prediction encoding method and the selected type of the second prediction encoding method, and to operate adaptively according to the block types of the frame in the environment of the block boundary to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the filtering operation, based on the selected types of the first and second prediction encoding method.

20. A mobile terminal comprising a video codec, the video codec comprising a coding block, a first decoding block and a first prediction block for prediction encoding a frame of a digital video signal by blocks, and a second decoding block and a second prediction block for decoding a prediction encoded frame of the digital video signal by blocks, a block type being defined according to the prediction encoding method for a block selected according to a predetermined set of coding types, the video codec comprising a block boundary filter for reducing visual artifacts due to a block boundary between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the block boundary filter is configured to receive information on the selected type of the first prediction encoding method and the selected type of the second prediction encoding method, and to operate adaptively according to the block types of the frame in the environment of the block boundary to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the filtering operation, based on the selected types of the first and second prediction encoding method.

21. A storage medium comprising a software program for reducing visual artifacts due to block boundaries between decoded image blocks in a frame of a digital video signal, the software program comprising machine executable code for performing an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the software program comprises machine executable code for receiving information on the selected type of the first prediction encoding method and the selected type of the second prediction encoding method and machine executable code for determining a first number of pixels to be filtered on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the adaptive block boundary filtering operation, based on the selected types of the first and second prediction encoding method.

22. A storage medium according to claim 21, wherein the first and second prediction encoding methods are of the same type.

23. A method of video encoding comprising:

performing an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary using an adaptive block boundary filter, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least;

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, the adaptive block boundary filtering operation comprising;

examining, by the adaptive block boundary filter, the type of the first prediction encoding method and the type of the second prediction encoding method; and

determining, by the adaptive block boundary filter, a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the filtering operation, based on the types of the first and second prediction encoding methods.

24. A method of video encoding according to claim 23, wherein the first and second prediction encoding methods are of the same type.

25. A method of video decoding, comprising:

performing an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary using an adaptive block boundary filter, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least;

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, the block boundary filtering operation comprising;

examining, by the adaptive block boundary filter, the type of the first prediction encoding method and the type of the second prediction encoding method; and

determining, by the adaptive block boundary filter, a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary as a parameter of the filtering operation based on the types of the first and second prediction encoding method.

26. A method of video decoding according to claim 25, wherein the first and second prediction encoding methods are of the same type.

27. A video encoder comprising an adaptive block boundary filter configured to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the adaptive block boundary filter is configured to examine the type of the first prediction encoding method and the type of the second prediction encoding method, and to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the adaptive block boundary filtering operation, based on the types of the first and second prediction encoding method.

28. A video encoder according to claim 27, wherein the first and second prediction encoding methods are of the same type.

29. A video decoder comprising an adaptive block boundary filter configured to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the adaptive block boundary filter is configured to examine the type of the first prediction encoding method and the type of the second prediction encoding method, and to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the adaptive block boundary filtering operation, based on the types of the first and second prediction encoding method.

30. A video decoder according to claim 29, wherein the first and second prediction encoding methods are of the same type.

31. A video codec comprising an adaptive block boundary filter configured to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the adaptive block boundary filter is configured to examine the type of the first prediction encoding method and the type of the second prediction encoding method, and to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the adaptive block boundary filtering operation, based on the types of the first and second prediction encoding method.

32. A video codec according to claim 31, wherein the first and second prediction encoding methods are of the same type.

33. A mobile terminal comprising an adaptive block boundary filter configured to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the adaptive block boundary filter is configured to examine the type of the first prediction encoding method and the type of the second prediction encoding method, and to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the adaptive block boundary filtering operation, based on the types of the first and second prediction encoding method.

34. A mobile terminal according to claim 33, wherein the first and second prediction encoding methods are of the same type.

35. A digital signal processor comprising a filtering block configured to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, wherein the filtering block is configured to examine the type of the first prediction encoding method and the second prediction encoding method, and to determine a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the adaptive block boundary filtering operation, based on the types of the first and second prediction encoding method.

36. A method, comprising performing a filtering operation on a block boundary that is dependent at least in part on a first prediction encoding method used to encode first image block on a first side of the block boundary and a second prediction encoding method used to encode a second image block on a second side of the block boundary, wherein the first and the second prediction encoding methods are selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding.

37. A apparatus comprising a filter configured to examine a prediction encoding method used to encode a first image block on a first side of a block boundary and a prediction encoding method used to encode a second image block on a second side of the block boundary and to perform a filtering operation on the block boundary in dependence at least in part on the first prediction encoding method used to encode the first image block on the first side of the block boundary and the second prediction encoding method used to encode the second image block on the second side of the block boundary, wherein the first and the second prediction encoding methods are selected from a group of prediction encoding methods comprising at least:

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding.

38. A video encoder comprising a filter according to claim 37.

39. A video decoder comprising a filter according to claim 37.

40. A mobile terminal comprising a filter according to claim 37.

41. A method comprising:

using an adaptive block boundary filter to perform an adaptive block boundary filtering operation on a block boundary formed between a first decoded image block on a first side of the block boundary and a second decoded image block on a second side of the block boundary, the first decoded image block having been encoded using a first type of prediction encoding method and the second decoded image block having been encoded using a second type of prediction encoding method, the first type of prediction encoding method and the second type of prediction encoding method being selected from a group of prediction encoding methods comprising at least;

intra coding, copy coding, motion-compensated prediction coding, and not-coded coding, the method further comprising;

receiving, by the adaptive block boundary filter, information on the type of the first prediction encoding method and the type of the second prediction encoding method, and

determining, by the adaptive block boundary filter, a first number of pixels to be examined on the first side of the block boundary and a second number of pixels to be examined on the second side of the block boundary, as a parameter of the filtering operation, based at least in part upon the types of the first and second prediction encoding methods.