Method and apparatus for encoding/decoding image information

• US 10,298,962 B2
• Filed: 04/25/2018
• Issued: 05/21/2019
• Est. Priority Date: 09/20/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Park, Seungwook, Lim, Jaehyun, Jeon, Yongjoon, Kim, Chulkeun, Kim, Jungsun, Park, Naeri, Hendry, Hendry, Jeon, Byeongmoon, Park, Joonyoung
• Primary Examiner(s): An, Shawn S
• Application Number:
  US15/962,939
• Publication Number:
  US 20180242022A1
• Time in Patent Office: 391 Days
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/134 characterised by the element, parameter or criterion affecting or controlling the adaptive coding
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

The present invention relates to a deblocking filtering method, a method for inducing bs (boundary strength) therefor, and a method and an apparatus for encoding/decoding using the same. The method for inducing the bS of the present invention comprises the steps of: inducing a boundary of a deblocking filtering unit block as a unit block for applying the deblocking filtering; and setting the bS according to each bS setting unit block within the deblocking filtering unit block, wherein the bS setting step can set a bS value for a target boundary corresponding to a boundary of the deblocking filtering unit block as the bs setting unit block.

Claims

1. A video decoding apparatus, comprising:

an entropy decoder configured to obtain offset information form a bitstream;

an inverse transformer configured to derive residual samples;

a predictor configured to generate prediction samples by performing an intra prediction or an inter prediction;

an adder configured to generate a reconstructed picture including reconstructed samples based on the prediction samples and the residual samples; and

a filter configured to perform a deblocking filtering process on the reconstructed picture, and to perform a sample adaptive offset (SAO) process on the reconstructed picture based on the offset information after completing the deblocking filtering process,

wherein for the deblocking filtering process, the filter sets a boundary strength (bS) value on a target boundary, wherein the bS value is set from three case values, and the filter applies deblocking filtering on the reconstructed samples neighboring the target boundary based on the bS value,

wherein the bS value is set for the target boundary which is an overlapped boundary of a boundary of a bS setting unit and a boundary of a deblocking filtering unit,

wherein the deblocking filtering unit is an array of 8×

8 samples and the bS setting unit is an array of 4×

4 samples.

2. The apparatus of claim 1, wherein the filter applies the deblocking filtering by determining whether the deblocking filtering is not to be applied on the target boundary based on the bS value, wherein the deblocking filtering is not applied on the target boundary when the bS value is set equal to 0, by determining based on specific samples neighboring the target boundary and located in specific sample rows or columns, whether the deblocking filtering is not to be applied on the target boundary when the set bS value is larger than 0, wherein even when the bS value is larger than 0 when it is determined that the deblocking filtering is not to be applied on the target boundary, the deblocking filtering is not applied on the target boundary, by determining whether strong filtering is to be applied or weak filtering is to be applied when the deblocking filtering is determined to be applied, and by applying a strong filtering or a weak filtering on the target boundary according to the determination on whether strong filtering is to be applied or weak filtering is to be applied,

wherein the specific samples in k-th sample row and (k+3)-th sample row are used for determining whether the deblocking filtering is not to be applied on the target boundary when the target boundary is a vertical boundary or the specific samples in k-th sample column and (k+3)-th sample column are used for determining whether the deblocking filtering is not to be applied on the target boundary when the target boundary is a horizontal boundary, wherein k is an integer and 0≤

k.

3. The apparatus of claim 2, the filter determines additionally whether the deblocking filtering is applied when the weak filtering is determined to be applied.

4. The apparatus of claim 2, the filter determines whether the weak filtering is to be applied on specific samples when the weak filtering is determined to be applied.

5. The apparatus of claim 2, wherein when the bS value is larger than 0 and the target boundary is the vertical boundary, whether the deblocking filtering is not to be applied is determined based on a first sum of a difference between the first sample and the second sample from the vertical boundary and a difference between the third sample and the second sample from the vertical boundary among samples in the k-th sample row, and a second sum of a difference between the first sample and the second sample from the vertical boundary and a difference between the third sample and the second sample from the vertical boundary among samples in the (k+3)-th sample row,

wherein when a sum of the first sum and the second sum is greater than a threshold value it is determined that the deblocking filtering is not to be applied for the target boundary.

6. The apparatus of claim 2, wherein when the bS value is larger than 0 and the target boundary is the horizontal boundary, whether the deblocking filtering is not to be applied is determined based on a first sum of a difference between the first sample and the second sample from the horizontal boundary and a difference between the third sample and the second sample from the horizontal boundary among the samples in the k-th sample column, and a second sum of a difference between the first sample and the second sample from the horizontal boundary and a difference between the third sample and the second sample from the horizontal boundary among samples in the (k+3)-th sample column,

wherein when a sum of the first sum and the second sum is greater than a threshold value it is determined that the deblocking filtering is not to be applied for the target boundary.

7. The apparatus of claim 1, wherein if one of two blocks facing each other across the target boundary includes a non-zero transform coefficient, the bS value is set equal to 1, and if different reference pictures are used for the inter prediction of the two blocks, the bS value is set equal to 1.

8. The apparatus of claim 1, wherein in the applying deblocking filtering, the deblocking filtering on the reconstructed samples for vertical boundaries are performed and then the deblocking filtering on the reconstructed samples for horizontal boundaries are performed.

9. The apparatus of claim 1, wherein the applying deblocking filtering includes determining whether strong filtering is to be applied or weak filtering is to be applied on the basis of samples of two blocks facing each other across the target boundary.

10. The apparatus of claim 9, wherein whether the strong filtering is to be applied or the weak filtering is to be applied is determined on the basis of samples to be subjected to the filtering out of samples in sample rows when the target boundary is the vertical boundary, or on the basis of samples to be subjected to the filtering out of samples in sample columns when the target boundary is the horizontal boundary.

11. A video encoding apparatus, comprising:

an inverse transformer configured to derive residual samples;

a predictor configured to generate prediction samples by performing an intra prediction or an inter prediction;

an adder configured to generate a reconstructed picture including reconstructed samples based on the prediction samples and the residual samples;

a filter configured to perform a deblocking filtering process on the reconstructed picture, to perform a sample adaptive offset (SAO) process on the reconstructed picture after completing the deblocking filtering process, and to generate offset information on the SAO process; and

an entropy encoder configured to encode video information including the offset information to generate a bitstream,

wherein for the deblocking filtering process, the filter sets a boundary strength (bS) value on a target boundary, wherein the bS value is set from three case values, and the filter applies deblocking filtering on the reconstructed samples neighboring the target boundary based on the bS value,

wherein the bS value is set for the target boundary which is an overlapped boundary of a boundary of a bS setting unit and a boundary of a deblocking filtering unit,

wherein the deblocking filtering unit is an array of 8×

8 samples and the bS setting unit is an array of 4×

4 samples.

12. The apparatus of claim 11, wherein the filter applies the deblocking filtering by determining whether the deblocking filtering is not to be applied on the target boundary based on the bS value, wherein the deblocking filtering is not applied on the target boundary when the bS value is set equal to 0, by determining based on specific samples neighboring the target boundary and located in specific sample rows or columns, whether the deblocking filtering is not to be applied on the target boundary when the set bS value is larger than 0, wherein even when the bS value is larger than 0 when it is determined that the deblocking filtering is not to be applied on the target boundary, the deblocking filtering is not applied on the target boundary, by determining whether strong filtering is to be applied or weak filtering is to be applied when the deblocking filtering is determined to be applied, and by applying a strong filtering or a weak filtering on the target boundary according to the determination on whether strong filtering is to be applied or weak filtering is to be applied,

wherein the specific samples in k-th sample row and (k+3)-th sample row are used for determining whether the deblocking filtering is not to be applied on the target boundary when the target boundary is a vertical boundary or the specific samples in k-th sample column and (k+3)-th sample column are used for determining whether the deblocking filtering is not to be applied on the target boundary when the target boundary is a horizontal boundary, wherein k is an integer and 0≤

k.

13. The apparatus of claim 12, the filter determines additionally whether the deblocking filtering is applied when the weak filtering is determined to be applied.

14. The apparatus of claim 12, the filter determines whether the weak filtering is to be applied on specific samples when the weak filtering is determined to be applied.

15. The apparatus of claim 12, wherein when the bS value is larger than 0 and the target boundary is the vertical boundary, whether the deblocking filtering is not to be applied is determined based on a first sum of a difference between the first sample and the second sample from the vertical boundary and a difference between the third sample and the second sample from the vertical boundary among samples in the k-th sample row, and a second sum of a difference between the first sample and the second sample from the vertical boundary and a difference between the third sample and the second sample from the vertical boundary among samples in the (k+3)-th sample row,

wherein when a sum of the first sum and the second sum is greater than a threshold value it is determined that the deblocking filtering is not to be applied for the target boundary.

16. The apparatus of claim 12, wherein when the bS value is larger than 0 and the target boundary is the horizontal boundary, whether the deblocking filtering is not to be applied is determined based on a first sum of a difference between the first sample and the second sample from the horizontal boundary and a difference between the third sample and the second sample from the horizontal boundary among the samples in the k-th sample column, and a second sum of a difference between the first sample and the second sample from the horizontal boundary and a difference between the third sample and the second sample from the horizontal boundary among samples in the (k+3)-th sample column,

wherein when a sum of the first sum and the second sum is greater than a threshold value it is determined that the deblocking filtering is not to be applied for the target boundary.

17. The apparatus of claim 11, wherein if one of two blocks facing each other across the target boundary includes a non-zero transform coefficient, the bS value is set equal to 1, and if different reference pictures are used for the inter prediction of the two blocks, the bS value is set equal to 1.

18. The apparatus of claim 11, wherein in the applying deblocking filtering, the deblocking filtering on the reconstructed samples for vertical boundaries are performed and then the deblocking filtering on the reconstructed samples for horizontal boundaries are performed.

19. The apparatus of claim 11, wherein the applying deblocking filtering includes determining whether strong filtering is to be applied or weak filtering is to be applied on the basis of samples of two blocks facing each other across the target boundary.

20. A non-transitory decoder-readable storage medium storing a bitstream generated by performing deriving residual samples, generating prediction samples by performing an intra prediction or an inter prediction, generating a reconstructed picture including reconstructed samples based on the prediction samples and the residual samples, performing a deblocking filtering process on the reconstructed picture, performing a sample adaptive offset (SAO) process on the reconstructed picture after completing the deblocking filtering process, generating offset information on the SAO process, encoding video information including the offset information to generate the bitstream, wherein performing the deblocking filtering process includes setting a boundary strength (bS) value on a target boundary, wherein the bS value is set from three case values, and applying deblocking filtering on the reconstructed samples neighboring the target boundary based on the bS value, wherein the bS value is set for the target boundary which is an overlapped boundary of a boundary of a bS setting unit and a boundary of a deblocking filtering unit, wherein the deblocking filtering unit is an array of 8×

8 samples and the bS setting unit is an array of 4×

4 samples.