Fine granularity scalable video encoding and decoding method and apparatus capable of controlling deblocking

• US 20060159359A1
• Filed: 01/18/2006
• Published: 07/20/2006
• Est. Priority Date: 01/19/2005
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Bae-keun
• Application Number:
  US11/333,206
• Publication Number:
  US 20060159359A1
• Time in Patent Office: Days
• US Class Current: 382/240
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/615 using motion compensated temporal filtering [MCTF]
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

Disclosed herein is a Fine Granularity Scalability (FGS)-based video encoding and decoding method and apparatus capable of controlling deblocking. In the video decoding method according to the present invention, original video data is received and a base layer is generated based on the original data. Next, the difference between the original data and data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer is obtained, thus generating an enhancement layer. Then, a reconstructed frame is generated based on the data that is obtained by reconstructing the enhancement layer, and data that is obtained by reconstructing and deblocking the reconstructed base layer. Finally, the reconstructed frame is deblocked at a lower intensity than that of deblocking performed in the first two steps.

Claims

1. A Fine Granularity Scalability (FGS)-based video encoding method capable of controlling deblocking, comprising:

receiving original data of video and generating a base layer based on the original data;

obtaining the difference between the original data and data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer, thus generating an enhancement layer;

generating a reconstructed frame, based on data that is obtained by reconstructing the enhancement layer, and the data that is obtained by deblocking the reconstructed base layer; and

deblocking the reconstructed frame at an intensity different from a deblocking intensity used in deblocking the reconstructed base layer.

2. The FGS-based video encoding method according to claim 1, wherein a deblocking intensity used in deblocking the reconstructed frame is lower than the deblocking intensity used in deblocking the reconstructed base layer.

3. The FGS-based video encoding method according to claim 1, wherein a deblocking coefficient used in deblocking the reconstructed frame is set to 1 or 2.

4. The FGS-based video encoding method according to claim 1, wherein generating of the base layer comprises transforming and quantizing the original data.

5. The FGS-based video encoding method according to claim 4, wherein the transformation comprises a Discrete Cosine Transform (DCT).

6. The FGS-based video encoding method according to claim 4, wherein reconstructing of the base layer comprises inverse transforming and inverse quantizing the original data which is transformed and quantized.

7. The FGS-based video encoding method according to claim 1, wherein generating of the enhancement layer comprises transforming and quantizing the difference between the original data and the data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer.

8. The FGS-based video encoding method according to claim 1, wherein generating of the enhancement layer comprises generating two or more enhancement layers.

9. The FGS-based video encoding method according to claim 8, wherein generating of the enhancement layer comprises:

encoding residual data generated by the difference between the original data and the data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer, thus generating a first enhancement layer; and

encoding a residual frame generated by the difference between a reconstructed frame and the original data, thus generating a second enhancement layer, the reconstructed frame being obtained by adding the data that is obtained by reconstructing the first enhancement layer to the data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer.

10. The FGS-based video encoding method according to claim 1, wherein the original video data is data obtained by performing Motion-Compensated Temporal Filtering (MCTF) on a Group of Pictures (GOP).

11. A Fine Granularity Scalability (FGS)-based video decoding method capable of controlling deblocking, comprising:

receiving a video stream and extracting a base layer from the video stream;

extracting an enhancement layer from the video stream;

adding data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer to data that is obtained by reconstructing the enhancement layer, thus generating a reconstructed frame; and

deblocking the reconstructed frame at an intensity different from a deblocking intensity used in deblocking the reconstructed base layer.

12. The FGS-based video decoding method according to claim 11, wherein the deblocking intensity used in the deblocking the reconstructed frame is lower than the deblocking intensity used in deblocking the reconstructed base layer.

13. The FGS-based video decoding method according to claim 11, wherein a deblocking coefficient used in deblocking the reconstructed frame is set to 1 or 2.

14. The FGS-based video decoding method according to claim 11, wherein reconstructing of the base layer comprises inverse transforming and inverse quantizing the base layer.

15. The FGS-based video decoding method according to claim 14, wherein the inverse transformation comprises an Inverse Discrete Cosine Transform (IDCT).

16. The FGS-based video decoding method according to claim 11, wherein reconstructing of the enhancement layer comprises inverse transforming and inverse quantizing the enhancement layer.

17. The FGS-based video decoding method according to claim 11, wherein extracting the enhancement layer comprises extracting two or more enhancement layers.

18. The FGS-based video decoding method according to claim 17, wherein extracting of the two or more enhancement layer comprises:

extracting a first enhancement layer from the video stream; and

extracting a second enhancement layer from remaining data of the video stream after extracting the first enhancement layer from the video stream.

19. A Fine Granularity Scalability (FGS)-based video encoder capable of controlling deblocking, the encoder comprising:

a base layer generation unit which generates a base layer based on original video data;

an enhancement layer generation unit which obtains a difference between the original data and data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer, thus generating an enhancement layer;

a reconstructed frame generation unit which generates a reconstructed frame based on data that is obtained by reconstructing the enhancement layer, and the data that is obtained by deblocking the reconstructed base layer; and

a deblocking unit which deblocks the reconstructed frame at an intensity different from a deblocking intensity used in deblocking the reconstructed base layer.

20. The FGS-based video encoder according to claim 19, wherein the deblocking unit which deblocks the reconstructed frame is configured to have a deblocking intensity lower than the deblocking intensity used in deblocking the reconstructed base layer.

21. The FGS-based video encoder according to claim 19, wherein the deblocking unit which deblocks the reconstructed frame is configured to have a deblocking coefficient set to 1 or 2.

22. The FGS-based video encoder according to claim 19, wherein the base layer generation unit is configured to transform and quantize the original data.

23. The FGS-based video encoder according to claim 22, wherein transforming of the original data comprises a Discrete Cosine Transform (DCT).

24. The FGS-based video encoder according to claim 22, wherein one of the base layer generation unit and the enhancement layer generation unit is configured to inverse-transform and inverse-quantize the original data in reconstructing the base layer.

25. The FGS-based video encoder according to claim 19, wherein the enhancement layer generation unit is configured to transform and quantize the difference between the original data and the data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer.

26. The FGS-based video encoder according to claim 19, wherein the enhancement layer generation unit is configured to generate two or more enhancement layers.

27. The FGS-based video encoder according to claim 26, wherein the enhancement layer generation unit comprises:

a first enhancement layer generation unit which encodes a residual data generated by the difference between the original data and the data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer, thus generating a first enhancement layer; and

a second enhancement layer generation unit which encodes a residual frame generated by the difference between a reconstructed frame and the original data, thus generating a second enhancement layer, the reconstructed frame being obtained by adding the data that is obtained by reconstructing the first enhancement layer to the data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer.

28. The FGS-based video encoder according to claim 19, wherein the original video data is data obtained by performing Motion-Compensated Temporal Filtering (MCTF) on a Group of Pictures (GOP).

29. A Fine Granularity Scalability (FGS)-based video decoder capable of controlling deblocking, the decoder comprising:

a base layer extraction unit which extracts a base layer from a received video stream;

an enhancement layer extraction unit which extracts an enhancement layer from the received video stream;

a reconstructed frame generation unit which adds data that is obtained by reconstructing the base layer and deblocking the reconstructed base layer to data that is obtained by reconstructing the enhancement layer, thus generating a reconstructed frame; and

a deblocking unit which deblocks the reconstructed frame at an intensity different from a deblocking intensity used in deblocking the reconstructed base layer.

30. The FGS-based video decoder according to claim 29, wherein the deblocking unit which deblocks the reconstructed frame is configured to have a deblocking intensity lower than the deblocking intensity used in deblocking the reconstructed base layer.

31. The FGS-based video decoder according to claim 29, wherein the deblocking unit which deblocks the reconstructed frame is configured to have a deblocking coefficient set to 1 or 2.

32. The FGS-based video decoder according to claim 29, the decoder further comprising:

an inverse quantization unit which inverse-quantizes the base layer; and

an inverse transform unit which inverse-transforms the inverse-quantized base layer,

wherein the data obtained by reconstructing the base layer and deblocking the reconstructed base layer is generated by deblocking the inverse-transformed base layer.

33. The FGS-based video decoder according to claim 32, wherein the inverse transformation comprises an Inverse Discrete Cosine Transform (IDCT).

34. The FGS-based video decoder according to claim 29, the decoder further comprising:

an inverse quantization unit which inverse-quantizes the enhancement layer; and

an inverse transform unit which inverse-transforms the inverse-quantized enhancement layer,

wherein the data obtained by reconstructing the enhancement layer is generated based on the inverse-transformed base layer.

35. The FGS-based video decoder according to claim 29, wherein the enhancement layer extraction unit is configured to extract two or more enhancement layers.

36. The FGS-based video decoder according to claim 35, wherein the enhancement layer extraction unit comprises:

a first enhancement layer extraction unit which extracts a first enhancement layer from the video stream; and

a second enhancement layer extraction unit which extracts a second enhancement layer from remaining data of the video stream after extracting the first enhancement layer from the video stream.