VIDEO CODING WITH LARGE MACROBLOCKS

• US 20100086029A1
• Filed: 09/18/2009
• Published: 04/08/2010
• Est. Priority Date: 10/03/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Karczewicz, Marta, Ye, Yan, Chen, Peisong
• Granted Patent: US 8,634,456 B2
• Time in Patent Office: Days
• US Class Current: 375/240.120
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

Techniques are described for encoding and decoding digital video data using macroblocks that are larger than the macroblocks prescribed by conventional video encoding and decoding standards. For example, the techniques include encoding and decoding a video stream using macroblocks comprising greater than 16×16 pixels, for example, 64×64 pixels. In one example, an apparatus includes a video encoder configured to encode a video block having a size of more than 16×16 pixels, generate block-type syntax information that indicates the size of the block, and generate a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient. The encoder may set the coded block pattern value to zero when the encoded block does not include at least one non-zero coefficient or set the coded block pattern value to one when the encoded block includes a non-zero coefficient.

Claims

1. A method comprising:

encoding, with a video encoder, a video block having a size of more than 16×

16 pixels;

generating block-type syntax information that indicates the size of the block; and

generating a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient.

2. The method of claim 1, further comprising:

setting the coded block pattern value to zero when the encoded block does not include at least one non-zero coefficient;

setting the coded block pattern value to one when the encoded block includes at least one non-zero coefficient; and

generating an encoded video bitstream comprising encoded video data for the encoded block, the block-type syntax information, and the coded block pattern value when the coded block pattern value is one.

3. The method of claim 1, further comprising:

when the encoded block does not include at least one non-zero coefficient, generating a single bit for the coded block pattern value and setting the value of the single bit to zero; and

when the encoded block includes at least one non-zero coefficient, generating a first bit of the coded block pattern value and setting the first bit to one, generating four partition bits for the coded block pattern value, each of the four partition bits corresponding to a different one of four equally-sized partitions of the encoded block, and setting the four partition bits to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient.

4. The method of claim 3, further comprising, when the encoded block includes at least one non-zero coefficient, identifying a 16×

16 pixel partition of the encoded block, generating a partition coded block pattern value for the 16×

16 pixel partition as a portion of the generated coded block pattern value and appending the partition coded block pattern to the coded block pattern value following the four partition bits.

5. The method of claim 4, further comprising, when the encoded block includes at least one non-zero coefficient, generating a coded block pattern value comprises generating a first luma_—

16×

8 bit and a second luma_—

16×

8 bit, the first luma_—

16×

8 bit representing whether a 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient and the second luma_—

16×

8 bit representing whether a second 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient.

6. The method of claim 4, wherein the video block has a size of at least 64×

64 pixels.

7. The method of claim 1, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

8. The method of claim 1, further comprising:

generating a quantization parameter modification value for the encoded block, wherein encoding the video block comprises quantizing the video block according to the quantization parameter modification value; and

including the quantization parameter modification value as syntax information for the encoded block.

9. An apparatus comprising a video encoder configured to encode a video block having a size of more than 16×

16 pixels, generate block-type syntax information that indicates the size of the block, and generate a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient.

10. The apparatus of claim 9, wherein video encoder is configured to set the coded block pattern value to zero when the encoded block does not include at least one non-zero coefficient, set the coded block pattern value to one when the encoded block includes at least one non-zero coefficient, and generate an encoded video bitstream comprising encoded video data for the encoded block, the block-type syntax information, and the coded block pattern value when the coded block pattern value is one.

11. The apparatus of claim 9, wherein the video encoder is configured to:

when the encoded block does not include at least one non-zero coefficient, generate a single bit for the coded block pattern value and set the value of the single bit to zero; and

when the encoded block includes at least one non-zero coefficient, generate a first bit of the coded block pattern value and set the first bit to one, generate four partition bits for the coded block pattern value, each of the four partition bits corresponding to a different one of four equally-sized partitions of the encoded block, and set the four partition bits to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient.

12. The apparatus of claim 11 wherein the video encoder is configured to, when the encoded block includes at least one non-zero coefficient, identify a 16×

16 pixel partition of the encoded block, generate a partition coded block pattern value for the 16×

16 pixel partition as a portion of the generated coded block pattern value, and append the partition coded block pattern value to the coded block pattern value following the four partition bits.

13. The apparatus of claim 12, wherein the video is configured to, when the encoded block includes at least one non-zero coefficient, generate a coded block pattern value comprises generating a first luma_—

16×

8 bit and a second luma_—

16×

8 bit, the first luma_—

16×

8 bit representing whether a 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient and the second luma_—

16×

8 bit representing whether a second 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient.

14. The apparatus of claim 9, wherein the video block has a size of at least 64×

64 pixels.

15. The apparatus of claim 9, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

16. The apparatus of claim 9, wherein the apparatus comprises a wireless communication device.

17. An apparatus comprising:

means for encoding a video block having a size of more than 16×

16 pixels;

means for generating block-type syntax information that indicates the size of the block; and

means for generating a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient.

18. The apparatus of claim 17, further comprising:

means for setting the coded block pattern value to zero when the encoded block does not include at least one non-zero coefficient;

means for setting the coded block pattern value to one when the encoded block includes at least one non-zero coefficient; and

means for generating an encoded video bitstream comprising encoded video data for the encoded block, the block-type syntax information, and the coded block pattern value when the coded block pattern value is one.

19. The apparatus of claim 17, further comprising:

when the encoded block does not include at least one non-zero coefficient, means for generating a single bit for the coded block pattern value and set the value of the single bit to zero; and

when the encoded block includes at least one non-zero coefficient, means for generating a first bit of the coded block pattern value and set the first bit to one, means for generating four partition bits for the coded block pattern value, each of the four partition bits corresponding to a different one of four equally-sized partitions of the encoded block, and means for setting the four partition bits to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient.

20. The apparatus of claim 19, further comprising, when the encoded block includes at least one non-zero coefficient, means for identifying a 16×

16 pixel partition of the encoded block, means for generating a partition coded block pattern value for the 16×

16 pixel partition as a portion of the generated coded block pattern value and means for appending the partition coded block pattern value to the coded block pattern value following the four partition bits.

21. The apparatus of claim 20, further comprising, when the encoded block includes at least one non-zero coefficient, means for generating a coded block pattern value comprises generating a first luma_—

16×

8 bit and a second luma_—

16×

8 bit, the first luma_—

16×

8 bit representing whether a 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient and the second luma_—

16×

8 bit representing whether a second 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient.

22. The apparatus of claim 17, wherein the video block has a size of at least 64×

64 pixels.

23. The apparatus of claim 17, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

24. A computer-readable storage medium encoded with instructions to cause a video encoding apparatus to:

encode, with a video encoder, a video block having a size of more than 16×

16 pixels;

generate block-type syntax information that indicates the size of the block; and

generate a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient.

25. The computer-readable storage medium of claim 24, further comprising instructions to cause the video encoding apparatus to:

set the coded block pattern value to zero when the encoded block does not include at least one non-zero coefficient;

set the coded block pattern value to one when the encoded block includes at least one non-zero coefficient; and

generate an encoded video bitstream comprising encoded video data for the encoded block, the block-type syntax information, and the coded block pattern value when the coded block pattern value is one.

26. The computer-readable storage medium of claim 24, further comprising instructions to cause the video encoding apparatus to:

when the encoded block does not include at least one non-zero coefficient, generate a single bit for the coded block pattern value and set the value of the single bit to zero; and

when the encoded block includes at least one non-zero coefficient, generate a first bit of the coded block pattern value and set the first bit to one, generate four partition bits for the coded block pattern value, each of the four partition bits corresponding to a different one of four equally-sized partitions of the encoded block, and set the four partition bits to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient.

27. The computer-readable storage medium of claim 26, further comprising further comprising instructions to cause the video encoding apparatus to, when the encoded block includes at least one non-zero coefficient, identify a 16×

16 pixel partition of the encoded block, generate a partition coded block pattern value for the 16×

16 pixel partition as a portion of the generated coded block pattern value and append the partition coded block pattern value to the coded block pattern value following the four partition bits.

28. The computer-readable storage medium of claim 27, further comprising instructions to cause the video encoding apparatus to, when the encoded block includes at least one non-zero coefficient, generate for the coded block pattern value a first luma_—

16×

8 bit and a second luma_—

16×

8 bit, the first luma_—

16×

8 bit representing whether a 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient and the second luma_—

16×

8 bit representing whether a second 16×

8 partition of the 16×

16 partition of the block includes at least one non-zero coefficient.

29. The computer-readable storage medium of claim 24, wherein the video block has a size of at least 64×

64 pixels.

30. The computer-readable storage medium of claim 24, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

31. A method comprising:

receiving, with a video decoder, an encoded video block having a size of more than 16×

16 pixels;

receiving block-type syntax information that indicates the size of the encoded block;

receiving a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient; and

decoding the encoded block based on the block-type syntax information and the coded block pattern value for the encoded block.

32. The method of claim 31, wherein the coded block pattern value is zero when the encoded block does not include at least one non-zero coefficient, and the coded block pattern value is one when the encoded block includes at least one non-zero coefficient, the method further comprising receiving encoded video data for the encoded block when the coded block pattern value is one.

33. The method of claim 31, wherein the coded block pattern value is a single bit equal to zero when the encoded block does not include at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, the coded block pattern includes a first bit equal to one and four partition bits, each of the partition bits corresponding to a different one of four equally-sized partitions of the encoded block, wherein the four partition bits are set to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient, and wherein the coded block pattern value includes, when the encoded block includes at least one non-zero coefficient, a partition coded block pattern value for a 16×

16 pixel partition appended to the coded block pattern value following the four partition bits.

34. The method of claim 31, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

35. The method of claim 31, wherein the video block has a size of at least 64×

64 pixels.

36. The method of claim 31, further comprising:

receiving a quantization parameter modification value,

wherein decoding the encoded block comprises dequantizing the encoded block according to the quantization parameter modification value.

37. An apparatus comprising a video decoder configured to:

receive an encoded video block having a size of more than 16×

16 pixels;

receive block-type syntax information that indicates the size of the encoded block;

receive a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient; and

decode the encoded block based on the block-type syntax information and the coded block pattern value for the encoded block.

38. The apparatus of claim 37, wherein the coded block pattern value is zero when the encoded block does not include at least one non-zero coefficient, and the coded block pattern value is one when the encoded block includes at least one non-zero coefficient, the video decoder being configured to receive encoded video data for the encoded block when the coded block pattern value is one.

39. The apparatus of claim 37, wherein the coded block pattern value is a single bit equal to zero when the encoded block does not include at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, the coded block pattern includes a first bit equal to one and four partition bits, each of the partition bits corresponding to a different one of four equally-sized partitions of the encoded block, wherein the four partition bits are set to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient, and wherein the coded block pattern value includes, when the encoded block includes at least one non-zero coefficient, a partition coded block pattern value for a 16×

16 pixel partition appended to the coded block pattern value following the four partition bits.

40. The apparatus of claim 37, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

41. The apparatus of claim 37, wherein the video block has a size of at least 64×

64 pixels.

42. The apparatus of claim 37, wherein the apparatus comprises a wireless communication device.

43. An apparatus comprising:

means for receiving an encoded video block having a size of more than 16×

16 pixels;

means for receiving block-type syntax information that indicates the size of the encoded block;

means for receiving a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient; and

means for decoding the encoded block based on the block-type syntax information and the coded block pattern value for the encoded block.

44. The apparatus of claim 43, wherein the coded block pattern value is zero when the encoded block does not include at least one non-zero coefficient, and the coded block pattern value is one when the encoded block includes at least one non-zero coefficient, the apparatus further comprising means for receiving encoded video data for the encoded block when the coded block pattern value is one.

45. The apparatus of claim 43, wherein the coded block pattern value is a single bit equal to zero when the encoded block does not include at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, the coded block pattern includes a first bit equal to one and four partition bits, each of the partition bits corresponding to a different one of four equally-sized partitions of the encoded block, wherein the four partition bits are set to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient, and wherein the coded block pattern value includes, when the encoded block includes at least one non-zero coefficient, a partition coded block pattern value for a 16×

16 pixel partition appended to the coded block pattern value following the four partition bits.

46. The apparatus of claim 43, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

47. The apparatus of claim 43, wherein the video block has a size of at least 64×

64 pixels.

48. A computer-readable storage medium comprising instructions to cause a video decoder to:

receive, with a video encoder, an encoded video block having a size of more than 16×

16 pixels;

receive block-type syntax information that indicates the size of the encoded block;

receive a coded block pattern value for the encoded block, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient; and

decode the encoded block based on the block-type syntax information and the coded block pattern value for the encoded block.

49. The computer-readable storage medium of claim 48, wherein the coded block pattern value is zero when the encoded block does not include at least one non-zero coefficient, and the coded block pattern value is one when the encoded block includes at least one non-zero coefficient, the method further comprising receiving encoded video data for the encoded block when the coded block pattern value is one.

50. The computer-readable storage medium of claim 48, wherein the coded block pattern value is a single bit equal to zero when the encoded block does not include at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, the coded block pattern includes a first bit equal to one and four partition bits, each of the partition bits corresponding to a different one of four equally-sized partitions of the encoded block, wherein the four partition bits are set to respective values representing whether the corresponding one of the four equally-sized partitions includes at least one non-zero coefficient, and wherein the coded block pattern value includes, when the encoded block includes at least one non-zero coefficient, a partition coded block pattern value for a 16×

16 pixel partition appended to the coded block pattern value following the four partition bits.

51. The computer-readable storage medium of claim 48, wherein the coded block pattern value indicates whether the encoded block includes at least one non-zero coefficient and, when the encoded block includes at least one non-zero coefficient, indicates whether any first-level partitions of the encoded block include at least one non-zero coefficient, and, when at least one of the first-level partitions of the encoded block includes at least one non-zero coefficient, indicates whether any second-level partitions of the first-level partitions include at least one non-zero coefficient, and wherein the coded block pattern value includes a pattern of bits corresponding to the encoded block, the first-level partitions of the encoded block, and the second-level partitions of the first-level partitions.

52. The computer-readable storage medium of claim 48, wherein the video block has a size of at least 64×

64 pixels.