Adaptive quantization for enhancement layer video coding

• US 9,571,840 B2
• Filed: 06/17/2014
• Issued: 02/14/2017
• Est. Priority Date: 06/03/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Regunathan, Shankar, Sun, Shijun, Tu, Chengjie, Lin, Chih-Lung
• Primary Examiner(s): Prince, Jessica M
• Application Number:
  US14/307,282
• Publication Number:
  US 20140294070A1
• Time in Patent Office: 973 Days
• Field of Search: 375/240.03
• US Class Current: 1/1
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/197 including determination of the initial value of an encoding parameter H04N19/56 takes precedence
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Techniques and tools for encoding enhancement layer video with quantization that varies spatially and/or between color channels are presented, along with corresponding decoding techniques and tools. For example, an encoding tool determines whether quantization varies spatially over a picture, and the tool also determines whether quantization varies between color channels in the picture. The tool signals quantization parameters for macroblocks in the picture in an encoded bit stream. In some implementations, to signal the quantization parameters, the tool predicts the quantization parameters, and the quantization parameters are signaled with reference to the predicted quantization parameters. A decoding tool receives the encoded bit stream, predicts the quantization parameters, and uses the signaled information to determine the quantization parameters for the macroblocks of the enhancement layer video. The decoding tool performs inverse quantization that can vary spatially and/or between color channels.

Claims

1. A computing device including a processor and memory, wherein the computing device implements a video encoder adapted to perform operations comprising:

encoding video for a picture organized in multiple color channels, including;

varying quantization spatially and between the multiple color channels of the video for the picture; and

for a current unit of the video for the picture, predicting a unit-level quantization parameter (“

QP”

) for the current unit using multiple unit-level QPs for spatially neighboring units; and

outputting the encoded video for the picture in a bitstream, including;

signaling QP information in the bitstream that indicates multiple QPs that at least in part parameterize the varied quantization of the video for the picture, the QP information including the unit-level QP for the current unit signaled as a differential QP relative to the predicted unit-level QP for the current unit.

2. The computing device of claim 1 wherein the units are blocks, and wherein the encoding further includes determining whether to use spatial quantization variation between the blocks of the video for the picture based at least in part on a user setting that controls speed and complexity of the encoding.

3. The computing device of claim 1 wherein the units are blocks, and wherein the encoding further includes determining whether to use spatial quantization variation between the blocks of the video for the picture based at least in part on analysis of complexity and spatial variance of the video for the picture.

4. The computing device of claim 1 wherein the encoding includes performing the quantization on transform coefficients of units of the video for the picture.

5. The computing device of claim 1 wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective color channels of the video for the picture.

6. The computing device of claim 1 wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

7. The computing device of claim 6 wherein, according to the one or more prediction rules, if the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

8. The computing device of claim 6 wherein, according to the one or more prediction rules:

when the QP for the left unit is not available, another QP is substituted for the QP for the left unit; and

when the QP for the above unit is not available, another QP is substituted for the QP for the above unit.

9. The computing device of claim 1 wherein the units are blocks, the operations further comprising:

during the encoding;

determining whether to use spatial quantization variation between the blocks of the video for the picture; and

determining whether to use quantization variation between color channels; and

as part of the outputting the encoded video;

signaling information in the bitstream that indicates whether the spatial quantization variation is used between the blocks of the video for the picture; and

signaling information in the bitstream that indicates whether the quantization variation between color channels is used.

10. In a computing device that implements a video decoder, a method comprising:

at the computing device that implements the video decoder, receiving encoded data in a bitstream for video for a picture organized in multiple color channels, the encoded data including quantization parameter (“

QP”

) information that indicates multiple QPs that at least in part parameterize inverse quantization of the video for the picture, the QP information including a differential QP for a unit-level QP for a current unit of the video for the picture; and

with the computing device that implements the video decoder, decoding the video for the picture, including varying inverse quantization spatially and between the multiple color channels of the video for the picture, and further including for the current unit;

predicting the unit-level QP for the current unit using multiple unit-level QPs for spatially neighboring units; and

combining the predicted unit-level QP for the current unit with the differential QP from the bitstream for the current unit.

11. The method of claim 10 wherein the decoding includes performing the inverse quantization on transform coefficients of units of the video for the picture.

12. The method of claim 10 wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective color channels of the video for the picture.

13. The method of claim 10 wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

14. The method of claim 13 wherein, according to the one or more prediction rules, if the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

15. The method of claim 13 wherein, according to the one or more prediction rules:

when the QP for the left unit is not available, another QP is substituted for the QP for the left unit; and

when the QP for the above unit is not available, another QP is substituted for the QP for the above unit.

16. The method of claim 10 wherein the units are blocks, wherein the encoded data further includes information in the bitstream that indicates whether spatial quantization variation is used between the blocks of the video for the picture, and wherein the decoding further comprises determining whether to use the spatial quantization variation between the blocks of the video for the picture.

17. A computer-readable storage medium storing computer-executable instructions for causing a processor, when programmed thereby, to perform operations, wherein the computer-readable storage medium is selected from the group consisting of volatile memory, non-volatile memory, magnetic disk, CD-ROM, and DVD, the operations comprising:

receiving encoded data in a bitstream for video for a picture organized in multiple color channels, the encoded data including quantization parameter (“

QP”

) information that indicates multiple QPs that at least in part parameterize inverse quantization of the video for the picture, the QP information including a differential QP for a unit-level QP for a current unit of the video for the picture; and

decoding the video for the picture, including varying inverse quantization spatially and between the multiple color channels of the video for the picture, and further including for the current unit;

predicting the unit-level QP for the current unit using multiple unit-level QPs for spatially neighboring units; and

combining the predicted unit-level QP for the current unit with the differential QP from the bitstream for the current unit.

18. The computer-readable storage medium of claim 17 wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective color channels of the video for the picture.

19. The computer-readable storage medium of claim 17 wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

20. The computer-readable storage medium of claim 19 wherein, according to the one or more prediction rules, if the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

21. In a computing device that implements a video encoder, a method comprising:

encoding video for a picture organized in multiple color channels, including;

varying quantization spatially and between the multiple color channels of the video for the picture; and

for a current unit of the video for the picture, predicting a unit-level quantization parameter (“

QP”

) for the current unit using multiple unit-level QPs for spatially neighboring units; and

outputting the encoded video for the picture in a bitstream, including;

signaling QP information in the bitstream that indicates multiple QPs that at least in part parameterize the varied quantization of the video for the picture, the QP information including the unit-level QP for the current unit signaled as a differential QP relative to the predicted unit-level QP for the current unit.

22. The method of claim 21 wherein the units are blocks, and wherein the encoding further includes determining whether to use spatial quantization variation between the blocks of the video for the picture based at least in part on a user setting that controls speed and complexity of the encoding.

23. The method of claim 21 wherein the units are blocks, and wherein the encoding further includes determining whether to use spatial quantization variation between the blocks of the video for the picture based at least in part on analysis of complexity and spatial variance of the video for the picture.

24. The method of claim 21 wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective color channels of the video for the picture.

25. The method of claim 21 wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

26. The method of claim 25 wherein, according to the one or more prediction rules, if the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

27. The method of claim 25 wherein, according to the one or more prediction rules:

when the QP for the left unit is not available, another QP is substituted for the QP for the left unit; and

when the QP for the above unit is not available, another QP is substituted for the QP for the above unit.

28. A computing device including a processor and memory, wherein the computing device implements a video decoder adapted to perform operations comprising:

receiving encoded data in a bitstream for video for a picture organized in multiple color channels, the encoded data including quantization parameter (“

QP”

) information that indicates multiple QPs that at least in part parameterize inverse quantization of the video for the picture, the QP information including a differential QP for a unit-level QP for a current unit of the video for the picture; and

decoding the video for the picture, including varying inverse quantization spatially and between the multiple color channels of the video for the picture, and further including for the current unit;

predicting the unit-level QP for the current unit using multiple unit-level QPs for spatially neighboring units; and

combining the predicted unit-level QP for the current unit with the differential QP from the bitstream for the current unit.

29. The computing device of claim 28 wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective color channels of the video for the picture.

30. The computing device of claim 28 wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

31. The computing device of claim 30 wherein, according to the one or more prediction rules, if the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

32. The computing device of claim 30 wherein, according to the one or more prediction rules:

when the QP for the left unit is not available, another QP is substituted for the QP for the left unit; and

when the QP for the above unit is not available, another QP is substituted for the QP for the above unit.

33. A computer-readable storage medium having stored thereon encoded data in a bitstream for video for a picture organized in multiple color channels, the encoded data including quantization parameter (“

QP”

) information that indicates multiple QPs that at least in part parameterize inverse quantization of the video for the picture, the QP information including a differential QP for a unit-level QP for a current unit of the video for the picture, wherein the computer-readable storage medium is selected from the group consisting of volatile memory, non-volatile memory, magnetic disk, CD-ROM, and DVD, and wherein the encoded data is organized to facilitate decoding the video for the picture, including varying inverse quantization spatially and between the multiple color channels of the video for the picture, and further including for the current unit;

predicting the unit-level QP for the current unit using multiple unit-level QPs for spatially neighboring units; and

combining the predicted unit-level QP for the current unit with the differential QP from the bitstream for the current unit.

34. The computer-readable storage medium of claim 33 wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective color channels of the video for the picture.