CONTENT ADAPTIVE QUANTIZATION STRENGTH AND BITRATE MODELING

• US 20200137389A1
• Filed: 10/31/2018
• Published: 04/30/2020
• Est. Priority Date: 10/31/2018
• Status: Active Grant

• Current Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Original Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Inventors: Qiu, Jinbo, Liu, Yang, Amer, Ihab, Zhang, Lei, Harold, Edward A., Hao, Zhiqi, Wang, Jiao, Sines, Gabor, Liu, Haibo, Ivanovic, Boris
• Granted Patent: US 11,368,692 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/197 including determination of the initial value of an encoding parameter H04N19/56 takes precedence

Abstract

Systems, apparatuses, and methods for generating a model for determining a quantization strength to use when encoding video frames are disclosed. A pre-encoder performs multiple encoding passes using different quantization strengths on a portion or the entirety of one or more pre-processed video frames. The pre-encoder captures the bit-size of the encoded output for each of the multiple encoding passes. Then, based on the multiple encoding passes, the pre-encoder generates a model for mapping bit-size to quantization strength for encoding video frames or portion(s) thereof. When the encoder begins the final encoding pass for one or more given video frames or any portion(s) thereof, the encoder uses the model to map a preferred bit-size to a given quantization strength. The encoder uses the given quantization strength when encoding the given video frame(s) or frame portion(s) to meet a specified bit-rate for the encoded bitstream.

Claims

1. A system comprising:

a pre-encoder configured to generate a mapping of frame size to quantization parameter (QP) based on a plurality of encodings of a portion of a first video frame using different QP settings; and

an encoder configured to;

determine a given QP value from the mapping based on a preferred encoded video frame size;

generate an encoded video frame by setting a QP to the given QP value for at least a portion of the encoded video frame, wherein the encoded video frame represents an input video frame; and

convey the encoded video frame to a decoder to be displayed.

2. The system as recited in claim 1, wherein the pre-encoder is further configured to:

perform a first encoding of at least the portion of the first video frame using a first QP setting;

capture a first size of a result of the first encoding;

perform a second encoding of the portion of the first video frame using a second QP setting;

capture a second size of a result of the second encoding; and

generate the mapping of frame size to QP based on relationships between the first and second QP settings and the first and second sizes, respectively.

3. The system as recited in claim 2, wherein the portion of the first video frame is downscaled prior to the first encoding and the second encoding being performed.

4. The system as recited in claim 2, wherein the encoder is configured to determine how to set an initial QP when encoding a final pass of the first video frame based on the mapping generated by the pre-encoder.

5. The system as recited in claim 2, wherein the second QP setting is different from the first QP setting.

6. The system as recited in claim 1, wherein the input video frame is the first video frame.

7. The system as recited in claim 1, wherein the input video frame is a second video frame which is subsequent to the first video frame in a video sequence.

8. A method comprising:

generating, by a pre-encoder, a mapping of frame size to quantization parameter (QP) based on a plurality of encodings of a portion of a first video frame using different QP settings;

determining, by an encoder, a given QP value from the mapping based on a preferred encoded video frame size;

generating, by the encoder, an encoded video frame by setting a QP to the given QP value for at least a portion of the encoded video frame, wherein the encoded video frame represents an input video frame; and

conveying, by the encoder, the encoded video frame to a decoder to be displayed.

9. The method as recited in claim 8, further comprising:

performing, by the pre-encoder, a first encoding of at least the portion of the first video frame using a first QP setting;

capturing, by the pre-encoder, a first size of a result of the first encoding;

performing, by the pre-encoder, a second encoding of the portion of the first video frame using a second QP setting;

capturing, by the pre-encoder, a second size of a result of the second encoding; and

generating, by the pre-encoder, the mapping of frame size to QP based on relationships between the first and second QP settings and the first and second sizes, respectively.

10. The method as recited in claim 9, wherein the portion of the first video frame is downsampled prior to the first encoding and the second encoding being performed.

11. The method as recited in claim 9, further comprising determining, by the encoder, how to set an initial QP when encoding a final pass of the first video frame based on the mapping generated by the pre-encoder.

12. The method as recited in claim 9, wherein the second QP setting is different from the first QP setting.

13. The method as recited in claim 8, wherein the input video frame is the first video frame.

14. The method as recited in claim 8, wherein the input video frame is a second video frame which is subsequent to the first video frame in a video sequence.

15. An apparatus comprising:

a memory; and

an encoder coupled to the memory, wherein the encoder is configured to;

determine a given quantization parameter (QP) value from a mapping based on a preferred encoded video frame size, and wherein the mapping specifies a relationship between bit size to QP based on two or more pre-encoding passes;

generate an encoded video frame by setting a QP to the given QP value for at least a portion of the encoded video frame, wherein the encoded video frame represents an input video frame; and

convey the encoded video frame to a decoder to be displayed.

16. The apparatus as recited in claim 15, wherein the two or more pre-encoding passes are performed on a portion of a first video frame which is downsampled prior to the two or more pre-encoding passes.

17. The apparatus as recited in claim 15, wherein the two or more pre-encoding passes are performed on a portion of a first video frame which is pre-processed prior to the two or more pre-encoding passes.

18. The apparatus as recited in claim 15, wherein the encoder is configured to determine how to set an initial QP when encoding a final pass of the first video frame based on the mapping.

19. The apparatus as recited in claim 15, wherein the two or more pre-encoding passes are performed using two or more different QP settings.

20. The apparatus as recited in claim 15, wherein the two or more pre-encoding passes are performed on the input video frame.