Rate control and bit allocation for low bit rate video communication applications

• US 6,212,232 B1
• Filed: 06/18/1998
• Issued: 04/03/2001
• Est. Priority Date: 06/18/1998
• Status: Expired due to Term

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Compaq Computer Corporation (HP Inc.)
• Inventors: Reed, Eric, Dufaux, Frederic
• Primary Examiner(s): Le, Vu
• Application Number:
  US09/099,583
• Time in Patent Office: 1,020 Days
• Field of Search: 375/240.03, 375/243, 375/245, 348/405, 348/419.1, 348/419, 382/251-252, 341/138, 341/200
• US Class Current: 375/240.03
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A method and apparatus is described for encoding a sequence of video frames at a target bit rate. A controller controls the bit r ate by providing values for a coding frame rate and quantization parameter to a frame encoder. A set of operating regions, including a first operating region and a second operating region, is defined. Each operating region includes a range of values for each parameter. These operating regions may intersect each other or be disjoint. The encoder codes the frame sequence with the value of each parameter being in the first operating region. During the coding, the controller determines to make an adjustment to the value of one parameter that would put that value out of the first operating region and in the second operating region. The controller makes the adjustment if a predetermined criterion is satisfied, otherwise the controller constrains the value of that one parameter to remain in the first operating region. In one embodiment, the criterion is that the value of that one parameter and the value of another parameter would be in the same operating region if the adjustment were made. In another embodiment, the criterion is that, when it is determined to make the adjustment to the one parameter, the value of another one of the parameters is in a predetermined region of the first operating region.

Claims

1. A computerized method for encoding a sequence of video frames at a bit rate, comprising the steps of:

providing parameters, each parameter having a value that can be adjusted to control the bit rate at which the sequence of frames is encoded;

defining a first operating region and a second operating region, each operating region including a range of values for each of the parameters;

encoding the sequence of frames with the value of each parameter being in the first operating region;

determining to make an adjustment to the value of one of the parameters that would put that value out of the first operating region and in the second operating region; and

making the adjustment to that value if a predetermined criterion is satisfied, otherwise constraining the value of that one parameter to remain in the first operating region.

2. The method of claim 1, wherein the predetermined criterion is that the value of that one parameter and the value of another one of the parameters would be in the same operating region as each other if the adjustment were made.

3. The method of claim 1 wherein the predetermined criterion is that the value of another one of the parameters is in a predetermined region of the first operating region when it is determined to make the adjustment of the value of the one parameter.

4. The method of claim 1, further comprising the step of:

adjusting the value of another one of the parameters when the predetermined criterion is unsatisfied and the value of the one parameter is constrained to remain in the first operating region.

5. The method of claim 4, further comprising the step of:

constraining the adjusted value of that another one of the parameters to be in the first operating region unless the predetermined criterion is satisfied.

6. The method of claim 1, wherein a first one of the parameters represents a frame rate at which to select video frames for encoding and a second one of the parameters represents a quantization parameter.

7. The method of claim 1 wherein the one parameter is a frame rate at which to select video frames for encoding, and further comprising the step of:

adjusting the frame rate when the predetermined criterion is satisfied if a predetermined interval of time has elapsed since a previous change to the frame rate, otherwise waiting for the predetermined interval of time to elapse before adjusting the frame rate.

8. The method of claim 7, further comprising the step of defining levels of frame rates;

and wherein the step of making the adjustment to the frame rate adjusts the frame rate by at least one level.

9. The method of claim 8, further comprising the step of:

limiting the adjustment to the frame rate to one level.

10. The method of claim 7, further comprising the steps of:

determining a target number of bits for encoding a current frame; and

encoding the current frame and each subsequent frame according to the target number of bits until the frame rate subsequently changes.

11. The method of claim 7, further comprising the steps of:

determining a target number of bits for encoding the sequence of video frames;

encoding the sequence of video frames using an actual number of bits for each encoded frame; and

determining to adjust the frame rate when the actual number of bits used to encode each of a predetermined number of successively encoded frames differs from the target number of bits on average by a threshold value.

12. The method of claim 1, wherein the one parameter is a quantization parameter, and the step of making the adjustment when the predetermined criterion is satisfied adjusts the quantization parameter by at least one.

13. The method of claim 12, further comprising the step of limiting the adjustment to the quantization parameter to less than three.

14. The method of claim 12, further comprising the steps of:

modeling expected behavior of a decoder using a buffer;

determining a target number of bits for encoding a current frame;

encoding the current frame using an actual number of bits;

determining a signal-to-noise ratio (SNR) for the current frame; and

wherein the adjustment to the quantization parameter depends on a difference between the actual number and the target number if the buffer is at risk of under-flowing, otherwise the adjustment depends on the SNR.

15. The method of claim 1, wherein each operating region represents a subjective level of visual quality, and encoding with the values of the parameters in the first operating region produces a better visual quality than encoding with the values of the parameters in the second operating region.

16. The method of claim 1, wherein the first operating region and the second operating region intersect each other.

17. The method of claim 1, wherein the first operating region and the second operating region are non-intersecting with respect to each other.

18. The method of claim 1, further comprising the steps of:

determining a target number of bits for encoding a current frame;

encoding the current frame using an actual number of bits; and

determining to adjust one of the parameters when the actual number of bits used to encode the current frame differs from the target number of bits by a threshold value.

19. A system for encoding a sequence of video frames at a bit rate, comprising:

an encoder; and

a controller coupled to provide values of coding parameters to the encoder to control the bit rate at which the video frame sequence is encoded, the controller defining a first operating region and a second operating region, each operating region including a range of values for each parameter,

wherein the encoder codes each selected frame while the controller constrains the values of the parameters to be in the first operating region until a predetermined criterion is satisfied, the controller then allowing an adjustment to the value of one of the parameters that would put that value out of the first operating region and in the second operating region.

20. The system of claim 19, wherein the predetermined criterion is that the value of that one parameter and the value of another one of the parameters would be in the same operating region as each other if the adjustment were made.

21. The system of claim 19 wherein the predetermined criterion is that the value of another one of the parameters is in a predetermined region of the first operating region when the adjustment of the value of the one parameter is to be made.

22. The system of claim 19, wherein the first operating region and the second operating region intersect each other.

23. The system of claim 19, wherein the first operating region and the second operating region are non-intersecting with respect to each other.