Delay aware rate control in the context of hierarchical P picture coding

• US 8,750,373 B2
• Filed: 01/20/2011
• Issued: 06/10/2014
• Est. Priority Date: 10/04/2010
• Status: Active Grant

• Current Assignee: Vidyo Incorporated (Enghouse Systems Limited)
• Original Assignee: Vidyo Incorporated (Enghouse Systems Limited)
• Inventors: Horowitz, Michael, Jang, Wonkap, Shapiro, Ofer
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): LUO, KATE H
• Application Number:
  US13/010,570
• Publication Number:
  US 20120082214A1
• Time in Patent Office: 1,237 Days
• Field of Search: None
• US Class Current: 375/240.03
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field

Abstract

The present invention provides bit rate control techniques for a hybrid block based motion compensated predictive video encoder (e.g., H.264, as well as other video coding algorithms and standards). The techniques aim to reduce the picture-to-picture bit rate fluctuations within a prediction structure or over a short time interval that can lead to undesirable additional delay on links without over-provisioned capacity. In one embodiment of the present invention, the end to end delay is estimated. The end to end delay is used to determine limits on the modulation of the target coded picture size, with the goal of trading an acceptable amount of additional delay for a better coding efficiency.

Claims

1. A method of determining a target number of bits for each of a plurality of coded pictures in a prediction structure having a hierarchy of temporal layers, each of the plurality of coded pictures belonging to one of the temporal layers, comprising:

(a) determining a one way delay taking into account at least a network delay and glass-to-glass-delay,

(b) computing a parameter maxRatio indicative of a limitation of a fluctuation of a coded picture size for at least one of the plurality of coded pictures, and

(c) modulating a target coded picture size for each of the plurality of coded pictures based on the computed parameter maxRatio, the one-way delay and a position of the coded picture in the hierarchy of the temporal layers, such that the target number of bits varies for each of the plurality of coded pictures in the prediction structure but stays within the limitation of the fluctuation of the coded picture size as indicated by the parameter maxRatio.

2. The method of claim 1, wherein the modulation is bounded by at least one of a first upper threshold for an allowed delay and a second lower threshold for the allowed delay.

3. The method of claim 1, wherein the parameter maxRatio is adjusted based on an increase or decrease of the end-to-end delay over time.

4. The method of claim 1, wherein the parameter maxRatio is adjusted based on user input.

5. The method of claim 1, wherein the one way delay is determined by taking into account an end-to-end delay between an encoder and all decoders in a multipoint conference.

6. The method of claim 5, wherein the one way delay is determined by using the longest end-to-end delay between the encoder and at least two of the decoders in the multipoint conference.

7. The method of claim 5, wherein the one way delay is determined by using a weighted average over the delay between the end-to-end delays between the encoder and at least two of the decoders in the multipoint conference.

8. The method of claim 1, wherein the fluctuation of coded picture size decreases with an increase in the one way delay.

9. A non-transitory computer-readable storage medium comprising a set of executable instructions to direct a processor to perform the methods in one of claims 5-7.