Video encoding control method, video encoding apparatus, and video encoding program

• US 9,179,149 B2
• Filed: 05/02/2011
• Issued: 11/03/2015
• Est. Priority Date: 05/12/2010
• Status: Active Grant

• Current Assignee: Nippon Telegraph and Telephone Corporation
• Original Assignee: Nippon Telegraph and Telephone Corporation
• Inventors: Kitahara, Masaki, Shimizu, Atsushi, Ono, Naoki
• Primary Examiner(s): ELAHI, SHAN E
• Application Number:
  US13/695,865
• Publication Number:
  US 20130051458A1
• Time in Patent Office: 1,646 Days
• Field of Search: 375/240.04
• US Class Current: 1/1
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/198 including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value

Abstract

A video encoding control method encodes an input video signal by controlling a generated bit rate so a hypothetical buffer in a decoder does not overflow or underflow includes: sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding; calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value, and if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so the generated bit rate resulting from encoding is reduced and performing re-encoding from a first picture of an encoding-order picture group that is being encoded using the changed encoding parameter.

Claims

1. A video encoding control method which encodes an input video signal by controlling a generated bit rate so that a hypothetical buffer in a decoder does not overflow or underflow, the method comprising utilizing a processor and a memory device storing instructions causing the processor to execute the following operations:

sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value; and

if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so that the generated bit rate resulting from encoding is reduced and performing re-encoding from a first picture of an encoding-order picture group that is being encoded using the changed encoding parameter,

wherein when sequentially encoding, each picture in the encoding-order picture group is sequentially encoded in accordance with an encoding parameter set depending on a retry count indicating the number of times of the re-encoding, and

when performing the re-encoding, the retry count is incremented if the quantization statistic exceeds the predetermined threshold value and the encoding parameter is changed to an encoding parameter with which the generated bit rate resulting from encoding is reduced as the value of the retry count increases.

2. The video encoding control method according to claim 1, comprising checking a residual bit rate of the hypothetical buffer if the quantization statistic of each encoded picture does not exceed the predetermined threshold value until encoding of a last picture in the encoding-order picture group is completed, not changing the value of the retry count if the residual bit rate is smaller than a predetermined residual bit rate threshold value or the retry count is 0, and decrementing the retry count if the residual bit rate is larger than or equal to the residual bit rate threshold value and the retry count is not 0.

3. The video encoding control method according to claim 1, comprising decrementing the retry count if the quantization statistic of each encoded picture does not exceed the predetermined threshold value until encoding of a last picture in the encoding-order picture group is completed.

4. The video encoding control method according to claim 1, wherein

the encoding parameter is a quantization parameter, filter strength of a pre-filter for the input video signal, or both of the quantization parameter and the filter strength,

when the encoding parameter is the quantization parameter, an encoding parameter in which a step size of the quantization parameter increases as the value of the retry count increases is set, and

when the encoding parameter is the filter strength of the pre-filter, an encoding parameter in which a blurring degree by a filtering process increases as the value of the retry count increases is set.

5. A video encoding control method which encodes an input video signal by controlling a generated bit rate so that a hypothetical buffer in a decoder does not overflow or underflow, the method comprising:

sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures, with a first picture being an intra-predictive encoded picture, and being a collection of successive pictures in the order of encoding;

calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value;

if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so that the generated bit rate resulting from encoding is reduced, and performing re-encoding from a first picture of the encoding-order picture group set as a retry point using the changed encoding parameter; and

when encoding of the encoding-order picture group is completed, checking a residual bit rate of the hypothetical buffer, setting the retry point to a first picture in a next encoding-order picture group if the residual bit rate is larger than or equal to a predetermined residual bit rate threshold value, not changing the retry point if the residual bit rate of the hypothetical buffer is smaller than the predetermined residual bit rate threshold value, and setting the retry point to the first picture in the next encoding-order picture group if the quantization statistic does not exceed the predetermined threshold value in encoding of the first picture in the next encoding-order picture group.

7. The video encoding control method according to claim 5, wherein if the quantization statistic of each encoded picture does not exceed the predetermined threshold value until encoding of a last picture in the encoding-order picture group is completed in the re-encoding of the encoding-order picture group, an encoding parameter used to encode a next encoding-order picture group is restored to the value of an encoding parameter at the time of normal encoding.

9. The video encoding control method according to claim 5, wherein

if the quantization statistic does not exceed the predetermined threshold value until encoding of a last picture in the encoding-order picture group is completed in the re-encoding of the encoding-order picture group, a residual bit rate of the hypothetical buffer is checked,

an encoding parameter used to encode a next encoding-order picture group is not changed if the residual bit rate is smaller than a predetermined residual bit rate threshold value, and

the encoding parameter is restored to the value of an encoding parameter at the time of normal encoding if the residual bit rate is larger than or equal to the predetermined residual bit rate threshold value.

11. The video encoding control method according to claim 5, wherein

the encoding parameter is a quantization parameter, filter strength of a pre-filter for the input video signal, or both of the quantization parameter and the filter strength, and

the encoding parameter is changed to increase a step size of the quantization parameter at the time of the re-encoding when the encoding parameter is the quantization parameter and to increase a blurring degree by a filtering process when the encoding parameter is the filter strength of the pre-filter, at the time of the re-encoding of the encoding-order picture group.

6. A video encoding control method which encodes an input video signal by controlling a generated bit rate so that a hypothetical buffer in a decoder does not overflow or underflow, the method comprising:

sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value;

if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so that the generated bit rate resulting from encoding is reduced, performing re-encoding from a picture in an encoding-order picture group that is being encoded set as a retry point using the changed encoding parameter; and

setting the retry point so as to indicate a position of the picture from which the re-encoding starts based on a maximum inter-picture distance that is the number of maximum pictures capable of being traced back as re-encoding target pictures at the time of the re-encoding.

8. The video encoding control method according to claim 6, wherein if the quantization statistic of each encoded picture does not exceed the predetermined threshold value until encoding of a last picture in the encoding-order picture group is completed in the re-encoding of the encoding-order picture group, an encoding parameter used to encode a next encoding-order picture group is restored to the value of an encoding parameter at the time of normal encoding.

10. The video encoding control method according to claim 6, wherein

if the quantization statistic does not exceed the predetermined threshold value until encoding of a last picture in the encoding-order picture group is completed in the re-encoding of the encoding-order picture group, a residual bit rate of the hypothetical buffer is checked,

an encoding parameter used to encode a next encoding-order picture group is not changed if the residual bit rate is smaller than a predetermined residual bit rate threshold value, and

the encoding parameter is restored to the value of an encoding parameter at the time of normal encoding if the residual bit rate is larger than or equal to the predetermined residual bit rate threshold value.

12. The video encoding control method according to claim 6, wherein

the encoding parameter is a quantization parameter, filter strength of a pre-filter for the input video signal, or both of the quantization parameter and the filter strength, and

the encoding parameter is changed to increase a step size of the quantization parameter at the time of the re-encoding when the encoding parameter is the quantization parameter and to increase a blurring degree by a filtering process when the encoding parameter is the filter strength of the pre-filter, at the time of the re-encoding of the encoding-order picture group.

13. A video encoder which encodes an input video signal by controlling a generated bit rate so that a hypothetical buffer in a decoder does not overflow or underflow, comprising:

an encoding circuit which sequentially encodes each picture of an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

a quantization statistic calculation circuit which calculates a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, checks whether the quantization statistic exceeds a predetermined threshold value, and outputs retry information if detecting that the quantization statistic exceeds the predetermined threshold value; and

a parameter adjustment circuit which, if the retry information is output, changes the encoding parameter so that the generated bit rate resulting from encoding is reduced and notifies the encoding circuit of the changed encoding parameter,

wherein if the retry information is output, the encoding circuit re-encodes the input video signal from a first picture in an encoding-order picture group that is being encoded, using the encoding parameter changed by the parameter adjustment circuit,

wherein the encoding circuit sequentially encodes each picture of the encoding-order picture group in accordance with an encoding parameter set depending on a retry count indicating the number of times of re-encoding,

the video encoder includes a retry count management circuit which increments the retry count if the retry information is output and decrements the retry count if the retry information is not output until encoding of a last picture in the encoding-order picture group is completed, and

the parameter adjustment circuit sets an encoding parameter with which the generated bit rate resulting from encoding is reduced as the value of the retry count increases, and notifies the encoding circuit of the set encoding parameter, the encoding parameter being determined depending on the retry count.

14. The video encoder according to claim 13, comprising a buffer state prediction circuit which outputs parameter change/non-change information indicating that a parameter change is required or a parameter change is not required depending on whether a residual bit rate of the hypothetical buffer is larger than or equal to a predetermined residual bit rate threshold value, if encoding is completed without the quantization statistic not exceeding the predetermined threshold value until the last picture in the encoding-order picture group is encoded,

wherein when the retry count management circuit receives the parameter change/non-change information from the buffer state prediction circuit, the retry count management circuit does not change the value of the retry count if the parameter change/non-change information indicates that the parameter change is not required or the retry count is 0, and decrements the retry count if the parameter change/non-change information indicates that the parameter change is required and the retry count is not 0.

15. A video encoder which encodes an input video signal by controlling a generated bit rate so that a hypothetical buffer in a decoder does not overflow or underflow, comprising:

an encoding circuit which sequentially encodes each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

a quantization statistic calculation circuit which calculates a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, checks whether the quantization statistic exceeds a predetermined threshold value, and outputs retry information if detecting that the quantization statistic exceeds the predetermined threshold value;

a parameter adjustment circuit which, if the retry information is output, changes the encoding parameter so that the generated bit rate resulting from encoding is reduced, and notifies the encoding circuit of the changed encoding parameter;

a buffer state prediction circuit which checks a residual bit rate of the hypothetical buffer when encoding of the encoding-order picture group is completed and determines whether the residual bit rate is larger than or equal to a predetermined residual bit rate threshold value; and

a retry point management circuit which, in accordance with a determination result of the buffer state prediction circuit, sets a retry point to a first picture in a next encoding-order picture group if the residual bit rate of the hypothetical buffer is larger than or equal to the predetermined residual bit rate threshold value, does not change the retry point if the residual bit rate of the hypothetical buffer is smaller than the predetermined residual bit rate threshold value, and sets the retry point to the first picture in the next encoding-order picture group if the quantization statistic does not exceed the predetermined threshold value in encoding of the first picture in the next encoding-order picture group,

wherein if the retry information is output, the encoding circuit re-encodes the input video signal from the first picture in the encoding-order picture group set as the retry point using the encoding parameter changed by the parameter adjustment circuit.

16. A video encoder which encodes an input video signal by controlling a generated bit rate so that a hypothetical buffer in a decoder does overflow or underflow, comprising:

an encoding circuit which sequentially encode each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

a quantization statistic calculation circuit which calculates a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, checks whether the quantization statistic exceeds a predetermined threshold value, and outputs retry information if detecting that the quantization statistic exceeds the predetermined threshold value;

a parameter adjustment circuit which, if the retry information is output, changes the encoding parameter so that the generated bit rate resulting from encoding is reduced, and notifies the encoding circuit of the changed encoding parameter; and

a retry point management circuit which sets a retry point indicating a position of a picture from which re-encoding starts based on a maximum inter-picture distance that is the number of maximum pictures capable of being traced back as re-encoding target pictures at the time of the re-encoding,

wherein if the retry information is output, the encoding circuit re-encodes the input video signal from the picture set as the retry point in an encoding-order picture group that is being encoded using the encoding parameter changed by the parameter adjustment circuit.

17. A non-transitory computer-readable recording medium which stores a video encoding program for causing a computer to execute a video encoding control method comprising:

sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value; and

if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so that a generated bit rate resulting from encoding is reduced and performing re-encoding from a first picture of an encoding-order picture group that is being encoded using the changed encoding parameter,

wherein when sequentially encoding, each picture in the encoding-order picture group is sequentially encoded in accordance with an encoding parameter set depending on a retry count indicating the number of times of the re-encoding, and

when performing the re-encoding, the retry count is incremented if the quantization statistic exceeds the predetermined threshold value and the encoding parameter is changed to an encoding parameter with which the generated bit rate resulting from encoding is reduced as the value of the retry count increases.

18. A non-transitory computer-readable recording medium which stores a video encoding program for causing a computer to execute a video encoding control method comprising:

sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures, with a first picture being an intra-predictive encoded picture, and being a collection of successive pictures in the order of encoding;

calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value;

if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so that a generated bit rate resulting from encoding is reduced, and performing re-encoding from a first picture of the encoding-order picture group set as a retry point using the changed encoding parameter; and

when encoding of the encoding-order picture group is completed, checking a residual bit rate of the hypothetical buffer, setting the retry point to a first picture in a next encoding-order picture group if the residual bit rate is larger than or equal to a predetermined residual bit rate threshold value, not changing the retry point if the residual bit rate of the hypothetical buffer is smaller than the predetermined residual bit rate threshold value, and setting the retry point to the first picture in the next encoding-order picture group if the quantization statistic does not exceed the predetermined threshold value in encoding of the first picture in the next encoding-order picture group.

19. A non-transitory computer-readable recording medium which stores a video encoding program for causing a computer to execute a video encoding control method comprising:

sequentially encoding each picture in an encoding-order picture group in accordance with a predetermined encoding parameter, the encoding-order picture group including a predetermined number of pictures and being a collection of successive pictures in the order of encoding;

calculating a quantization statistic of each picture based on quantization parameter information used to encode each picture each time each picture is encoded, and checking whether the quantization statistic exceeds a predetermined threshold value;

if the quantization statistic exceeds the predetermined threshold value, changing the encoding parameter so that a generated bit rate resulting from encoding is reduced, performing re-encoding from a picture in an encoding-order picture group that is being encoded set as a retry point using the changed encoding parameter; and

setting the retry point so as to indicate a position of the picture from which the re-encoding starts based on a maximum inter-picture distance that is the number of maximum pictures capable of being traced back as re-encoding target pictures at the time of the re-encoding.