Low latency video encoder

• US 9,706,203 B2
• Filed: 07/21/2015
• Issued: 07/11/2017
• Est. Priority Date: 07/25/2014
• Status: Active Grant

• Current Assignee: Allegro DVT2 Co.
• Original Assignee: Allegro Dvt
• Inventors: Eymery, Pascal, Chong-Pan, Christophe
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US14/805,120
• Publication Number:
  US 20160029020A1
• Time in Patent Office: 721 Days
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

The invention concerns a method comprising: encoding, by a video encoder and based on a first quantization factor (QP), one or more first groups of image blocks of a video frame; estimating, by a processing device, the size of an image slice comprising a plurality of further groups of image blocks to be encoded; and determining, based on the estimated size of the image slice, a second quantization factor (QP) to be applied to one or more of the further groups.

Claims

1. A method comprising:

encoding, by a video encoder and based on a first quantization factor (QP), one or more first groups of image blocks of a first video frame;

estimating, by a processing device, the size of an image slice comprising a first plurality of further groups of image blocks to be encoded; and

determining, based on the estimated size of the image slice, a second quantization factor (QP) to be applied to one or more of the further groups of the first plurality of further groups.

2. The method of claim 1, wherein the image slice is a sliding window comprising a fixed number N_G of further groups of image blocks to be encoded, wherein N_G is an integer equal to 2 or more.

3. The method of claim 2, wherein the one or more first groups of image blocks are stored in a buffer, and wherein the method further comprises predicting the occurrence of buffer overflow in said buffer based on the estimated size of the sliding window.

4. The method of claim 2, wherein the further groups of image blocks of the image slice comprise at least one group of image blocks of the first video frame and at least one group of image blocks of a second video frame following the first video frame.

5. The method of claim 2, further comprising:

encoding, based on the second quantization factor (QP), the one or more further groups of image blocks of the first plurality of image blocks; and

estimating, by the processing device, a new size of the sliding window comprising a second plurality of N_G further groups of image blocks to be encoded; and

determining, based on the estimated new size of the sliding window, a third quantization factor (QP) to be applied to one or more of the further groups of the second plurality of further groups.

6. The method of claim 1, wherein the first video frame comprises N groups of image blocks, N being equal to 3 or more, and wherein the further groups of the first plurality comprise N′

groups, where N′

is less than N.

7. The method of claim 1, wherein estimating the size of the image slice comprises estimating the size of each of the first plurality of further groups of image blocks based on the size of the first group of image blocks.

8. The method of claim 7, wherein the size of each of the further groups of image blocks of the first plurality is estimated by:

identifying, for each further group of image blocks, a corresponding group of image blocks in a previous video frame; and

estimating the size of each further group of image blocks based on the size of its corresponding group of image blocks in the previous frame and on the quantization factor that was used to encode the corresponding group of image blocks, wherein estimating the size of each of the further groups of image blocks is based on the equation;

9. The method of claim 8, wherein, for each further group of image blocks, the corresponding group of image blocks is either:

a group of image blocks of the previous frame having the same position in the image as the further group;

or

a group of image blocks identified based on one or more motion vectors between image blocks of the previous video frame and image blocks of the first video frame.

10. The method of claim 1, wherein determining the second quantization factor comprises comparing the estimated size of the image slice with an image slice size limit, and reducing or increasing the first quantization factor based on the comparison.

11. The method of claim 1, further comprising:

detecting by the processing device whether or not a scene change occurred between the video frame and a previous video frame by comparing the size of the first group of image blocks with at least one threshold determined based on the size of a group of image blocks in a previous frame corresponding to the first group;

if a scene change is not detected, estimating the size of each further group of image blocks based on the size of a corresponding group of image blocks in the previous video frame; and

if a scene change is detected, estimating the size of each further group of image blocks based on the size of one or more encoded groups of image blocks of the current video frame.

12. The method of claim 1, wherein each video frame comprises N groups of image blocks, and wherein the video slice comprises N groups of image blocks.

13. A processing device comprising:

estimator circuitry that determines, based on a first quantization factor (QP) used to encode one or more first groups of image blocks of a first video frame, the size of an image slice comprising a first plurality of further groups of image blocks to be encoded; and

rate control circuitry that determines, based on the estimated size of the image slice, a second quantization factor (QP) to be applied to one or more of the further groups of the first plurality of further groups.

14. A video transmission circuit comprising:

a video encoder adapted to compress a video signal based on quantization parameter;

the processing device of claim 13 for providing the quantization parameter; and

an output buffer for storing the compressed video signal.

15. A video transmission system comprising:

the video transmission circuit of claim 14, wherein the video signal is provided by a capture device;

a receive circuit coupled to the video transmission circuit by a transmission interface, the receive circuit comprising;

an input buffer for receiving the compressed video signal;

a decoder for decoding the compressed video signal to generate a decompressed video signal; and

a display for displaying the decompressed video signal.

16. A video transmission circuit comprising:

a video encoder adapted to compress a video signal based on quantization parameter;

a processing device for providing the quantization parameter, adapted to estimate, based on a first quantization factor (QP) used to encode one or more first groups of image blocks of a first video frame, the size of an image slice comprising a first plurality of further groups of image blocks to be encoded, and to determine, based on the estimated size of the image slice, a second quantization factor (QP) to be applied to one or more of the further groups of the first plurality of further groups; and

an output buffer for storing the compressed video signal.

17. A video transmission system comprising:

the video transmission circuit of claim 16, wherein the video signal is provided by a capture device;

a receive circuit coupled to the video transmission circuit by a transmission interface, the receive circuit comprising;

an input buffer for receiving the compressed video signal;

a decoder for decoding the compressed video signal to generate a decompressed video signal; and

a display for displaying the decompressed video signal.