Pre-processing of bit rate allocation in a multi-channel video encoder

• US 6,259,733 B1
• Filed: 06/16/1998
• Issued: 07/10/2001
• Est. Priority Date: 06/16/1998
• Status: Expired due to Term

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: General Instrument Corporation (CommScope Holding Company, Inc.)
• Inventors: Kaye, James E., Manansala, Arthur C., Haskell, Paul E.
• Primary Examiner(s): Kelley, Chris
• Assistant Examiner(s): WONG, ALLEN C
• Application Number:
  US09/097,645
• Time in Patent Office: 1,120 Days
• Field of Search: 348/384, 348/385, 348/386, 348/387, 348/449, 348/405, 375/240
• US Class Current: 375/240
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/23655 Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams

Abstract

A method and apparatus for bit rate allocation, or statistical multiplexing, in a multi-channel video data encoder. A pre-processor in each channel determines a bit rate need prior to compression and encoding. A control processes the bit rate need in each channel to arrive at an allocated bit rate for each channel. The video data is then compressed and encoded according to the allocated bit rate. The bit rate demand accounts for various characteristics of the current picture data in each channel, including spatial activity, temporal activity, image size, frame rate, scene change, brightness, flash, fade, and horizontal pixel resolution. The system also biases the bit rate allocation according to inter-frame distance, whether the average spatial activity level is below a lower threshold, whether the inter-frame distance is above an upper threshold or below a lower threshold, whether the quantization of previous frames is above an upper threshold, the length of the Group of Pictures (GOP), and a user-selectable priority factor. The system also allocates any surplus bit rate among the channels to avoid having unused bandwidth.

Claims

1. A method for determining a bit rate need of a plurality of variable rate video channels in a video encoder, comprising the steps of:

processing video data from a current picture in each respective channel to determine at least a spatial activity and a temporal activity thereof;

determining a bit rate demand for each current picture according to the associated spatial activity and temporal activity;

determining an overall available bit rate for transmitting the current pictures in a multiplexed data stream;

determining, in an initial iteration, an initial allocated bit rate for each current picture according to a ratio of bit rate demand thereof to a sum of the bit rate demands from each current picture;

determining a bit rate surplus or deficit between the overall available bit rate and a sum of the initial allocated bit rates; and

adjusting, in at least one successive iteration, the initial allocated bit rate for at least some of the current pictures according to the surplus or deficit, and a ratio of bit rate demand thereof to a sum of the bit rate demands thereof.

2. The method of claim 1, wherein:

current pictures that have new bit rate demands have their initial allocated bit rates adjusted in said adjusting step.

3. The method of claim 1, wherein:

current pictures that have unchanged bit rate demands do not have their initial allocated bit rates adjusted in said adjusting step.

4. The method of claim 1, comprising the further step of:

providing the allocated bit rate for each current picture to respective video data compressors for compressing the respective current pictures to obtain compressed video data for transmission in said multiplexed data stream.

5. An apparatus for determining a bit rate need of a plurality of variable rate video channels in a video encoder, comprising:

means for processing video data from a current picture in each respective channel to determine at least a spatial activity and a temporal activity thereof;

means for determining a bit rate demand for each current picture according to the associated spatial activity and temporal activity;

means for determining an overall available bit rate for transmitting the current pictures in a multiplexed data stream;

means for determining, in an initial iteration, an initial allocated bit rate for each current picture according to a ratio of bit rate demand thereof to a sum of the bit rate demands from each current picture;

determining a bit rate surplus or deficit between the overall available bit rate and a sum of the initial allocated bit rates; and

means for adjusting, in at least one successive iteration, the initial allocated bit rate for at least some of the current pictures according to the surplus or deficit, and a ratio of bit rate demand thereof to a sum of the bit rate demands thereof.

6. The apparatus of claim 5, wherein:

current pictures that have new bit rate demands have their initial allocated bit rates adjusted by said adjusting means.

7. The apparatus of claim 5, wherein:

current pictures that have unchanged bit rate demands do not have their initial allocated bit rates adjusted by said adjusting means.

8. The apparatus of claim 6, further comprising:

means for providing the allocated bit rate for each current picture to respective video data compressors for compressing the respective current pictures to obtain compressed video data for transmission in said multiplexed data stream.