Image encoding apparatus

• US 5,631,644 A
• Filed: 12/22/1994
• Issued: 05/20/1997
• Est. Priority Date: 12/22/1993
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Fujiwara, Yohichi, Katata, Hiroyuki, Kusao, Hiroshi
• Primary Examiner(s): Gaffin, Jeffrey A.
• Assistant Examiner(s): Kost, Jason L. W.
• Application Number:
  US08/362,148
• Time in Patent Office: 880 Days
• Field of Search: 341/67, 341/51, 358/426, 358/430, 382/232, 382/238, 382/239
• US Class Current: 341/67
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

In an image encoding apparatus, image information is quantized and variable-length encoding is performed thereon so that the data are stored in a buffer. Thereafter, the data in the buffer are transmitted to the outside at a fixed data rate. At this time, a controller monitors a number of occupied bits in the buffer, and when the number of occupied bits is not more than predetermined thresholds, the controller switches the output of the apparatus to a dummy data generator. At this time, a parameter which is used for rate control is initialized, and dummy data which can be eliminated at a decoding circuit are outputted from the dummy data generator. Furthermore, bit allocation is changed so that a sum of the number of occupied bits and the bit allocation to a frame, which is determined before encoding, does not exceed a fixed amount. Moreover, when the number of occupied bits exceeds the fixed value, a quantization step size is changed to a greater value. This efficiently prevents underflow and overflow of the buffer, and the image information can be encoded with excellent quality.

Claims

1. An image encoding apparatus comprising:

quantizing means for quantizing an input image;

variable-length encoding means for performing variable-length encoding on the quantized result of said quantizing means;

temporary storage means for temporarily storing encoded data from said variable-length encoding means, the stored encoded data thereafter being transmitted at a fixed data rate;

encoded data amount control means for calculating a quantization step size of quantizing information to be encoded based upon the encoded result of said variable-length encoding means to control an amount of data encoded by said variable-length encoding means;

dummy data generating means for generating dummy data, eliminatable when decoding the encoded data;

switching means for switching an output of said image encoding apparatus between the encoded data from said temporary storage means and the dummy data from said dummy data generating means; and

control means for monitoring a number of occupied bits of encoded data in said temporary storage means to control switching of said switching means such that the output of the image encoding apparatus is the encoded data from said temporary storage means when the number of occupied bits of encoded data exceeds a predetermined threshold, and such that transmission of encoded data from said temporary storage means is suspended and the output of the image encoding apparatus is the dummy data generated from said dummy data generating means when the number of occupied bits of encoded data is not more than the predetermined threshold, wherein said control means outputs a switching signal to said encoded data amount control means when the number of occupied bits of encoded data is not more than the predetermined threshold, and

said encoded data amount control means initializes parameters which are used for calculation of the quantization step size when the switching signal is output.

2. The image encoding apparatus as defined in claim 1, further comprising:

block dividing means for dividing one frame of the input image into a plurality of macroblocks; and

two-dimensional orthogonal transforming means for carrying out two-dimensional orthogonal transformation on an output of said block dividing means,

wherein said quantizing means quantizes an output of said two-dimensional orthogonal transforming means.

3. The image encoding apparatus as defined in claim 2, further comprising:

motion compensation inter-frame predicting means for, while calculating a motion vector of each macroblock by comparing a current frame with another frame, predicting a macroblock in the current frame from the another frame,

wherein intra-frame encoding is performed on a frame of a picture (I) appearing at predetermined frame intervals and inter-frame prediction encoding is performed on a frame of a picture other than the I picture.

4. The image encoding apparatus as defined in claim 3, further comprising:

subtracting means for obtaining a difference between image data predicted by said motion compensation inter-frame predicting means and current input image data,

wherein when inter-frame prediction encoding is performed, two-dimensional orthogonal transformation is carried out on a prediction difference obtained by said subtracting means by said two-dimensional orthogonal transforming means and the transformed prediction difference is quantized by said quantizing means.

5. The image encoding apparatus as defined in claim 3, wherein said motion compensation inter-frame predicting means includes:

inverse quantizing means for inversely quantizing an output of said quantizing means;

inverse orthogonal transforming means for carrying out inverse orthogonal transformation on an output of said inverse quantizing means;

a frame memory for storing image data reconstructed by said inverse orthogonal transforming means; and

motion compensation predicting circuit for calculating a motion vector from reconstructed image data stored in said frame memory and current input image data so as to predict a macroblock of a current frame.

6. The image encoding apparatus as defined in claim 1, wherein said encoded data amount control means includes:

bit allocating means for calculating a degree of complexity in an image of a frame to be encoded from the encoded results up to the previous frame, wherein a number of bits to be allocated to the frame to be encoded is determined from the calculated degree of complexity;

reference quantization step size determining means for calculating a virtual buffer fullness based upon the number of generated bits obtained from said variable-length encoding means and the number of bits allocated by said bit allocating means so as to determine the reference quantization step size from the virtual buffer fullness; and

quantization step size determining means for calculating activities relating to fineness of a picture of an image, to determine a quantization step size used in the quantizing means by changing the reference quantization step size based upon calculated activities of an image to be encoded and an average value of the calculated activities of the frame previously encoded,

wherein the parameters, initialized when the switching signal is input to said encoded data amount control means, include the degree of complexity, the initial virtual buffer fullness and the average value of the activities of the previous frame.

7. The image encoding apparatus as defined in claim 1, wherein said dummy data generating means generates dummy data with an arbitrary data length which include a dummy data start code indicating starting of the dummy data generation and a dummy data end code indicating an end of the generated dummy data.

8. The image encoding apparatus as defined in claim 1, wherein said dummy data generating means successively generates predetermined dummy codes composed of a plurality of bits.

9. The image encoding apparatus as defined in claim 1, wherein:

said variable-length encoding means adds a predetermined start code to a front of each frame,

said dummy data generating means generates dummy data wherein same bits continue, and

said control means controls a switching operation of the switching means immediately after the start code is outputted from said temporary storage means so that the dummy data are outputted from said dummy data generating means successively after generating the start code, when the output of the image encoding apparatus is switched to the dummy data.

10. The image encoding apparatus as defined in claim 1, wherein:

said temporary storage means stores a predetermined amount of eliminatable dummy data in an initial state, and

the predetermined thresholds are set to value relatively smaller than the number of occupied bits in said temporary storage means, in an initial stage.

11. An image encoding apparatus, comprising:

quantizing means for quantizing information of an input image;

variable-length encoding means for performing variable-length encoding on the quantized result of said quantizing means;

temporary storage means for temporary storing encoded data from said variable-length encoding means, the stored encoded data thereafter being transmitted at a fixed data rate; and

encoded data amount control means for calculating bit allocation per frame of image information to be encoded based upon the encoded result of said variable-length encoding means, and calculating a quantization step size from the calculated bit allocation, and adjusting the quantization step size of quantization in said quantizing means according to the calculated bit allocation to control an amount of the encoded data of said variable-length encoding means,

wherein said encoded data amount control means includes bit allocation changing means for monitoring a number of occupied bits of encoded data in the temporary storage means and for changing the calculated bit allocation when a sum of a bit allocation of a frame, which has been calculated before encoding, and a number of occupied bits of encoded data in said temporary storage means, at the time of the calculation of the bit allocation, exceeds a predetermined threshold, the bit allocation being changed such that the sum does not exceed the predetermined threshold.

12. The image encoding apparatus as defined in claim 11, further comprising:

block dividing means for dividing one frame of the input image into a plurality of macroblocks; and

two-dimensional orthogonal transforming means for carrying out two-dimensional orthogonal transformation on an output of said block dividing means,

wherein said quantizing means quantizes an output of said two-dimensional orthogonal transforming means.

13. The image encoding apparatus as defined in claim 12, further comprising:

motion compensation inter-frame predicting means for, while calculating a motion vector of each macroblock by comparing a current frame with another frame, predicting a macroblock of the current frame from the another frame,

wherein intra-frame encoding is performed on a frame of a picture (I) appearing at predetermined frame intervals and inter-frame prediction encoding is performed on a frame of a picture other than the I picture.

14. The image encoding apparatus as defined in claim 13, further comprising:

subtracting means for obtaining a difference between image data predicted by said motion compensation inter-frame predicting means and current input image data,

wherein when inter-frame prediction encoding is performed, two-dimensional orthogonal transformation is carried out on a prediction difference obtained by said subtracting means by said two-dimensional orthogonal transforming means and the transformed prediction difference is quantized by said quantizing means.

15. The image encoding apparatus as defined in claim 13, wherein said motion compensation inter-frame predicting means includes:

inverse quantizing means for inversely quantizing an output of said quantizing means;

inverse orthogonal transforming means for carrying out inverse orthogonal transformation on an output of said inverse quantizing means;

a frame memory for storing image data reconstructed by said inverse orthogonal transforming means; and

motion compensation predicting circuit for calculating a motion vector from the reconstructed image data stored in said frame memory and current input image data so as to predict a macroblock of a current frame.

16. The image encoding apparatus as defined in claim 11, wherein said encoded data amount control means includes:

bit allocating means for calculating a degree of complexity in an image of a frame to be encoded from the encoded results up to the previous frame, wherein a number of bits to be allocated to the frame to be encoded is determined from the calculated degree of complexity;

said bit allocation changing means changing the bit allocation obtained by said bit allocating means;

reference quantization step size determining means for calculating a virtual buffer fullness based upon the number of generated bits obtained from said variable-length encoding means and the bit allocation changed by said bit allocation changing means so as to determine a reference quantization step size from the virtual buffer fullness; and

quantization step size determining means for calculating activities relating to fineness of a picture of an image, to determine a quantization step size used in the quantization step size determining circuit by changing the reference quantization step size based upon calculated activities of an image to be encoded and an average value of the calculated activities of the frame to be previously encoded.

17. The image encoding apparatus as defined in claim 11, wherein said bit allocation changing means changes the bit allocation to a value obtained by subtracting the number of occupied bits of encoded data from the predetermined threshold when the sum of the bit allocation to the frame, calculated before encoding, and the number of occupied bits of encoded data in the temporary storage means, at the time of calculation of the bit allocation, exceeds the predetermined threshold.

18. The image encoding apparatus as defined in claim 11, wherein said encoded data amount control means further includes quantization step size changing means for monitoring a number of occupied bits of encoded data in said temporary storage means and for changing the calculated quantization step size to a greater value when the number of occupied bits of encoded data exceeds the predetermined threshold.