Interframe adaptive vector quantization encoding apparatus and video encoding transmission apparatus

• US 4,710,812 A
• Filed: 02/28/1986
• Issued: 12/01/1987
• Est. Priority Date: 02/28/1985
• Status: Expired due to Term

• Current Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Itoh, Atsushi, Asai, Kohtaro, Murakami, Tokumichi, Nishida, Masami, Kamizawa, Koh
• Primary Examiner(s): Britton, Howard W.
• Assistant Examiner(s): Peng, John K.
• Application Number:
  US06/833,269
• Time in Patent Office: 641 Days
• Field of Search: 358/11, 358/105, 358/133, 358/134-136, 358/180-182, 375/27
• US Class Current: 375/240.13
• CPC Class Codes: G06T 9/008 Vector quantisation
• CPC Class Codes: H04N 11/042 Codec means
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/94 Vector quantisation
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00

Abstract

In an interframe adaptive quantization encoding apparatus to perform efficient encoding of video signals using vector quantization method, analog signals raster-scanned from the left to the right on the screen and from the upper side to the lower side are converted into digital signals, the digital signals per every m picture elements x n lines are made a block and the block data is subjected to mean value separation in a vector quantization encoder thereby input vector is formed, inner product between the input vector and output vector read from a code book ROM is estimated by an inner product operation circuit, and maximum value of the inner product is estimated by a maximum inner product detection circuit and made amplitude coefficient, thereby efficient encoding is performed. The efficient encoding data is transmitted to the transmission path by a transmission data buffer and at the same time threshold value of movement detection in the vector quantization encoding is controlled by a movement detection control circuit, and the encoding data supplied from the vector quantizer is decoded by a vector quantization decoder and the block data is reproduced, thereby the apparatus can be constituted without increasing the circuit scale.

Claims

1. An interframe adaptive vector quantization apparatus comprising:

a frame memory for storing at least one frame of video signals normally;

a subtractor where, when input signal series of K in number (K;

integer) are brought together into a block and the last video signal series is inputted, prediction signal series in a block at position corresponding to the same position as the previous block at least one frame before the previous signal series on the screen is read from the frame memory and the interframe difference signal series is calculated;

a mean value separation circuit for estimating intrablock mean value of the interframe difference signal series and converting it into input vector by the mean value separation;

a vector quantization encoding member for encoding the input vector into discrimination code of the output vector to maximize total sum of products of elements of the input and output vectors, i.e., the inner product, among a plurality of sets of the output vectors optimized by clustering method in the poly-dimensional space based on statistical properties of normalization vectors by the normalization of the input vectors by the intrablock standard deviation;

a movement detection circuit for executing processing that a block having amplitude coefficient as the total sum of products and the intrablock mean value both being less than prescribed threshold value is made insignificant block and the intrablock picture element values of the interframe difference signal series are made all zero;

a vector quantization decoding member for selecting output vector among the output vector discrimination code corresponding to the significant blocks other than the insignificant blocks and reproducing the interframe difference signal series by multiplication of the amplitude coefficient and adding of the mean value and making the interframe difference signal series to be zero for the insignificant block;

an adder for adding the interframe difference signal series reproduced after the vector quantization to the prediction signal series and reproducing the video signal and writing the video signal to the frame memory; and

a transmission data buffer for performing the variable length encoding of the significance/insignificance block discrimination code, the output vector discrimination code, the block mean value and the amplitude coefficient and controlling the threshold value to make the information generating amount constant.

2. An interframe adaptive vector quantization encoding apparatus as set forth in claim 1, wherein when the output vector to maximize the total sum of products of elements of input and output vectors is retrieved in the vector quantization encoding member, set of the output vectors are arranged in tree structure, total sum of products of elements of two output vectors and input vector in each branch is calculated, and vector having larger total sum of products is selected in sequence from upper stage to lower stage of the tree structure.

3. An interframe adaptive vector quantization encoding apparatus as set forth in claim 1, further comprising:

means for eliminating redundancy component of the mean value and the amplitude coefficient in the encoding member and the decoding member using differential PCM encoding (hereinafter referred to as "DPCM encoding") and then converting the mean value and the amplitude coefficient of the DPCM encoding into prescribed codes utilizing variable encoding; and

means for obtaining the mean value and the amplitude coefficient of the DPCM encoding among the prescribed codes as output of the encoding circuit and then decoding and reproducing the mean value and the amplitude coefficient using the DPCM decoding method.

4. An interframe adaptive vector quantization decoding apparatus as set forth in claim 1, the vector quantization encoding member comprises a normalization output vector code table memory for storing set of mean value separation normalization output vectors specified to provide the minimum distortion previously to the normalization input vector by mean value separation normalization, an absolute value distortion calculation circuit for calculating distortion between the normalization input vector and the normalization output vectors read in sequence from the normalization output vector code table and subjected to the mean value separation, a minimum distortion normalization output vector detection circuit for detecting the minimum distortion among the distortions and determining index of the normalization output vector to provide the minimum distortion, an amplitude correction circuit for correcting the normalization constant calculated in the mean value separation normalization circuit referring to the minimum distortion so that distortion between the output vectors by the amplitude reproduction and the mean value adding to the normalization output to provide said minimum distortion and the input vector becomes minimum, and an encoding member for encoding the mean value component of the input vector, the corrected amplitude value and the vector quantization index to provide the minimum distortion, and the vector quantization decoding member comprises a decoder for decoding the output of the encoding member and obtaining index of the normalization output vector to provide the minimum distortion, the mean value and the corrected amplitude value, and a decoding member for performing the amplitude adding and the mean value adding to the normalization output vector which is read from the normalization output vector code table memory according to the decoded index and subjected to the mean value separation, using the decoded mean value component and the corrected amplitude value so as to obtain the reproduction output vector.

5. An interframe adaptive vector quantization encoding apparatus as set forth in claim 1, wherein the mean value separation circuit is cos conversion normalization member for performing cos conversion of the input vector and separating the d.c. component and normalizing the amplitude of the a.c. component so as to obtain the cos conversion normalization input vector, and the vector quantization encoding member comprises a vector quantization member including a first code table memory to enable rewriting of content of the cos conversion normalization input vector dynamically for selecting the cos conversion normalization output vector to provide the minimum distortion to the cos conversion normalization input vector among set of the cos conversion output vectors stored in the first code table memory and outputting the vector quantization index of the cos conversion normalization output vector, a code table updating member for performing vector adding averaging of the cos conversion normalization input vector group quantized to the same index in the vector quantization member and writing it as set of the updated cos conversion normalization output vectors in the first code table memory, and an encoder for encoding the updated cos conversion normalization output vectors, the vector quantization index obtained in the vector quantization member using the set, the d.c. component and the amplitude and transmitting them, and the vector quantization decoding member comprises a decoder for decoding the encoding member output signals transmitted from the encoder, a second code table memory which can write the set of the updated cos conversion normalization output vectors, and a normalization restoration inverse cos conversion circuit for multiplying the amplitude component decoded by the decoder to the cos conversion normalization output vectors read from the second code table memory according to the vector quantization index decoded by the decoder and adding the d.c. component decoded and performing the inverse cos conversion so as to reproduce the output vectors.

6. An interframe adaptive vector quantization encoding apparatus as set forth in claim 1, wherein the subtractor performs subtraction of color video correlation prediction signal formed from the color video input signal series composed of three components utilizing the color video reproduction signal series already encoded per each channel and outputs each color video difference signal, the vector quantization encoding member is provided with a vector quantizer which brings together the color video difference signals of K in number (K:

integer being not less than

     3) and performs the vector quantization of the vectors at K-dimensional signal space and outputs the output vector to provide the minimum distortion to the input vector and the index thereof, the adder addes the output vector to provide the minimum distortion as the color video vector quantization signal to the color video correlation prediction signal per each channel so as to obtain each color video reproduction signal, and the color video correlation prediction signal is obtained from the color video signal prediction device which performs multiplication of each color video signal prediction coefficient and each prediction coefficient between color video signals to the encoded signal series of each color video reproduction signal based on correlation not only between adjacent picture elements but also between various color channel picture elements.

7. An interframe adaptive vector quantization encoding apparatus as set forth in claim 1, wherein a matrix conversion circuit converts the color video input signal composed of three elements into luminance component and color difference component, a mean value separation circuit separates one or plural mean values among input vectors obtained by block formation of the luminous component and the color difference component throughout plural picture elements and normalizes amplitude of the output signals so as to obtain the mean value separation normalization vector, the vector quantization encoding member comprises an input vector register for storing each signal component after the vector normalization, a distortion calculation circuit for taking output signal of the output vector control table which previously stores mean value separation normalization output vector group specified to provide the minimum distortion to the output of the input vector register so as to output the mean value separation normalization output vector group, and thereby the distortion calculation circuit calculating the distortion, a minimum distortion detection circuit for detecting the minimum distortion among the distortions, and an index latch using the mean value outputted from the mean value separation circuit, the amplitude value outputted from the normalization circuit and the index strobe signal from the minimum distortion detection circuit as input and providing index of the minimum distortion vector outputted through the index register, and the vector quantization decoding member comprises an output vector address counter for supplying address signal to the output vector code table and index signal to the register, an amplitude reproduction circuit for decoding the encoding signal of the encoding circuit and obtaining the index of the mean value separation normalization output vector to provide the minimum distortion and the mean value and the amplitude value and performing the amplitude reproduction to the mean value separation normalization output vector decoded by the output vector code table using the decoded amplitude value, a mean value adding circuit for performing the mean value adding to the output of the amplitude reproduction circuit using the decoded mean value, and a matrix reverse conversion circuit for performing the matrix reverse conversion of the output of the mean value adding circuit composed of the luminance component and the color difference component into components of red, green and blue.

8. An interframe adaptive vector quantization encoding apparatus as set forth in claim 7, wherein the mean value separation of only the luminance component is performed in the mean value separation circuit.

9. A video encoding transmission apparatus comprising:

a video encoding circuit for inputting video signal and performing A/D conversion of the signal and then applying efficient video encoding processing per frame to digital video data taken per every other video frame;

a transmission buffer constituted by a double buffer to enable simultaneous write/read, for storing one video frame of variable length encoding data with the information generating amount as the video encoding circuit output being not constant and outputting the encoding data at constant speed by the speed smoothing;

a transmission control member at transmission side for performing the transmission framing to enable discrimination per one frame unit to the encoding data transmitted from the transmission buffer and transmitting the encoding data from the transmission buffer to the digital transmission path at constant speed;

a transmission control member at receiving side for receiving the encoded data transmitted from the digital transmission path;

a receiving buffer constituted by a double buffer to enable simultaneous write/read, for storing one frame of encoding data among the receiving data supplied from the transmission control member at receiving side and outputting one video frame of the encoding data at speed being different from the inputting state using synchronous signal supplied from a synchronous signal generating circuit at decoding side as hereinafter described;

a synchronous signal generating circuit at decoding side for generating various clocks required for the decoding action at asynchronous state to the transmission side;

a video decoding circuit for performing decoding of one video frame of the encoding data using the decoding clock supplied from the synchronous signal generating circuit at decoding side; and

a controller for controlling the input/output operation of the transmission buffer and the receiving buffer.