Adaptive video coder with dynamic bit allocation

• US 5,457,495 A
• Filed: 05/25/1994
• Issued: 10/10/1995
• Est. Priority Date: 05/25/1994
• Status: Expired due to Term

• Current Assignee: AT&T IPM Corp. (AT&T, Inc.)
• Original Assignee: AT&T IPM Corp. (AT&T, Inc.)
• Inventors: Hartung, John
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US08/248,982
• Time in Patent Office: 503 Days
• Field of Search: 348/400, 348/401, 348/414, 348/417, 348/418, 348/422, 348/14, 348/15
• US Class Current: 375/240.14
• CPC Class Codes: G06T 9/008 Vector quantisation
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/94 Vector quantisation

Abstract

A method of coding a video signal at a fixed bit rate with use of a vector quantization codebook, wherein advantageous codebook updates are determined by comparing a coding error associated with a first provisional coding of a frame with a coding error associated with a second provisional coding of the frame. The first provisional coding uses a fixed available number of bits to code a frame with use of the unmodified codebook, whereas the second provisional coding uses a modified codebook to code the same frame. However, the second provisional coding codes both the frame and the codebook updates with the fixed available number of bits. The provisional coding having the smaller coding error is selected as the coding of the frame which will be adopted. In addition, the codebook may be replaced with the modified codebook when the second provisional coding is selected. In this manner, the coder will adapt the codebook to the characteristics of the scene.

Claims

1. A method of coding a signal with use of a vector quantization codebook, the codebook comprising a plurality of vectors, the signal comprising a succession of frames, each of the frames comprising one or more frame portions, the method comprising the steps of:

determining a first provisional coding of a given one or more of said frames wherein each of one or more of the portions of the given one or more of said frames are coded with use of the codebook, the first provisional coding using at most a fixed, predetermined number of bits;

generating a modified codebook by replacing one or more of said vectors in said codebook with one or more substitute vectors;

determining a second provisional coding of the given one or more of said frames, wherein

(i) the one or more substitute vectors which replaced the one or more of said vectors in said codebook are coded, and

(ii) each of one or more of the portions of the given one or more frames are coded with use of the modified codebook,

the second provisional coding using at most the fixed, predetermined number of bits;

determining a first coding error associated with the first provisional coding and a second coding error associated with the second provisional coding; and

selecting the provisional coding having the smaller associated coding error as the coding of the given one or more frames.

2. The method of claim 1 further comprising the step of replacing the codebook with the modified codebook when the first coding error is greater than the second coding error.

3. The method of claim 1 wherein each of the substitute vectors comprises one of the frame portions.

4. The method of claim 1 wherein each of the substitute vectors comprises a transformation of one of the frame portions into a frequency domain.

5. The method of claim 1 wherein each of the substitute vectors comprises a transformation into a frequency domain of a difference between one of the frame portions of one of said one or more frames and a corresponding portion of a previous one of said one or more frames.

6. The method of claim 1 wherein each of the substitute vectors comprises a transformation into a frequency domain of a difference between one of the frame portions of one of said one or more frames and a corresponding motion compensated portion of a previous one of said one or more frames.

7. The method of claim 1 wherein the coding of the frame portions comprises quantizing the frame portions by performing a subband decomposition of said frame portions.

8. The method of claim 1 wherein the coding of the frame portions comprises quantizing differences between the frame portions of one of said one or more frames and corresponding portions of a previous one of said one or more frames by performing a subband decomposition of said differences.

9. The method of claim 1 wherein the coding of the frame portions comprises quantizing differences between the frame portions of one of said one or more flames and corresponding motion compensated portions of a previous one of said one or more flames by performing a subband decomposition of said differences.

10. The method of claim 1 wherein the coding of the frame portions comprises quantizing the frame portions by performing a transformation of said frame portions into a frequency domain.

11. The method of claim 10 wherein the transformation of said frame portions comprises a discrete cosine transformation.

12. The method of claim 1 wherein the coding of the frame portions comprises quantizing differences between the frame portions of one of said one or more frames and corresponding portions of a previous one of said one or more frames by performing a transformation of said differences into a frequency domain.

13. The method of claim 12 wherein the transformation of said differences comprises a discrete cosine transformation.

14. The method of claim 1 wherein the coding of the frame portions comprises quantizing differences between the frame portions of one of said one or more frames and corresponding motion compensated portions of a previous one of said one or more frames by performing a transformation of said differences into a frequency domain.

15. The method of claim 14 wherein the transformation of said differences comprises a discrete cosine transformation.

16. An apparatus for coding a signal with use of a vector quantization codebook, the codebook comprising a plurality of vectors, the signal comprising a succession of frames, each of the frames comprising one or more frame portions, the apparatus comprising:

means for determining a first provisional coding of a given one or more of said frames wherein each of one or more of the portions of the given one or more of said frames are coded with use of the codebook, the first provisional coding using at most a fixed, predetermined number of bits;

means for generating a modified codebook by replacing one or more of said vectors in said codebook with one or more substitute vectors;

means for determining a second provisional coding of the given one or more of said frames, wherein

(i) the one or more substitute vectors which replaced the one or more of said vectors in said codebook are coded, and

(ii) each of one or more of the portions of the given one or more frames are coded with use of the modified codebook,

the second provisional coding using at most the fixed, predetermined number of bits;

means for determining a first coding error associated with the first provisional coding and a second coding error associated with the second provisional coding; and

means for selecting the provisional coding having the smaller associated coding error as the coding of the given one or more frames.

17. The apparatus of claim 16 further comprising means for replacing the codebook with the modified codebook when the first coding error is greater than the second coding error.

18. The apparatus of claim 16 further comprising means for generating the one or more substitute vectors, wherein each of the substitute vectors comprises one of the frame portions.

19. The apparatus of claim 16 further comprising means for generating the one or more substitute vectors, wherein each of the substitute vectors comprises a transformation of one of the frame portions into a frequency domain.

20. The apparatus of claim 16 further comprising means for generating the one or more substitute vectors, wherein each of the substitute vectors comprises a transformation into a frequency domain of a difference between one of the frame portions of one of said one or more frames and a corresponding portion of a previous one of said one or more frames.

21. The apparatus of claim 16 further comprising means for generating the one or more substitute vectors, wherein each of the substitute vectors comprises a transformation into a frequency domain of a difference between one of the frame portions of one of said one or more frames and a corresponding motion compensated portion of a previous one of said one or more frames.

22. The apparatus of claim 16 further comprising means for quantizing the frame portions by performing a subband decomposition of said frame portions.

23. The apparatus of claim 16 further comprising means for quantizing differences between the frame portions of one of said one or more frames and corresponding portions of a previous one of said one or more frames by performing a subband decomposition of said differences.

24. The apparatus of claim 16 further comprising means for quantizing differences between the frame portions of one of said one or more frames and corresponding motion compensated portions of a previous one of said one or more frames by performing a subband decomposition of said differences.

25. The apparatus of claim 16 further comprising means for performing a transformation of said frame portions into a frequency domain.

26. The apparatus of claim 25 wherein said transformation comprises a discrete cosine transformation.

27. The apparatus of claim 16 further comprising means for quantizing differences between the frame portions of one of said one or more frames and corresponding portions of a previous one of said one or more frames by performing a transformation of said differences into a frequency domain.

28. The apparatus of claim 27 wherein the transformation of said differences comprises a discrete cosine transformation.

29. The apparatus of claim 16 further comprising means for quantizing differences between the frame portions of one of said one or more frames and corresponding motion compensated portions of a previous one of said one or more frames by performing a transformation of said differences into a frequency domain.

30. The apparatus of claim 25 wherein the transformation of said differences comprises a discrete cosine transformation.

31. A video teleconferencing system comprising:

a video camera for generating a video input signal;

means for coding the video input signal with use of a vector quantization codebook, the codebook comprising a plurality of vectors, the video input signal comprising a succession of frames, each of the frames comprising one or more frame portions, the coding means comprising

means for determining a first provisional coding of a given one or more of said frames wherein each of one or more of the portions of the given one or more of said frames are coded with use of the codebook, the first provisional coding using at most a fixed, predetermined number of bits,

means for generating a modified codebook by replacing one or more of said vectors in said codebook with one or more substitute vectors, means for determining a second provisional coding of the given one or more of said frames, wherein

(i) the one or more substitute vectors which replaced the one or more of said vectors in said codebook are coded, and

(ii) each of one or more of the portions of the given one or more frames are coded with use of the modified codebook,

the second provisional coding using at most the fixed, predetermined number of bits,

means for determining a first coding error associated with the first provisional coding and a second coding error associated with the second provisional coding, and

means for selecting the provisional coding having the smaller associated coding error as the coding of the given one or more frames; and

means for transmitting the coded video input signal to a video receiver.

32. The video teleconferencing system in accordance with claim 31 further comprising:

means for receiving a received coded video signal;

means for decoding the received coded video signal to generate a decoded video signal; and

a video display for displaying the decoded video signal.

33. A video telephone comprising:

video camera means for generating a video input signal;

means for coding the video input signal with use of a vector quantization codebook, the codebook comprising a plurality of vectors, the video input signal comprising a succession of frames, each of the frames comprising one or more frame portions, the coding means comprising

means for determining a first provisional coding of a given one or more of said frames wherein each of one or more of the portions of the given one or more of said frames are coded with use of the codebook, the first provisional coding using at most a fixed, predetermined number of bits,

means for generating a modified codebook by replacing one or more of said vectors in said codebook with one or more substitute vectors,

means for determining a second provisional coding of the given one or more of said frames, wherein

(i) the one or more substitute vectors which replaced the one or more of said vectors in said codebook are coded, and

(ii) each of one or more of the portions of the given one or more frames are coded with use of the modified codebook,

the second provisional coding using at most the fixed, predetermined number of bits,

means for determining a first coding error associated with the first provisional coding and a second coding error associated with the second provisional coding, and

means for selecting the provisional coding having the smaller associated coding error as the coding of the given one or more frames; and

means for transmitting the coded video input signal across a telecommunications network.

34. The video telephone in accordance with claim 33 further comprising:

means for receiving a received coded video signal;

means for decoding the received coded video signal to generate a decoded video signal; and

a video display for displaying the decoded video signal.