Method and apparatus for limiting data rate and image quality loss in lossy compression of sequences of digital images

• US 6,330,369 B1
• Filed: 07/10/1998
• Issued: 12/11/2001
• Est. Priority Date: 07/10/1998
• Status: Expired due to Term

• Current Assignee: Avid Technology Incorporated
• Original Assignee: Avid Technology Incorporated
• Inventors: Hoag, David F., Cornog, Katherine H.
• Primary Examiner(s): Tran, Phuoc
• Application Number:
  US09/113,954
• Time in Patent Office: 1,250 Days
• Field of Search: 382/232, 382/236, 382/239, 382/248, 382/250, 382/251, 348/405, 348/404, 358/536, 358/261.3, 358/430, 358/432, 358/433, 375/240.02, 375/240.03
• US Class Current: 382/251
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/197 including determination of the initial value of an encoding parameter H04N19/56 takes precedence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/60 using transform coding

Abstract

By limiting the extent to which the degree of quantization is lowered to increase the amount of compressed data, problems of data rate overshoots and image quality degradation in multi layer composites may be avoided. In particular, when a more complex image occurs after a simple image, the quantization used to compress the complex image will not cause as large of a change in the total amount of compressed data. Recovery from such a change also may occur more quickly. Where quantization tables are adjusted using a scaling factor, a limit on the scaling factor may be established such that the target data rate is not achieved for simple images. When rendering multi layer composites, this limit is such that recompression of previously compressed data does not result in additional loss of information. As a result, degradation of image quality in each layer of the composite is avoided. Where quantization tables are adjusted using a scaling factor, a limit on the scaling factor is established such that the same quantization table is used for each layer of the composite.

Claims

1. A computer-implemented process for compressing a sequence of digital images, comprising:

performing compression on at least part of a first image in the sequence of digital images according to a quantization table and a scale factor to provide an amount of compressed data;

if the amount of compressed data is greater than a target data rate, adjusting the scale factor such that a smaller amount of compressed data will be obtained by performing compression according to the adjusted scale factor and the quantization table than if the scale factor is not adjusted;

if the amount of compressed data is less than the target data rate, adjusting the scale factor such that a larger amount of data will be obtained by performing compression according to the adjusted scale factor and the quantization table than if the scale factor is not adjusted;

[and] comparing a magnitude of the scale factor to the magnitude of a limit factor; and

limiting the magnitude of the scale factor according to the comparison.

2. The computer-implemented process of claim 1, wherein the step of performing compression includes the steps of:

transforming blocks of the first image into matrices of values in a frequency domain; and

quantizing the matrices of values using the quantization table scaled by the scale factor[; and

wherein the steps of adjusting include changing the scale factor subject to the limit factor].

3. The computer-implemented process of claim 2, wherein the step of performing compression compresses the first image, and the process further comprises the step of, after adjusting the scale factor and limiting the magnitude of the scale factor, compressing a next image in the sequence of digital images using the adjusted scale factor having the limited magnitude and the quantization table.

4. The computer-implemented process of claim 3, wherein the step of performing compression compresses the first image only once.

5. The computer-implemented process of claim 2, wherein the step of performing compression compresses a first block of the first image in the sequence of digital images, and the process further comprises the step of, after adjusting the scale factor and limiting the magnitude of the scale factor, compressing a next block in the first image using the adjusted scale factor having the limited magnitude and the quantization table.

6. The computer-implemented process of claim 5, wherein the step of performing compression compresses the first block only once.

7. The computer-implemented process of claim 1, wherein the step of performing compression compresses the first image in the sequence of digital images, and the step of performing compression compresses the first image only once.

8. The computer-implemented process of claim 7, wherein both the step of adjusting the scale factor and the step of limiting the magnitude of the scale factor are performed only once on the first image.

9. The computer-implemented process of claim 1, wherein the step of performing compression compresses the first image in the sequence of digital images, and both the step of adjusting the scale factor and the step of limiting the magnitude of the scale factor are performed only once for the first image.

10. The computer-implemented process of claim 1, wherein the step of performing compression compresses a block of the first image in the sequence of digital images, and the step of performing compression compresses the block only once.

11. The computer-implemented process of claim 10, wherein both the step of adjusting the scale factor and the step of limiting the magnitude of the scale factor are performed only once on the block.

12. The computer-implemented process of claim 1, wherein the step of performing compression compresses a block of the image in the sequence of digital images, and both the step of adjusting the scale factor and the step of limiting the magnitude of the scale factor are performed only once for the block.

13. An apparatus for compressing a sequence of digital images, comprising:

an encoder having a first input for receiving uncompressed image data defining at least part of a first image of the sequence of digital images, a second input for receiving a signal indicating a quantization table, a third input for receiving a signal indicating a scale factor, both the quantization table and the scale factor for compressing the uncompressed image data, and an output for providing an amount of compressed data according to the quantization table and the scale factor; and

a controller comprising;

a circuit having a first input for receiving a signal indicating the amount of compressed data, a second input for receiving a signal indicating a target amount of compressed data and an output for providing an updated scale factor updated according to the difference between the target amount of data and the amount of compressed data; and

a comparator having a first input for receiving a limit factor, a second input for receiving the updated scale factor, and an output for providing a signal indicating an adjusted scale factor to the encoder, the adjusted scale factor selected according to a comparison of a magnitude of the updated scale factor to a magnitude of the limit factor such that the adjusted scale factor has a magnitude limited by the limit factor.

14. The apparatus of claim 13, wherein the encoder compresses the at least part of the first image using the quantization table scaled by the scale factor.

15. The apparatus of claim 13, wherein the uncompressed image data defines the first image, and the encoder is operative to compress the first image using the quantization table and the scale factor, and wherein the encoder is operative to compress the first image only once.

16. The apparatus of claim 15, wherein the controller is operative to adjust the scale factor only once for the first image and to limit the magnitude of the scale factor according to the limit factor only once for the first image.

17. The apparatus of claim 13, wherein the uncompressed image data defines the first image, and the encoder is operative to compress the first image using the quantization table and the scale factor, and wherein the controller is operative to adjust the scale factor only once for the first image and to limit the magnitude of the scale factor according to the limit factor only once for the first image.

18. The apparatus of claim 13, wherein the uncompressed image data defines a block of the first image, and the encoder is operative to compress the block using the quantization table and the scale factor, and wherein the encoder is operative to compress the block only once.

19. The apparatus of claim 18, wherein the controller is operative to adjust the scale factor only once for the block and to limit the scale factor according to the limit factor only once for the block.

20. The apparatus of claim 13, wherein the uncompressed image data defines a block of the first image, and the encoder is operative to compress the block using the quantization table and the scale factor, and wherein the controller is operative to adjust the scale factor only once for the block and to limit the magnitude of the scale factor according to the limit factor only once for the block.

21. The apparatus of claim 13, wherein the uncompressed image data defines the first image, the encoder is operative to compress the first image, and the third input is operative to receive the signal indicating the adjusted scale factor, and wherein the encoder is further operative to compress a next image in the sequence of digital images using the adjusted scale factor and the quantization table.

22. The apparatus of claim 21, wherein the encoder is operative to compress the first image only once.

23. The apparatus of claim 13, wherein the uncompressed image data defines a first block of the first image, the encoder is operative to compress the first block, and the third input is operative to receive the signal indicating the adjusted scale factor, and wherein the encoder is further operative to compress a next block of the image using the adjusted scale factor and the quantization table.

24. The apparatus of claim 23, wherein the encoder is operative to compress the first block only once.

25. A system for compressing a sequence of digital images, comprising:

means for performing compression on at least part of a first image in the sequence of digital images according to a quantization table and a scale factor to provide an amount of compressed data;

means for adjusting, if the amount of compressed data is greater than a target data rate, the scale factor such that a smaller amount of compressed data will be obtained by performing compression according to the adjusted scale factor and the quantization table than if the scale factor is not adjusted;

means for adjusting, if the amount of compressed data is less than the target data rate, the scale factor such that a larger amount of data will be obtained by performing compression according to the adjusted scale factor and the quantization table than if the scale factor is not adjusted;

means for comparing a magnitude of the scale factor to a magnitude of a limit factor; and

means for limiting a magnitude of the scale factor according to the comparison.

26. The system of claim 25, wherein the means for performing compression includes:

means for transforming blocks of the first image into matrices of values in a frequency domain; and

means for quantizing the matrices of values using the quantization table scaled by the scale factor.

27. The system of claim 26, wherein the means for performing compression comprises means for compressing the first image, and

wherein the system further comprises means for compressing, after adjusting the scale factor and limiting the magnitude of the scale factor, a next image in the sequence of digital images using the adjusted scale factor having the limited magnitude and the quantization table.

28. The system of claim 27, wherein the means for performing compression comprises means for compressing the first image only once.

29. The system of claim 26, wherein the means for performing compression comprises means for compressing a first block of the first image in the sequence of digital images, and the system further comprises means for compressing, after adjusting the scale factor and limiting the magnitude of the scale factor, a next block in the first image using the adjusted scale factor having the limited magnitude and the quantization table.

30. The system of claim 29, wherein the means for performing compression compresses the first block only once.

31. The system of claim 25, wherein the means for performing compression comprises means for compressing the first image in the sequence of digital images, and the means for performing compression comprises means for compressing the first image only once.

32. The system of claim 31, wherein the means for adjusting the scale factor comprises means for adjusting the scale factor only once on the first image, and wherein the means for limiting the scale factor comprises means for limiting the scale factor only once on the first image.

33. The system of claim 25, wherein:

the means for performing compression comprises means for compressing the first image in the sequence of digital images;

the means for adjusting the scale factor comprises means for adjusting the scale factor only once for the first image; and

the means for limiting the scale factor comprises means for limiting the scale factor only once for the first image.

34. The system of claim 25, wherein the means for performing compression comprises means for compressing a block of the first image in the sequence of digital images;

and

wherein the means for performing compression comprises means for compressing the block only once.

35. The system of claim 34, wherein the means for adjusting the scale factor comprises means for adjusting the scale factor only once on the block, and wherein the means for limiting the scale factor comprises means for limiting the scale factor only once on the block.

36. The system of claim 25, wherein:

the means for performing compression comprises means for compressing a block of the image in a sequence of digital images;

the means for adjusting the scale factor comprises means for adjusting the scale factor only once for the block; and

the means for limiting the scale factor comprises means for limiting the scale factor only once for the block.