Bitrate reduction techniques for image transcoding

• US 8,213,498 B2
• Filed: 10/05/2007
• Issued: 07/03/2012
• Est. Priority Date: 05/31/2007
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Liu, Shizhong, Nguyen, Ricky
• Primary Examiner(s): Mattis, Jason
• Assistant Examiner(s): Clawson, Stephen J
• Application Number:
  US11/868,211
• Publication Number:
  US 20080298469A1
• Time in Patent Office: 1,733 Days
• Field of Search: 375/240.26
• US Class Current: 375/240
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

This disclosure describes techniques for encoding data to compress image data to a reduced size. The techniques may be particularly effective in transcoding an image to a reduced size for transmission. An encoding device may transcode an image to an acceptable file size using bitrate control techniques that affect the entire image uniformly to transcode the image. For example, the encoding device may modify one or more quantization tables as a function of the near linear relationship between bitrate (R) and the number of zero-valued quantized transform coefficients to reduce the file size uniformly over the entire image. Alternatively, or additionally, the encoding device may transcode the image using bitrate control techniques that affect only specific localized regions of the image.

Claims

1. A method of processing blocks of digital image data comprising:

scaling one or more quantization tables as a function of a computed scaling factor to create a first quantization table set;

encoding a first portion of a plurality of blocks of pixels of the digital image data using the first quantization table set;

encoding a second portion of a remaining unencoded portion of the plurality of blocks of image data using the first quantization table set;

tracking a difference between a total number of encoded bits of the encoded second portion and a number of bits that ideally should be encoded at the second encoded portion to achieve a target bitrate; and

removing one or more bits of the encoded second portion when the difference is greater than or equal to a threshold, wherein scaling the one or more quantization tables comprises scaling a luma quantization table and a chroma quantization table, wherein the chroma quantization table is scaled more than the luma quantization table, and

wherein scaling the luma quantization table and the chroma quantization table comprises

scaling a first portion of the luma quantization table by the computed scaling factor, and

scaling a second portion of the luma quantization table and the chroma quantization table by a second scaling factor, wherein the second scaling factor is determined as a function of the computed scaling factor, and

wherein the computed scaling factor and second scaling factor are greater than or equal to one, and further wherein the computed scaling factor is smaller than the second scaling factor.

2. The method of claim 1, further comprising:

identifying a desired number of zero-valued quantized transform coefficients to achieve the target bitrate based on a bitrate of the image data as initially encoded, a number of zero-valued quantized transform coefficients of the image data as initially encoded, and the target bitrate; and

computing the scaling factor for use in scaling the one or more quantization tables based on the desired number of zero-valued quantized transform coefficients.

3. The method of claim 1, further comprising:

ordering quantization entries of the luma quantization table and the chroma quantization table into a single sequence beginning with low frequency quantization entries of the luma quantization table followed by high frequency quantization entries of the luma quantization table then low frequency quantization entries of the chroma quantization table and then high frequency quantization entries of the chroma quantization table;

scaling the first k quantization entries of the sequence by the computed scaling factor; and

scaling the remaining N-k quantization entries of the sequence by the second scaling factor, wherein N is the total number of quantization entries of the sequence.

4. The method of claim 1, wherein removing the one or more bits comprises:

selecting one or more quantized transform coefficients that will not equal zero when decremented to a value below a respective power of two; and

decrementing the one or more selected quantized transform coefficients until the selected quantized transform coefficients are less than the respective power of two.

5. The method of claim 1, wherein removing the one or more bits comprises:

identifying at least one bit sequence that includes a plurality of bits arranged in a manner to act as a marker that requires stuffing of one or more bits; and

changing at least one of the plurality of bits of the bit sequence that corresponds to a residue such that the bit sequence no longer acts as the marker.

12. The method of claim 1, further comprising transmitting the first encoded portion.

6. A computer-program product for processing digital image data comprising a non-transitory computer readable medium having instructions thereon, the instructions comprising:

code for scaling one or more quantization tables as a function of a computed scaling factor to create a first quantization table set;

code for encoding a plurality of blocks of pixels of the digital image data using the first quantization table set;

code for encoding a second portion of a remaining unencoded portion of the plurality of blocks of image data using the first quantization table set;

code for tracking a difference between a total number of encoded bits at the second encoded portion and a number of bits that ideally should be encoded at the second encoded portion to achieve a target bitrate; and

code for removing one or more bits of the second encoded portion when the difference is greater than or equal to a threshold, wherein code for scaling the one or more quantization tables comprises code for scaling a luma quantization table and a chroma quantization table, wherein the chroma quantization table is scaled more than the luma quantization table, wherein code for scaling the luma quantization table and the chroma quantization table comprises;

code for scaling a first portion of the luma quantization table by the computed scaling factor,

code for scaling a second portion of the luma quantization table and the chroma quantization table by a second scaling factor, wherein the second scaling factor is determined as a function of the computed scaling factor, and

wherein the computed scaling factor and second scaling factor are greater than or equal to one, and further wherein the computed scaling factor is smaller than the second scaling factor.

7. The computer-program product of claim 6, wherein the instructions further comprise:

code for identifying a desired number of zero-valued quantized transform coefficients to achieve the target bitrate based on a bitrate of the image data as initially encoded, a number of zero-valued quantized transform coefficients of the image data as initially encoded, and the target bitrate; and

code for computing the scaling factor for use in scaling the one or more quantization tables based on the desired number of zero-valued quantized transform coefficients.

8. The computer-program product of claim 6, wherein code for scaling the luma quantization table and the chroma quantization table comprises:

code for ordering quantization entries of the luma quantization table and the chroma quantization table into a single sequence beginning with low frequency quantization entries of the luma quantization table followed by high frequency quantization entries of the luma quantization table then low frequency quantization entries of the chroma quantization table and then high frequency quantization entries of the chroma quantization table;

code for scaling the first k quantization entries of the sequence by the computed scaling factor; and

code for scaling the remaining N-k quantization entries of the sequence by the second scaling factor, wherein N is the total number of quantization entries of the sequence.

9. The computer-program product of claim 6, wherein code for removing the one or more bits comprises:

code for selecting one or more quantized transform coefficients that will not equal zero when decremented to a value below a respective power of two; and

code for decrementing the one or more selected quantized transform coefficients until the selected quantized transform coefficients are less than the respective power of two.

10. The computer-program product of claim 6, wherein code for removing the one or more bits comprises:

code for identifying at least one bit sequence that includes a plurality of bits arranged in a manner to act as a marker that requires stuffing of one or more bits; and

code for changing at least one of the plurality of bits of the bit sequence such that the bit sequence no longer acts as the marker.

11. The computer-program product of claim 6, further comprising code for resuming the encoding of the blocks of the image data using the one or more scaled quantization tables without removing the one or more additional bits when the difference falls below the threshold.

13. The computer program product of claim 6, further including instructions comprising code for transmitting the first encoded portion.