IMAGE COMPRESSION APPARATUS, IMAGE EXPANSION APPARATUS, AND IMAGE PROCESSING APPARATUS

• US 20090279800A1
• Filed: 04/23/2009
• Published: 11/12/2009
• Est. Priority Date: 05/09/2008
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Budsabathon, Chatree, Uetani, Yoshiharu
• Application Number:
  US12/428,537
• Publication Number:
  US 20090279800A1
• Time in Patent Office: Days
• US Class Current: 382/238
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

An input pixel valid-bit-number setting unit sets an input pixel valid-bit-number which is the number of gradations of input pixel data. A predictive pixel value generating unit refers to the higher-order bits of earlier already-input pixel data to generate a predictive pixel value for the higher-order bits of a new input pixel. A prediction error group detecting unit detects a prediction error group indicative of the magnitude range of a difference between the predictive pixel value and the value of the higher-order bits of the new input pixel. A prediction error encoding unit multiplexes variable-length encoded information indicative of the prediction error group, overhead bits indicative of a specific value within the prediction error group, and the lower-order bits of the input pixel appropriate for the input pixel valid-bit-number.

Claims

1. An image compression apparatus comprising:

a setting unit configured to set an input pixel valid-bit-number;

a predictive pixel value generating unit configured to refer to a plurality of higher-order bits of earlier already-input pixel data to generate a predictive pixel value for a plurality of higher-order bits of a new input pixel;

a prediction error group detecting unit configured to detect a prediction error group indicative of the magnitude range of a difference between the predictive pixel value and a value of the plurality of higher-order bits of the new input pixel;

a prediction error encoding unit configured to multiplex variable-length-encoded information indicative of the prediction error group, overhead bits indicative of a specific value within the prediction error group, and lower-order input pixel bits appropriate for the input pixel valid-bit-number; and

a packing unit configured to output data multiplexed by the prediction error encoding unit in units of a predetermined number of bits.

2. The image compression apparatus according to claim 1, further comprising:

a target code quantity difference level detecting unit provided in a stage behind the packing unit or the prediction error encoding unit, in order to detect a target code quantity difference level indicative of the extent of excess of an output code quantity against a target code quantity corresponding to the number of already-encoded pixels;

an error level detecting unit provided in a stage followed by the prediction error group detecting unit, in order to detect an error level indicative of the magnitude level of a difference between a plurality of higher-order bits of the corrected output data of an input pixel one pixel earlier and a plurality of higher-order bits of input pixel data;

an input pixel value correcting unit configured to make a replacement correction to lower-order bits within the plurality of higher-order bits of the input pixel data, so that the lower-order bits are the same as bit data corresponding to a corrected output pixel value one pixel earlier, according to the target code quantity difference level and the error level; and

a prediction error calculating unit configured to calculate a prediction error which is a difference between corrected input pixel data sent from the input pixel value correcting unit and a predictive pixel value sent from the predictive pixel value generating unit;

wherein the prediction error encoding unit excludes the lower-order bit data of overhead bits of the prediction error and lower-order input pixel bits appropriate for the input pixel valid-bit-number from the objects of encoding, according to the prediction error group and the target code quantity difference level, before encoding the prediction error.

3. The image compression apparatus according to claim 2, further comprising a correcting data storing unit connected to the higher-order bit line and the lower-order bit line of input pixel data, so that when the lower-order bit data within the plurality of higher-order bits are subjected to replacement correction, the correcting data storing unit stores as many pre-replacement data items as the number of the replaced bits, on the basis of information from the input pixel value correcting unit and, for the lower-order input pixel bits, the correcting data storing unit stores data on the lower-order bits excluded from the objects of encoding,

wherein the packing unit packs and outputs pre-replacement lower-order bit data within the replaced plurality of higher-order bits sent from the correcting data storing unit and the data on the lower-order bits not included in the objects of encoding, up to the amount of code quantity left over as a result of the capacity of a memory unit having the unit of fixed length setting being not filled up, after the completion of packing the output data of the prediction error encoding unit.

4. The image compression apparatus according to claim 1, wherein the prediction error encoding unit includes a storing unit configured to store prediction error group information one pixel earlier indicative of a group to which the magnitude of a prediction error one pixel earlier belongs, in order to switch the variable-length code table of group information indicative of the group to which the magnitude of the prediction error belongs, according to the prediction error group information one pixel earlier.

5. The image compression apparatus according to claim 2, wherein the error level detecting unit includes:

an adder configured to find a difference between an input pixel value and the predictive pixel value sent from the predictive pixel value generating unit; and

a level detecting unit configured to output an error level appropriate for the magnitude of the difference sent from the adder;

wherein the input pixel value correcting unit includes an LSB (less significant bits)-side correcting unit configured to correct the lower-order bit data within the plurality of higher-order bits of the input pixel data, according to a combination of an error level output from the error level detecting unit and a target code quantity difference level output from the target code quantity difference level detecting unit, so that the data is the same as the lower-order bit data of the predictive pixel value sent from the predictive pixel value generating unit.

6. The image compression apparatus according to claim 2, wherein the prediction error encoding unit includes:

a bit length detecting unit configured to detect prediction error group information indicative of a group to which the magnitude of the prediction error belongs, according to a prediction error input from the prediction error calculating unit, output the information to a later-described variable-length code table, and detect the number of overhead bits of the information, wherein if the group is a prediction error group in which the magnitude of the prediction error is greater than a predetermined value, then the bit length detecting unit detects the number of reduced bits of the overhead bits appropriate for the target code quantity difference level input from the target code quantity difference level detecting unit through a one-clock delaying unit, and outputs a total code length obtained by subtracting the number of bits to be reduced from the sum of a variable-length code length received from the variable-length code table and the number of overhead bits to a one-clock delaying unit;

a variable-length encoding table configured to output the length of a variable-length code and the variable-length code appropriate for the prediction error group information received from the bit length detecting unit to a later-described selector, and output the length of the variable-length code to the bit length detecting unit; and

a selector configured to select the variable-length code received from the variable-length encoding table and overhead bit data on the basis of the variable-length code received from the variable-length encoding table and the prediction error group information received from the bit length detecting unit, and output the data as serial data.

7. The image compression apparatus according to claim 1, wherein the packing unit outputs output data sent from the prediction error encoding unit in units of the number of bits twice or more as large as a set average code quantity.

8. The image compression apparatus according to claim 2, wherein the target code quantity difference level detecting unit performs the calculation of a difference between the set average code quantity and the output code quantity of the packing unit and the cumulative calculation of the results of the differential calculation using a single adder, in order to determine a target code quantity difference level by nonlinearly quantizing the result of the cumulative calculation.

9. The image compression apparatus according to claim 2, wherein the target code quantity difference level detecting unit includes:

an adder configured to add a set average code quantity and target code quantity difference information one clock earlier retained by a one-clock delaying unit, subtract the number of output bits from the result of the addition if output byte count information from the packing unit is valid, and output the result of the subtraction through the one-clock delaying unit as target code quantity difference information; and

a quantizing unit, to which the target code quantity difference information output from the one-clock delaying unit is input, thereby performing quantization appropriate for the target code quantity difference information and outputting the result of the quantization as a target code quantity difference level.

10. An image expansion apparatus comprising:

a setting unit configured to set an output pixel valid-bit-number;

an encoded data loading unit configured to load the variable-length code of a prediction error group indicative of the magnitude range of a prediction error, overhead bits indicative of the value of the prediction error, and data encoded using lower-order bits appropriate for the output pixel valid-bit-number;

a prediction error decoding unit configured to reproduce lower-order bits appropriate for the prediction error and the output pixel valid-bit-number out of the data loaded by the encoded data loading unit;

a predictive pixel value generating unit configured to refer to a plurality of higher-order bits of an earlier already-reproduced pixel to generate a predictive pixel value; and

a pixel value reproducing unit configured to add the reproduced prediction error to the predictive pixel value to reproduce the pixel value of a plurality of higher-order bits.

11. The image expansion apparatus according to claim 10, further comprising a target code quantity difference level detecting unit configured to detect a target code quantity difference level indicative of the extent of excess of an already-decoded code quantity against a target code quantity corresponding to the number of already-reproduced pixels,

wherein the prediction error decoding unit reproduces the overhead bits indicative of the value of the prediction error and the lower-order bits appropriate for the output pixel valid-bit-number as 0, on the basis of the target code quantity difference level and the prediction error group.

12. The image expansion apparatus according to claim 10, further comprising:

a reproduced data loading unit, to which information on the start-of-loading position of correcting data following encoded data is supplied at the timing of the completion of loading the encoded data by the encoded data loading unit, so that the reproduced data loading unit loads the correcting data by separating the correcting data from the encoded data at a precise data position on the basis of the start-of-loading position information; and

a correction processing unit configured to correctively restore lower-order bit data within a plurality of higher-order bits of an input pixel before correction at the time of encoding and lower-order bit data excluded from the objects of encoding, using the correcting data, thereby correcting the decoded and reproduced data.

13. The image expansion apparatus according to claim 10, wherein the prediction error decoding unit includes a storing unit configured to store prediction error group information one pixel earlier indicative of a group to which the magnitude of a prediction error one pixel earlier belongs, in order to switch the variable-length decoding table of group information indicative of the group to which the magnitude of the prediction error belongs, according to the prediction error group information one pixel earlier.

14. The image expansion apparatus according to claim 10, wherein the encoded data loading unit loads the variable-length encoded data in units of the number of bits twice or more as large as the set average code quantity.

15. The image expansion apparatus according to claim 11, wherein the target code quantity difference level detecting unit performs the calculation of a difference between the set average code quantity and a code quantity loaded by the encoded data loading unit and the cumulative calculation of the results of the differential calculation using a single adder, in order to determine a target code quantity difference level by nonlinearly quantizing the result of the cumulative calculation.

16. The image expansion apparatus according to claim 10, wherein the encoded data loading unit includes:

first and second selectors configured to receive compressively-encoded data as an input, in order to load the data sequentially to first and second one-clock delaying units for each one clock during a period in which information on the number of bytes to be loaded is valid or retain data already loaded to the first and second one-clock delaying units during a period in which the information on the number of bytes to be loaded is invalid;

a third selector configured to make a cue search of encoded data retained in the first and second one-clock delaying units for a variable-length code at a stage one pixel earlier, as one serial data item, on the basis of information on the result of accumulating the number of bits of a variable-length code decoded until two pixels earlier which is less than the number of bytes to be loaded;

a fourth selector configured to receive data output from the third selector as an input and make a cue search of the next decoded pixel for a variable-length code on the basis of the number of bits of encoded data one pixel earlier sent from a variable-length code decoding table within the prediction error decoding unit; and

an adder configured to add code length data input from the variable-length code decoding table and a predetermined number of lower-order bits of an accumulation result one clock earlier retained in a third one-clock delaying unit, and output data composed of a predetermined number of lower-order bits+1 bit, including carry bits, to the third one-clock delaying unit.

17. The image expansion apparatus according to claim 10, wherein the prediction error decoding unit includes:

a fourth one-clock delaying unit configured to cause a one-clock delay in variable-length encoded data output from the encoded data loading unit;

a decoding table configured to receive variable-length encoded data sent from the fourth one-clock delaying unit as an input, decode information on a prediction error group indicative of the magnitude of a prediction error and the code length thereof, reproduce the number of overhead bits used to indicate a specific value of the prediction error within the group on the basis of the group information and, if the prediction error is larger than a predetermined value, reproduce the number of reduced bits of the number of overhead bits according to the target code quantity difference level detected by the target code quantity difference level detecting unit on the basis of the group information, thereby generating a total number of bits obtained by subtracting the number of reduced bits from a sum of the code length of the group information and the number of overhead bits; and

a fifth selector configured to remove the encoded data of group information from among data output from the fourth one-clock delaying unit on the basis of the code length of the group information obtained as a result of decoding using the variable-length code decoding table, extract and perform code expansion processing on overhead bit data on the number of overhead bits, and substitute the lower-order bit data of the number of reduced bits, among the overhead bit data, with 0.

18. The image expansion apparatus according to claim 11, wherein the target code quantity difference level detecting unit includes:

a fifth one-clock delaying unit to which information on the number of loaded bytes generated at the encoded data loading unit is input at a point in time except a period of a predetermined number of clocks for initial data loading, wherein the fifth one-clock delaying unit is configured to supply the information as an already-decoded code quantity in units of a predetermined code quantity, to the negative input end of a later-described adder with a one-clock delay;

an adder configured to receive a set average code quantity as one input, add the input set average code quantity to an accumulation result one clock earlier retained by a sixth one-clock delaying unit, subtract a predetermined code quantity from the result of accumulating the set average code quantity each time a one-bit signal indicative of the predetermined code quantity is input from the fifth one-clock delaying unit, and output the result of the subtraction through the sixth one-clock delaying unit as target code quantity difference information; and

a quantizing unit configured to receive target code quantity difference information output from the sixth one-clock delaying unit as an input, perform the same predetermined quantization on the target code quantity difference information as is performed on the encoding apparatus side, and output the quantized information as a target code quantity difference level.

19. An image processing apparatus comprising:

a pixel compressing unit provided with an image compression apparatus including;

a setting unit configured to set an input pixel valid-bit-number;

a predictive pixel value generating unit configured to refer to a plurality of higher-order bits of earlier already-input pixel data to generate a predictive pixel value for a plurality of higher-order bits of a new input pixel;

a prediction error group detecting unit configured to detect a prediction error group indicative of the magnitude range of a difference between the predictive pixel value and a value of the plurality of higher-order bits of the new input pixel;

a prediction error encoding unit configured to multiplex variable-length-encoded information indicative of the prediction error group, overhead bits indicative of a specific value within the prediction error group, and lower-order input pixel bits appropriate for the input pixel valid-bit-number; and

a packing unit configured to output data multiplexed by the prediction error encoding unit in units of a predetermined number of bits;

a pixel expanding unit provided with an image expanding apparatus including;

a setting unit configured to set an output pixel valid-bit-number;

an encoded data loading unit configured to load the variable-length code of a prediction error group indicative of the magnitude range of a prediction error, overhead bits indicative of the value of the prediction error, and data encoded using lower-order bits appropriate for the output pixel valid-bit-number;

a prediction error decoding unit configured to reproduce lower-order bits appropriate for the prediction error and the output pixel valid-bit-number out of the data loaded by the encoded data loading unit;

a predictive pixel value generating unit configured to refer to a plurality of higher-order bits of an earlier already-reproduced pixel to generate a predictive pixel value; and

a pixel value reproducing unit configured to add the reproduced prediction error to the predictive pixel value to reproduce the pixel value of a plurality of higher-order bits; and

an image processing unit configured to temporarily store an intermediate processing result obtained by processing input image data in an external memory unit through the pixel compressing unit, read a plurality of intermediate processing results stored in the external memory unit through the pixel expanding unit, and output an image-processed final processing result.