VIDEO ENCODING APPARATUS, VIDEO DECODING APPARATUS, VIDEO ENCODING METHOD, VIDEO DECODING METHOD, AND COMPUTER PROGRAM

• US 20160073114A1
• Filed: 03/25/2014
• Published: 03/10/2016
• Est. Priority Date: 03/28/2013
• Status: Abandoned Application

• Current Assignee: KDDI Corporation
• Original Assignee: KDDI Corporation
• Inventors: KAWAMURA, Kei, NAITO, Sei
• Application Number:
  US14/780,212
• Publication Number:
  US 20160073114A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A video encoding apparatus encodes an input image having three color components each having the same color spatial resolution. The video encoding apparatus performs color space conversion by applying a transformation coefficient to a residual signal which represents a difference between the input image and a predicted image generated by intra frame prediction or otherwise inter frame prediction, so as to generate a residual signal in an uncorrelated space. Such an arrangement provides a hardware-friendly configuration with a reduced processing load and with reduced redundancy in the color space.

Claims

1. A video encoding apparatus that encodes a video having a plurality of color components by means of intra frame prediction or otherwise inter frame prediction, the video encoding apparatus comprising:

a transformation matrix derivation unit that derives a transformation matrix using encoded pixels;

a color space conversion unit that performs color space conversion by applying the transformation matrix derived by the transformation matrix derivation unit to a residual signal which represents a difference between an input image that forms the video and a predicted image generated by means of the inter frame prediction or otherwise the intra frame prediction, so as to generate a residual signal in an uncorrelated space;

a quantization unit that quantizes the residual signal generated in an uncorrelated space by means of the color space conversion unit, so as to generate a quantized coefficient; and

an encoding unit that encodes the quantized coefficient generated by the quantization unit.

2. The video encoding apparatus according to claim 1, wherein the transformation matrix derivation unit derives the transformation matrix after color spatial resolutions set for the color components of an image formed of encoded pixels are adjusted such that the color spatial resolutions match a highest color spatial resolution,

and wherein the color space conversion unit generates a residual signal in the uncorrelated space after the color spatial resolutions set for the color components of the residual signal are adjusted such that the color spatial resolutions match a highest color spatial resolution, following which the color space conversion unit returns the color spatial resolutions with respect to the color components of the residual signal generated in the uncorrelated space to original spatial resolutions.

3. The video encoding apparatus according to claim 1, wherein, in a case in which intra frame prediction is applied, the transformation matrix derivation unit uses, as reference pixels, the encoded pixels located neighboring a coding target block set in a frame to be subjected to the intra frame prediction,

wherein, in a case in which inter frame prediction is applied, the transformation matrix derivation unit generates a predicted image of the coding target block set in a frame to be subjected to the inter frame prediction, based on a region in a reference frame indicated by a motion vector obtained for the coding target block, and uses the pixels that form the predicted image thus generated as the reference pixels,

and wherein the transformation matrix derivation unit derives the transformation matrix using the reference pixels.

4. The video encoding apparatus according to claim 3, wherein, in a case in which the intra frame prediction is applied, the transformation matrix derivation unit uses, as the reference pixels, encoded pixels located on an upper side or otherwise a left side neighboring a coding target block set in a frame to be subjected to the intra frame prediction,

and wherein, in a case in which the inter frame prediction is applied, the transformation matrix derivation unit generates a predicted image of a coding target block set in a frame to be subjected to the inter frame prediction based on a region in a reference frame indicated by a motion vector obtained for the coding target block, uses the pixels that form the predicted image thus generated as the reference pixels, and subsamples the reference pixels such that the number of reference pixels is represented by a power of 2.

5. The video encoding apparatus according to claim 1, wherein the transformation matrix derivation unit comprises:

an inverse square root calculation unit that calculates an inverse square root using fixed-point computation; and

a Jacobi calculation unit that performs calculation using the Jacobi method for calculating eigenvalues and eigenvectors using fixed-point computation.

6. The video encoding apparatus according to claim 5, wherein the inverse square root calculation unit calculates an inverse square root using fixed-point computation that is adjusted according to a bit depth of an input image that forms the video,

and wherein the Jacobi calculation unit performs calculation using the Jacobi method for calculating eigenvalues and eigenvectors using fixed-point computation that is adjusted according to the bit depth of the input image that forms the video.

7. A video decoding apparatus that decodes a video having a plurality of color components by means of intra frame prediction or otherwise inter frame prediction, the video decoding apparatus comprising:

a transformation matrix derivation unit that derives a transformation matrix using encoded pixels;

a decoding unit that decodes an encoded signal;

an inverse quantization unit that performs inverse quantization on the signal decoded by the decoding unit, so as to generate a residual signal; and

an inverse color space conversion unit that performs inverse color space conversion by applying the transformation matrix derived by the transformation matrix derivation unit to the residual signal subjected to the inverse quantization by means of the inverse quantization unit, so as to generate a residual signal in a correlated space.

8. The video decoding apparatus according to claim 7, wherein the transformation matrix derivation unit derives the transformation matrix after color spatial resolutions set for the color components of an image formed of encoded pixels are adjusted such that the color spatial resolutions match a highest color spatial resolution,

and wherein the inverse color space conversion unit generates a residual signal in the correlated space after the color spatial resolutions set for the color components of the residual signal are adjusted such that the color spatial resolutions match a highest color spatial resolution, following which the inverse color space conversion unit returns the color spatial resolutions with respect to the color components of the residual signal generated in the correlated space to original spatial resolutions.

9. The video decoding apparatus according to claim 7, wherein the transformation matrix derivation unit uses, as reference pixels, the encoded pixels located neighboring a coding target block set in a frame to be subjected to the intra frame prediction,

wherein the transformation matrix derivation unit generates a predicted image of the coding target block set in a frame to be subjected to the inter frame prediction, based on a region in a reference frame indicated by a motion vector obtained for the coding target block, and uses the pixels that form the predicted image thus generated as the reference pixels,

and wherein the transformation matrix derivation unit derives the transformation matrix using the reference pixels.

10. The video decoding apparatus according to claim 9, wherein, in a case in which the intra frame prediction is applied, the transformation matrix derivation unit uses, as the reference pixels, encoded pixels located on an upper side or otherwise a left side neighboring a coding target block set in a frame to be subjected to the intra frame prediction,

and wherein, in a case in which the inter frame prediction is applied, the transformation matrix derivation unit generates a predicted image of a coding target block set in a frame to be subjected to the inter frame prediction based on a region in a reference frame indicated by a motion vector obtained for the coding target block, uses the pixels that form the predicted image thus generated as the reference pixels, and subsamples the reference pixels such that the number of reference pixels is represented by a power of 2.

11. The video decoding apparatus according to claim 7, wherein the transformation matrix derivation unit comprises:

an inverse square root calculation unit that calculates an inverse square root using fixed-point computation; and

a Jacobi calculation unit that performs calculation using the Jacobi method for calculating eigenvalues and eigenvectors using fixed-point computation.

12. The video decoding apparatus according to claim 11, wherein the inverse square root calculation unit calculates an inverse square root using fixed-point computation that is adjusted according to a bit depth of an input image that forms the video,

and wherein the Jacobi calculation unit performs calculation using the Jacobi method for calculating eigenvalues and eigenvectors using fixed-point computation that is adjusted according to the bit depth of the input image that forms the video.

13. A video encoding method used by a video encoding apparatus that comprises a transformation matrix derivation unit, a color space conversion unit, a quantization unit, and an encoding unit, and that encodes a video having a plurality of color components by means of intra frame prediction or otherwise inter frame prediction, the video encoding method comprising:

first processing in which the transformation matrix derivation unit derives a transformation matrix using encoded pixels;

second processing in which the color space conversion unit performs color space conversion by applying the transformation matrix derived by the transformation matrix derivation unit to a residual signal which represents a difference between an input image that forms the video and a predicted image generated by means of the inter frame prediction or otherwise the intra frame prediction, so as to generate a residual signal in an uncorrelated space;

third processing in which the quantization unit quantizes the residual signal generated in an uncorrelated space by means of the color space conversion unit, so as to generate a quantized coefficient; and

fourth processing in which the encoding unit encodes the quantized coefficient generated by the quantization unit.

14. A video decoding method used by a video decoding apparatus that comprises a transformation matrix derivation unit, a decoding unit, an inverse quantization unit, and an inverse color space conversion unit, and that decodes a video having a plurality of color components by means of intra frame prediction or otherwise inter frame prediction, wherein the video decoding method comprising:

first processing in which the transformation matrix derivation unit derives a transformation matrix using encoded pixels;

second processing in which the decoding unit decodes an encoded signal;

third processing in which the inverse quantization unit performs inverse quantization on the signal decoded by the decoding unit, so as to generate a residual signal; and

fourth processing in which the inverse color space conversion unit performs inverse color space conversion by applying the transformation matrix derived by the transformation matrix derivation unit to the residual signal subjected to the inverse quantization by means of the inverse quantization unit, so as to generate a residual signal in a correlated space.

15. A computer program product including a non-transitory computer readable medium storing a program which, when executed by a computer, causes the computer to perform a video encoding method used by a video encoding apparatus that comprises a transformation matrix derivation unit, a color space conversion unit, a quantization unit, and an encoding unit, and that encodes a video having a plurality of color components by means of intra frame prediction or otherwise inter frame prediction, the video encoding method comprising:

first processing in which the transformation matrix derivation unit derives a transformation matrix using encoded pixels;

second processing in which the color space conversion unit performs color space conversion by applying the transformation matrix derived by the transformation matrix derivation unit to a residual signal which represents a difference between an input image that forms the video and a predicted image generated by means of the inter frame prediction or otherwise the intra frame prediction, so as to generate a residual signal in an uncorrelated space;

third processing in which the quantization unit quantizes the residual signal generated in an uncorrelated space by means of the color space conversion unit, so as to generate a quantized coefficient; and

fourth processing in which the encoding unit encodes the quantized coefficient generated by the quantization unit.

16. A computer program product including a non-transitory computer readable medium storing a program which, when executed by a computer, causes the computer to perform a video decoding method used by a video decoding apparatus that comprises a transformation matrix derivation unit, a decoding unit, an inverse quantization unit, and an inverse color space conversion unit, and that decodes a video having a plurality of color components by means of intra frame prediction or otherwise inter frame prediction, the video decoding method comprising:

first processing in which the transformation matrix derivation unit derives a transformation matrix using encoded pixels;

second processing in which the decoding unit decodes an encoded signal;

third processing in which the inverse quantization unit performs inverse quantization on the signal decoded by the decoding unit, so as to generate a residual signal; and

fourth processing in which the inverse color space conversion unit performs inverse color space conversion by applying the transformation matrix derived by the transformation matrix derivation unit to the residual signal subjected to the inverse quantization by means of the inverse quantization unit, so as to generate a residual signal in a correlated space.