VIDEO-ENCODING METHOD AND VIDEO-ENCODING APPARATUS USING PREDICTION UNITS BASED ON ENCODING UNITS DETERMINED IN ACCORDANCE WITH A TREE STRUCTURE, AND VIDEO-DECODING METHOD AND VIDEO-DECODING APPARATUS USING PREDICTION UNITS BASED ON ENCODING UNITS DETERMINED IN ACCORDANCE WITH A TREE STRUCTURE

• US 20180184105A1
• Filed: 02/23/2018
• Published: 06/28/2018
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: MIN, Jung-hye, HAN, Woo-jin, KIM, Il-koo
• Granted Patent: US 10,412,411 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/197 including determination of the initial value of an encoding parameter H04N19/56 takes precedence
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness
• CPC Class Codes: H04N 19/96 : Tree coding, e.g. quad-tree coding

Abstract

Provided are a method and apparatus for encoding a video and a method and apparatus for decoding a video. The encoding method includes: splitting a picture of the video into one or more maximum coding units; encoding the picture based on coding units according to depths which are obtained based on a partition type determined according to the depths of the coding units according to depths, determining coding units according to coded depths with respect to each of the coding units according to depths, and thus determining coding units having a tree structure; and outputting data that is encoded based on the partition type and the coding units having the tree structure, information about the coded depths and an encoding mode, and coding unit structure information indicating a size and a variable depth of a coding unit.

Claims

1. A method of decoding a video, the method comprising:

receiving a bitstream with respect to an encoded video;

extracting, from the received bitstream, coding unit structure information indicating a size of a coding unit that is a data unit for decoding of a picture of the encoded video, a variable depth of the coding unit, information about a coded depth and information about an encoding mode indicating one among prediction types including skip mode, inter mode and intra mode;

determining a current coding unit based on the coding unit structure information, the variable depth of the coding unit and the information about the coded depth;

determining a prediction type of the current coding unit based on the information about an encoding mode;

performing prediction on at least one prediction unit of the current coding unit according to the prediction type to obtain prediction samples of the current coding unit; and

determining reconstructed samples of the current coding unit by using the prediction samples,

wherein the determining the current coding unit comprises;

when the information about the coded depth indicates a split for a current depth, splitting the current coding unit of the current depth into coding units of a lower depth, independently from neighboring coding units, and

wherein the performing the prediction on the at least one prediction unit of the current coding unit comprises;

when the information about the coded depth indicates a non-split of a current depth, determining a prediction unit from the current coding unit;

when the prediction type is the skip mode, determining the prediction unit having a same size as the current coding unit;

when the prediction type is one of the intra mode and the inter mode, extracting partition type information indicating a partition of the current coding unit from the bitstream;

when the prediction type is the intra mode, determining the prediction unit including at least one square block, from the current coding unit, based on the partition type information; and

when the prediction type is the inter mode, determining the prediction unit including one of a partition, symmetric partitions and asymmetric partitions, from the current coding unit, based on the partition type information,

wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the current coding unit,

wherein the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the current coding unit,

2. A method of encoding a video, the method comprising:

determining coding units that are data units for encoding a picture of the video;

generating coding unit structure information about a size of the coding units, and information about a variable depth of the coding units; and

generating information about a coded depth, and an encoding mode indicating one among prediction modes including skip mode, inter mode and intra mode, wherein a coding unit of the coded depth, among the coding units, is encoded in the encoding mode,

wherein the generating the information about the coded depth, and the encoding mode comprises;

determining at least one prediction unit from the coding unit of the coded depth and a prediction mode of the coding unit of the coded depth;

when prediction is performed in the skip mode using a prediction unit having a same size as the coding unit of the coded depth, generating the encoding mode to indicate the skip mode;

when prediction is performed in the intra mode using a prediction unit including at least one square block determined from the coding unit of the coded depth, generating the encoding mode to indicate the intra mode; and

when prediction is performed in the inter mode using a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, determined from the coding unit of the coded depth, generating the encoding mode to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.

3. An apparatus for encoding a video, the apparatus comprising:

a coding unit determiner which is configured to determine coding units that are data units for encoding a picture of the video; and

an encoder which is configured to generate coding unit structure information about a size of the coding units, and information about a variable depth of the coding units, and generate information about a coded depth, and an encoding mode indicating one among prediction modes including skip mode, inter mode and intra mode, wherein a coding unit of the coded depth, among the coding units, is encoded in the encoding mode,

wherein;

the encoder determines at least one prediction unit from the coding unit of the coded depth and a prediction mode of the coding unit of the coded depth,

when prediction is performed in the skip mode using a prediction unit having a same size as the coding unit of the coded depth, the encoder generates the encoding mode to indicate the skip mode,

when prediction is performed in the intra mode using a prediction unit including at least one square block determined from the coding unit of the coded depth, the encoder generates the encoding mode to indicate the intra mode, and

when prediction is performed in the inter mode using a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, determined from the coding unit of the coded depth, the encoder generates the encoding mode to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.

4. A method of encoding a video, the method comprising:

determining coding units that are data units for encoding a picture of the video;

generating coding unit structure information about a size of the coding units, and information about a variable depth of the coding units; and

generating information about a coded depth, and an encoding mode indicating one among prediction modes including skip mode, inter mode and intra mode, wherein a coding unit of the coded depth, among the coding units, is encoded in the encoding mode,

wherein the generating the information about the coded depth, and the encoding mode comprises;

when a coding unit of a current depth is split into coding units of a lower depth, generating the information about the coded depth to indicate a split for the current depth;

when the coding unit of the current depth is not split into the coding units of a lower depth and prediction is performed on the coding unit of the current depth, generating the information about the coded depth to indicate a non-split of the current depth;

when prediction is performed in the skip mode using a prediction unit having a same size as the coding unit of the current depth, generating the encoding mode to indicate the skip mode;

when prediction is performed in the intra mode using a prediction unit including at least one square block determined from the coding unit of the current depth, generating the encoding mode to indicate the intra mode; and

when prediction is performed in the inter mode using a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, determined from the coding unit of the current depth, generating the encoding mode to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the current depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the current depth.

5. An apparatus for encoding a video, the apparatus comprising:

a coding unit determiner which is configured to determine coding units that are data units for encoding a picture of the video; and

an encoder which is configured to generate coding unit structure information about a size of the coding units, and information about a variable depth of the coding units, and generate information about a coded depth, and an encoding mode indicating one among prediction modes including skip mode, inter mode and intra mode, wherein a coding unit of the coded depth, among the coding units, is encoded in the encoding mode,

wherein;

when a coding unit of a current depth is split into coding units of a lower depth, the encoder generates the information about the coded depth to indicate a split for the current depth,

when the coding unit of the current depth is not split into the coding units of a lower depth and prediction is performed on the coding unit of the current depth, the encoder generates the information about the coded depth to indicate a non-split of the current depth,

when prediction is performed in the skip mode using a prediction unit having a same size as the coding unit of the current depth, the encoder generates the encoding mode to indicate the skip mode,

when prediction is performed in the intra mode using a prediction unit including at least one square block determined from the coding unit of the current depth, the encoder generates the encoding mode to indicate the intra mode, and

when prediction is performed in the inter mode using a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, determined from the coding unit of the current depth, the encoder generates the encoding mode to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the current depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the current depth.

6. A method of encoding a video, the method comprising:

determining coding units that are data units for encoding a picture of the video;

generating coding unit structure information about a size of the coding units, and information about a variable depth of the coding units; and

generating information about a coded depth, and an encoding mode indicating one among prediction modes including skip mode, inter mode and intra mode, wherein a coding unit of the coded depth, among the coding units, is encoded in the encoding mode,

wherein the determining the coding units comprises;

determining a plurality of maximum coding units by splitting an image according to the size of the coding units and the variable depth of the coding units;

hierarchically splitting a maximum coding unit, among the plurality of maximum coding units, into coding units according to depths; and

determining the coding unit of a current depth by dividing a height and width of a coding unit of an upper depth by two,

wherein the generating the information about the coded depth, and the encoding mode comprises;

when the coding unit of the current depth is split into coding units of a lower depth, independently from neighboring coding units, generating the information about the coded depth to indicate a split for the current depth;

when the coding unit of the current depth is not split into the coding units of a lower depth and prediction is performed on the coding unit of the current depth, generating the information about the coded depth to indicate a non-split of the current depth;

when prediction is performed in the skip mode using a prediction unit having a same size as the coding unit of the current depth, generating the encoding mode to indicate the skip mode;

when prediction is performed in the intra mode using a prediction unit including at least one square block determined from the coding unit of the current depth, generating the encoding mode to indicate the intra mode; and

when prediction is performed in the inter mode using a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, determined from the coding unit of the current depth, generating the encoding mode to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the current depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the current depth.

7. A non-transitory computer-readable storage medium storing a bitstream, the bitstream comprising:

coding unit structure information about a size of coding units, wherein the coding units are data units for encoding a picture of a video;

information about a variable depth of the coding units, wherein a maximum coding unit is hierarchically split into the coding units according to depths in the variable depth; and

information about a coded depth to indicate whether a coding unit of a depth, among the coding units, is not split into smaller coding units,

wherein;

a prediction unit is determined from the coding unit of the coded depth which is no longer splint into smaller coding units,

when prediction is performed in a skip mode, a prediction unit having a same size as the coding unit of the coded depth is used for prediction on the coding unit of the coded depth,

when prediction is performed in an intra mode, a prediction unit including at least one square block is determined from the coding unit of the coded depth and used for prediction on the coding unit of the coded depth, and

when prediction is performed in an inter mode, a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, is determined from the coding unit of the coded depth, and used for prediction on the coding unit of the coded depth, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.

8. A non-transitory computer-readable storage medium storing a bitstream, the bitstream comprising:

coding unit structure information about a size of coding units, wherein the coding units are data units for encoding a picture of the video;

information about a variable depth of the coding units, wherein a maximum coding unit is hierarchically split into the coding units according to depths in the variable depth;

information about a coded depth to indicate whether a coding unit of a depth, among the coding units, is not split into smaller coding units; and

an encode mode of the coding unit of the coded depth to indicate one among prediction types including skip mode, inter mode and intra mode,

wherein;

prediction is performed on the coding unit of the coded depth which is no longer splint into smaller coding units,

when prediction is performed in the skip mode, a prediction unit having a same size as the coding unit of the coded depth is used for prediction on the coding unit of the coded depth and the encoding mode is generated to indicate the skip mode,

when prediction is performed in the intra mode, a prediction unit including at least one square block is determined from the coding unit of the coded depth and used for prediction on the coding unit of the coded depth, and the encoding mode is generated to indicate the intra mode, and

when prediction is performed in the inter mode, a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, is determined from the coding unit of the coded depth, and used for prediction on the coding unit of the coded depth, and the encoding mode is generated to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.

9. A non-transitory computer-readable storage medium storing a bitstream, the bitstream comprising:

coding unit structure information about a size of coding units, wherein the coding units are data units for encoding a picture of the video;

information about a variable depth of the coding units, wherein a maximum coding unit is hierarchically split into the coding units according to depths in the variable depth;

information about a coded depth to indicate whether a coding unit of a depth, among the coding units, is not split into smaller coding units; and

an encode mode of the coding unit of the coded depth to indicate one among prediction types including skip mode, inter mode and intra mode,

wherein;

when a coding unit of a current depth is split into coding units of a lower depth, the information about the coded depth is generated to indicate a split for the current depth,

when the coding unit of the current depth is not split into the coding units of a lower depth and prediction is performed on the coding unit of the current depth, the information about the coded depth is generated to indicate a non-split of the current depth,

when prediction is performed in the skip mode, a prediction unit having a same size as the coding unit of the coded depth is used for prediction on the coding unit of the coded depth and the encoding mode is generated to indicate the skip mode,

when prediction is performed in the intra mode, a prediction unit including at least one square block is determined from the coding unit of the coded depth and used for prediction on the coding unit of the coded depth, and the encoding mode is generated to indicate the intra mode, and

when prediction is performed in the inter mode, a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, is determined from the coding unit of the coded depth, and used for prediction on the coding unit of the coded depth, and the encoding mode is generated to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.

10. A non-transitory computer-readable storage medium storing a bitstream, the bitstream comprising:

coding unit structure information about a size of coding units, wherein the coding units are data units for encoding a picture of the video;

information about a variable depth of the coding units, wherein a maximum coding unit is hierarchically split into the coding units according to depths in the variable depth;

information about a coded depth to indicate whether a coding unit of a depth, among the coding units, is not split into smaller coding units; and

an encode mode of the coding unit of the coded depth to indicate one among prediction types including skip mode, inter mode and intra mode,

wherein;

a plurality of maximum coding units are determined by splitting an image according to the size of the coding units and the variable depth of the coding units,

a maximum coding unit, among the plurality of maximum coding units, is hierarchically split into the coding units according to depths, and

a coding unit of a current depth is determined by dividing a height and width of a coding unit of an upper depth by two,

when a coding unit of the current depth is split into coding units of a lower depth, the information about the coded depth is generated to indicate a split for the current depth,

when the coding unit of the current depth is not split into the coding units of a lower depth and prediction is performed on the coding unit of the current depth, the information about the coded depth is generated to indicate a non-split of the current depth,

when prediction is performed in the skip mode, a prediction unit having a same size as the coding unit of the coded depth is used for prediction on the coding unit of the coded depth and the encoding mode is generated to indicate the skip mode,

when prediction is performed in the intra mode, a prediction unit including at least one square block is determined from the coding unit of the coded depth and used for prediction on the coding unit of the coded depth, and the encoding mode is generated to indicate the intra mode, and

when prediction is performed in the inter mode, a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, is determined from the coding unit of the coded depth, and used for prediction on the coding unit of the coded depth, and the encoding mode is generated to indicate the inter mode, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.

11. A non-transitory computer-readable storage medium storing a bitstream, the bitstream comprising:

coding unit structure information about a size of coding units, wherein the coding units are data units for encoding a picture of the video;

information about a variable depth of the coding units, wherein a maximum coding unit is hierarchically split into the coding units according to depths in the variable depth;

information about a coded depth to indicate whether a coding unit of a depth, among the coding units, is not split into smaller coding units;

an encode mode of the coding unit of the coded depth to indicate one among prediction types including skip mode, inter mode and intra mode; and

a partition type to indicate a partition for prediction on the coding unit of the coded depth,

wherein;

prediction is performed on the coding unit of the coded depth which is no longer splint into smaller coding units,

when prediction is performed in the skip mode, the encoding mode is generated to indicate the skip mode, and the partition type is generated to indicate a prediction unit having a same size as the coding unit of the coded depth used for prediction,

when prediction is performed in the intra mode, the encoding mode is generated to indicate the intra mode, and the partition type is generated to indicate a prediction unit including at least one square block determined from the coding unit of the coded depth, and

when prediction is performed in the inter mode, the encoding mode is generated to indicate the inter mode, and the partition type is generated to indicate a prediction unit including one of a partition, symmetric partitions and asymmetric partitions, wherein the symmetric partitions are obtained by symmetrically splitting at least one of a height and a width of the coding unit of the coded depth, and the asymmetric partitions are obtained by asymmetrically splitting one of the height and the width of the coding unit of the coded depth.