Inheritance in sample array multitree division

• US 10,003,828 B2
• Filed: 06/29/2016
• Issued: 06/19/2018
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: GE Video Compression, LLC (General Electric Company)
• Original Assignee: GE Video Compression, LLC (General Electric Company)
• Inventors: Helle, Philipp, Marpe, Detlev, Oudin, Simon, Wiegand, Thomas
• Primary Examiner(s): Le, Peter D
• Application Number:
  US15/196,890
• Publication Number:
  US 20160309199A1
• Time in Patent Office: 720 Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/439 using cascaded computational arrangements for performing a single operation, e.g. filtering
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims

1. A decoder for reconstructing an array of information samples representing a spatially sampled video information signal, which is subdivided into leaf regions of different sizes using multi-tree subdivision according to subdivision information, wherein each leaf region has associated therewith (a) a hierarchy level out of a sequence of hierarchy levels of the multi-tree subdivision, and (b) coding parameters, wherein the coding parameters are, for each leaf region, represented by a respective set of syntax elements, each syntax element is of a respective syntax element type out of a set of syntax element types, the decoder comprising:

an extractor for extracting, from a data stream, the subdivision information, inheritance information indicating as to whether inheritance is used, and based on an indication from the inheritance information that inheritance is to be used, at least one inheritance region of the array of information samples which is spatially divided into a set of non-overlapping sub-regions and corresponds to a first hierarchy level of the sequence of hierarchy levels, the first hierarchy level being lower than a second hierarchy level of the sequence of hierarchy levels with which the set of non-overlapping sub-regions are associated, wherein each of the set of non-overlapping sub-regions has a same resolution as that of the at least one inheritance region;

wherein the decoder is configured to, responsive to the indication from the inheritance information that inheritance is to be used,

extract, from the data stream, at least one syntax element of a predetermined syntax element type including an intra-prediction mode syntax element associated with the at least one inheritance region,

for each of the set of non-overlapping sub-regions, copy the intra-prediction mode syntax element associated with the at least one inheritance region as, or use the intra-prediction mode syntax element associated with the at least one inheritance region to predict, a corresponding intra-prediction mode syntax element representing an intra coding parameter associated with the corresponding non-overlapping sub-region, and

obtain a separate intra prediction signal for each of the set of non-overlapping sub-regions according to the corresponding intra coding parameter, wherein each of the set of non-overlapping sub-regions is reconstructed based on the respective intra prediction signal.

2. The decoder according to claim 1, wherein the decoder is a hybrid decoder.

3. The decoder according to claim 1, wherein the decoder is configured to decode a residual for each non-overlapping sub-region.

4. The decoder according to claim 1, wherein the extractor is configured to extract, from the data stream, at least one syntax element of the predetermined syntax element type representing a coding parameter associated with a leaf region that is not a sub-region of the at least one inheritance region.

5. The decoder according to claim 1, wherein the extractor is configured to, responsive to the indication from the inheritance information that inheritance is not to be used, extract at least one syntax element of the predetermined syntax element type representing a coding parameter associated with the leaf regions of the array of information samples.

6. The decoder according to claim 1, wherein the decoder is configured to reconstruct the array of information samples by way of prediction using a prediction mode depending on the at least one syntax element of the predetermined syntax element type associated with the leaf regions.

7. The decoder according to claim 1, wherein the decoder is configured to, for the at least one inheritance region,

decode, in a residual decoding order, a residual signal for each of the set of non-overlapping sub-regions,

obtain, in the residual decoding order, the separate intra prediction signal for each of the set of non-overlapping sub-regions by using neighboring samples of a reconstructed signal of already reconstructed sub-regions as a reference signal, and

reconstructing each of the set of non-overlapping sub-regions by adding the respective intra prediction signal and the respective residual signal.

8. The decoder according to claim 7, the decoder is configured such that the residual decoding order is a depth-first traversal order.

9. A method for reconstructing an array of information samples representing a spatially sampled video information signal, which is subdivided into leaf regions of different sizes using multi-tree subdivision according to subdivision information, wherein each leaf region has associated therewith (a) a hierarchy level out of a sequence of hierarchy levels of the multi-tree subdivision, and (b) coding parameters, wherein the coding parameters are, for each leaf region, represented by a respective set of syntax elements, each syntax element is of a respective syntax element type out of a set of syntax element types, the method comprising:

extracting the subdivision information from the data stream;

extracting, from the data stream, inheritance information-indicating as to whether inheritance is used, and based on an indication from the inheritance information that inheritance is to be used, at least one inheritance region of the array of information samples which is spatially divided into a set of non-overlapping sub-regions and corresponds to a first hierarchy level of the sequence of hierarchy levels, the first hierarchy level being lower than a second hierarchy level of the sequence of hierarchy levels with which the set of non-overlapping sub-regions are associated, wherein each of the set of non-overlapping sub-regions has a same resolution as that of the at least one inheritance region; and

responsive to the indication from the inheritance information that inheritance is to be used,

extracting, from the data stream, at least one syntax element of a predetermined syntax element type including an intra-prediction mode syntax element associated with the at least one inheritance region,

for each of the set of non-overlapping sub-regions, copying the intra-prediction mode syntax element associated with the at least one inheritance region as, or using the intra-prediction mode syntax element associated with the at least one inheritance region to predict, a corresponding intra-prediction mode syntax element representing an intra coding parameter associated with the corresponding non-overlapping sub-region,

obtaining a separate intra prediction signal for each of the set of non-overlapping sub regions according to the corresponding intra coding parameter, and

reconstructing each of the set of non-overlapping sub-regions based on the corresponding intra prediction signal.

12. A non-transitory computer readable digital storage medium having stored thereon a computer program having a program code for performing, when running on a computer, a method according to claim 9.

10. An encoder for encoding, into a data stream, an array of information samples representing a spatially sampled video information signal, which is subdivided, according to subdivision information, into leaf regions of different sizes by multi-tree subdivision, wherein each leaf region has associated therewith (a) a hierarchy level out of a sequence of hierarchy levels of the multi-tree subdivision, and (b) coding parameters, wherein the coding parameters are, for each leaf region, represented by a respective set of syntax elements, each syntax element is of a respective syntax element type out of a set of syntax element types, the encoder comprising:

a data stream inserter for inserting, into the data stream, the subdivision information, inheritance information the inheritance information indicating as to whether inheritance is used, and based on an indication from the inheritance information that inheritance is to be used, at least one inheritance region of the array of information samples which is spatially divided into a set of non-overlapping sub-regions and corresponds to a first hierarchy level of the sequence of hierarchy levels, the first hierarchy level being lower than a second hierarchy level of the sequence of hierarchy levels with which the set of non-overlapping sub-regions are associated, wherein each of the set of non-overlapping sub-regions has a same resolution as that of the at least one inheritance region,

wherein the encoder is configured to, responsive to the indication from the inheritance information that inheritance is to be used,

insert, into the data stream, at least one syntax element of a predetermined syntax element type including an intra-prediction mode syntax element associated with the at least one inheritance region, and

for each of the set of non-overlapping sub-regions, suppress coding a syntax element representing an intra coding parameter associated with the respective non-overlapping sub-region corresponding to the intra-prediction mode syntax element, or use the intra-prediction mode syntax element associated with the at least one inheritance region to predict the syntax element representing an intra coding parameter associated with the respective non-overlapping sub-region, and

obtain a separate intra prediction signal for each of the set of non-overlapping sub-regions according to the corresponding intra coding parameter, wherein each of the set of non-overlapping sub-regions is reconstructed based on the corresponding intra prediction signal.

11. A method for encoding, into a data stream, an array of information samples representing a spatially sampled video information signal, which is subdivided, according to subdivision information, into leaf regions of different sizes by multi-tree subdivision, wherein each leaf region has associated therewith (a) a hierarchy level out of a sequence of hierarchy levels of the multi-tree subdivision, and (b) coding parameters, the coding parameters are, for each leaf region, represented by a respective set of syntax elements, each syntax element is of a respective syntax element type out of a set of syntax element types, the method comprising:

inserting the subdivision information into the data stream;

inserting, into the data stream, inheritance information indicating as to whether inheritance is used, and based on an indication from the inheritance information that inheritance is to be used, at least one inheritance region of the array of information samples which is spatially divided into a set of non-overlapping sub-regions and corresponds to a first hierarchy level of the sequence of hierarchy levels, the first hierarchy level being lower than a second hierarchy level of the sequence of hierarchy levels with which the set of non-overlapping sub-regions are associated, wherein each of the set of non-overlapping sub-regions has a same resolution as that of the at least one inheritance region; and

responsive to the indication from the inheritance information that inheritance is to be used;

inserting, into the data stream, at least one syntax element of a predetermined syntax element type including an intra-prediction mode syntax element associated with the at least one inheritance region,

for each of the set of non-overlapping sub-regions, suppressing coding a syntax element representing an intra coding parameter associated with the respective non-overlapping sub-region corresponding to the intra-prediction mode syntax element, or use the intra-prediction mode syntax element associated with the at least one inheritance region to predict the syntax element representing an intra coding parameter associated with the respective non-overlapping sub-region, and

obtaining a separate intra prediction signal for each of the set of non-overlapping sub regions according to the corresponding intra coding parameter, wherein each of the set of non-overlapping sub-regions is reconstructed based on the corresponding intra prediction signal.

14. A non-transitory computer readable digital storage medium having stored thereon a computer program having a program code for performing, when running on a computer, a method according to claim 11.

13. A non-transitory computer-readable medium for storing thereon a data stream and a computer program the computer program when read by a microprocessor causes the microprocessor to generate:

the data stream stored in the non-transitory computer-readable medium and having encoded therein an array of information samples representing a spatially sampled video information signal, which is subdivided, according to subdivision information, into leaf regions of different sizes by multi-tree subdivision, wherein each leaf region has associated therewith (a) a hierarchy level out of a sequence of hierarchy levels of the multi-tree subdivision, and (b) coding parameters, the coding parameters are, for each leaf region, represented by a respective set of syntax elements, each syntax element is of a respective syntax element type out of a set of syntax element types, wherein the data stream comprises;

the sub-division information; and

inheritance information indicating as to whether inheritance is used, and based on an indication from the inheritance information that inheritance is to be used, at least one inheritance region of the array of information samples which is spatially divided into a set of non-overlapping sub-regions and corresponds to a first hierarchy level of the sequence of hierarchy levels, the first hierarchy level being lower than a second hierarchy level of the sequence of hierarchy levels with which the set of non-overlapping sub-regions are associated, wherein each of the set of non-overlapping sub-regions has a same resolution as that of the at least one inheritance region,

wherein the data stream is obtained by executing operations using a processor, the operations comprising;

inserting, into the data stream, the subdivision information and the inheritance information, and

responsive to the indication from the inheritance information that inheritance is to be used, inserting, into the data stream, at least one syntax element of a predetermined syntax element type including an intra-prediction mode syntax element associated with the at least one inheritance region, so that the intra-prediction mode syntax element associated with the at least one inheritance region is to be copied as, or is to be used as a prediction for, a corresponding syntax element representing an intra coding parameter associated with the set of non-overlapping sub-regions, wherein a separate intra prediction signal for each of the set of non-overlapping sub-regions is obtained according to the corresponding intra coding parameter, wherein each of the set of non-overlapping sub-regions is reconstructed based on the corresponding intra prediction signal.