Inheritance in sample array multitree subdivision

• US 10,432,978 B2
• Filed: 06/29/2016
• Issued: 10/01/2019
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: GE Video Compression, LLC (General Electric Company)
• Original Assignee: GE Video Compression, LLC (General Electric Company)
• Inventors: Helle, Philipp, Marpe, Detlev, Oudin, Simon, Wiegand, Thomas
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Kwan, Matthew K
• Application Number:
  US15/196,342
• Publication Number:
  US 20160309198A1
• Time in Patent Office: 1,189 Days
• Field of Search: 37524022
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/439 using cascaded computational arrangements for performing a single operation, e.g. filtering
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims

1. A decoder for reconstructing an array of spatially sampled video information encoded in a data stream, the decoder comprising:

an extractor configured to;

extract, from the data stream, multi-tree structure information associated with the array and an inheritance syntax element, wherein

the multi-tree structure information specifies a primary subdivision associated with prediction coding of a video array and a subordinate subdivision associated with transform coding of the video array, and

the inheritance syntax element indicates whether inheritance is used, and if inheritance is used, an inheritance region of the prediction coding which includes a set of leaf regions of the transform coding obtained by sub-dividing the inheritance region via the sub-ordinate sub-division,

extract, from the data stream, a first intra-prediction mode syntax element and a second intra-prediction mode syntax element, wherein a type of the second intra-prediction mode syntax element depends on the first intra-prediction mode syntax element and the second intra-prediction mode syntax element represents an intra-prediction coding parameter used in an intra mode of the prediction coding associated with the inheritance region, and

copy the intra-prediction coding parameter associated with the inheritance region into a subset of coding parameters for each of the set of leaf regions of the transform coding;

a residual reconstructor configured to;

decode a respective residual signal for each of the set of leaf regions of the transform coding; and

a predictor configured to;

calculate a respective intra prediction signal for each of the set of leaf regions according to the intra mode of the prediction coding using the intra-prediction coding parameter copied from the inheritance region, and a reconstructed reference signal of already reconstructed neighboring leaf regions of the multi-tree structure,

wherein each of the set of leaf regions within the inheritance region is reconstructed by combining the respective intra prediction signal and the respective residual signal.

2. The decoder of claim 1, wherein the inheritance syntax element includes an inheritance flag indicating whether inheritance is used, and the extractor is configured to extract the inheritance flag from the data stream.

3. The decoder of claim 1, wherein the decoder is a hybrid video decoder.

4. The decoder of claim 1, wherein the extractor is configured to extract, from the data stream, at least one syntax element representing a coding parameter associated with a leaf region of the transform coding that is not a leaf region of the inheritance region.

5. The decoder of claim 1, wherein the extractor is configured to, if inheritance is indicated not to be used, extract at least one syntax element representing a coding parameter associated with a region of obtained by the primary subdivision of the video array for which inheritance is not used.

6. The decoder of claim 5, wherein the at least one syntax element represents an inter-prediction coding parameter used in an inter mode of the prediction coding.

7. An encoder for encoding an array of spatially sampled video information encoded into a data stream, the encoder comprising:

a data stream inserter configured to;

insert, into the data stream, multi-tree structure information associated with the array and an inheritance syntax element, wherein

the multi-tree structure information specifies a primary subdivision associated with prediction coding of a video array and a subordinate subdivision associated with transform coding of the video array, and

the inheritance syntax element indicates whether inheritance is used, and if inheritance is used, an inheritance region of the prediction coding which includes a set of leaf regions of the transform coding obtained by sub-dividing the inheritance region via the sub-ordinate sub-division,

insert, into the data stream, a first intra-prediction mode syntax element and a second intra-prediction mode syntax element, wherein a type of the second intra-prediction mode syntax element depends on the first intra-prediction mode syntax element and the second intra-prediction mode syntax element represents an intra-prediction coding parameter used in an intra mode of the prediction coding associated with the inheritance region, wherein the intra-prediction coding parameter associated with the inheritance region is to be copied into a subset of coding parameters for each of the set of leaf regions of the transform coding, and

insert, into the data stream, a respective residual signal for each of the set of leaf regions of the transform coding,

wherein a respective intra prediction signal for each of the set of leaf regions is calculated according to the intra mode of the prediction coding using the intra-prediction coding parameter copied from the inheritance region and a reconstructed reference signal of already reconstructed neighboring leaf regions of the multi-tree structure, and

each of the set of leaf regions within the inheritance region is reconstructed by combining the respective intra prediction signal and the respective residual signal.

8. The encoder of claim 7, wherein the inheritance syntax element includes an inheritance flag indicating whether inheritance is used, and the data stream inserter is configured to insert the inheritance flag into the data stream.

9. The encoder of claim 7, wherein the encoder is a hybrid video encoder.

10. The encoder of claim 7, wherein the data stream inserter is configured to insert, into the data stream, at least one syntax element representing a coding parameter associated with a leaf region of the transform coding that is not a leaf region of the inheritance region.

11. The encoder of claim 7, wherein the data stream inserter is configured to, if inheritance is indicated not to be used, insert at least one syntax element representing a coding parameter associated with a region of obtained by the primary subdivision of the video array for which inheritance is not used.

12. The encoder of claim 11, wherein the at least one syntax element represents an inter-prediction coding parameter used in an inter mode of the prediction coding.

13. A machine readable non-transitory medium for storing data associated with a multi-view signal, comprising:

a data stream stored in the non-transitory machine readable medium, the data stream comprising an array of spatially sampled video information, multi-tree structure information associated with the array and an inheritance syntax element, wherein

the multi-tree structure information specifies a primary subdivision associated with prediction coding of a video array and a subordinate subdivision associated with transform coding of the video array, and

the inheritance syntax element indicates whether inheritance is used, and if inheritance is used, an inheritance region of the prediction coding which includes a set of leaf regions of the transform coding obtained by sub-dividing the inheritance region via the sub-ordinate sub-division,

the data stream further comprising a first intra-prediction mode syntax element and a second intra-prediction mode syntax element, wherein a type of the second intra-prediction mode syntax element depends on the first intra-prediction mode syntax element and the second intra-prediction mode syntax element represents an intra-prediction coding parameter used in an intra mode of the prediction coding associated with the inheritance region, wherein the intra-prediction coding parameter associated with the inheritance region is to be copied into a subset of coding parameters for each of the set of leaf regions of the transform coding, and

a respective residual signal for each of the set of leaf regions of the transform coding,

wherein a respective intra prediction signal for each of the set of leaf regions is calculated according to the intra mode of the prediction coding using the intra-prediction coding parameter copied from the inheritance region and a reconstructed reference signal of already reconstructed neighboring leaf regions of the multi-tree structure, and

each of the set of leaf regions within the inheritance region is reconstructed by combining the respective intra prediction signal and the respective residual signal.

14. The machine readable non-transitory medium of claim 13, wherein the data stream further comprises at least one syntax element representing a coding parameter associated with a leaf region of the transform coding that is not a leaf region of the inheritance region.

15. The machine readable non-transitory medium of claim 13, wherein, if inheritance is indicated not to be used, the data stream further comprises at least one syntax element representing a coding parameter associated with a region of obtained by the primary subdivision of the video array for which inheritance is not used.

16. The machine readable non-transitory medium of claim 15, wherein the at least one syntax element represents an inter-prediction coding parameter used in an inter mode of the prediction coding.