Inheritance in sample array multitree subdivision

• US 10,721,496 B2
• Filed: 09/23/2019
• Issued: 07/21/2020
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: GE Video Compression, LLC (General Electric Company)
• Original Assignee: GE Video Compression, LLC (General Electric Company)
• Inventors: Helle, Philipp, Marpe, Detlev, Oudin, Simon, Wiegand, Thomas
• Primary Examiner(s): Mahmud, Farhan
• Application Number:
  US16/578,620
• Publication Number:
  US 20200021857A1
• Time in Patent Office: 302 Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/439 using cascaded computational arrangements for performing a single operation, e.g. filtering
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims

1. A decoder for reconstructing an array of information samples from a data stream, the array of information samples representing a spatially sampled information signal, the decoder comprising:

an extractor configured to extract, from the data stream, first subdivision information, second subdivision information, and a maximum size;

a divider configured to;

subdivide the array of information samples into prediction blocks associated with prediction coding according to the first subdivision information,

subdivide at least one of the prediction blocks that is greater than the maximum size into a root block of the maximum size, wherein the root block is associated with transform coding,

determine whether the root block is to be subdivided based on the second subdivision information, and

responsive to a determination that the root block is to be subdivided, subdivide the root block into the residual blocks associated with transform coding;

wherein the extractor is configured to;

extract, for each of the prediction blocks that is greater than the maximum size, inheritance information from the data stream, the inheritance information indicating whether inheritance is used or not and,

if inheritance is indicated to be used, share a coding parameter among the residual blocks corresponding to the respective prediction block; and

a reconstructor configured to;

determine each of residual signals for each of the residual blocks based on the respective coding parameter in transform coding,

determine prediction signals for the prediction blocks using prediction coding, and

reconstruct the array of information samples based on a combination of the prediction signals and the residual signals.

2. The decoder according to claim 1, wherein the spatially sampled information signal is a video accompanied with depth information.

3. The decoder according to claim 1, wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

4. The decoder according to claim 1, wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

5. The decoder according to claim 1, wherein the extractor is configured to, if inheritance is indicated not to be used, extract the coding parameter from the data stream for each of the residual blocks corresponding to the respective prediction block.

6. The decoder according to claim 1, wherein the decoder is configured to reconstruct the array information samples by prediction using a prediction mode which is extracted and decoded from the data stream.

7. The decoder according to claim 1, wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

8. A method for reconstructing an array of information samples from a data stream, the array of information samples representing a spatially sampled information signal, the method comprising:

extracting, from the data stream, first subdivision information, second subdivision information, and a maximum size;

subdividing the array of information samples into prediction blocks associated with prediction coding according to the first subdivision information;

subdividing at least one of the prediction blocks that is greater than the maximum size into a root block of the maximum size, wherein the root block is associated with transform coding;

determining whether the root block is to be subdivided based on the second subdivision information,

responsive to a determination that the root block is to be subdivided, subdividing the root block into the residual blocks associated with transform coding;

extracting, for each of the prediction blocks that is greater than the maximum size, inheritance information from the data stream, the inheritance information indicating whether inheritance is used or not and, if inheritance is indicated to be used, sharing a coding parameter among the residual blocks corresponding to the respective prediction block;

determining each of residual signals for each of the residual blocks based on the respective coding parameter in transform coding;

determining prediction signals for the prediction blocks using prediction coding; and

reconstructing the array of information samples based on a combination of the prediction signals and the residual signals.

9. The method according to claim 8, wherein the spatially sampled information signal is a video accompanied with depth information.

10. The method according to claim 8, wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

11. The method according to claim 8, wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

12. The method according to claim 8, further comprising:

if inheritance is indicated not to be used, extracting the coding parameter from the data stream for each of the residual blocks corresponding to the respective prediction block.

13. The method according to claim 8, wherein the array information samples is reconstructed by prediction using a prediction mode which is extracted and decoded from the data stream.

14. The method according to claim 8, wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

15. An encoder for encoding an array of information samples into a data stream, the array of information samples representing a spatially sampled information signal, the encoder comprising:

an inserter configured to insert, into the data stream, first subdivision information, second subdivision information, and a maximum size; and

a divider configured to;

subdivide the array of information samples into prediction blocks associated with prediction coding according to the first subdivision information,

subdivide at least one of the prediction blocks that is greater than the maximum size into a root block of the maximum size, wherein the root block is associated with transform coding,

determine whether the root block is to be subdivided based on the second subdivision information, and

responsive to a determination that the root block is to be subdivided, subdivide the root block into the residual blocks associated with transform coding;

wherein the inserter is configured to;

insert, for each of the prediction blocks that is greater than the maximum size, inheritance information into the data stream, the inheritance information indicating whether inheritance is used or not and,

if inheritance is indicated to be used, share a coding parameter among the residual blocks corresponding to the respective prediction block.

16. The encoder according to claim 15, wherein the spatially sampled information signal is a video accompanied with depth information.

17. The encoder according to claim 15, wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

18. The encoder according to claim 15, wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

19. The encoder according to claim 15, wherein the inserter is configured to, if inheritance is indicated not to be used, insert the coding parameter into the data stream for each of the residual blocks corresponding to the respective prediction block.

20. The encoder according to claim 15, wherein the encoder is configured to encode the array information samples by prediction using a prediction mode which is inserted into the data stream.

21. The encoder according to claim 15, wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

22. The encoder according to claim 21, wherein, according to the quadtree partitioning technique, the array of information samples is subdivided into prediction blocks such that a plurality of hierarchical levels are created, wherein each of the prediction blocks is associated with one of the plurality of hierarchical levels.

23. A non-transitory computer-readable medium for storing data, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information associated with an array of information samples representing a spatially sampled information signal, the encoded information including first subdivision information, second subdivision information, a maximum size, and inheritance information, wherein the array of information samples is reconstructed based on a plurality of instructions including;

subdividing the array of information samples into prediction blocks associated with prediction coding according to the first subdivision information;

subdividing at least one of the prediction blocks that is greater than the maximum size into a root block of the maximum size, wherein the root block is associated with transform coding;

determining whether the root block is to be subdivided based on the second subdivision information,

responsive to a determination that the root block is to be subdivided, subdividing the root block into the residual blocks associated with transform coding;

extracting, for each of the prediction blocks that is greater than the maximum size, inheritance information from the data stream, the inheritance information indicating whether inheritance is used or not and, if inheritance is indicated to be used, sharing a coding parameter among the residual blocks corresponding to the respective prediction block;

determining each of residual signals for each of the residual blocks based on the respective coding parameter in transform coding;

determining prediction signals for the prediction blocks using prediction coding; and

reconstructing the array of information samples based on a combination of the prediction signals and the residual signals.

24. The computer-readable medium of claim 23, wherein the spatially sampled information signal is a video accompanied with depth information.

25. The computer-readable medium of claim 23, wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

26. The computer-readable medium of claim 23, wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

27. The computer-readable medium of claim 23, the plurality of instructions including further including:

if inheritance is indicated not to be used, extracting the coding parameter from the data stream for each of the residual blocks corresponding to the respective prediction block.

28. The computer-readable medium of claim 23, wherein the array information samples is reconstructed by prediction using a prediction mode which is extracted and decoded from the data stream.

29. The computer-readable medium of claim 23, wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

30. The computer-readable medium of claim 29, wherein, according to the quadtree partitioning technique, the array of information samples is subdivided into prediction blocks such that a plurality of hierarchical levels are created, wherein each of the prediction blocks is associated with one of the plurality of hierarchical levels.