Multitree subdivision and inheritance of coding parameters in a coding block

• US 10,038,920 B2
• Filed: 10/11/2012
• Issued: 07/31/2018
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: GE Video Compression, LLC (General Electric Company)
• Original Assignee: GE Video Compression, LLC (General Electric Company)
• Inventors: Helle, Philipp, Marpe, Detlev, Oudin, Simon, Wiegand, Thomas
• Primary Examiner(s): Suh, Joseph
• Application Number:
  US13/649,233
• Publication Number:
  US 20130034157A1
• Time in Patent Office: 2,119 Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/439 using cascaded computational arrangements for performing a single operation, e.g. filtering
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims

1. A decoder, comprising:

an extractor configured to extract, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree spatial subdivision of the coding block, in which each of the plurality of non-overlapping coding sub-blocks has a same resolution as that of the coding block, the first information includes inheritance information with respect to the plurality of non-overlapping coding sub-blocks, the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an intra coding process; and

a reconstruction mechanism configured to;

obtain the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on the one or more coding parameters associated with the coding block,

predict at least one coding parameter to use in the intra coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the one or more coding parameters associated with the coding block, wherein the predicted value of the at least one coding parameter is the same as or differs from that of the one or more coding parameters associated with the coding block; and

reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the predicted value of the at least one coding parameter.

2. The decoder according to claim 1, wherein the reconstruction mechanism comprises a residual reconstructor configured to generate residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.

3. The decoder according to claim 1, wherein the extractor is configured to extract information based on a depth-first traversal order.

4. The decoder according to claim 1, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters, the reconstruction mechanism is further configured to:

obtain, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstruct the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

5. The decoder according to claim 1, wherein the data stream comprises at least a portion associated with color samples.

6. The decoder according to claim 1, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

7. A method for decoding a coding block, the method comprising:

extracting, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree spatial subdivision of the coding block, in which each of the plurality of non-overlapping coding sub-blocks has a same resolution as that of the coding block, the first information includes inheritance information with respect to the plurality of non-overlapping coding sub-blocks, the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an intra coding process;

obtaining the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on the one or more coding parameters associated with the coding block;

predicting at least one coding parameter to use in the intra coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the one or more coding parameters associated with the coding block, wherein the predicted value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block; and

reconstructing the at least one of the plurality of non-overlapping coding sub-blocks based on the predicted value of the at least one coding parameter.

8. The method according to claim 7, wherein the extracting is based on a depth-first traversal order.

9. The method according to claim 7, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters, the method comprises:

obtaining, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstructing the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

10. The method according to claim 7, wherein the data stream comprises at least a portion associated with color samples.

11. The method according to claim 7, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

12. The method according to claim 7, wherein the reconstructing comprises generating residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.

13. An encoder configured to code, into a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree spatial subdivision of the coding block, the first information includes inheritance information with respect to the plurality of coding sub-blocks, in which each of the plurality of non-overlapping coding sub-blocks has a same resolution as that of the coding block, the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an intra coding process,

wherein the encoder is further configured to code the one or more coding parameters associated with the coding block into the data stream and when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on the one or more coding parameters associated with the coding block, the one or more coding parameters associated with the coding block are to be used to predict at least one coding parameter to use in the intra coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein the predicted value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on predicted value of the at least one coding parameter.

14. The encoder according to claim 13, wherein the encoder is configured to code information based on a depth-first traversal order.

15. The encoder according to claim 13, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters, the encoder is further configured to code, into the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

16. The encoder according to claim 13, wherein the data stream comprises at least a portion associated with color samples.

17. The encoder according to claim 13, wherein the data stream comprises at least portion associated with depth values related to a depth map.

18. A method for coding, comprising:

coding, into a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree spatial subdivision of the coding block, in which each of the plurality of non-overlapping coding sub-blocks has a same resolution as that of the coding block, the first information includes inheritance information with respect to the plurality of non-overlapping coding sub-blocks, the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an intra coding process; and

coding the one or more coding parameters associated with the coding block into the data stream, wherein when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on the one or more coding parameters associated with the coding block, the one or more coding parameters associated with the coding block are to be used to predict at least one coding parameter to use in the intra coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein the predicted value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the predicted value of the at least one coding parameter.

19. The method according to claim 18, wherein at least the coding of the first information is based on a depth-first traversal order.

20. The method according to claim 18, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters, the method comprises coding, into the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

21. The method according to claim 18, wherein the data stream comprises at least a portion associated with color samples.

22. The method according to claim 18, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

23. A data stream stored in a non-transitory storage medium, the data stream comprising encoded first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree spatial subdivision of the coding block, in which each of the plurality of non-overlapping coding sub-blocks has a same resolution as that of the coding block, the first information includes inheritance information with respect to the plurality of non-overlapping coding sub-blocks, the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an intra coding process;

wherein the data stream further comprises the one or more coding parameters associated with the coding block and when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on the one or more coding parameters associated with the coding block, the one or more coding parameters associated with the coding block are to be used to predict at least one coding parameter to use in the intra coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein the predicted value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the predicted value of the at least one coding parameter.

24. The data stream according to claim 23, wherein at least the first information is encoded based on a depth-first traversal order.

25. The data stream according to claim 23, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters, the data stream comprises at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

26. The data stream according to claim 23, wherein the data stream comprises at least a portion associated with color samples.

27. The data stream according to claim 23, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

28. A non-transitory machine readable digital storage medium having computer instructions stored thereon for decoding, wherein the computer instructions, when read by the machine, causing the machine to at least perform:

extracting, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree spatial subdivision of the coding block, in which each of the plurality of non-overlapping coding sub-blocks has a same resolution as that of the coding block, the first information includes inheritance information with respect to the plurality of non-overlapping coding sub-blocks, the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an intra coding process;

obtaining the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be predicted based on the one or more coding parameters associated with the coding block;

predicting at least one coding parameter to use in the intra coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the one or more coding parameters associated with the coding block, wherein the predicted value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block; and

reconstructing the at least one of the plurality of non-overlapping coding sub-blocks based on the predicted value of the at least one coding parameter.

29. The non-transitory machine readable digital storage medium according to claim 28, wherein the extracting is based on a depth-first traversal order.

30. The non-transitory machine readable digital storage medium according to claim 28, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters, the machine is caused to perform:

obtaining, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstructing the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

31. The non-transitory machine readable digital storage medium according to claim 28, wherein the reconstructing comprises generating residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.