Multitree subdivision and inheritance of coding parameters in a coding block

• US 10,448,060 B2
• Filed: 06/25/2018
• Issued: 10/15/2019
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: GE Video Compression, LLC (General Electric Company)
• Original Assignee: GE Video Compression, LLC (General Electric Company)
• Inventors: Helle, Philipp, Marpe, Detlev, Oudin, Simon, Wiegand, Thomas
• Primary Examiner(s): Suh, Joseph
• Application Number:
  US16/017,453
• Publication Number:
  US 20180310030A1
• Time in Patent Office: 477 Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/439 using cascaded computational arrangements for performing a single operation, e.g. filtering
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims

1. A decoder, comprising:

an extractor configured to extract, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process; and

a reconstruction mechanism including a processor configured to;

obtain an inheritance syntax element representing the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block,

copy the inheritance syntax element into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks,

determine at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the copied inheritance syntax element representing the one or more coding parameters associated with the coding block, wherein a value of the at least one coding parameter is the same as or differs from that of the one or more coding parameters associated with the coding block, and

reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

2. The decoder of claim 1, wherein the reconstruction mechanism comprises a residual reconstructor configured to generate residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.

3. The decoder of claim 1, wherein the extractor is configured to extract information based on a depth-first traversal order.

4. The decoder of claim 1, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the reconstruction mechanism is further configured to:

obtain, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstruct the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

5. The decoder of claim 1, wherein the data stream comprises at least a portion associated with color samples.

6. The decoder of claim 1, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

7. The decoder of claim 1, wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

8. The decoder of claim 1, wherein the one or more coding parameters of the coding block are one or more motion parameters.

9. A method for decoding a coding block, the method comprising:

extracting, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process;

obtaining an inheritance syntax element representing the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block;

copying the inheritance syntax element into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks;

determining at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the copied inheritance syntax element representing the one or more coding parameters associated with the coding block, wherein a value of the at least one coding parameter is the same as or differs from that of the one or more coding parameters associated with the coding block; and

reconstructing the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

10. The method of claim 9, further comprising generating residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.

11. The method of claim 9, wherein extracting the information is based on a depth-first traversal order.

12. The method of claim 9, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the method further comprises:

obtaining, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstructing the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

13. The method of claim 9, wherein the data stream comprises at least a portion associated with color samples.

14. The method of claim 9, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

15. The method of claim 9, wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

16. The method of claim 9, wherein the one or more coding parameters of the coding block are one or more motion parameters.

17. An encoder configured to code, into a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process,

wherein the encoder is further configured to code an inheritance syntax element representing the one or more coding parameters associated with the coding block into the data stream and when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block, the inheritance syntax element is to be copied into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks, and used to determine at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein a value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

18. The encoder of claim 17, wherein the encoder is configured to code information based on a depth-first traversal order.

19. The encoder of claim 17, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the encoder is further configured to code, into the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

20. The encoder of claim 17, wherein the data stream comprises at least a portion associated with color samples.

21. The encoder of claim 17, wherein the data stream comprises at least portion associated with depth values related to a depth map.

22. The encoder of claim 17, wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

23. The encoder of claim 17, wherein the one or more coding parameters of the coding block are one or more motion parameters.

24. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process,

wherein the data stream further comprises an inheritance syntax element representing the one or more coding parameters associated with the coding block, and

when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block, the inheritance syntax element is to be copied into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks, and used to determine at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein a value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

25. The non-transitory computer-readable medium of claim 24, wherein information in the data stream is coded based on a depth-first traversal order.

26. The non-transitory computer-readable medium of claim 24, wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the data stream comprises at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

27. The non-transitory computer-readable medium of claim 24, wherein the data stream comprises at least a portion associated with color samples.

28. The non-transitory computer-readable medium of claim 24, wherein the data stream comprises at least portion associated with depth values related to a depth map.

29. The non-transitory computer-readable medium of claim 24, wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

30. The non-transitory computer-readable medium of claim 24, wherein the one or more coding parameters of the coding block are one or more motion parameters.