Inter-plane reuse of coding parameters

• US 10,873,749 B2
• Filed: 10/11/2012
• Issued: 12/22/2020
• Est. Priority Date: 04/13/2010
• Status: Active Grant

• Current Assignee: GE Video Compression, LLC (General Electric Company)
• Original Assignee: GE Video Compression, LLC (General Electric Company)
• Inventors: Winken, Martin, Kirchhoffer, Heiner, Schwarz, Heiko, Marpe, Detlev, Wiegand, Thomas
• Primary Examiner(s): Retallick, Kaitlin A
• Application Number:
  US13/649,291
• Publication Number:
  US 20130034171A1
• Time in Patent Office: 2,994 Days
• Field of Search: None
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.

Claims

1. A decoder, comprising:

an extractor configured for extracting, from a data stream, first information individually encoded for a first coding block located in a first array of information samples that represents a first color component of a picture, wherein the first information is indicative of whether a coding parameter including a first intra coding parameter of the first coding block containing information related to the first color component is determined using one or more parameters including a second intra coding parameter associated with a second coding block in a second array of information samples that represents a second color component, different from the first color component, of the picture, the second coding block containing information related to the second color component of the picture; and

a reconstruction mechanism configured for

if the first information indicates that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, obtaining the one or more parameters including the second intra coding parameter associated with the second coding block in the second array of information samples that represents the second color component, and obtaining at least one coding parameter for the first coding block containing information related to the first color component of the picture by copying the second intra coding parameter as the first intra coding parameter such that the first and second intra coding parameters are equal, wherein a spatial resolution of the second array is twice a spatial resolution of the first array, the first intra coding parameter indicates a directionality of intra prediction within the first array in an intra prediction mode and the second intra coding parameter indicates a directionality of intra prediction within the second array in the intra prediction mode,

if the first information does not indicate that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, obtaining at least one coding parameter specifically encoded into the data stream for the first coding block containing information related to the first color component of the picture, wherein the at least one coding parameter is independent of the one or more parameters associated with the second coding block, and

reconstructing the first coding block based on the at least one coding parameter.

2. The decoder of claim 1, wherein the one or more parameters include:

information related to prediction mode;

information related to motion parameters for motion based prediction;

or

subdivision information specifying how the second coding block is to be further subdivided.

3. The decoder of claim 1, wherein the second coding block is determined based on at least one of:

similarity between information in the first coding block and information in the second coding block; and

an extent of overlap between information in the first coding block and information in the second coding block.

4. The decoder of claim 1, wherein the first coding block is obtained by applying a first subdivision of the first array of information samples.

5. The decoder of claim 4, wherein the second coding block is obtained by applying a second subdivision of the second array of information samples.

6. The decoder of claim 5, wherein the first subdivision of the first array of information samples differs from the second subdivision of the second array of information samples.

7. The decoder of claim 1, wherein the reconstructing comprises:

obtaining, from the data stream, residual data associated with the first coding block;

deriving enhanced at least one coding parameter for reconstructing the first coding block based on the at least one coding parameter and the residual data; and

reconstructing the first coding block using the enhanced at least one coding parameter.

8. The decoder of claim 1, wherein the first or the second array of information samples includes depth information.

9. The decoder of claim 1, wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

10. A method for decoding, comprising:

extracting, from a data stream, first information individually encoded for a first coding block located in a first array of information samples that represents a first color component of a picture, wherein the first information is indicative of whether a coding parameter including a first intra coding parameter of the first coding block containing information related to the first color component is determined using one or more parameters including;

a second intra coding parameter associated with a second coding block in a second array of information samples that represents a second color component, different from the first color component, of the picture, the second coding block containing information related to the second color component of the picture;

if the first information indicates that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, obtaining the one or more parameters including the second intra coding parameter associated with the second coding block in the second array of information samples that represents the second color component, and obtaining at least one coding parameter for the first coding block containing information related to the first color component of the picture by copying the second intra coding parameter as the first intra coding parameter such that the first and second intra coding parameters are equal, wherein a spatial resolution of the second array is twice a spatial resolution of the first array, the first intra coding parameter indicates a directionality of intra prediction within the first array in an intra prediction mode and the second intra coding parameter indicates a directionality of intra prediction within the second array in the intra prediction mode;

if the first information does not indicate that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, obtaining at least one coding parameter specifically encoded into the data stream for the first coding block containing information related to the first color component of the picture, wherein the at least one coding parameter is independent of the one or more parameters associated with the second coding block; and

reconstructing the first coding block based on the at least one coding parameter.

11. The method of claim 10, wherein the one or more parameters include:

information related to prediction mode;

information related to motion parameters for motion based prediction;

or

subdivision information specifying how the second coding block is to be further subdivided.

12. The method of claim 10, wherein the second coding block is determined based on at least one of:

similarity between information in the first coding block and information in the second coding block; and

an extent of overlap between information in the first coding block and information in the second coding block.

13. The method of claim 10, wherein the first coding block is obtained by applying a first subdivision of the first array of information samples.

14. The method of claim 13, wherein the second coding block is obtained by applying a second subdivision of the second array of information samples.

15. The method of claim 14, wherein the first subdivision of the first array of information samples differs from the second subdivision of the second array of information samples.

16. The method of claim 10, wherein the reconstructing comprises:

obtaining, from the data stream, residual data associated with the first coding block;

deriving enhanced at least one coding parameter for reconstructing the first coding block based on the at least one coding parameter and the residual data; and

reconstructing the first coding block using the enhanced at least one coding parameter.

17. The method of claim 10, wherein the first or the second array of information samples includes depth information.

18. The method of claim 10, wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

19. A non-transitory machine readable digital storage medium having computer instructions stored thereon for decoding, wherein the computer instructions, when read by the machine, causing the machine to at least perform:

extracting, from a data stream, first information individually encoded for a first coding block located in a first array of information samples that represents a first color component of a picture, wherein the first information is indicative of whether a coding parameter including a first intra coding parameter of the first coding block containing information related to the first color component is determined using one or more parameters including a second intra coding parameter associated with a second coding block in a second array of information samples that represents a second color component, different from the first color component, of the picture, the second coding block containing information related to the second color component of the picture;

if the first information indicates that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, obtaining the one or more parameters including the second intra coding parameter associated with the second coding block in the second array of information samples that represents the second color component, and obtaining at least one coding parameter for the first coding block containing information related to the first color component of the picture by copying the second intra coding parameter as the first intra coding parameter such that the first and second intra coding parameters are equal, wherein a spatial resolution of the second array is twice a spatial resolution of the first array, the first intra coding parameter indicates a directionality of intra prediction within the first array in an intra prediction mode and the second intra coding parameter indicates a directionality of intra prediction within the second array in the intra prediction mode;

if the first information does not indicate that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, obtaining at least one coding parameter specifically encoded into the data stream for the first coding block containing information related to the first color component of the picture, wherein the at least one coding parameter is independent of the one or more parameters associated with the second coding block; and

reconstructing the first coding block based on the at least one coding parameter.

20. The medium of claim 19, wherein the one or more parameters include:

information related to prediction mode;

information related to motion parameters for motion based prediction;

or

subdivision information specifying how the second coding block is to be further subdivided.

21. The medium of claim 19, wherein the second coding block is determined based on at least one of:

similarity between information in the first coding block and information in the second coding block; and

an extent of overlap between information in the first coding block and information in the second coding block.

22. The medium of claim 19, wherein the first coding block is obtained by applying a first subdivision of the first array of information samples.

23. The medium of claim 22, wherein the second coding block is obtained by applying a second subdivision of the second array of information samples.

24. The medium of claim 23, wherein the first subdivision of the first array of information samples differs from the second subdivision of the second array of information samples.

25. The medium of claim 19, wherein the reconstructing comprises:

obtaining, from the data stream, residual data associated with the first coding block;

deriving enhanced at least one coding parameter for reconstructing the first coding block based on the at least one coding parameter and the residual data; and

reconstructing the first coding block using the enhanced at least one coding parameter.

26. The medium of claim 19, wherein the first or the second array of information samples includes depth information.

27. The medium of claim 19, wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

28. An encoder configured for coding, into a data stream, first information individually encoded for a first coding block located in a first array of information samples that represents a first color component of a picture, wherein the first information is indicative of whether a coding parameter including a first intra coding parameter of the first coding block containing information related to the first color component is determined using one or more parameters including a second intra coding parameter associated with a second coding block in a second array of information samples that represents a second color component, different from the first color component, of the picture, the second coding block containing information related to the second color component of the picture,

wherein the encoder is further configured for:

coding, into the data stream, the one or more parameters associated with the second coding block in the second array of information samples so that if the first information indicates that that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, the second intra coding parameter associated with the second coding block is copied as the first intra coding parameter such that the first and second intra coding parameters are equal to reconstruct the first coding block, wherein a spatial resolution of the second array is twice a spatial resolution of the first array, the first intra coding parameter indicates a directionality of intra prediction within the first array in an intra prediction mode and the second intra coding parameter indicates a directionality of intra prediction within the second array in the intra prediction mode; and

coding, into the data stream, at least one coding parameter of the first coding block containing information related to the first color component of the picture, if the first information does not indicate that that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, such that the at least one coding parameter is independent of the one or more parameters associated with the second coding block.

29. The encoder of claim 28, wherein the one or more parameters include:

information related to prediction mode;

information related to motion parameters for motion based prediction;

or

subdivision information specifying how the second coding block is to be further subdivided.

30. The encoder of claim 28, wherein the second coding block is determined based on at least one of:

similarity between information in the first coding block and information in the second coding block; and

an extent of overlap between information in the first coding block and information in the second coding block.

31. The encoder of claim 28, wherein the encoder is further configured for coding, into the data stream, residual data associated with the first coding block, wherein the residual data are to be used to derive enhanced at least one coding parameter, for reconstructing the first coding block, based on the one or more parameters associated with the second coding block.

32. The encoder of claim 28, wherein the first or the second array of information samples includes depth information.

33. The encoder of claim 28, wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

34. A method for encoding, comprising:

coding, into a data stream, first information individually encoded for a first coding block located in a first array of information samples that represents a first color component of a picture, wherein the first information is indicative of whether a coding parameter including a first intra coding parameter of the first coding block containing information related to the first color component is determined using one or more parameters including a second intra coding parameter associated with a second coding block in a second array of information samples that represents a second color component, different from the first color component, of the picture, the second coding block containing information related to the second color component of the picture;

coding, into the data stream, the one or more parameters associated with the second coding block in the second array of information samples so that if the first information indicates that that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, the second intra coding parameter associated with the second coding block is copied as the first intra coding parameter such that the first and second intra coding parameters are equal to reconstruct the first coding block, wherein a spatial resolution of the second array is twice a spatial resolution of the first array, the first intra coding parameter indicates a directionality of intra prediction within the first array in an intra prediction mode and the second intra coding parameter indicates a directionality of intra prediction within the second array in the intra prediction mode; and

coding, into the data stream, at least one coding parameter of the first coding block containing information related to the first color component of the picture, if the first information does not indicate that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, such that the at least one coding parameter is independent of the one or more parameters associated with the second coding block.

35. The method of claim 34, wherein the one or more parameters include:

information related to prediction mode;

information related to motion parameters for motion based prediction;

or

subdivision information specifying how the second coding block is to be further subdivided.

36. The method of claim 34, wherein the second coding block is determined based on at least one of:

similarity between information in the first coding block and information in the second coding block; and

an extent of overlap between information in the first coding block and information in the second coding block.

37. The method of claim 34, further comprising coding, into the data stream, residual data associated with the first coding block, wherein the residual data are to be used to derive enhanced at least one coding parameter, for reconstructing the first coding block, based on the one or more parameters associated with the second coding block.

38. The method of claim 34, wherein the first or the second array of information samples includes depth information.

39. The method of claim 34, wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in horizontal first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

40. A data stream stored in a non-transitory storage medium, the data stream comprising encoded first information individually encoded for a first coding block located in a first array of information samples that represents a first color component of a picture, wherein the first information is indicative of whether a coding parameter including a first intra coding parameter of the first coding block containing information related to the first color component is determined using one or more parameters including a second intra coding parameter associated with a second coding block in a second array of information samples that represents a second color component, different from the first color component, of the picture, the second coding block containing information related to the second color component of the picture,

wherein the data stream further comprises the one or more parameters including the second intra coding parameter associated with the second coding block in the second array of information samples so that if the first information indicates that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, the second intra coding parameter is copied as the first intra coding parameter such that the first and second intra coding parameters are equal to reconstruct the first coding block, wherein a spatial resolution of the second array is twice a spatial resolution of the first array, the first intra coding parameter indicates a directionality of intra prediction within the first array in an intra prediction mode and the second intra coding parameter indicates a directionality of intra prediction within the second array in the intra prediction mode, and

at least one coding parameter of the first coding block containing information related to the first color component of the picture, if the first information does not indicate that a coding parameter of the first coding block is determined using the one or more parameters associated with the second coding block, such that the at least one coding parameter is independent of the one or more parameters associated with the second coding block.

41. The data stream of claim 40, wherein the one or more parameters include:

information related to prediction mode;

information related to motion parameters for motion based prediction;

or

subdivision information specifying how the second coding block is to be further subdivided.

42. The data stream of claim 40, wherein the second coding block is determined based on at least one of:

similarity between information in the first coding block and information in the second coding block; and

an extent of overlap between information in the first coding block and information in the second coding block.

43. The data stream of claim 40, wherein the first coding block is obtained by applying a first subdivision of the first array of information samples.

44. The data stream of claim 43, wherein the second coding block is obtained by applying a second subdivision of the second array of information samples.

45. The data stream of claim 44, wherein the first subdivision of the first array of information samples differs from the second subdivision of the second array of information samples.

46. The data stream of claim 40, further comprising residual data associated with the first coding block, wherein the residual data are to be used to derive enhanced at least one coding parameter, for reconstructing the first coding block, based on the one or more parameters associated with the second coding block.

47. The data stream of claim 40, wherein the first or the second array of information samples includes depth information.

48. The data stream of claim 40, wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.