PREDICTION PARAMETER INHERITANCE FOR 3D VIDEO CODING

• US 20140098189A1
• Filed: 11/20/2012
• Published: 04/10/2014
• Est. Priority Date: 10/04/2012
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Chiu, Yi-Jen, Xu, Lidong, Zhang, Wenhao, Han, Yu, Cai, Xiaoxia, Deng, Zhipin
• Granted Patent: US 9,544,612 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/122 Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
• CPC Class Codes: H04N 19/157 Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A three-dimensional (3D) video codec encodes multiple views of a 3D video, each including texture and depth components. The encoders of the codec encode video blocks of their respective views based on a set of prediction parameters, such as quad-tree split flags, prediction modes, partition sizes, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes. The prediction parameters may be inherited across different views and different ones of the texture and depth components.

Claims

1. A non-transitory computer readable medium encoded with a computer program, including instructions to cause a processor to:

encode a video block from each of

a texture component of a first view of multiple views of multi-view video,

a depth component of the first view,

a texture component of a second view of the multiple views, and

a depth component of the second view;

wherein the instructions to cause the processor to encode each video block include instructions to cause the processor to encode the respective video block based on a selectable one of

prediction parameters inherited from a selectable one of the other video blocks, and

prediction parameters that are not inherited from one of the other video blocks.

2. The computer readable medium of claim 1, wherein the multi-view video is three-dimensional (3D) multi-view video.

3. The computer readable medium of claim 1, wherein the instructions to cause the processor to encode the respective video block based on prediction parameters inherited from one of the other blocks include instructions to cause the processor to:

encode the respective video block of one of the texture and depth components of the first view based on prediction parameters inherited from the one of the other video blocks of the other one of the texture and depth components of the first view; and

encode the respective video block of the one of the texture and depth components of the second view based on prediction parameters inherited from a selectable one of the other video blocks of

the texture component of the first view

the depth component of the first view, and

the other one of the texture and depth components of the second view.

4. The computer readable medium of claim 1, wherein the instructions to encode include instruction to encode the respective video block based on prediction parameters inherited from one of the other blocks, and wherein the inherited prediction parameters include:

inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes;

intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes; and

a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on the combination of the inter and intra modes.

5. The computer readable medium of claim 1, wherein the instructions to encode include instructions to the respective video block based on prediction parameters inherited from the one of the other video blocks, and wherein the inherited prediction parameters include a quadtree structure splitting video blocks into coding units (CUs) and prediction units (PUs), sizes of the PUs, and inter and intra prediction modes used to encode the PUs.

6. The computer readable medium of claim 5, wherein the inherited prediction parameters further include at least two or more of motion a motion vector, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes.

7. The computer readable medium of claim 1, further comprising instructions to cause the processor to:

determine whether to encode the respective video block based on inherited prediction parameters;

encode the respective video block based on the inherited prediction parameters if it is determined to encode based on inherited prediction parameters; and

encode the respective video block based on prediction parameters that are not inherited if it is determined not to encode based on inherited prediction parameters.

8. The computer readable medium of claim 1, further comprising instructions to cause the processor to:

generate an encoded bitstream comprising encoded video blocks of the texture and the depth components in each of the multiple views; and

embed into the encoded bitstream a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including

a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters,

information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, and

the inherited prediction parameters.

9. A apparatus, comprising:

an encoder to encode a video block from each of

a texture component of a first view of multiple views of multi-view video,

a depth component of the first view,

a texture component of a second view of the multiple views, and

a depth component of the second view;

wherein the encoder is configured to encode each respective video block based on a selectable one of

prediction parameters inherited from a selectable one of the other video blocks, and

prediction parameters that are not inherited from one of the other video blocks.

10. The apparatus of claim 9, wherein the multi-view video is three-dimensional (3D) multi-view video.

11. The apparatus of claim 9, wherein the encoder is configured to:

encode the respective video block of one of the texture and depth components of the first view based on prediction parameters inherited from the one of the other video blocks of the other one of the texture and depth components of the first view; and

encode the respective video block of the one of the texture and depth components of the second view based on prediction parameters inherited from a selectable one of the other video blocks of

the texture component of the first view

the depth component of the first view, and

the other one of the texture and depth components of the second view.

12. The apparatus of claim 9, wherein the encoder is configured to encode the respective video block based on prediction parameters inherited from the one of the other video blocks, and wherein the inherited prediction parameters include:

inter-prediction modes if the one of the other video blocks includes coding blocks encoded by the encoder based on the inter-prediction modes;

intra-prediction modes if the one of the other video blocks includes coding blocks encoded by the encoder based on the intra-prediction modes; and

a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded by the encoder based on the combination of the inter and intra modes.

13. The apparatus of claim 9, wherein the encoder is configured to encode the respective video block based on prediction parameters inherited from the one of the other video blocks, and wherein the inherited prediction parameters include a quadtree structure splitting video blocks into coding units (CUs) and prediction units (PUs), sizes of the PUs, and inter and intra prediction modes used to encode the PUs.

14. The apparatus of claim 13, wherein the inherited prediction parameters further include at least two or more of motion a motion vector, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes.

15. The apparatus of claim 9, wherein the encoder is further configured to:

determine whether to encode the respective video block based on inherited prediction parameters;

encode the respective video block based on the inherited prediction parameters if it is determined to encode based on inherited prediction parameters; and

encoding the respective video block based on prediction parameters that are not inherited if it is determined not to encode based on inherited prediction parameters.

16. The apparatus of claim 9, the encoder is further configured to:

generate an encoded bitstream comprising encoded video blocks of the texture and the depth components in each of the multiple views; and

embed into the encoded bitstream a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including

a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters,

information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, and

the inherited prediction parameters.

17. The apparatus of claim 9, further comprising:

communication components to communicate with a communication network;

a user interface;

a processor and memory to communicate with the communication components and the user interface; and

a housing to house the encoder, the processor and memory, the communication components, and the user interface.

18. A method, comprising:

encoding a video block from each of

a texture component of a first view of multiple views of multi-view video,

a depth component of the first view,

a texture component of a second view of the multiple views, and

a depth component of the second view;

wherein the encoding of each video block includes encoding the respective video block based on a selectable one of

prediction parameters inherited from a selectable one of the other video blocks, and

prediction parameters that are not inherited from one of the other video blocks.

19. The method of claim 18, wherein the multi-view video is three-dimensional (3D) multi-view video.

20. The method of claim 18, wherein encoding the respective video block includes:

encoding the respective video block of one of the texture and depth components of the first view based on prediction parameters inherited from the one of the other video blocks of the other one of the texture and depth components of the first view; and

encoding the respective video block of the one of the texture and depth components of the second view based on prediction parameters inherited from a selectable one of the other video blocks of

the texture component of the first view

the depth component of the first view, and

the other one of the texture and depth components of the second view.

21. The method of claim 18, wherein the encoding includes encoding the respective video block based on prediction parameters inherited from the one of the other video blocks, and wherein the inherited prediction parameters include:

inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes;

intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes; and

a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on the combination of the inter and intra modes.

22. The method of claim 18, wherein the encoding includes encoding the respective video block based on prediction parameters inherited from the one of the other video blocks, and wherein the inherited prediction parameters include a quadtree structure splitting video blocks into coding units (CUs) and prediction units (PUs), sizes of the PUs, and inter and intra prediction modes used to encode the PUs.

23. The method of claim 22, wherein the inherited prediction parameters further include at least two or more of motion a motion vector, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes.

24. The method of claim 18, further comprising, prior to encoding the respective video block:

determining whether to encode the respective video block based on inherited prediction parameters;

if it is determined to encode based on inherited prediction parameters, then encoding the respective video block based on the inherited prediction parameters; and

if it is determined not to encode based on inherited prediction parameters, then encoding the respective video block based on prediction parameters that are not inherited.

25. The method of claim 18, further comprising:

generating an encoded bitstream comprising encoded video blocks of the texture and the depth components in each of the multiple views; and

embedding into the encoded bitstream a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including

a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters,

information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, and

the inherited prediction parameters.

26. A non-transitory computer readable medium encoded with a computer program, including instructions to cause a processor to:

receive an encoded video block of each of

a texture component of a first view of multiple views of multi-view video,

a depth component of the first view,

a texture component of a second view of the multiple views, and

a depth component of the second view;

determine whether each encoded video block is associated with a prediction parameter inheritance syntax (PPI) indicating that the respective encoded video block was encoded based on inherited prediction parameters; and

decode the respective encoded video block based on prediction parameters inherited from a selectable one of the other encoded video blocks indicated in the PPI syntax, if inherited prediction parameters are indicated for the respective encoded video block.

27. The computer readable medium of claim 26, wherein the multi-view video is three-dimensional (3D) multi-view video.

28. The computer readable medium of claim 26, wherein the instruction to cause the processor to decode include instructions to cause the processor to:

decode the respective encoded video block of one of the texture and depth components of the first view based on prediction parameters inherited from the one of the other encoded video blocks from the other one of the texture and depth components of the first view; and

decode the respective encoded video block of one of the texture and depth components of the second view based on prediction parameters inherited from a selectable one of the other encoded video blocks of

the texture component of the first view

the depth component of the first view, and

the other one of the texture and depth components of the second view.

29. The computer readable medium of claim 26, wherein the inherited prediction parameters include:

inter-prediction modes if the one of the other encoded video blocks includes coding blocks encoded based on the inter-prediction modes;

intra-prediction modes if the one of the other encoded video blocks includes coding blocks encoded based on the intra-prediction modes; and

a combination of inter and intra prediction modes if the one of other encoded video blocks includes coding blocks encoded based on the combination of the inter and intra modes.

30. The computer readable medium of claim 26, wherein the inherited prediction parameters include a quadtree structure splitting encoded video blocks into coding units (CUs) and prediction units (PUs), sizes of the PUs, and inter and intra prediction modes used to encode the PUs.

31. The computer readable medium of claim 30, wherein the inherited prediction parameters further include at least two or more of a motion vector, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes.

32. The computer readable medium of claim 26, wherein the instructions to cause the processor to decode include instructions to cause the processor to identify the one of the other encoded video blocks based on a generated disparity vector, if the PPI syntax indicates the prediction parameters are to be inherited from an encoded video block of one of the views of the multiple views that is different from the view of the respective encoded video block.

33. The computer readable medium of claim 26, wherein the instruction to decode further include instructions to cause the processor to decode the respective encoded video block based on prediction parameters that are not inherited if inherited prediction parameters are not indicated.

34. A apparatus, comprising:

a decoder configured to;

receive an encoded video block of each of

a texture component of a first view of multiple views of multi-view video,

a depth component of the first view,

a texture component of a second view of the multiple views, and

a depth component of the second view;

determine whether each encoded video block is associated with a prediction parameter inheritance syntax (PPI) indicating that the respective encoded video block was encoded based on inherited prediction parameters; and

decode the respective encoded video block based on prediction parameters inherited from a selectable one of the other encoded video blocks indicated in the PPI syntax, if inherited prediction parameters are indicated for the respective encoded video block.

35. The apparatus of claim 34, wherein the multi-view video is three-dimensional (3D) multi-view video.

36. The apparatus of claim 34, wherein the decoder is configured to:

decode the respective encoded video block of one of the texture and depth components of the first view based on prediction parameters inherited from the one of the other encoded video blocks from the other one of the texture and depth components of the first view; and

decode the respective encoded video block of one of the texture and depth components of the second view based on prediction parameters inherited from a selectable one of the other encoded video blocks of

the texture component of the first view

the depth component of the first view, and

the other one of the texture and depth components of the second view.

37. The apparatus of claim 34, wherein the inherited prediction parameters include:

inter-prediction modes if the one of the other encoded video blocks includes coding blocks encoded based on the inter-prediction modes;

intra-prediction modes if the one of the other encoded video blocks includes coding blocks encoded based on the intra-prediction modes; and

a combination of inter and intra prediction modes if the one of other encoded video blocks includes coding blocks encoded based on the combination of the inter and intra modes.

38. The apparatus of claim 34, wherein the inherited prediction parameters include a quadtree structure splitting encoded video blocks into coding units (CUs) and prediction units (PUs), sizes of the PUs, and inter and intra prediction modes used to encode the PUs.

39. The apparatus of claim 38, wherein the inherited prediction parameters further include at least two or more of a motion vector, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes.

40. The apparatus of claim 34, wherein the decoder is further configured to identify the one of the other encoded video blocks based on a generated disparity vector, if the PPI syntax indicates the prediction parameters are to be inherited from an encoded video block of one of the views of the multiple views that is different from the view of the respective encoded video block.

41. The apparatus of claim 34, wherein the decoder is further configured to decode the respective encoded video block based on prediction parameters that are not inherited if inherited prediction parameters are not indicated.

42. The apparatus of claim 34, further comprising:

communication components to communicate with a communication network;

a user interface;

a processor and memory to communicate with the communication components and the user interface; and

a housing to house the decoder, the processor and memory, the communication components, and the user interface.

43. A method, comprising:

receiving an encoded video block of each of

a texture component of a first view of multiple views of multi-view video,

a depth component of the first view,

a texture component of a second view of the multiple views, and

a depth component of the second view;

determining whether each encoded video block is associated with a prediction parameter inheritance syntax (PPI) indicating that the respective encoded video block was encoded based on inherited prediction parameters; and

decoding the respective encoded video block based on prediction parameters inherited from a selectable one of the other encoded video blocks indicated in the PPI syntax, if inherited prediction parameters are indicated for the respective encoded video block.

44. The method of claim 43, wherein the multi-view video is three-dimensional (3D) multi-view video.

45. The method of claim 43, wherein the decoding includes:

decoding the respective encoded video block of one of the texture and depth components of the first view based on prediction parameters inherited from the one of the other encoded video blocks from the other one of the texture and depth components of the first view; and

decoding the respective encoded video block of one of the texture and depth components of the second view based on prediction parameters inherited from a selectable one of the other encoded video blocks of

the texture component of the first view

the depth component of the first view, and

the other one of the texture and depth components of the second view.

46. The method of claim 43, wherein the inherited prediction parameters include:

inter-prediction modes if the one of the other encoded video blocks includes coding blocks encoded based on the inter-prediction modes;

intra-prediction modes if the one of the other encoded video blocks includes coding blocks encoded based on the intra-prediction modes; and

a combination of inter and intra prediction modes if the one of other encoded video blocks includes coding blocks encoded based on the combination of the inter and intra modes.

47. The method of claim 43, wherein the inherited prediction parameters include a quadtree structure splitting encoded video blocks into coding units (CUs) and prediction units (PUs), sizes of the PUs, and inter and intra prediction modes used to encode the PUs.

48. The method of claim 47, wherein the inherited prediction parameters further include at least two or more of a motion vector, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes.

49. The method of claim 43, wherein the decoding includes identifying the one of the other encoded video blocks based on a generated disparity vector, if the PPI syntax indicates the prediction parameters are to be inherited from an encoded video block of one of the views of the multiple views that is different from the view of the respective encoded video block.

50. The method of claim 43, further comprising decoding the respective encoded video block based on prediction parameters that are not inherited if inherited prediction parameters are not indicated.