METHOD AND APPARATUS of INTER-VIEW SUB-PARTITION PREDICTION in 3D VIDEO CODING

• US 20150172714A1
• Filed: 06/28/2013
• Published: 06/18/2015
• Est. Priority Date: 07/09/2012
• Status: Abandoned Application

• Current Assignee: MediaTek, Inc.
• Original Assignee: MediaTek, Inc.
• Inventors: Wu, Chi-Ling, Chang, Yu-Lin, Tsai, Yu-Pao, Lei, Shaw-Min
• Application Number:
  US14/412,197
• Publication Number:
  US 20150172714A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding

Abstract

A method and apparatus for three-dimensional video encoding or decoding using sub-block based inter-view prediction are disclosed. The method partitions a texture block into texture sub-blocks and determines disparity vectors of the texture sub-blocks. The inter-view reference data is derived based on the disparity vectors of the texture sub-blocks and a reference texture frame in a different view. The inter-view reference data is then used as prediction of the current block for encoding or decoding. One aspect of the present invention addresses partitioning the current texture block. Another aspect of the present invention addresses derivation of disparity vectors for the current texture sub-blocks.

Claims

1. A method for three-dimensional video encoding or decoding, the method comprising:

receiving first data associated with a current block of a current frame corresponding to a current view;

partitioning the current block into current sub-blocks;

determining disparity vectors of the current sub-blocks;

deriving inter-view reference data from a reference frame based on the disparity vectors of the current sub-blocks, wherein the reference frame and the current frame correspond to different views, and the reference frame and the current frame have a same picture timestamp; and

applying inter-view predictive encoding or decoding to the first data based on the inter-view reference data.

2. The method of claim 1, wherein the first data corresponds to residue data or a flag associated with the current block for the three-dimensional video decoding and the first data corresponds to pixel data or depth data of the current block for the three-dimensional video encoding.

3. The method of claim 2, wherein said applying inter-view predictive decoding comprises reconstructing the current block from the inter-view reference data, and said applying inter-view predictive encoding comprises generating the residue data or the flag associated with the current block.

4. The method of claim 3, wherein an inter-view Skip mode is signaled for the current block if motion information and the residue data are omitted.

5. The method of claim 3, wherein an interview Direct mode is signaled for the current block if motion information is omitted and the residue data is transmitted.

6. The method of claim 1, wherein said partitioning the current block partitions the current block into rectangular shaped sub-blocks having a same first size, square shaped sub-blocks having a same second size, or arbitrary shaped sub-blocks.

7. The method of claim 6, wherein the square shaped sub-blocks correspond to 4×

4 sub-blocks or 8×

8 sub-blocks and indication of the 4×

4 sub-blocks or the 8×

8 sub-blocks is signaled in Sequence Parameter Set (SPS) of a bitstream associated with the three-dimensional video encoding or decoding.

8. The method of claim 6, wherein the square shaped sub-blocks correspond to n×

n sub-blocks and n is signaled in a sequence level, a slice level, or a coding unit (CU) level of a bitstream associated with the three-dimensional video encoding or decoding, wherein n is an integer.

9. The method of claim 6, wherein sub-block size is equal to a specified smallest size of a motion compensation block.

10. The method of claim 1, wherein said partitioning the current block is based on object boundaries of a depth map associated with the current frame.

11. The method of claim 10, wherein said partitioning the current block is based on object boundaries of a collocated block in the depth map corresponding to the current block.

12. The method of claim 1, wherein the inter-view reference data for the current block is obtained from corresponding sub-blocks of the reference frame and the corresponding sub-blocks are determined based on the disparity vectors of the current sub-blocks.

13. The method of claim 12, wherein the disparity vectors of the current sub-blocks are determined based on depth values of collocated sub-blocks in a depth map corresponding to the current block.

14. The method of claim 13, wherein the depth values are obtained from the depth map coded in an encoder side, decoded in a decoder side, or estimated in both the encoder and the decoder sides.

15. The method of claim 13, wherein the disparity vectors of the current sub-blocks are determined based on average, maximum, minimum, or median of all depth values or partial depth values within the collocated sub-block in the depth map respectively.

16. The method of claim 12, wherein the disparity vectors of the current sub-blocks are obtained from neighboring disparity vectors associated with neighboring sub-blocks of the current block coded in an inter-view mode.

17. The method of claim 16, wherein a first disparity vector of a first current sub-block adjacent to at least one neighboring block coded in the inter-view mode is derived from the neighboring disparity vectors of said at least one neighboring sub-block.

18. The method of claim 17, wherein the first disparity vector of said first current sub-block is derived from maximum, minimum, average, or median of the neighboring disparity vectors of said at least one neighboring sub-block.

19. The method of claim 16, wherein a first disparity vector of a first current sub-block not adjacent to any neighboring sub-block coded in the inter-view mode is derived from one or more adjacent current sub-blocks, wherein disparity vectors of said one or more adjacent current sub-blocks are already derived.

20. The method of claim 19, wherein if a second disparity vector of above-left sub-block of said first current sub-block is more similar to a third disparity vector of above sub-block of said first current sub-block than a fourth disparity vector of left sub-block of said first current sub-block, the first disparity vector is set to the fourth disparity vector;

and the first disparity vector is set to the third disparity vector otherwise.

21. The method of claim 20, wherein a signal is used to identify whether the fourth disparity vector or the third disparity vector is selected as the first disparity vector.

22. The method of claim 16, wherein a first disparity vector of a first current sub-block not adjacent to any neighboring block coded in the inter-view mode is derived from a collocated block in a previous frame.

23. The method of claim 22, wherein the first disparity vector is set to a second disparity vector of the collocated block if the collocated block uses the inter-view mode.

24. The method of claim 22, wherein the first disparity vector is derived from depth values of the collocated block.

25. The method of claim 16, wherein a first disparity vector of a first current sub-block not adjacent to any neighboring block coded in the inter-view mode is derived from a collocated block in a previous frame or from one or more adjacent current sub-blocks, wherein disparity vectors of said one or more adjacent current sub-blocks are already derived, and a signal is signaled to indicate whether the collocated block or said one or more adjacent current sub-blocks is used to derive the first disparity vector.

26. The method of claim 12, wherein the disparity vectors of the current sub-blocks are derived from first neighboring sub-blocks of a collocated block of the reference frame coded in an inter-view mode or from second neighboring sub-blocks of a collocated depth block of one reference frame coded in the inter-view mode.

27. The method of claim 1, wherein a flag for the current block is incorporated in a bitstream associated with the three-dimensional video encoding or decoding and the flag is used to indicate if sub-block inter-view mode is enabled.

28. The method of claim 27, wherein the flag is signaled in a sequence level, a slice level, or a coding unit level of the bitstream.

29. The method of claim 27, wherein the flag is adaptively placed with respect to another flag according to mode information of adjacent blocks of the current block, wherein the flag is placed in a higher priority position than said another flag if majority of the adjacent blocks use the inter-view mode.

30. The method of claim 27, wherein a second flag is used for each current sub-block to indicate whether the inter-view predictive encoding or decoding is applied to the current sub-block and the second flags for the current sub-blocks are signaled in a line scan order or zigzag order across the current sub-blocks.

31. The method of claim 30, wherein the second flag for a last current sub-block is omitted if all other current sub-blocks use the inter-view predictive encoding or decoding.

32. The method of claim 1, wherein the current block corresponds to a coding unit (CU).

33. An apparatus for three-dimensional video encoding or decoding, the apparatus comprising:

means for receiving first data associated with a current block of a current frame corresponding to a current view;

means for partitioning the current block into current sub-blocks;

means for determining disparity vectors of the current sub-blocks;

means for deriving inter-view reference data from a reference frame based on the disparity vectors of the current sub-blocks, wherein the reference frame and the current frame correspond to different views and a same picture timestamp; and

means for applying inter-view predictive encoding or decoding to the first data based on the inter-view reference data.

34. The apparatus of claim 33, further comprising means for performing motion compensation, wherein said means for performing motion compensation is used to derive the inter-view reference data from the reference frame based on the disparity vectors of the current sub-blocks, the reference frame is used as a reference picture and the disparity vectors of the current sub-blocks are used as motion vectors for said means for performing motion compensation.