Inside view motion prediction among texture and depth view components

• US 9,485,503 B2
• Filed: 11/15/2012
• Issued: 11/01/2016
• Est. Priority Date: 11/18/2011
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Zhang, Li, Chen, Ying, Karczewicz, Marta
• Primary Examiner(s): Torrente, Richard
• Assistant Examiner(s): Haghani, Shadan E
• Application Number:
  US13/678,374
• Publication Number:
  US 20130128965A1
• Time in Patent Office: 1,447 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/157 Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

The techniques of this disclosure may be generally related to using motion information for a corresponding block from a texture view component that corresponds with a block in a depth view component in coding the block in the depth view component. In some examples, for coding purposes, the techniques may use motion information when the spatial resolution of the texture view component is different than the spatial resolution of the depth view component.

Claims

1. A method for coding video data, the method comprising:

coding a plurality of texture view blocks of a texture view component, wherein the plurality of texture view blocks corresponds to a single depth view block of a depth view component, wherein a spatial resolution of the depth view component is a quarter of a spatial resolution of the texture view component, and wherein the spatial resolution of the depth view component is half width and half height relative to the texture view component;

based on a texture view block of the plurality of texture view blocks that corresponds to at least one partition of the single depth view block being partitioned into a plurality of texture view block partitions;

determining which one of the plurality of texture view block partitions of the texture block of the texture view component encompasses at least a same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block in the depth view component having the quarter spatial resolution relative to the texture view component, wherein the determined one of the plurality of texture view block partitions encompasses at least the same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block based on the determined one of the plurality of texture view block partitions and the at least one partition of the single depth view block including the same corner in respective ones of the texture block and the depth view block;

selecting the determined one of the plurality of texture view block partitions;

determining a reference index of the selected texture view block partition, the reference index of the selective texture view block partition identifying a reference texture view component having a picture order count (POC) value; and

determining a reference index of the at least one partition of the single depth view block based on the reference index of the selected texture view block partition, the reference index of the at least one partition of the single depth view block identifies a POC value that is equal to the POC value of the identified reference texture view component; and

coding the single depth view block based on the determined reference index of the at least one partition,

wherein the depth view component and the texture view component belong to a same view within an access unit, and

wherein the single depth view block indicates relative depth of all pixels within the corresponding plurality of texture view blocks.

2. The method of claim 1, further comprising:

determining that Inside View Motion Prediction (IVMP) is enabled for the single depth view block,

wherein determining the reference index of the at least one partition comprises determining the reference index of the at least one partition based on IVMP being enabled.

3. The method claim 2, wherein determining that IVMP is enabled comprises determining that IVMP is enabled based on an IVMP flag indicating that IVMP is enabled.

4. The method of claim 1, wherein the single depth view block comprises a first depth view block and the plurality of texture view blocks comprises a first plurality of texture view blocks, the method further comprising:

determining that Inside View Motion Prediction (IVMP) is disabled for a second depth view block that corresponds to a second plurality of texture view blocks, based on at least one of a prediction mode of any of the second plurality of texture view blocks or a partition mode of any of the second plurality of texture view blocks.

5. The method of claim 4, wherein determining that IVMP is disabled comprises determining that IVMP is disabled based on any of the second plurality of texture view blocks being intra-predicted or based on any of the second plurality of texture view blocks being partitioned into four 8×

8 texture view macroblock partitions.

6. The method of claim 1, further comprising:

determining a motion vector for the at least one partition of the single depth view block, and wherein determining the motion vector for the at least one partition of the single depth view block comprises;

scaling a motion vector for the texture view block of the plurality of texture view blocks that corresponds to the at least one partition; and

setting the scaled motion vector as the motion vector for the at least one partition of the single depth view block.

7. The method of claim 1, wherein the texture view block that corresponds to the at least one partition of the single depth view block is partitioned as one 16×

16 texture view block partition.

8. The method of claim 1, wherein determining which one of the plurality of texture view block partitions encompasses at least the same area, selecting the determined one of the plurality of texture view block partitions, and determining the reference index of the at least one partition comprise determining which one of the plurality of texture view block partitions encompasses at least the same area, selecting the determined one of the plurality of texture view block partitions, and determining the reference index of the at least one partition based on the texture view block that corresponds to the at least one partition of the single depth view block not being partitioned as two texture view block partitions and a reference index for both of the two texture view block partitions in one reference picture list not being equal to −

1, the method further comprising;

based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned as two texture view block partitions and a reference index for both of the two texture view block partitions in one reference picture list being equal to −

1, setting the reference index for the at least one partition of the single depth view block equal to −

1.

9. The method of claim 1, wherein determining which one of the plurality of texture view block partitions encompasses at least the same area, selecting the determined one of the plurality of texture view block partitions, and determining the reference index of the at least one partition comprises determining which one of the plurality of texture view block partitions encompasses at least the same area, selecting the determined one of the plurality of texture view block partitions, and determining the reference index of the at least one partition based on the texture view block that corresponds to the at least one partition of the single depth view block not being partitioned as two texture view block partitions and a reference index for both of the two texture view block partitions in one reference picture list not being equal to −

1, the method further comprising;

based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned as two texture view block partitions and a reference index for a reference picture list of a first partition of the two texture view block partitions being unequal to −

1 and a reference index for the reference picture list of a second partition of the two texture view block partition is equal to −

1, setting the reference index of the first partition of the two texture view block partition as the reference index for the at least one partition of the single depth view block.

10. The method of claim 1, further comprising:

determining a partition mode for the at least one partition of the single depth view block, wherein determining the partition mode for the at least one partition of the single depth view block comprises;

setting the partition mode of the at least one partition of the single depth view block as one 8×

8 sub-block based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned into two texture view block partitions and a reference index of both of the texture view block partitions being different.

11. The method of claim 1, further comprising:

determining a partition mode for the at least one partition of the single depth view block, wherein determining the partition mode for the at least one partition of the single depth view block comprises;

setting the partition mode of the at least one partition of the single depth view block as one 8×

4 sub-block or one 4×

8 sub-block based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned into two texture view block partitions and a reference index of both of the texture view block partitions being the same.

12. The method of claim 1, wherein the texture view block that corresponds to the at least one partition of the single depth view block is partitioned into two 16×

8 texture view block partitions or two 8×

16 texture view block partitions.

13. The method of claim 1,

wherein coding the plurality of texture view blocks comprises decoding the plurality of texture view blocks of the texture view component, wherein the plurality of texture view blocks corresponds to the single depth view block of the depth view component, and

wherein coding the single depth view block comprises decoding the single depth view block based on the determined reference index of the at least one partition.

14. The method of claim 1,

wherein coding the plurality of texture view blocks comprises encoding the plurality of texture view blocks of the texture view component, wherein the plurality of texture view blocks corresponds to the single depth view block of the depth view component, and

wherein coding the single depth view block comprises encoding the single depth view block based on the determined reference index of the at least one partition.

15. A device for coding video data, the device comprising:

a memory unit configured to store a plurality reference pictures; and

a video coder configured to;

code a plurality of texture view blocks of a texture view component, wherein the plurality of texture view blocks corresponds to a single depth view block of a depth view component, wherein a spatial resolution of the depth view component is a quarter of a spatial resolution of the texture view component, and wherein the spatial resolution of the depth view component is half width and half height relative to the texture view component;

based on a texture view block of the plurality of texture view blocks that corresponds to at least one partition of the single depth view block being partitioned into a plurality of texture view block partitions;

determine which one of the plurality of texture view block partitions of the texture block of the texture view component encompasses at least a same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block in the depth view component having the quarter spatial resolution relative to the texture view component, wherein the determined one of the plurality of texture view block partitions encompasses at least the same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block based on the determined one of the plurality of texture view block partitions and the at least one partition of the single depth view block including the same corner in respective ones of the texture block and the depth view block;

select the determined one of the plurality of texture view block partitions;

determine a reference index of the selected texture view block partition, the reference index of the selective texture view block partition identifying a reference texture view component having a picture order count (POC) value; and

determine a reference index of the at least one partition of the single depth view block based on the reference index of the selected texture view block partition, the reference index of the at least one partition of the single depth view block identifies a POC value that is equal to the POC value of the identified reference texture view component; and

code the single depth view block based on a reference picture of the plurality of reference pictures identified from the determined reference index of the at least one partition,

wherein the depth view component and the texture view component belong to a same view within an access unit, and

wherein the single depth view block indicates relative depth of all pixels within the corresponding plurality of texture view blocks.

16. The device of claim 15, wherein the video coder is configured to:

determine that Inside View Motion Prediction (IVMP) is enabled for the single depth view block,

wherein the video coder is configured to determine the reference index of the at least one partition based on IVMP being enabled.

17. The device of claim 16, wherein the video coder is configured to code an IVMP flag to indicate that IVMP is enabled.

18. The device of claim 15, wherein the single depth view block comprises a first depth view block and the plurality of texture view blocks comprises a first plurality of texture view blocks, wherein the video coder is configured to determine that Inside View Motion Prediction (IVMP) is disabled for a second depth block that corresponds to a second plurality of texture view blocks, based on at least one of a prediction mode of any of the second plurality of texture view blocks or a partition mode of any of the second plurality of texture view blocks.

19. The device of claim 18, wherein the video coder is configured to determine that IVMP is disabled based on any of the second plurality of texture view blocks being intra-predicted or based on any of the second plurality of texture view blocks being partitioned into four 8×

8 texture view macroblock partitions.

20. The device of claim 15, wherein the video coder is configured to determine a motion vector for the at least one partition of the single depth view block, and wherein, to determine the motion vector for the at least one partition of the single depth view block, the video coder is configured to:

scale a motion vector for the texture view block of the plurality of texture view blocks that corresponds to the at least one partition; and

set the scaled motion vector as the motion vector for the at least one partition of the single depth view block.

21. The device of claim 15, wherein the texture view block that corresponds to the at least one partition of the single depth view block is partitioned as one 16×

16 texture view block partition.

22. The device of claim 15, wherein the video coder is configured to determine which one of the plurality of texture view blocks partitions encompasses at least the same area, select the determined one of the plurality of texture view block partitions, and determine the reference index for the at least one partition of the single depth view block based on the texture view block that corresponds to the at least one partition of the single depth view block not being partitioned as two texture view block partitions and a reference index for both of the two texture view block partitions in one reference picture list not being equal to −

1, wherein the video coder is configured to set the reference index for the at least one partition of the single depth view block equal to −

1 based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned as two texture view block partitions and a reference index for both of the two texture view block partitions in one reference picture list being equal to −

1.

23. The device of claim 15, wherein the video coder is configured to determine which one of the plurality of texture view blocks partitions encompasses at least the same area, select the determined one of the plurality of texture view block partitions, and determine the reference index for the at least one partition of the single depth view block based on the texture view block that corresponds to the at least one partition of the single depth view block not being partitioned as two texture view block partitions and a reference index for both of the two texture view block partitions in one reference picture list not being equal to −

1, wherein the video coder is configured to set the reference index of the first partition of the two texture view block partition as the reference index for the at least one partition of the single depth view block based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned as two texture view block partitions and a reference index for a reference picture list of a first partition of the two texture view block partitions being unequal to −

1 and a reference index for the reference picture list of a second partition of the two texture view block partition being equal to −

1.

24. The device of claim 15, wherein the video coder is configured to determine a partition mode for the at least one partition of the single depth view block, and wherein, to determine the partition mode for the at least one partition of the single depth view block, the video coder is configured to:

set the partition mode of the at least one partition of the single depth view block as one 8×

8 sub-block based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned into two texture view block partitions and a reference index of both of the texture view block partitions being different.

25. The device of claim 15, wherein the video coder is configured to determine a partition mode for at least one partition of the single depth view block, and wherein, to determine the partition mode for the at least one partition of the single depth view block, the video coder is configured to:

set the partition mode of the at least one partition of the single depth view block as one 8×

4 sub-block or one 4×

8 sub-block based on the texture view block that corresponds to the at least one partition of the single depth view block being partitioned into two texture view block partitions and a reference index of both of the texture view block partitions being the same.

26. The device of claim 15, wherein the texture view block that corresponds to the at least one partition of the single depth view block is partitioned into two 16×

8 texture view block partitions or two 8×

16 texture view block partitions.

27. The device of claim 15,

wherein the video coder comprises a video decoder, and

wherein the video decoder is configured to:

decode the plurality of texture view blocks of the texture view component, wherein the plurality of texture view blocks corresponds to the single depth view block of the depth view component; and

decode the single depth view block based on the determined reference index of the at least one partition.

28. The device of claim 15,

wherein the video coder comprises a video encoder, and

wherein the video encoder is configured to:

encode the plurality of texture view blocks of the texture view component, wherein the plurality of texture view blocks corresponds to the single depth view block of the depth view component; and

encode the single depth view block based on the determined reference index of the at least one partition.

29. The device of claim 15, wherein the device comprises one of:

a wireless communication device;

a microprocessor;

or

an integrated circuit.

30. A non-transitory computer-readable storage medium having stored thereon instructions that when executed, cause a processor of a device for coding video data to:

code a plurality of texture view blocks of a texture view component, wherein the plurality of texture view blocks corresponds to a single depth view block of a depth view component, wherein a spatial resolution of the depth view component is a quarter of a spatial resolution of the texture view component, and wherein the spatial resolution of the depth view component is half width and half height relative to the texture view component;

based on a texture view block of the plurality of texture view blocks that corresponds to at least one partition of the single depth view block being partitioned into a plurality of texture view block partitions;

determine which one of the plurality of texture view block partitions of the texture block of the texture view component encompasses at least a same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block in the depth view component having the quarter spatial resolution relative to the texture view component, wherein the determined one of the plurality of texture view block partitions encompasses at least the same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block based on the determined one of the plurality of texture view block partitions and the at least one partition of the single depth view block including the same corner in respective ones of the texture block and the depth view block;

select the determined one of the plurality of texture view block partitions;

determine a reference index of the selected texture view block partition, the reference index of the selective texture view block partition identifying a reference texture view component having a picture order count (POC) value;

determine a reference index of the at least one partition of the single depth view block based on the reference index of the selected texture view block partition, the reference index of the at least one partition of the single depth view block identifies a POC value that is equal to the POC value of the identified reference texture view component; and

code the single depth view block based on the determined reference index of the at least one partition,

wherein the depth view component and the texture view component belong to a same view within an access unit, and

wherein the single depth view block indicates relative depth of all pixels within the corresponding plurality of texture view blocks.

31. A device for coding video data, the device comprising:

means for coding a plurality of texture view blocks of a texture view component, wherein the plurality of texture view blocks corresponds to a single depth view block of a depth view component, wherein a spatial resolution of the depth view component is a quarter of a spatial resolution of the texture view component, and wherein the spatial resolution of the depth view component is half width and half height relative to the texture view component;

means for determining which one of the plurality of texture view block partitions of a texture block of the texture view component encompasses at least a same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block in the depth view component having the quarter spatial resolution relative to the texture view component based on the texture view block of the plurality of texture view blocks that corresponds to at least one partition of the single depth view block being partitioned into a plurality of texture view block partitions, wherein the determined one of the plurality of texture view block partitions encompasses at least the same area relative to the texture view block as where the at least one partition of the single depth view block is located relative to the single depth view block based on the determined one of the plurality of texture view block partitions and the at least one partition of the single depth view block including the same corner in respective ones of the texture block and the depth view block;

means for selecting the determined one of the plurality of texture view block partitions based on the texture view block of the plurality of texture view blocks that corresponds to the at least one partition of the single depth view block being partitioned into the plurality of texture view block partitions;

means for determining a reference index of the selected texture view block partition, the reference index of the selective texture view block partition identifying a reference texture view component having a picture order count (POC) value based on the texture view block of the plurality of texture view blocks that corresponds to the at least one partition of the single depth view block being partitioned into the plurality of texture view block partitions;

means for determining a reference index of the at least one partition of the single depth view block based on the reference index of the selected texture view block partition, the reference index of the at least one partition of the single depth view block identifies a POC value that is equal to the POC value of the identified reference texture view component, based on the texture view block of the plurality of texture view blocks that corresponds to the at least one partition of the single depth view block being partitioned into the plurality of texture view block partitions; and

means for coding the single depth view block based on the determined reference index of the at least one partition,

wherein the depth view component and the texture view component belong to a same view within an access unit, and

wherein the single depth view block indicates relative depth of all pixels within the corresponding plurality of texture view blocks.