MULTI-HYPOTHESIS DISPARITY VECTOR CONSTRUCTION IN 3D VIDEO CODING WITH DEPTH

• US 20130176390A1
• Filed: 01/03/2013
• Published: 07/11/2013
• Est. Priority Date: 01/06/2012
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Ying, Karczewicz, Marta
• Application Number:
  US13/733,704
• Publication Number:
  US 20130176390A1
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

A method and apparatus for decoding and encoding multiview video data is described. An example method may include coding a block of video data using a motion vector prediction process, determining a motion vector candidate list, determining a disparity vector candidate list for the motion prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a smooth temporal-view (STV) disparity vector, a view disparity vector (VDV), and a temporal disparity vector (TDV), and performing the motion vector prediction process using one of the disparity vector candidate list and the motion vector candidate list.

Claims

1. A method of decoding multiview video data comprising:

determining a motion vector candidate list for a motion vector prediction process;

determining a disparity vector candidate list for the motion vector prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

performing the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to decode a block of video data using the motion vector prediction process.

2. The method of claim 1, wherein the SDV is derived from a disparity motion vector of a spatially neighboring block and the TDV is derived from a disparity motion vector of a temporally neighboring block.

3. The method of claim 1, wherein the disparity vector candidate list further includes a smooth temporal-view (STV) disparity vector.

4. The method of claim 1, wherein decoding the block of video data using the motion vector prediction process comprises decoding the block of video data using an advanced motion vector prediction (AMVP) mode.

5. The method of claim 1, wherein decoding the block of video data using the motion vector prediction process comprises decoding the block of video data using a merge mode.

6. The method of claim 1, wherein determining the disparity vector candidate list comprises determining the disparity vector candidate list using a priority process, wherein all available disparity vector types assigned a higher priority are added to the disparity vector candidate list before disparity vector types assigned a relatively lower priority, up to a maximum length of the disparity vector candidate list.

7. The method of claim 6, wherein the priority process assigns the SDV a highest priority.

8. The method of claim 7, wherein the priority process assigns the STV disparity vector a second highest priority, the VDV a third highest priority, and the TDV a lowest priority.

9. The method of claim 1, further comprising:

determining at least one of the types of disparity vector using one of an estimated depth mode and an accurate depth mode, and

wherein decoding the block of video data using the motion vector prediction process comprises decoding the block of video data using a merge mode.

10. The method of claim 1, wherein the motion vector prediction process is a merge mode, and wherein the method further comprises:

receiving a flag indicating whether the motion vector prediction process is performed using the disparity vector candidate list or the motion vector candidate list.

11. The method of claim 1, wherein the motion vector prediction process is an advanced motion vector prediction (AMVP) mode, and wherein the method further comprises:

receiving a reference picture index; and

determining whether to perform the motion vector prediction process with the disparity vector candidate list or the motion vector candidate list based on the received reference index.

12. A method of encoding multiview video data comprising:

determining a motion vector candidate list for a motion vector prediction process;

determining a disparity vector candidate list for the motion prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

performing the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to encode a block of video data using the motion vector prediction process.

13. The method of claim 12, wherein the SDV is derived from a disparity motion vector of a spatially neighboring block and the TDV is derived from a disparity motion vector of a temporally neighboring block.

14. The method of claim 12, wherein the disparity vector candidate list further includes a smooth temporal-view (STV) disparity vector.

15. The method of claim 12, wherein encoding the block of video data using the motion vector prediction process comprises encoding the block of video data using an advanced motion vector prediction (AMVP) mode.

16. The method of claim 12, wherein encoding the block of video data using the motion vector prediction process comprises encoding the block of video data using a merge mode.

17. The method of claim 12, wherein determining the disparity vector candidate list comprises determining the disparity vector candidate list using a priority process, wherein all available disparity vector types assigned a higher priority are added to the disparity vector candidate list before disparity vector types assigned a relatively lower priority, up to a maximum length of the disparity vector candidate list.

18. The method of claim 17, wherein the priority process assigns the SDV a highest priority.

19. The method of claim 18, where the priority process assigns the STV disparity vector a second highest priority, the VDV a third highest priority, and the TDV a lowest priority.

20. The method of claim 12, further comprising:

determining at least one of the types of disparity vector using one of an estimated depth mode and an accurate depth mode, and

wherein encoding the block of video data using the motion vector prediction process comprises encoding the block of video data using a merge mode.

21. The method of claim 12, wherein the motion vector prediction process is a merge mode, and wherein the method further comprises:

signaling a flag indicating whether the motion vector prediction process is performed using the disparity vector candidate list or the motion vector candidate list.

22. The method of claim 12, wherein the motion vector prediction process is an advanced motion vector prediction (AMVP) mode, and wherein the method further comprises:

signaling a reference picture index to indicate whether to perform the motion vector prediction process with the disparity vector candidate list or the motion vector candidate list based.

23. An apparatus configured to decode multiview video data comprising:

a video decoder configured to;

determine a motion vector candidate list for a motion vector prediction process;

determine a disparity vector candidate list for the motion vector prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

perform the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to decode a block of video data using the motion vector prediction process.

24. The apparatus of claim 23, wherein the SDV is derived from a disparity motion vector of a spatially neighboring block and the TDV is derived from a disparity motion vector of a temporally neighboring block.

25. The apparatus of claim 23, wherein the disparity vector candidate list further includes a smooth temporal-view (STV) disparity vector.

26. The apparatus of claim 23, wherein the video decoder is configured to decode the block of video data using the motion vector prediction process by decoding the block of video data using an advanced motion vector prediction (AMVP) mode.

27. The apparatus of claim 23, wherein the video decoder is configured to decode the block of video data using the motion vector prediction process by decoding the block of video data using a merge mode.

28. The apparatus of claim 23, wherein the video decoder is configured to determine the disparity vector candidate list by using a priority process, wherein all available disparity vector types assigned a higher priority are added to the disparity vector candidate list before disparity vector types assigned a relatively lower priority, up to a maximum length of the disparity vector candidate list.

29. The apparatus of claim 28, wherein the priority process assigns the SDV a highest priority.

30. The apparatus of claim 29, wherein the priority process assigns the STV disparity vector a second highest priority, the VDV a third highest priority, and the TDV a lowest priority.

31. The apparatus of claim 23, wherein the video decoder is further configured to:

determine at least one of the types of disparity vector using one of an estimated depth mode and an accurate depth mode, and

decode the block of video data using a merge mode.

32. The apparatus of claim 23, wherein the motion vector prediction process is a merge mode, and wherein the video decoder is further configured to:

receive a flag indicating whether the motion vector prediction process is performed using the disparity vector candidate list or the motion vector candidate list.

33. The apparatus of claim 23, wherein the motion vector prediction process is an advanced motion vector prediction (AMVP) mode, and wherein the video decoder is further configured to:

receive a reference picture index; and

determine whether to perform the motion vector prediction process with the disparity vector candidate list or the motion vector candidate list based on the received reference index.

34. An apparatus configured to encode multiview video data comprising:

a video encoder configured to;

determine a motion vector candidate list for a motion vector prediction process;

determine a disparity vector candidate list for the motion prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

perform the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to encode a block of video data using the motion vector prediction process.

35. The apparatus of claim 34, wherein the SDV is derived from a disparity motion vector of a spatially neighboring block and the TDV is derived from a disparity motion vector of a temporally neighboring block.

36. The apparatus of claim 34, wherein the disparity vector candidate list further includes a smooth temporal-view (STV) disparity vector.

37. The apparatus of claim 34, wherein the video encoder is further configured to encode the block of video data using the motion vector prediction process by encoding the block of video data using an advanced motion vector prediction (AMVP) mode.

38. The apparatus of claim 34, wherein the video encoder is further configured to encode the block of video data using the motion vector prediction process by encoding the block of video data using a merge mode.

39. The apparatus of claim 34, wherein the video encoder is further configured to determine the disparity vector candidate list by determining the disparity vector candidate list using a priority process, wherein all available disparity vector types assigned a higher priority are added to the disparity vector candidate list before disparity vector types assigned a relatively lower priority, up to a maximum length of the disparity vector candidate list.

40. The apparatus of claim 39, wherein the priority process assigns the SDV a highest priority.

41. The apparatus of claim 40, where the priority process assigns the STV disparity vector a second highest priority, the VDV a third highest priority, and the TDV a lowest priority.

42. The apparatus of claim 34, wherein the video encoder is further configured to:

determine at least one of the types of disparity vector using one of an estimated depth mode and an accurate depth mode, and

encode the block of video data using a merge mode.

43. The apparatus of claim 34, wherein the motion vector prediction process is a merge mode, and wherein the video encoder is further configured to:

signal a flag indicating whether the motion vector prediction process is performed using the disparity vector candidate list or the motion vector candidate list.

44. The apparatus of claim 34, wherein the motion vector prediction process is an advanced motion vector prediction (AMVP) mode, and wherein the video encoder is further configured to:

signal a reference picture index to indicate whether to perform the motion vector prediction process with the disparity vector candidate list or the motion vector candidate list based.

45. An apparatus configured to decode multiview video data comprising:

means for determining a motion vector candidate list for a motion vector prediction process;

means for determining a disparity vector candidate list for the motion vector prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

means for performing the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to decode a block of video data using the motion vector prediction process.

46. An apparatus configured to encode multiview video data comprising:

means for determining a motion vector candidate list for a motion vector prediction process;

means for determining a disparity vector candidate list for the motion prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

means for performing the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to encode a block of video data using the motion vector prediction process.

47. A computer-readable storage medium storing instructions that, when executed, cause one or more processors of a device configured to decode video data to:

determine a motion vector candidate list for a motion vector prediction process;

determine a disparity vector candidate list for the motion vector prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

perform the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to decode a block of video data using the motion vector prediction process.

48. A computer-readable storage medium storing instructions that, when executed, cause one or more processors of a device configured to encode video data to:

determine a motion vector candidate list for a motion vector prediction process;

determine a disparity vector candidate list for the motion prediction process, wherein the disparity vector candidate list includes at least two types of disparity vectors from a plurality of disparity vector types, the plurality including a spatial disparity vector (SDV), a view disparity vector (VDV), and a temporal disparity vector (TDV); and

perform the motion vector prediction process using one or more of the candidates in the disparity vector candidate list to encode a block of video data using the motion vector prediction process.