SIGNALING VIEW SYNTHESIS PREDICTION SUPPORT IN 3D VIDEO CODING

• US 20130176389A1
• Filed: 08/17/2012
• Published: 07/11/2013
• Est. Priority Date: 01/05/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Ying, Wang, Ye-Kui, Karczewicz, Marta
• Granted Patent: US 9,288,506 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

In one example, a video coder is configured to code information indicative of whether view synthesis prediction is enabled for video data. When the information indicates that view synthesis prediction is enabled for the video data, the video coder may generate a view synthesis picture using the video data and code at least a portion of a current picture relative to the view synthesis picture. The at least portion of the current picture may comprise, for example, a block (e.g., a PU, a CU, a macroblock, or a partition of a macroblock), a slice, a tile, a wavefront, or the entirety of the current picture. On the other hand, when the information indicates that view synthesis prediction is not enabled for the video data, the video coder may code the current picture using at least one of intra-prediction, temporal inter-prediction, and inter-view prediction without reference to any view synthesis pictures.

Claims

1. A method of coding video data, the method comprising:

coding information indicative of whether view synthesis prediction is enabled for video data;

when the information indicates that view synthesis prediction is enabled for the video data;

generating a view synthesis picture using the video data; and

coding at least a portion of a current picture relative to the view synthesis picture.

2. The method of claim 1, wherein coding the information comprises coding a syntax element of a parameter set corresponding to the at least portion of the current picture.

3. The method of claim 2, wherein coding the syntax element comprises coding a syntax element of a sequence parameter set corresponding to a sequence of pictures including the current picture.

4. The method of claim 2, wherein coding the syntax element comprises coding a syntax element of at least one of a picture parameter set corresponding to the current picture and an access unit level parameter set corresponding to a slice comprising the at least portion of the current picture.

5. The method of claim 4, wherein the access unit level parameter set comprises one of an adaptation parameter set and a depth parameter set.

6. The method of claim 1, wherein the at least portion of the current picture comprises a current slice, and wherein coding the information comprises coding a syntax element of a slice header for the current slice.

7. The method of claim 1, further comprising coding a value representative of a selected coding mode for the at least portion of the current picture separately from the information indicative of whether view synthesis prediction is enabled.

8. The method of claim 1, further comprising coding identifying information for a reference view to use to generate the view synthesis picture, wherein generating the view synthesis picture comprises generating the view synthesis picture relative to a picture of the reference view.

9. The method of claim 8, wherein coding the identifying information comprises coding a value based on a view identifier (view_id) for the reference view.

10. The method of claim 8, wherein coding the identifying information comprises coding a value based on horizontal translation information for the reference view.

11. The method of claim 1, further comprising, when the information indicates that view synthesis prediction is not enabled for the video data, coding the current picture using at least one of intra-prediction, temporal inter-prediction, and inter-view prediction without reference to any view synthesis pictures.

12. The method of claim 1, wherein when the information indicates that view synthesis prediction is not enabled for the video data, view synthesis pictures are not generated while coding the video data.

13. The method of claim 1, wherein coding the at least portion of the current picture comprises decoding the at least portion of the current picture.

14. The method of claim 1, wherein coding the at least portion of the current picture comprises encoding the at least portion of the current picture.

15. A device for coding video data, the device comprising a video coder configured to code information indicative of whether view synthesis prediction is enabled for video data, and when the information indicates that view synthesis prediction is enabled for the video data, to generate a view synthesis picture using the video data and code at least a portion of a current picture relative to the view synthesis picture.

16. The device of claim 15, wherein the video coder is configured to code a syntax element of a parameter set corresponding to the at least portion of the current picture.

17. The device of claim 16, wherein the video coder is configured to code a syntax element of a sequence parameter set corresponding to a sequence of pictures including the current picture.

18. The device of claim 16, wherein the video coder is configured to code a syntax element of at least one of a picture parameter set corresponding to the current picture and an access unit level parameter set corresponding to a slice comprising the at least portion of the current picture.

19. The device of claim 15, wherein the at least portion of the current picture comprises a current slice, and wherein the video coder is configured to code a syntax element of a slice header for the current slice.

20. The device of claim 15, wherein the video coder is further configured to code identifying information for a reference view to use to generate the view synthesis picture, and wherein the video coder is configured to generate the view synthesis picture relative to a picture of the reference view.

21. The device of claim 20, wherein the video coder is configured to code a view identifier (view_id) for the reference view as the identifying information.

22. The device of claim 20, wherein the video coder is configured to code horizontal translation information for the reference view as the identifying information.

23. The device of claim 15, wherein when the information indicates that view synthesis prediction is not enabled for the video data, the video coder is configured to code the current picture using at least one of intra-prediction, temporal inter-prediction, and inter-view prediction without reference to any view synthesis pictures.

24. The device of claim 15, wherein the video coder comprises a video decoder.

25. The device of claim 15, wherein the video coder comprises a video encoder.

26. The device of claim 15, wherein the device comprises at least one of:

an integrated circuit;

a microprocessor; and

a wireless communication device that includes the video coder.

27. A device for coding video data, the device comprising:

means for coding information indicative of whether view synthesis prediction is enabled for video data;

means for generating a view synthesis picture using the video data when the information indicates that view synthesis prediction is enabled for the video data; and

means for coding at least a portion of a current picture relative to the view synthesis picture when the information indicates that view synthesis prediction is enabled for the video data.

28. The device of claim 27, wherein the means for coding the information comprises means for coding a syntax element of a parameter set corresponding to the at least portion of the current picture.

29. The device of claim 28, wherein the means for coding the syntax element comprises means for coding a syntax element of a sequence parameter set corresponding to a sequence of pictures including the current picture.

30. The device of claim 28, wherein the means for coding the syntax element comprises means for coding a syntax element of at least one of a picture parameter set corresponding to the current picture and an access unit level parameter set corresponding to a slice comprising the at least portion of the current picture.

31. The device of claim 27, wherein the at least portion of the current picture comprises a current slice, and wherein the means for coding the information comprises means for coding a syntax element of a slice header for the current slice.

32. The device of claim 27, further comprising means for coding identifying information for a reference view to use to generate the view synthesis picture, wherein the means for generating the view synthesis picture comprises means for generating the view synthesis picture relative to a picture of the reference view.

33. The device of claim 32, wherein the means for coding the identifying information comprises means for coding a view identifier (view_id) for the reference view.

34. The device of claim 32, wherein the means for coding the identifying information comprises means for coding horizontal translation information for the reference view.

35. The device of claim 27, further comprising means for coding, when the information indicates that view synthesis prediction is not enabled for the video data, the current picture using at least one of intra-prediction, temporal inter-prediction, and inter-view prediction without reference to any view synthesis pictures.

36. The device of claim 27, wherein the means for coding the at least portion of the current picture comprises means for decoding the at least portion of the current picture.

37. The device of claim 27, wherein the means for coding the at least portion of the current picture comprises means for encoding the at least portion of the current picture.

38. A computer-readable storage medium having stored thereon instructions that, when executed, cause a processor to:

code information indicative of whether view synthesis prediction is enabled for video data;

when the information indicates that view synthesis prediction is enabled for the video data;

generate a view synthesis picture using the video data; and

code at least a portion of a current picture relative to the view synthesis picture.

39. The computer-readable storage medium of claim 38, wherein the instructions that cause the processor to code the information comprise instructions that cause the processor to code a syntax element of a parameter set corresponding to the at least portion of the current picture.

40. The computer-readable storage medium of claim 39, wherein the instructions that cause the processor to code the syntax element comprise instructions that cause the processor to code a syntax element of a sequence parameter set corresponding to a sequence of pictures including the current picture.

41. The computer-readable storage medium of claim 39, wherein the instructions that cause the processor to code the syntax element comprise instructions that cause the processor to code a syntax element of at least one of a picture parameter set corresponding to the current picture and an access unit level parameter set corresponding to a slice comprising the at least portion of the current picture.

42. The computer-readable storage medium of claim 38, wherein the at least portion of the current picture comprises a current slice, and wherein the instructions that cause the processor to code the information comprise instructions that cause the processor to code a syntax element of a slice header for the current slice.

43. The computer-readable storage medium of claim 38, further comprising instructions that cause the processor to code identifying information for a reference view to use to generate the view synthesis picture, wherein the instructions that cause the processor to generate the view synthesis picture comprise instructions that cause the processor to generate the view synthesis picture relative to a picture of the reference view.

44. The computer-readable storage medium of claim 43, wherein the instructions that cause the processor to code the identifying information comprise instructions that cause the processor to code a view identifier (view_id) for the reference view.

45. The computer-readable storage medium of claim 43, wherein the instructions that cause the processor to code the identifying information comprise instructions that cause the processor to code horizontal translation information for the reference view.

46. The computer-readable storage medium of claim 38, further comprising instructions that cause the processor to, when the information indicates that view synthesis prediction is not enabled for the video data, code the current picture using at least one of intra-prediction, temporal inter-prediction, and inter-view prediction without reference to any view synthesis pictures.

47. The computer-readable storage medium of claim 38, wherein the instructions that cause the processor to code the at least portion of the current picture comprise instructions that cause the processor to decode the at least portion of the current picture.

48. The computer-readable storage medium of claim 38, wherein the instructions that cause the processor to code the at least portion of the current picture comprise instructions that cause the processor to encode the at least portion of the current picture.