MULTIVIEW VIDEO CODING

• US 20130114705A1
• Filed: 07/26/2012
• Published: 05/09/2013
• Est. Priority Date: 07/28/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Ying, Karczewicz, Marta
• Granted Patent: US 9,674,525 B2
• Time in Patent Office: Days
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Aspects of this disclosure relate to a method of coding video data. In an example, the method includes obtaining, from an encoded bitstream and for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view. The method also includes including, for decoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, where the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, where the number of reference candidates is equal to the number of reference views. The method also includes decoding the first view component based on the one or more reference candidates in the reference picture list.

Claims

1. A method of decoding video data comprising:

obtaining, from an encoded bitstream and for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

including, for decoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views; and

decoding the first view component based on the one or more reference candidates in the reference picture list.

2. The method of claim 1, wherein the reference view information is the same and only obtained once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

3. The method of claim 1, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only included once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein including view components of the one or more reference views as reference candidates comprises adding the same view components to the first reference picture list and the second reference picture list.

4. The method of claim 1, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

5. The method of claim 4, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

6. The method of claim 1, wherein obtaining the reference view information comprises obtaining the reference view information at a sequence level.

7. The method of claim 6, wherein obtaining the reference view information comprises obtaining the reference view information for each view at a sequence level.

8. The method of claim 6, wherein obtaining the reference view information at the sequence level comprises obtaining a view order index of the one or more reference views in a sequence parameter set (SPS).

9. The method of claim 1, further comprising adding view components of the same access unit into one of a first initial list of a first reference picture list, and a second initial list of a second reference picture list based on the order in which the one or more reference views are included in the reference view information.

10. The method of claim 1, further comprising reordering the one or more reference candidates to any position of a final reference picture list.

11. The method of claim 1, wherein reordering the one or more reference candidates is based on the reference view information.

12. The method of claim 1, further comprising excluding the one or more reference candidates from a final reference picture list.

13. An apparatus for decoding video data, the apparatus comprising one or more processors configured to:

obtain, from an encoded bitstream and for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

include, for decoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views; and

decode the first view component based on the one or more reference candidates in the reference picture list.

14. The apparatus of claim 13, wherein the reference view information is the same and only obtained once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

15. The apparatus of claim 13, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only included once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein to include view components of the one or more reference views as reference candidates the one or more processors are configured to add the same view components to the first reference picture list and the second reference picture list.

16. The apparatus of claim 13, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

17. The apparatus of claim 16, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

18. The apparatus of claim 13, wherein to obtain the reference view information the one or more processors are configured to obtain the reference view information at a sequence level.

19. The apparatus of claim 18, wherein to obtain the reference view information the one or more processors are configured to obtain the reference view information for each view at a sequence level.

20. The apparatus of claim 18, wherein to obtain the reference view information at the sequence level comprises the one or more processors are configured to obtain a view order index of the one or more reference views in a sequence parameter set (SPS).

21. The apparatus of claim 13, the one or more processors are further configured to add view components of the same access unit into one of a first initial list of a first reference picture list, and a second initial list of a second reference picture list based on the order in which the one or more reference views are included in the reference view information.

22. The apparatus of claim 13, the one or more processors are further configured to reorder the one or more reference candidates to any position of a final reference picture list.

23. The apparatus of claim 13, wherein the one or more processors are configured to reorder the one or more reference candidates based on the reference view information.

24. The apparatus of claim 13, the one or more processors are configured to exclude the one or more reference candidates from a final reference picture list.

25. An apparatus for decoding video data, the apparatus comprising:

means for obtaining, from an encoded bitstream and for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

means for including, for decoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views; and

means for decoding the first view component based on the one or more reference candidates in the reference picture list.

26. The apparatus of claim 25, wherein the reference view information is the same and only obtained once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

27. The apparatus of claim 25, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only included once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein means for including view components of the one or more reference views as reference candidates comprises means for adding the same view components to the first reference picture list and the second reference picture list.

28. The apparatus of claim 25, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

29. The apparatus of claim 28, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

30. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed, cause one or more processors to:

obtain, from an encoded bitstream and for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

include, for decoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views; and

decode the first view component based on the one or more reference candidates in the reference picture list.

31. The non-transitory computer-readable storage medium of claim 30, wherein the reference view information is the same and only obtained once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

32. The non-transitory computer-readable storage medium of claim 30, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only included once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein to include view components of the one or more reference views as reference candidates the instructions cause the one or more processors to add the same view components to the first reference picture list and the second reference picture list.

33. The non-transitory computer-readable storage medium of claim 30, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

34. The non-transitory computer-readable storage medium of claim 33, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

35. A method of encoding video data comprising:

determining, for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

including, for encoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views;

encoding the first view component based on the one or more reference candidates in the reference picture list; and

providing the encoded first view component with the determined reference view information in an encoded bitstream.

36. The method of claim 35, wherein the reference view information is the same and only provided once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

37. The method of claim 35, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only provided once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein including view components of the one or more reference views as reference candidates comprises adding the same view components to the first reference picture list and the second reference picture list.

38. The method of claim 35, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

39. The method of claim 38, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

40. The method of claim 35, wherein providing the reference view information comprises providing the reference view information at a sequence level.

41. The method of claim 40, wherein providing the reference view information comprises providing the reference view information for each view at a sequence level.

42. The method of claim 40, wherein providing the reference view information at the sequence level comprises providing a view order index of the one or more reference views in a sequence parameter set (SPS).

43. The method of claim 35, further comprising adding view components of the same access unit into one of a first initial list of a first reference picture list, and a second initial list of a second reference picture list based on the order in which the one or more reference views are included in the reference view information.

44. The method of claim 35, further comprising reordering the one or more reference candidates to any position of a final reference picture list.

45. The method of claim 35, wherein reordering the one or more reference candidates is based on the reference view information.

46. The method of claim 35, further comprising excluding the one or more reference candidates from a final reference picture list.

47. An apparatus for encoding video data comprising one or more processors configured to:

determine, for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

include, for encoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views;

encode the first view component based on the one or more reference candidates in the reference picture list; and

provide the encoded first view component with the determined reference view information in an encoded bitstream.

48. The apparatus of claim 47, wherein the reference view information is the same and only provided once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

49. The apparatus of claim 47, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only provided once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein to include view components of the one or more reference views as reference candidates the one or more processors are configured to add the same view components to the first reference picture list and the second reference picture list.

50. The apparatus of claim 47, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

51. The apparatus of claim 50, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

52. The apparatus of claim 47, wherein to provide the reference view information the one or more processors are configured to provide the reference view information at a sequence level.

53. The apparatus of claim 52, wherein to provide the reference view information the one or more processors are configured to provide the reference view information for each view at a sequence level.

54. The apparatus of claim 52, wherein to provide the reference view information at the sequence level the one or more processors are configured to provide a view order index of the one or more reference views in a sequence parameter set (SPS).

55. The apparatus of claim 47, the one or more processors are further configured to add view components of the same access unit into one of a first initial list of a first reference picture list, and a second initial list of a second reference picture list based on the order in which the one or more reference views are included in the reference view information.

56. The apparatus of claim 47, the one or more processors are further configured to reorder the one or more reference candidates to any position of a final reference picture list.

57. The apparatus of claim 47, wherein the reordering of the one or more reference candidates is based on the reference view information.

58. The apparatus of claim 47, wherein the one or more processors are further configured to exclude the one or more reference candidates from a final reference picture list.

59. An apparatus for encoding video data, the apparatus comprising:

means for determining, for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

means for including, for encoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views;

means for encoding the first view component based on the one or more reference candidates in the reference picture list; and

means for providing the encoded first view component with the determined reference view information in an encoded bitstream.

60. The apparatus of claim 59, wherein the reference view information is the same and only provided once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

61. The apparatus of claim 59, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only provided once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein means for including view components of the one or more reference views as reference candidates comprises means for adding the same view components to the first reference picture list and the second reference picture list.

62. The apparatus of claim 59, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

63. The apparatus of claim 62, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.

64. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed, cause one or more processors to:

determine, for any view component of a first view, reference view information indicating one or more reference views for predicting view components of the first view;

include, for encoding a first view component in an access unit and in the first view, one or more reference candidates in a reference picture list, wherein the one or more reference candidates comprise view components in the access unit and in the reference views indicated by the reference view information, wherein the number of reference candidates is equal to the number of reference views;

encode the first view component based on the one or more reference candidates in the reference picture list; and

provide the encoded first view component with the determined reference view information in an encoded bitstream.

65. The non-transitory computer-readable storage medium of claim 64, wherein the reference view information is the same and only provided once for decoding view components of the first view that are used as a random access point and view components of the first view that are not used as a random access point.

66. The non-transitory computer-readable storage medium of claim 64, wherein the reference picture list comprises one of a first reference picture list and a second reference picture list, and wherein the reference view information is the same and only provided once for the first reference picture list and the second reference picture list of any view component of the first view, and wherein to include view components of the one or more reference views as reference candidates the instructions cause the one or more processors to add the same view components to the first reference picture list and the second reference picture list.

67. The non-transitory computer-readable storage medium of claim 64, wherein the reference view information comprises, for each reference view, an indication of a view order index indicating a decoding order of a view within an access unit.

68. The non-transitory computer-readable storage medium of claim 67, wherein the indication of the view order index comprises a difference between the view order index of a reference view and the view order index of the first view.