View dependency in multi-view coding and 3D coding

• US 10,205,961 B2
• Filed: 04/22/2013
• Issued: 02/12/2019
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Ying, Wang, Ye-Kui
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Brumfield, Shanika M
• Application Number:
  US13/867,924
• Publication Number:
  US 20130279576A1
• Time in Patent Office: 2,122 Days
• Field of Search: 375 2402-2402
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

This disclosure described techniques for coding layer dependencies for a block of video data. According to these techniques, a video encoder generates layer dependencies associated with a given layer. The video encoder also generates a type of prediction associated with one or more of the layer dependencies. In some examples, the video encoder generates a first syntax element to signal layer dependencies and a second syntax element to signal a type of prediction associated with one or more of the layer dependencies. A video decoder may obtain the layer dependencies associated with a given layer and the type of prediction associated with one or more of the layer dependencies.

Claims

1. A method of decoding video data, the method comprising:

obtaining, from a coded bitstream, a syntax element specifying a number of dependent layers associated with a given layer, the dependent layers associated with the given layer being layers available to be used to decode the given layer;

for each respective dependent layer of the dependent layers associated with the given layer;

obtaining, from the coded bitstream, a first syntax element for the respective dependent layer, the first syntax element for the respective dependent layer specifying a view index of the respective dependent layer; and

obtaining, from the coded bitstream, a second syntax element for the respective dependent layer, distinct from the first syntax element for the respective dependent layer, the second syntax element for the respective dependent layer indicating which one of the following types of prediction is usable with the respective dependent layer;

(1) texture prediction but not motion prediction,

(2) motion prediction but not texture prediction, and

(3) both texture prediction and motion prediction;

constructing a reference picture set (RPS) that includes an inter-view reference picture set, wherein the dependent layers associated with the given layer include a particular dependent layer and, based on the second syntax element for the particular dependent layer indicating that the type of prediction usable with the particular dependent layer is texture prediction, the inter-view reference picture set includes a view component with a view order index equal to a view index of the particular dependent layer; and

using a reference picture in the RPS for inter prediction of a coded picture of the video data.

2. The method of claim 1, wherein the given layer is one of:

a view;

a texture component of a view;

a depth component of a view;

a spatial scalable layer; and

a quality scalable layer.

3. The method of claim 1,

wherein obtaining, from the coded bitstream, the first syntax element for the respective dependent layer comprises obtaining, from a sequence parameter set of the coded bitstream, the first syntax element for the respective dependent layer, and

wherein obtaining, from the coded bitstream, the second syntax element for the respective dependent layer comprises obtaining, from the sequence parameter set, the second syntax element for the respective dependent layer.

4. A method of encoding video data, the method comprising:

including, in a coded bitstream, a syntax element specifying a number of dependent layers associated with a given layer, the dependent layers associated with the given layer being layers available to be used to decode the given layer;

for each respective dependent layer of the dependent layers associated with the given layer;

including, in the coded bitstream, a first syntax element for the respective dependent layer, the first syntax element for the respective dependent layer specifying a view index of the respective dependent layer;

including, in the coded bitstream, a second syntax element for the respective dependent layer, distinct from the first syntax element for the respective dependent layer, the second syntax element for the respective dependent layer indicating which one of the following types of prediction is usable with the respective dependent layer;

(1) texture prediction but not motion prediction,

(2) motion prediction but not texture prediction, and

(3) both texture prediction and motion prediction;

constructing a reference picture set (RPS) that includes an inter-view reference picture set, wherein the dependent layers associated with the given layer include a particular dependent layer and, based on the second syntax element for the particular dependent layer indicating that the type of prediction usable with the particular dependent layer is texture prediction, the inter-view reference picture set includes a view component with a view order index equal to a view index of the particular dependent layer; and

using a reference picture in the RPS for inter prediction of a coded picture of the video data.

5. The method of claim 4, wherein the given layer is one of:

a view;

a texture component of a view;

a depth component of a view;

a spatial scalable layer; and

a quality scalable layer.

6. The method of claim 4,

wherein including, in the coded bitstream, the first syntax element for the respective dependent layer comprises including, in a sequence parameter set of the coded bitstream, the first syntax element for the respective dependent layer, and

wherein including, in the coded bitstream, the second syntax element for the respective dependent layer comprises including, in the sequence parameter set, the second syntax element for the respective dependent layer.

7. An apparatus for decoding video data comprising:

a memory storing video data; and

one or more processors configured to;

obtain, from a coded bitstream, a syntax element specifying a number of dependent layers associated with a given layer, the dependent layers associated with the given layer being layers available to be used to decode the given layer;

for each respective dependent layer of the dependent layers associated with the given layer;

obtain, from the coded bitstream, a first syntax element for the respective dependent layer, the first syntax element for the respective dependent layer specifying a view index of the respective dependent layer; and

obtain, from the coded bitstream, a second syntax element for the respective dependent layer, distinct from the first syntax element for the respective dependent layer, the second syntax element for the respective dependent layer indicating which one of the following types of prediction is usable with the respective dependent layer;

(1) texture prediction but not motion prediction,

(2) motion prediction but not texture prediction, and

(3) both texture prediction and motion prediction;

construct a reference picture set (RPS) that includes an inter-view reference picture set, wherein the dependent layers associated with the given layer include a particular dependent layer and, based on the second syntax element for the particular dependent layer indicating that the type of prediction usable with the particular dependent layer is texture prediction, the inter-view reference picture set includes a view component with a view order index equal to a view index of the particular dependent layer; and

use a reference picture in the RPS for inter prediction of a coded picture of the video data.

8. The apparatus of claim 7, wherein the given layer is one of:

a view;

a texture component of a view;

a depth component of a view;

a spatial scalable layer; and

a quality scalable layer.

9. The apparatus of claim 7, wherein the one or more processors are configured to:

obtain, from a sequence parameter set of the coded bitstream, the first syntax element for the respective dependent layer, and

obtain, from the sequence parameter set, the second syntax element for the respective dependent layer.

10. A device that encodes video data, the device comprising:

a memory storing video data; and

one or more processors configured to;

include, in a coded bitstream, a syntax element specifying a number of dependent layers associated with a given layer, the dependent layers associated with the given layer being layers available to be used to decode the given layer;

for each respective dependent layer of the dependent layers associated with the given layer;

include, in the coded bitstream, a first syntax element for the respective dependent layer, the first syntax element for the respective dependent layer specifying a view index of the respective dependent layer; and

include, in the coded bitstream, a second syntax element for the respective dependent layer, distinct from the first syntax element for the respective dependent layer, the second syntax element for the respective dependent layer indicating which one of the following types of prediction is usable with the respective dependent layer;

(1) texture prediction but not motion prediction,

(2) motion prediction but not texture prediction, and

(3) both texture prediction and motion prediction;

construct a reference picture set (RPS) that includes an inter-view reference picture set, wherein the dependent layers associated with the given layer include a particular dependent layer and, based on the second syntax element for the particular dependent layer indicating that the type of prediction usable with the particular dependent layer is texture prediction, the inter-view reference picture set includes a view component with a view order index equal to a view index of the particular dependent layer; and

use a reference picture in the RPS for inter prediction of a coded picture of the video data.

11. The device of claim 10, wherein the given layer is one of:

a view;

a texture component of a view;

a depth component of a view;

a spatial scalable layer; and

a quality scalable layer.

12. The device of claim 10,

wherein the one or more processors are configured such that to include, in the coded bitstream, the first syntax element for the respective dependent layer, the one or more processors include, in a sequence parameter set of the coded bitstream, the first syntax element for the respective dependent layer, and

wherein the one or more processors are configured such that to include, in the coded bitstream, the second syntax element for the respective dependent layer, the one or more processors include, in the sequence parameter set, the second syntax element for the respective dependent layer.

13. A non-transitory computer readable storage medium having stored thereon instructions that, when executed, cause one or more processors of an apparatus for decoding video data to:

obtain, from a coded bitstream, a syntax element specifying a number of dependent layers associated with a given layer, the dependent layers associated with the given layer being layers available to be used to decode the given layer;

for each respective dependent layer of the dependent layers associated with the given layer;

obtain, from the coded bitstream, a first syntax element for the respective dependent layer, the first syntax element for the respective dependent layer specifying a view index of the respective dependent layer; and

obtain, from the coded bitstream, a second syntax element for the respective dependent layer, distinct from the first syntax element for the respective dependent layer, the second syntax element for the respective dependent layer indicating which one of the following types of prediction is usable with the respective dependent layer;

(1) texture prediction but not motion prediction,

(2) motion prediction but not texture prediction, and

(3) both texture prediction and motion prediction;

construct a reference picture set (RPS) that includes an inter-view reference picture set, wherein the dependent layers associated with the given layer include a particular dependent layer and, based on the second syntax element for the particular dependent layer indicating that the type of prediction usable with the particular dependent layer is texture prediction, the inter-view reference picture set includes a view component with a view order index equal to a view index of the particular dependent layer; and

use a reference picture in the RPS for inter prediction of a coded picture of the video data.

14. The non-transitory computer readable storage medium of claim 13, wherein the given layer is one of:

a view;

a texture component of a view;

a depth component of a view;

a spatial scalable layer; and

a quality scalable layer.

15. The non-transitory computer readable storage medium of claim 13, wherein execution of the instructions causes the one or more processors to

obtain, from a sequence parameter set of the coded bitstream, the first syntax element for the respective dependent layer, and

obtain, from the sequence parameter set, the second syntax element for the respective dependent layer.