Dependency parameter set for scalable video coding

• US 8,938,004 B2
• Filed: 07/02/2012
• Issued: 01/20/2015
• Est. Priority Date: 03/10/2011
• Status: Active Grant

• Current Assignee: Vidyo Incorporated (Enghouse Systems Limited)
• Original Assignee: Vidyo Incorporated (Enghouse Systems Limited)
• Inventors: Boyce, Jill, Hong, Danny, Wenger, Stephan
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): FINDLEY, CHRISTOPHER G
• Application Number:
  US13/539,900
• Publication Number:
  US 20120275517A1
• Time in Patent Office: 932 Days
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

System and methods for video decoding include receiving at least one Dependency Parameter Set (DPS); and determining at least one inter-layer dependency based on the received DPS. Systems and methods for video encoding include selecting a layering structure; encoding at least one Dependency Parameter Set (DPS) including a representation of the layering structure in a binary format; and including the encoded DPS in a bitstream or sending the encoded DPS out of band.

Claims

1. A method for video decoding, comprising:

receiving at least one Dependency Parameter Set (DPS) including a representation of a layering structure pertaining to a plurality of coded video sequences, wherein at least one of the plurality of coded video sequences is coded in a layered format;

wherein the representation of the layering structure comprises a plurality of layer descriptions corresponding to a plurality of layers, each layer description referencable by an index;

receiving at least one Network Abstraction Layer (NAL) unit including a layer_id value and belonging to a picture belonging to one of the least one of the plurality of coded video sequences; and

determining at least one inter-layer dependency of the NAL unit based on the received DPS through accessing the layer description by using the layer_id as the index into the plurality of layer descriptions;

wherein the DPS includes a dependency parameter set id, the dependency parameter set id being referred to from a sequence parameter set (SPS);

wherein the DPS comprises a raw byte sequence payload (RESP) separate from the SPS or SPS extensions, if any; and

wherein the DPS is activated once in at least one of the plurality of coded video sequences and pertains to all pictures of the plurality of coded video sequences.

2. The method of claim 1, wherein the DPS further includes a flag indicating a presence of the layering structure in binary form.

3. The method of claim 1, wherein the DPS further includes a flag indicating the presence of a multiview structure.

4. The method of claim 1, wherein the DPS further includes a flag indicating the presence of Visual Usability Information pertaining to a plurality of layers.

5. The method of claim 1, wherein the DPS further includes a flag indicating the presence of an extension of the DPS.

6. The method of claim 1 wherein the DPS further includes a value indicating a number of layer descriptions.

7. The method of claim 1, wherein at least one of the layer descriptions includes a flag indicating that the layer depends, through inter-layer prediction, on another layer.

8. The method of claim 1, wherein a layer description pertaining to a first layer of the plurality of layers includes an identification of a second layer of the plurality of layers, and wherein the first layer depends on the second layer through inter-layer prediction.

9. The method of claim 1, wherein the layer descriptions comprise spatial layer descriptions.

10. The method of claim 7, wherein in at least two of the plurality of layer descriptions, the flag indicating that the layer depends, through inter-layer prediction, on another layer, indicates no inter-layer prediction.

11. The method of claim 9, wherein the layer description pertaining to a first layer of the plurality of layers includes information about at least a second layer of the plurality of layers which depends on the first layer.

12. The method of claim 11, wherein the first layer is a spatial layer, and the information is a number of quality layers of the plurality of layers depending on the spatial layer.

16. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 1.

17. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 3.

18. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 7.

19. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 8.

20. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 9.

21. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 11.

22. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 12.

23. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 10.

13. A method for video encoding, comprising:

selecting a layering structure;

encoding at least one Dependency Parameter Set (DPS) including a representation of the layering structure pertaining to a plurality of coded video sequences, wherein at least one of the plurality of coded video sequences is coded in a layered format;

wherein the representation of the layering structure comprises a plurality of layer descriptions corresponding to a plurality of layers, each layer description reference by an index;

sending at least one Network Abstraction Layer (NAL) unit including a layer_id value and belonging to a picture belonging to one of the least one of the plurality of coded video sequences;

wherein at least one inter-layer dependency of the NAL unit is determined based on the received DPS through accessing the layer description by using the layer_id as the index into the plurality of layer descriptions; and

performing one of;

including the encoded DPS in a bitstream, or sending the encoded DPS out of band;

wherein the DPS includes a dependency parameter set id, the dependency parameter set id being referred to from a sequence parameter set (SPS);

wherein the DPS comprises a raw byte sequence payload (RESP) separate from the SPS or SPS extensions, if any; and

wherein the DPS is activated once in at least one of the plurality of coded video sequences and pertains to all pictures of the plurality of coded video sequences.

24. A non-transitory computer readable medium comprising a set of instructions to direct a processor to perform the method of claim 13.

14. A system for video communications comprising:

a decoder configured to;

receive at least one Dependency Parameter Set (DPS) including a representation of a layering structure pertaining to a plurality of coded video sequences, wherein at least one of the plurality of coded video sequences is coded in a layered format;

wherein the representation of the layering structure comprises a plurality of layer descriptions corresponding to a plurality of layers, each layer description referencable by an index;

receiving at least one Network Abstraction Layer (NAL) unit including a layer_id value and belonging to a picture belonging to one of the least one of the plurality of coded video sequences;

decode the at least one DPS; and

determining at least one inter-layer dependency of the NAL unit based on the received DPS through accessing the layer description by using the layer_id as the index into the plurality of layer descriptions;

wherein the DPS includes a dependency parameter set id, the dependency parameter set id being referred to from a sequence parameter set (SPS);

wherein the DPS comprises a raw byte sequence payload (RBSP) separate from the SPS or SPS extensions, if any; and

wherein the DPS is activated once in at least one of the plurality of coded video sequences and pertains to all pictures of the plurality of coded video sequences.

15. A system for video communications, comprising:

an encoder configured to;

select a layering structure;

encode at least one Dependency Parameter Set (DPS) including a representation of the layering structure pertaining to a plurality of coded video sequences, wherein at least one of the plurality of coded video sequences is coded in a layered format;

wherein the representation of the layering structure comprises a plurality of layer descriptions corresponding to a plurality of layers, each layer description referencable by an index;

sending at least one Network Abstraction layer (NAL) unit including a layer_id value and belonging to a picture belonging to one of the least one of the plurality of coded video sequences;

wherein at least one inter-layer dependency of the NAL unit is determined based on the received DPS through accessing the layer description by using the layer_id as the index into the plurality of layer descriptions; and

perform one of;

including the encoded DPS in a bitstream, or sending the encoded DPS out of band;

wherein the DPS includes a dependency parameter set id, the dependency parameter set id being referred to from a sequence parameter set (SPS);

wherein the DPS comprises a raw byte sequence payload (RBSP) separate from the SPS or SPS extensions, if any; and

wherein the DPS is activated once in at least one of the plurality of coded video sequences and pertains to all pictures of the plurality of coded video sequences.