Signaling for addition or removal of layers in scalable video

• US 10,560,701 B2
• Filed: 12/17/2018
• Issued: 02/11/2020
• Est. Priority Date: 05/21/2014
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Inventors: Narasimhan, Mandayam, Luthra, Ajay K.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Dhillon, Peet
• Application Number:
  US16/221,879
• Publication Number:
  US 20190124338A1
• Time in Patent Office: 421 Days
• Field of Search: 37524012, 37524026, 375E07021
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2362 Generation or processing of Service Information [SI]
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4345 Extraction or processing of SI, e.g. extracting service information from an MPEG stream
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer

Abstract

In one embodiment, a method of signaling individual layers in a transport stream includes: determining a plurality of layers in a transport stream, wherein each layer includes a respective transport stream parameter setting; determining an additional layer for the plurality of layers in the transport stream, wherein the additional layer enhances one or more of the plurality of layers including a base layer and the respective layer parameter settings for the plurality of layers do not take into account the additional layer; and determining an additional transport stream parameter setting for the additional layer, the additional transport stream parameter setting specifying a relationship between the additional layer and at least a portion of the plurality of layers, wherein the additional transport stream parameter setting is used to decode the additional layer and the at least a portion of the plurality of layers.

Claims

1. A method of decoding high efficiency video coding (HEVC) layers in a transport stream, the method comprising:

receiving and decoding said transport stream, said transport stream including packetized elementary streams (PES) for an encoded plurality of HEVC layers, said decoding including decoding one or more descriptors in the transport stream for;

determining a respective transport stream parameter setting for each of said packetized encoded plurality of HEVC layers;

identifying syntax elements carried in the one or more descriptors, said syntax elements including a transport stream parameter setting for each of the plurality of HEVC layers;

determining an additional transport stream parameter setting for an additional layer in the packetized encoded plurality of HEVC layers that is decodable from the transport stream in addition to the packetized encoded plurality of HEVC layers, the additional transport stream parameter setting specifying a relationship between the additional layer and at least a portion of the encoded plurality of HEVC layers, wherein the additional transport stream parameter setting is for decoding the additional layer and the at least a portion of the plurality of layers;

identifying an operation point that identifies the additional layer; and

identifying from an extension descriptor to the one or more descriptors at least one additional transport stream setting for the additional layer, the at least one additional layer parameter setting including a hierarchy parameter indexing a dependency between the additional layer and at least a portion of the encoded plurality of HEVC layers;

decoding the packetized encoded plurality of HEVC layers including the additional layer having a dependency on at least a portion of the encoded plurality of HEVC layers.

2. The method of claim 1, further comprising:

receiving the additional layer and the at least a portion of the plurality of layers with each respective transport stream parameter setting and the additional transport stream parameter setting at a decoder.

3. The method of claim 1, wherein the additional transport stream parameter setting is included in a video descriptor in the transport stream.

4. The method of claim 1, wherein the respective transport stream parameter settings for each of the plurality of layers in the transport stream are included in a video descriptor in the transport stream.

5. The method of claim 1, the decoding further comprising:

identifying a parameter indicating that additional layers were added to the at least a portion of the plurality of layers in the transport stream.

6. The method of claim 5, wherein the parameter in the transport stream indicates that the additional transport stream parameter setting is included in the transport stream.

7. The method of claim 1, wherein the additional transport stream parameter setting specifies layer specific information for the additional layer.

8. The method of claim 1, wherein the additional transport stream parameter setting specifies layer dependent information for the additional layer and the at least a portion of the plurality of layers other than the additional layer.

9. The method of claim 1, wherein the additional transport stream parameter setting includes a maximum bit rate for the additional layer and the at least a portion of the plurality of layers other than the additional layer.

10. The method of claim 1, wherein the additional transport stream parameter setting includes a maximum buffer size for the additional layer and the at least a portion of the plurality of layers other than the additional layer.

11. The method of claim 1, wherein the transport stream comprises HEVC, scalable HEVC (SHVC), multiview HEVC (MV HEVC), or combinations thereof.

12. An apparatus comprising:

one or more computer processors; and

a computer readable storage medium comprising instructions that, when executed, cause the one or more processors to;

receive and decode said transport stream, said transport stream including packetized elementary streams (PES) for an encoded plurality of HEVC layers, said decoding including decoding one or more descriptors in the transport stream for;

determine a respective transport stream parameter setting for each of said packetized encoded plurality of HEVC layers;

identify syntax elements carried in the one or more descriptors, said syntax elements including a transport stream parameter setting for each of the plurality of HEVC layers;

determine an additional transport stream parameter setting for an additional layer in the packetized encoded plurality of HEVC layers that is decodable from the transport stream in addition to the packetized encoded plurality of HEVC layers, the additional transport stream parameter setting specifying a relationship between the additional layer and at least a portion of the encoded plurality of HEVC layers, wherein the additional transport stream parameter setting is for decoding the additional layer and the at least a portion of the plurality of layers;

identify an operation point that identifies the additional layer; and

identify from an extension descriptor to the one or more descriptors at least one additional transport stream setting for the additional layer, the at least one additional layer parameter setting including a hierarchy parameter indexing a dependency between the additional layer and at least a portion of the encoded plurality of HEVC layers;

decode the packetized encoded plurality of HEVC layers including the additional layer having a dependency on at least a portion of the encoded plurality of HEVC layers.

13. The apparatus of claim 12, wherein the plurality of layers in the transport stream is encoded.

14. The apparatus of claim 12, wherein the instructions further cause the one or more processors to:

decode the additional layer, wherein the plurality of layers other than the additional layer are encoded separately from the additional layer, and the respective transport stream parameter settings for the plurality of layers other than the additional layer is changed by the additional layer.

15. The apparatus of claim 12, wherein the additional transport stream parameter setting includes a maximum bit rate for the additional layer and the at least a portion of the plurality of layers other than the additional layer.

16. The apparatus of claim 12, wherein the additional transport stream parameter setting includes a maximum buffer size for the additional layer and the at least a portion of the plurality of layers other than the additional layer.