Signaling and selection for the enhancement of layers in scalable video

• US 10,034,002 B2
• Filed: 05/21/2015
• Issued: 07/24/2018
• Est. Priority Date: 05/21/2014
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Inventors: Narasimhan, Mandayam, Luthra, Ajay K.
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dhillon, Peet
• Application Number:
  US14/718,216
• Publication Number:
  US 20150341649A1
• Time in Patent Office: 1,160 Days
• Field of Search: 37524026, 375E07021
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2362 Generation or processing of Service Information [SI]
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4345 Extraction or processing of SI, e.g. extracting service information from an MPEG stream
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer

Abstract

A method is provided for signaling individual layer parameters in a transport stream that includes: indicating, using a supplemental enhancement information (SEI) message in the video stream, operation point information; inserting the operation point information in the transport stream using an operation point descriptor; and providing the operation point descriptor in a Program Map Table (PMT).

Claims

1. A method for decoding individual layer parameters signaled in a transport stream including a high efficiency video coding (HEVC) layered stream with a plurality of HEVC temporal layers in the transport stream carried in separate elementary streams, the method comprising:

receiving an HEVC video descriptor including one or more syntax elements in the HEVC video descriptor that apply to the whole HEVC layered video stream;

determining from the HEVC video descriptor one or more elements that indicate whether the plurality of HEVC temporal layers are present in one or more spatial layers in the HEVC layered video stream, wherein one or more of the plurality of HEVC temporal layers are carried in respective elementary streams;

receiving at least one extension descriptor that extends the HEVC video descriptor for each elementary stream having an associated HEVC temporal layer in the HEVC layered video stream; and

wherein the at least one extension descriptor includes operation point information signaled in the transport stream using an operation point descriptor, the transport stream carrying the operation point descriptor in a Program Map Table (PMT),

wherein the one or more spatial layers in the HEVC layered video stream in the transport stream include at least one of one combined layer that includes a base layer and an enhancement layer or individual layers that include a separate base layer and one or more enhancement layers.

2. The method of claim 1, further comprising:

identifying, using the operation point descriptor, a maximum bit rate.

3. The method of claim 1, wherein the individual layers comprise one enhancement layer and an additional enhancement layer that has been added.

4. The method of claim 3, further comprising receiving in the transport stream at least one of the bitrate, rendering capability, and decoding capability of the additional enhancement layer.

5. The method of claim 4, further comprising selecting and rendering the additional enhancement layer in the PMT.

6. The method of claim 1, wherein the transport stream indicates a scalable enhancement for the transport stream.

7. The method of claim 6, wherein the scalable enhancement comprises a spatial, temporal, and/or signal-to-noise ratio (SNR) enhancement.

8. The method of claim 6, wherein scalable enhancement comprises a view-depth and/or view-texture enhancement.

9. The method of claim 1, wherein the transport stream comprises HEVC, scalable HEVC (SHVC), multiview HEVC (MV HEVC), or combinations thereof.