Individual buffer management in transport of scalable video

• US 10,057,582 B2
• Filed: 05/21/2015
• Issued: 08/21/2018
• Est. Priority Date: 05/21/2014
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Inventors: Narasimhan, Mandayam, Luthra, Ajay K.
• Primary Examiner(s): Beasley, Deirdre
• Application Number:
  US14/718,188
• Publication Number:
  US 20150341644A1
• Time in Patent Office: 1,188 Days
• Field of Search: 375 002
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer

Abstract

A method is provided to determine buffer parameter settings for a plurality of layers in a transport stream. Each layer includes a respective transport stream buffer parameter setting. Then, the method provides respective transport stream buffer parameter settings to individual transport stream buffers for respective layers in the plurality of layers. Then, the method buffers the respective layers in the individual transport stream buffers according to the respective transport stream buffer parameter settings. After buffering, the method combines the respective layers to form a combined bit stream.

Claims

1. A method of decoding a transport stream including a high efficiency video coding (HEVC) layered stream having a plurality of HEVC temporal layers included in one or more elementary streams, the method comprising:

receiving an HEVC video descriptor including one or more syntax elements in the HEVC video descriptor that apply to the whole HEVC layered stream;

determining from the HEVC video descriptor one or more elements that indicate whether the plurality of HEVC temporal layers are present in one or more spatial layers in the HEVC layered stream;

receiving at least one extension descriptor that extends the HEVC video descriptor for each of the plurality of HEVC temporal layers present in the HEVC layered stream;

determining from the at least one extension descriptor that individual layer parameters for each of the plurality of HEVC temporal layers in the HEVC layered stream are present; and

decoding each layer of the HEVC layered stream according to individual layer parameters signaled, wherein buffering for a decoding process includes;

determining buffer parameter settings for buffering each of the plurality of HEVC temporal layers in the transport stream, wherein each of the plurality of HEVC temporal layers includes a respective buffer parameter setting;

providing respective HEVC temporal layers to individual transport stream buffers for buffering each of the respective HEVC temporal layers in the one or more spatial layers in the HEVC layered stream;

buffering the plurality of HEVC temporal layers in the individual transport stream buffers according to the respective buffer parameter settings.

2. The method of claim 1, wherein the transport stream comprises HEVC, scalable HEVC (SHVC), multiview HEVC (MV HEVC), or combinations thereof.

3. The method of claim 1, wherein at least one of the buffer parameter settings specifies a bitrate for a respective HEVC temporal layer entering the individual transport stream buffer.

4. The method of claim 1, wherein transport stream buffer parameter settings each specify a buffer size for an individual transport stream buffer.

5. The method of claim 1, further comprising:

buffering one or more HEVC temporal layers in the plurality of HEVC temporal layers present in a single spatial layer in an elementary stream buffer before combining multiple spatial layers for decoding a reassembled bitstream.

6. The method of claim 1, wherein the transport stream buffer parameter settings indicate that individual parameter settings are included in a video layer and/or transport stream.

7. The method of claim 1, wherein the transport stream buffer parameter settings are derived from the respective video stream buffer parameter settings.

8. The method of claim 7, wherein a supplemental enhancement information field includes the video stream buffer parameter settings.

9. The method of claim 8, wherein the video stream buffer parameter settings are linked to the respective transport stream buffer parameter settings.

10. The method of claim 1, wherein the buffer parameter settings are received from an encoder and are encoded in the transport stream that includes the plurality of HEVC temporal layers.

11. The method of claim 10, wherein the buffer parameter settings received from the encoder are included in a video descriptor including the plurality of HEVC layers.

12. The method of claim 1, wherein determining the buffer parameter settings comprises:

pre-setting the transport stream buffer parameter settings in a decoder.

13. An apparatus comprising:

one or more computer processors; and

a computer readable storage medium comprising instructions that, when executed, cause the one or more computer processors to;

receive a high efficiency video coding (HEVC) video descriptor including one or more syntax elements in the HEVC video descriptor that apply to the whole HEVC layered stream;

determine from the HEVC video descriptor one or more elements that indicate whether a plurality of HEVC temporal layers are present in one or more spatial layers in the HEVC layered stream;

receive at least one extension descriptor that extends the HEVC video descriptor for each of the plurality of HEVC temporal layers present in the HEVC layered stream;

determine from the at least one extension descriptor that individual layer parameters for each of the plurality of HEVC temporal layers in the HEVC layered stream are present; and

decode each layer of the HEVC layered stream according to individual layer parameters signaled, wherein buffering for a decoding process includes;

determining buffer parameter settings for buffering each of the plurality of HEVC temporal layers in the transport stream, wherein each of the plurality of HEVC temporal layers includes a respective buffer parameter setting;

sending respective buffer parameter settings to individual transport stream buffers for buffering each of the respective HEVC temporal layers in the one or more spatial layers in the HEVC layered stream.

14. The apparatus of claim 13, wherein sending comprises sending the buffer parameter settings in a transport steam layer including the plurality of HEVC layers.

15. The apparatus of claim 13, wherein at least one of the buffer parameter settings specifies a bitrate for a respective HEVC temporal layer entering the individual transport stream buffer.

16. The apparatus of claim 13, wherein at least one of the buffer parameter settings specifies a buffer size for an individual transport stream buffer.

17. An apparatus comprising:

one or more computer processors; and

a computer readable storage medium comprising instructions that, when executed, cause the one or more computer processors to;

receive a high efficiency video coding (HEVC) video descriptor including one or more syntax elements in the HEVC video descriptor that apply to the whole HEVC layered stream;

determine from the HEVC video descriptor one or more elements that indicate whether a plurality of HEVC temporal layers are present in one or more spatial layers in the HEVC layered stream;

receive at least one extension descriptor that extends the HEVC video descriptor for each of the plurality of HEVC temporal layers present in the HEVC layered stream;

determine from the at least one extension descriptor that individual layer parameters for each of the plurality of HEVC temporal layers in the HEVC layered stream are present;

decode each layer of the HEVC layered stream according to individual layer parameters signaled, wherein buffering for a decoding process includes;

determining buffer parameter settings for buffering each of the plurality of HEVC temporal layers in the transport stream, wherein each of the plurality of HEVC temporal layers includes a respective buffer parameter setting;

applying respective buffer parameter settings to individual buffers for respective HEVC temporal layers in the one or more spatial layers in the HEVC layered stream.

18. The apparatus of claim 17, wherein the buffer parameter settings are received from an encoder and are encoded in the transport stream that includes the plurality of HEVC temporal layers.

19. The apparatus of claim 18, wherein the buffer parameter settings received from the encoder are included in a video descriptor including the plurality of HEVC temporal layers.

20. The apparatus of claim 17, wherein the buffer parameter settings are transport stream buffer parameters linked to respective video stream buffer parameter settings.