Method and apparatus for managing buffer for encoding and decoding multilayer video

• US 10,448,050 B2
• Filed: 04/12/2016
• Issued: 10/15/2019
• Est. Priority Date: 10/12/2013
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Byeong-doo, Park, Min-woo, Lee, Jin-young, Cho, Yong-jin, Kim, Chan-yul, Wey, Ho-cheon
• Primary Examiner(s): Hance, Robert J
• Application Number:
  US15/096,666
• Publication Number:
  US 20160227249A1
• Time in Patent Office: 1,281 Days
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer

Abstract

Provided are multilayer video encoding/decoding methods and apparatuses. A multilayer video decoding method may comprise obtaining, from a bitstream, information indicating a maximum size of a decoded picture buffer (DPB) with respect to a layer set comprising a plurality of layers; determining a size of the DPB with respect to the layer set based on the obtained information indicating the maximum size of the DPB; and storing a decoded picture of the layer set in the DPB of the determined size.

Claims

1. A multilayer video decoding method comprising:

obtaining, from a bitstream, information indicating a maximum size of a decoded picture buffer (DPB) with respect to a layer set comprising a plurality of layers;

determining whether it is possible to obtain, from the bitstream, information indicating a maximum size of a sub DPB with respect to a layer format group included in the layer set;

when it is determined that it is possible to obtain the information indicating the maximum size of the sub DPB;

further obtaining, from the bitstream, information indicating a maximum size of a sub DPB with respect to a layer format group included in the layer set;

determining a size of a sub DPB with respect to the layer format group included in the layer set based on the obtained information indicating the maximum size of the sub DPB; and

storing a decoded picture of the layer format group in the sub DPB of the determined size, and

when it is determined that it is impossible to obtain the information indicating the maximum size of the sub DPB;

determining a size of the DPB with respect to the layer set based on the obtained information indicating the maximum size of the DPB; and

storing a decoded picture for the layer set in the DPB of the determined size, and

wherein the DPB comprises at least one sub DPB determined for each predetermined format group based on the information indicating the maximum size of the sub DPB, and

wherein the layer format group included in the layer set comprises at least one layer having a same image format.

2. The multilayer video decoding method of claim 1, wherein the obtaining of the information indicating the maximum size of the DPB with respect to the layer set comprises:

when the layer set comprises a plurality of temporal sub layers, obtaining information indicating the maximum size of the DPB for each of the plurality of temporal sub layers included in the layer set.

3. The multilayer video decoding method of claim 2, wherein information indicating the maximum size of the DPB with respect to a temporal sub layer of a first index among the plurality of temporal sub layers included in the layer set indicates the maximum size of the DPB that is the same as or greater than the maximum size of the DPB with respect to a temporal sub layer of a second index indicating a temporal sub layer of a level lower than the first index.

4. The multilayer video decoding method of claim 1, wherein the obtaining of the information indicating the maximum size of the sub DPB comprises:

when the layer set comprises a plurality of temporal sub layers, obtaining information indicating the maximum size of the sub DPB with respect to the layer format group for each of the plurality of temporal sub layers included in the layer set.

5. The multilayer video decoding method of claim 1, wherein the obtaining of the information indicating the maximum size of the DPB comprises:

from the bitstream comprising high efficiency video coding (HEVC) network abstract layer (NAL) units, obtaining the information indicating the maximum size of the DPB from a video parameter set (VPS) extension region included in a raw bytes sequence payload (RBSP) of each of the HEVC NAL units.

6. A multilayer video decoding apparatus comprising at least one processor, the at least one processor that is configured to:

obtain, from a bitstream, information indicating a maximum size of a decoded picture buffer (DPB) with respect to a layer set comprising a plurality of layers;

determine whether it is possible to obtain, from the bitstream, information indicating a maximum size of a sub DPB with respect to a layer format group included in the layer set;

when it is determined that it is possible to obtain the information indicating the maximum size of the sub DPB;

further obtain, from the bitstream, information indicating a maximum size of a sub DPB with respect to a layer format group included in the layer set;

determine a size of a sub DPB with respect to the layer format group included in the layer set based on the obtained information indicating the maximum size of the sub DPB; and

store a decoded picture of the layer format group in the sub DPB of the determined size, and

when it is determined that it is impossible to obtain the information indicating the maximum size of the sub DPB;

determine a size of the DPB with respect to the layer set based on the obtained information indicating the maximum size of the DPB; and

store a decoded picture for the layer set in the DPB of the determined size, and

wherein the DPB comprises at least one sub DPB determined for each predetermined format group based on the information indicating the maximum size of the sub DPB, and

wherein the layer format group included in the layer set comprises at least one layer having a same image format.

7. The multilayer video decoding apparatus of claim 6, wherein, when the layer set comprises a plurality of temporal sub layers, the processor is configured to obtain information indicating the maximum size of the DPB for each of the plurality of temporal sub layers included in the layer set.

8. The multilayer video decoding apparatus of claim 7, wherein information indicating the maximum size of the DPB with respect to a temporal sub layer of a first index among the plurality of temporal sub layers included in the layer set indicates the maximum size of the DPB that is the same as or greater than the maximum size of the DPB with respect to a temporal sub layer of a second index indicating a temporal sub layer of a lower level than the first index.

9. The multilayer video decoding apparatus of claim 6, wherein, when the layer set comprises a plurality of temporal sub layers, the processor is configured to obtain information indicating the maximum size of the sub DPB with respect to the layer format group for each of the plurality of temporal sub layers included in the layer set.

10. The multilayer video decoding apparatus of claim 6, wherein the processor is configured to, from the bitstream comprising high efficiency video coding (HEVC) network abstract layer (NAL), units, obtain the information indicating the maximum size of the DPB from a video parameter set (VPS) extension region included in a raw bytes sequence payload (RBSP) of each of the HEVC NAL units.