Method and apparatus of depth prediction mode selection

• US 10,306,266 B2
• Filed: 11/21/2016
• Issued: 05/28/2019
• Est. Priority Date: 01/11/2013
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Gu, Zhouye, Zheng, Jianhua, Ling, Nam, Zhang, Chen-Xiong
• Primary Examiner(s): Kalapodas, Dramos
• Application Number:
  US15/357,676
• Publication Number:
  US 20170127087A1
• Time in Patent Office: 918 Days
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A method, an apparatus and a decoder for decoding a block of a depth map are provided. An ordered list of decoding modes is obtained, wherein the ordered list of decoding modes comprises a plurality of decoding modes each of which is capable of being used for decoding of the block. A plurality of depth modeling modes (DMMs) each of which is capable of being used for decoding of the block are obtained. And whether a DMM of the plurality of DMMs is to be added into the ordered list of decoding modes in accordance with a decision condition is determined.

Claims

1. A computer-implemented method for decoding a block of depth data for a video frame, comprising:

obtaining, by a decoder, a list comprising a plurality of depth data decoding modes;

determining, by the decoder, to add a depth modeling mode (DMM) to the list comprising of the plurality of depth data decoding modes based on a decision condition;

updating, by the decoder, the list comprising the plurality of depth data decoding modes with at least one or more DMMs based on the determination;

selecting, by the decoder, one or more depth data coding modes from the list comprising the plurality of depth data decoding modes to decode the block of depth data for the video frame;

decoding, by the decoder, at least one block of depth data for a video frame with the one or more decoding modes selected from the list comprising the plurality of depth data decoding modes, wherein

the decision condition is based on whether a first mode in the list is a planar mode and a second mode in the list is a DC mode, and when the first mode in the list is the planar mode, and the second mode in the list is not a DC mode, updating the list with the at least one or more DMMs; and

when the first mode in the list of the one or more depth data coding modes is not the planar mode, and the second mode in the list of the one or more depth data coding modes is the DC mode, updating the list with the at least one or more DMMs.

2. The computer-implemented method of claim 1, wherein the list is not updated based on the determination resulting in not adding the one or more DMMs into the list.

3. The computer-implemented method of claim 1, further comprising:

skipping a cost calculation of the list in the decoding process of the depth data when the list is not updated based on the determination resulting in not adding the one or more DMMs into the list.

4. The computer-implemented method of claim 1, wherein the decision condition is based on whether a first mode in the list is a flat decoding mode, and further comprising adding the one or more DMMs into the list when the first mode is the flat decoding mode, wherein the flat decoding mode comprises at least one of a planar mode and a DC mode.

5. The computer-implemented method of claim 1, wherein the decision condition is based on whether a first mode in the list is a planar mode, and the one or more DMMs are not added into the list when the first mode is the planar mode.

6. An decoder for decoding a block of depth data for a video frame, comprising:

a non-transitory memory storage comprising instructions; and

one or more processors in communication with the memory, wherein the one or more processors execute the instructions to;

obtain a list comprising a plurality of depth data decoding modes;

determine to add a depth modeling mode (DMM) to the list comprising of the plurality of depth data decoding modes based on a decision condition;

update the list the list comprising the plurality of depth data decoding modes with at least one or more DMMs based on the determination;

selecting, by the decoder, one or more depth data coding modes from the list comprising the plurality of depth data decoding modes to decode the block of depth data for the video frame to update the list comprising the plurality of depth data decoding modes with at least one or more DMMs based on the determination;

decode at least one block of depth data for a video frame with one or more decoding modes from the list, wherein

the decision condition is based on whether a first mode in the list is a planar mode and a second mode in the list is a DC mode, and when the first mode in the list is the planar mode, and the second mode in the list is not a DC mode, update the list with the at least one or more DMMs; and

when the first mode in the list of the one or more depth data coding modes is not the planar mode, and the second mode in the list of the one or more depth data coding modes is the DC mode, update the list with the at least one or more DMMs.

7. The decoder of claim 6, wherein the list is not updated based on the determination resulting in not adding the one or more DMMs into the list.

8. The decoder of claim 6, wherein the one or more processors further execute the instructions to skip a cost calculation of the list in the decoding process of the depth data when the list is not updated based on the determination resulting in not adding the one or more DMMs into the list.

9. The decoder of claim 6, wherein the decision condition is based on whether a first mode in the list is a flat decoding mode, and the one or more processors further execution the instructions to add the one or more DMMs into the list when the first mode is the flat decoding mode, wherein the flat decoding mode comprises at least one of a planar mode and a DC mode.

10. The decoder of claim 6, wherein the decision condition is based on whether a first mode in the list is a planar mode, and the one or more DMMs are not added into the list when the first mode is the planar mode.

11. A decoder decoding a block of depth data for a video frame, wherein the decoder comprises one or more prediction units (PUs) performing a mode selection in the decoding process for the decoder, and the one or more PUs are configured to:

obtain a list comprising a plurality of depth data decoding modes;

determine to add a depth modeling mode (DMM) to the list comprising of the plurality of depth data decoding modes based on a decision condition;

update the list the list comprising the plurality of depth data decoding modes with at least one or more DMMs based on the determination;

selecting, by the decoder, one or more depth data coding modes from the list comprising the plurality of depth data decoding modes to decode the block of depth data for the video frame update the list comprising the plurality of depth data decoding modes with at least one or more DMMs based on the determination;

decode at least one block of depth data for a video frame with one or more decoding modes from the list, wherein

the decision condition is based on whether a first mode in the list is a planar mode and a second mode in the list is a DC mode, and

when the first mode in the list is the planar mode, and the second mode in the list is not a DC mode, update the list with the at least one or more DMMs;

when the first mode in the list of the one or more depth data coding modes is not the planar mode, and the second mode in the list of the one or more depth data coding modes is the DC mode, update the list with the at least one or more DMMs.

12. The decoder of claim 11, wherein the list is not updated based on the determination resulting in not adding the one or more DMMs into the list.

13. The decoder of claim 11, wherein the one or more PUs are further configured to skip a cost calculation of the list in the decoding process of the depth data when the list is not updated based on the determination resulting in not adding the one or more DMMs into the list.

14. The decoder of claim 11, wherein the decision condition is based on whether a first mode in the list is a flat decoding mode, and the one or more processors further execution the instructions to add the one or more DMMs into the list when the first mode is the flat decoding mode, wherein the flat decoding mode comprises at least one of a planar mode and a DC mode.

15. The decoder of claim 11, wherein decision condition is based on whether a first mode in the list is a planar mode, and the one or more DMMs are not added into the list when the first mode is the planar mode.