COMBINATION OF INTER-PREDICTION AND INTRA-PREDICTION IN VIDEO CODING

• US 20180376149A1
• Filed: 06/21/2018
• Published: 12/27/2018
• Est. Priority Date: 06/23/2017
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Zhang, Kai, Chen, Jianle, Zhang, Li, Li, Xiang, Karczewicz, Marta
• Granted Patent: US 10,757,420 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/463 by compressing encoding parameters before transmission
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques

Abstract

Techniques are described for using an inter-intra-prediction block. A video coder may generate a first prediction block according to an intra-prediction mode and generate a second prediction block according to an inter-prediction mode. The video coder may weighted combine, such as based on the intra-prediction mode, the two prediction blocks to generate an inter-intra-prediction block (e.g., final prediction block). In some examples, an inter-intra candidate is identified in a list of candidate motion vector predictors, and an inter-intra-prediction block is used based on identification of the inter-intra candidate in the list of candidate motion vector predictors.

Claims

1. A method of decoding video data, the method comprising:

constructing a list of candidate motion vector predictors for a current block, wherein constructing the list of candidate motion vector predictors comprises;

including an inter-prediction candidate in the list of candidate motion vector predictors, wherein the inter-prediction candidate comprises motion information of a neighboring or collocated block of the current block; and

including an inter-intra candidate in the list of candidate motion vector predictors, wherein the inter-intra candidate comprises information to generate a first prediction block according to an intra-prediction mode and information to generate a second prediction block according to an inter-prediction mode;

determining that the inter-intra candidate is to be used;

generating an inter-intra-prediction block based on the first prediction block and the second prediction block; and

reconstructing the current block based on the inter-intra-prediction block.

2. The method of claim 1, wherein reconstructing the current block based on the inter-intra-prediction block comprises adding values of the inter-intra-prediction block to values of a residual block to reconstruct the current block.

3. The method of claim 1, wherein determining that the inter-intra candidate is to be used for the current block comprises:

receiving an index into the list of candidate motion vector predictors;

determining that the inter-intra candidate is identified in the list of candidate motion vector predictors by the received index.

4. The method of claim 1, wherein constructing the list of candidate motion vector comprises:

after including the inter-prediction candidate into the list of candidate motion vector predictors, including the inter-intra candidate in the list of candidate motion vector predictors.

5. The method of claim 1, further comprising:

determining motion information of an inter-predicted block identified by a smallest index in the list of candidate motion vector predictors to determine the information to generate the second prediction block; and

generating the second prediction block based on the motion information.

6. The method of claim 1, further comprising:

determining a maximum number of allowable inter-intra candidates,

wherein including the inter-intra candidate in the list of candidate motion vector predictors comprises including the inter-intra candidate in the list based on the determined maximum number of allowable inter-intra candidates.

7. The method of claim 1, wherein determining that the inter-intra candidate is to be used comprises determining that the inter-intra candidate is to be used without receiving any additional signaling indicating that the current block is predicted according to an inter-intra-prediction mode.

8. The method of claim 1, wherein the list of candidate motion vector predictors comprises one of a merge candidate list or an advanced motion vector prediction (AMVP) candidate list.

9. The method of claim 1, further comprising:

determining an intra-prediction mode to determine the information to generate the first prediction block; and

generating the first prediction block based on the determined intra-prediction mode.

10. A method of encoding video data, the method comprising:

constructing a list of candidate motion vector predictors for a current block, wherein constructing the list of candidate motion vector predictors comprises;

including an inter-prediction candidate in the list of candidate motion vector predictors, wherein the inter-prediction candidate comprises motion information of a neighboring or collocated block of the current block; and

including an inter-intra candidate in the list of candidate motion vector predictors, wherein the inter-intra candidate comprises information to generate a first prediction block according to an intra-prediction mode and information to generate a second prediction block according to an inter-prediction mode;

determining that the inter-intra candidate is to be used; and

signaling an index value into the list of candidate motion vector predictors that identifies the inter-intra candidate in the list of candidate motion vector predictors based on the determination.

11. The method of claim 10, further comprising:

generating an inter-intra-prediction block based on the first prediction block and the second prediction block;

determining a residual between the current block and the inter-intra-prediction block; and

signaling information indicative of the residual.

12. The method of claim 10, wherein constructing the list of candidate motion vector comprises:

after including the inter-prediction candidate into the list of candidate motion vector predictors, including the inter-intra candidate in the list of candidate motion vector predictors.

13. The method of claim 10, further comprising:

determining motion information of an inter-predicted block identified by a smallest index in the list of candidate motion vector predictors to determine the information to generate the second prediction block; and

generating the second prediction block based on the motion information.

14. The method of claim 10, further comprising:

determining a maximum number of allowable inter-intra candidates,

wherein including the inter-intra candidate in the list of candidate motion vector predictors comprises including the inter-intra candidate in the list based on the determined maximum number of allowable inter-intra candidates.

15. The method of claim 10, wherein the list of candidate motion vector predictors comprises one of a merge candidate list or an advanced motion vector prediction (AMVP) candidate list.

16. The method of claim 10, further comprising:

determining an intra-prediction mode to determine the information to generate the first prediction block; and

generating the first prediction block based on the determined intra-prediction mode.

17. A device for coding video data, the device comprising:

a memory; and

a video coder comprising processing circuitry, wherein the video coder is configured to;

construct a list of candidate motion vector predictors, for storage in the memory, for a current block, wherein to construct the list of candidate motion vector predictors, the video coder is configured to;

include an inter-prediction candidate in the list of candidate motion vector predictors, wherein the inter-prediction candidate comprises motion information of a neighboring or collocated block of the current block; and

include an inter-intra candidate in the list of candidate motion vector predictors, wherein the inter-intra candidate comprises information to generate a first prediction block according to an intra-prediction mode and information to generate a second prediction block according to an inter-prediction mode;

determine that the inter-intra candidate is to be used;

generate an inter-intra-prediction block based on the first prediction block and the second prediction block; and

at least one of;

reconstruct the current block based on the inter-intra-prediction block;

or

signal a residual between the current block and the inter-intra-prediction block and an index value into the list of candidate motion vector predictors that identifies the inter-intra candidate in the list of candidate motion vector predictors based on the determination that the inter-intra candidate is to be used.

18. The device of claim 17, wherein the video coder comprises a video decoder, and wherein the video decoder is configured to reconstruct the current block based on the inter-intra-prediction block by adding values of the inter-intra-prediction block to values of a residual block to reconstruct the current block.

19. The device of claim 17, wherein the video coder comprises a video decoder, wherein to determine that the inter-intra candidate is to be used for the current block, the video decoder is configured to:

receive an index into the list of candidate motion vector predictors;

determine that the inter-intra candidate is identified in the list of candidate motion vector predictors by the received index.

20. The device of claim 17, wherein the video coder comprises a video encoder, wherein the video encoder is configured to:

determine the residual between the current block and the prediction block.

21. The device of claim 17, wherein to construct the list of candidate motion vector, the video coder is configured to:

after including the inter-prediction candidate into the list of candidate motion vector predictors, include the inter-intra candidate in the list of candidate motion vector predictors.

22. The device of claim 17, wherein the video coder is configured to:

determine motion information of an inter-predicted block identified by a smallest index in the list of candidate motion vector predictors to determine the information to generate the second prediction block; and

generate the second prediction block based on the motion information.

23. The device of claim 17, wherein the video coder is configured to:

determine a maximum number of allowable inter-intra candidates,

wherein to include the inter-intra candidate in the list of candidate motion vector predictors, the video coder is configured to include the inter-intra candidate in the list based on the determined maximum number of allowable inter-intra candidates.

24. The device of claim 17, wherein the video coder comprises a video decoder, and wherein to determine that the inter-intra candidate is to be used, the video decoder is configured to determine that the inter-intra candidate is to be used without receiving any additional signaling indicating that the current block is predicted according to an inter-intra-prediction mode.

25. The device of claim 17, wherein the list of candidate motion vector predictors comprises one of a merge candidate list or an advanced motion vector prediction (AMVP) candidate list.

26. The device of claim 17, wherein the video coder is configured to:

determine an intra-prediction mode to determine the information to generate the first prediction block; and

generating the first prediction block based on the determined intra-prediction mode.

27. A computer-readable storage medium storing instructions thereon that when executed cause one or more processors to:

construct a list of candidate motion vector predictors, for storage in the memory, for a current block, wherein to construct the list of candidate motion vector predictors, the instructions cause the one or more processors to;

include an inter-prediction candidate in the list of candidate motion vector predictors, wherein the inter-prediction candidate comprises motion information of a neighboring or collocated block of the current block; and

include an inter-intra candidate in the list of candidate motion vector predictors, wherein the inter-intra candidate comprises information to generate a first prediction block according to an intra-prediction mode and information to generate a second prediction block according to an inter-prediction mode;

determine that the inter-intra candidate is to be used;

generate an inter-intra-prediction block based on the first prediction block and the second prediction block; and

at least one of;

reconstruct the current block based on the inter-intra-prediction block;

or

signal a residual between the current block and the inter-intra-prediction block and an index value into the list of candidate motion vector predictors that identifies the inter-intra candidate in the list of candidate motion vector predictors based on the determination that the inter-intra candidate is to be used.