Encoder-side decisions for block flipping and skip mode in intra block copy prediction

• US 10,368,092 B2
• Filed: 03/04/2014
• Issued: 07/30/2019
• Est. Priority Date: 03/04/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Li, Bin, Xu, Jizheng, Wu, Feng
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dang, Philip P.
• Application Number:
  US15/029,585
• Publication Number:
  US 20160277761A1
• Time in Patent Office: 1,974 Days
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

Innovations in the area of encoding blocks using hash-based block matching improve coding efficiency in many situations. For example, some of the innovations relate to encoder-side decisions about when to use block flipping during prediction. Other innovations relate to encoder-side decisions about when to use skip mode for a block predicted using intra block copy (“BC”) prediction.

Claims

1. In a computing device with a video encoder or an image encoder, a method comprising:

deciding whether a current block in a current picture is to be encoded using an intra block copy (“

BC”

) prediction in a skip mode, including;

performing a hash-based block matching for the current block;

determining that the hash-based block matching fails for the current block;

determining a reference region in the current picture, including selecting a predicted block vector (“

BV”

) value for the current block from among multiple available BV values in a neighborhood around the current block, wherein the predicted BV value indicates a displacement to the reference region in the current picture; and

determining that input sample values of the reference region identically match corresponding input sample values of the current block, a quantization parameter (“

QP”

) value for the current block being greater than or equal to a QP value for the reference region; and

encoding the current block using the intra BC prediction in the skip mode, the skip mode using the predicted BV value for the current block; and

outputting in a bitstream encoded data, wherein the bitstream lacks a BV differential value for the current block and lacks residual data for the current block.

2. The method of claim 1 wherein the reference region covers at least part of each of multiple blocks in the current picture, at least some of the multiple blocks having different QP values, and wherein the QP value for the reference region is one of:

a smallest QP value among the different QP values for the multiple blocks;

a QP value of whichever block among the multiple blocks covers a largest portion of the reference region;

an average QP value among the different QP values for the multiple blocks; and

a weighted average QP value among the different QP values for the multiple blocks.

3. The method of claim 1 wherein the intra BC prediction includes:

determining an intra BC prediction region for the current block using the reference region, wherein the intra BC prediction region is flipped relative to the reference region.

4. The method of claim 3 wherein the intra BC prediction region is flipped horizontally relative to the reference region and/or flipped vertically relative to the reference region.

5. The method of claim 1 wherein the current block is part of a coding unit.

6. One or more computer-readable memory or storage devices storing computer-executable instructions for causing a computing device, when programmed thereby, to perform operations comprising:

deciding whether a current block in a current picture is to be encoded using an intra block copy (“

BC”

) prediction in a skip mode, including;

performing a hash-based block matching for the current block;

determining that the hash-based block matching fails for the current block;

determining a reference region in the current picture, including selecting a predicted block vector (“

BV”

) value for the current block from among multiple available BV values in a neighborhood around the current block, wherein the predicted BV value indicates a displacement to the reference region in the current picture; and

determining that input sample values of the reference region identically match corresponding input sample values of the current block, a quantization parameter (“

QP”

) value for the current block being greater than or equal to a QP value for the reference region; and

encoding the current block using the intra BC prediction in the skip mode, the skip mode using the predicted BV value for the current block; and

outputting in a bitstream encoded data, wherein the bitstream lacks a BV differential value for the current block and lacks residual data for the current block.

7. The one or more computer-readable memory or storage devices of claim 6 wherein the reference region covers at least part of each of multiple blocks in the current picture, at least some of the multiple blocks having different QP values, and wherein the QP value for the reference region is one of:

a smallest QP value among the different QP values for the multiple blocks;

a QP value of whichever block among the multiple blocks covers a largest portion of the reference region;

an average QP value among the different QP values for the multiple blocks; and

a weighted average QP value among the different QP values for the multiple blocks.

8. The one or more computer-readable memory or storage devices of claim 6 wherein the current block is part of a coding unit.

14. The one or more computer-readable memory or storage devices of claim 6 wherein the intra BC prediction includes:

determining an intra BC prediction region for the current block using the reference region, wherein the intra BC prediction region is flipped relative to the reference region.

15. The one or more computer-readable memory or storage devices of claim 14 wherein the intra BC prediction region is flipped horizontally relative to the reference region and/or flipped vertically relative to the reference region.

9. A computing device comprising:

one or more buffers configured to store a current picture; and

a video encoder or an image encoder configured to perform operations comprising;

deciding whether a current block in the current picture is to be encoded using an intra block copy (“

BC”

) prediction in a skip mode, including;

performing a hash-based block matching for the current block;

determining that the hash-based block matching fails for the current block;

determining a reference region in the current picture, including selecting a predicted block vector (“

BV”

) value for the current block from among multiple available BV values in a neighborhood around the current block, wherein the predicted BV value indicates a displacement to the reference region in the current picture; and

determining that input sample values of the reference region identically match corresponding input sample values of the current block, a quantization parameter (“

QP”

) value for the current block being greater than or equal to a QP value for the reference region; and

encoding the current block using the intra BC prediction in the skip mode, the skip mode using the predicted BV value for the current block; and

outputting in a bitstream encoded data, wherein the bitstream lacks a BV differential value for the current block and lacks residual data for the current block.

10. The computing device of claim 9 wherein the reference region covers at least part of each of multiple blocks in the current picture, at least some of the multiple blocks having different QP values, and wherein the QP value for the reference region is one of:

a smallest QP value among the different QP values for the multiple blocks;

a QP value of whichever block among the multiple blocks covers a largest portion of the reference region;

an average QP value among the different QP values for the multiple blocks; and

a weighted average QP value among the different QP values for the multiple blocks.

11. The computing device of claim 9 wherein the current block is part of a coding unit.

12. The computing device of claim 9 wherein the intra BC prediction includes:

determining an intra BC prediction region for the current block using the reference region, wherein the intra BC prediction region is flipped relative to the reference region.

13. The computing device of claim 12 wherein the intra BC prediction region is flipped horizontally relative to the reference region and/or flipped vertically relative to the reference region.