ENCODER, DECODER, COMPUTER PROGRAM AND COMPUTER PROGRAM PRODUCT FOR PROCESSING A FRAME OF A VIDEO SEQUENCE

• US 20200137387A1
• Filed: 12/30/2019
• Published: 04/30/2020
• Est. Priority Date: 06/30/2017
• Status: Abandoned Application

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: ZHAO, Zhijie, BLAESER, Max, WIEN, Mathias
• Application Number:
  US16/730,841
• Publication Number:
  US 20200137387A1
• Time in Patent Office: Days
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/56 Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
• CPC Class Codes: H04N 19/567 Motion estimation based on rate distortion criteria
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

Methods for encoding and decoding a frame of a video sequence and corresponding encoder and decoder are provided. The encoder comprises a partitioning unit and an entropy coding unit, the partitioning unit is configured to receive a current block of the frame, obtain a template list including line information representing one or more candidate geometric partitioning (GP) lines, determine a final GP line that partitions the current block into two segments; select a GP line from the template list of one or more GP lines to obtain a selected GP line; and generate a GP parameter for the current block. The GP parameter includes an offset information indicating an offset between the final GP line and the selected GP line; the entropy coding unit is configured to encode the GP parameter.

Claims

1. A method for encoding a frame of a video sequence, applied to an encoder comprising a digital signal processor, the method comprising:

receiving a current block of the frame;

obtaining a template list including line information representing one or more candidate geometric partitioning lines;

determining a final GP line that partitions the current block into two segments;

selecting a GP line from the template list of one or more GP lines to obtain a selected GP line; and

generating a GP parameter for the current block, wherein the GP parameter includes offset information indicating an offset between the final GP line and the selected GP line; and

encoding the GP parameter.

2. The method according to claim 1, wherein the template list comprises, for each candidate GP line of the one or more candidate GP lines, a candidate GP line specific line information,

wherein the candidate GP line specific line information comprises one of the following (a) and (b):

(a) a coordinate (x,y) indicating a start point and a coordinate indicating an end point of the respective candidate GP line of the one or more candidate GP lines; and

(b) a distance between the respective candidate GP line of the one or more candidate GP lines and a center of a template block, and an angle of the respective candidate GP line of the one or more candidate GP lines.

3. The method according to claim 2, wherein the offset between the final GP line and the selected GP line comprises an offset between the start point of the selected GP line and a start point of the final GP line, and an offset between the end point of the selected GP line and an end point of the final GP line.

4. The method according to claim 2, wherein the template list comprises two or more candidate GP lines, the candidate GP line specific line information further comprises an index for each of the candidate GP lines, and the GP parameter further includes an index of the selected GP line.

5. The method according to claim 1, wherein the template list comprises two or more candidate GP lines, and the method further comprises one of the following (a) and (b):

(a) selecting the candidate GP line from the template list that is closest to the final GP line as the selected GP line; and

(b) selecting the candidate GP line from the template list such that a rate distortion is minimized.

6. The method according to claim 1, wherein determining the final GP line comprises:

selecting a candidate GP line from the template list as an initial GP line; and

implementing at least one of the following (a) and (b);

(a) repeatedly modifying the selected initial GP line to obtain a modified GP line, obtaining a rate distortion cost for the modified GP line, and selecting the modified GP line as the final GP line, wherein the rate distortion cost of the modified GP line is below or equal to a threshold; and

(b) repeatedly modifying the selected initial GP line to obtain a plurality of modified GP lines, obtaining a rate distortion cost for each of the plurality of modified GP lines, and selecting the modified GP line with the smallest rate distortion cost.

7. The method according to claim 1, wherein the offset information comprises a step size and a quantized offset value, wherein an offset between the final GP line and the selected GP line is associated with a product of the step size and the quantized offset value.

16. A non-transitory computer-readable medium having processor-executable instructions stored thereon, which when executed by a computer or a digital signal processor, cause the computer or the digital signal processor to implement the method according to claim 1.

8. A method for decoding a frame in a video sequence, applied to a decoder comprising a digital signal processor, the method comprising:

decoding an encoded geometric partitioning parameter for the current block;

obtaining a template list including line information representing one or more candidate geometric partitioning lines;

selecting a GP line from the template list of the one or more GP lines to obtain a selected GP line; and

obtaining, based on the decoded GP parameter and the selected GP line, the final GP line that partitions the current block into two segments, wherein the GP parameter includes offset information indicating an offset between the final GP line and the selected GP line.

9. The method according to claim 8, wherein the template list comprises for each candidate GP line of the one or more candidate GP lines a candidate GP line specific line information,

wherein the candidate GP line specific line information comprises one of the following (a) and (b):

(a) a coordinate (x,y) indicating a start point and a coordinate indicating an end point of each of the respective candidate GP line of the one or more candidate GP lines; and

(b) a distance between the respective candidate GP line of the one or more candidate GP lines and a center of a template block, and an angle of the respective candidate GP line of the one or more candidate GP lines.

10. The method according to claim 9, wherein the offset between the final GP line and the selected GP line comprises an offset between the start point of the selected GP line and a start point of the final GP line, and an offset between the end point of the selected GP line and an end point of the final GP line.

11. The method according to claim 9, wherein the template list comprises two or more candidate GP lines, the candidate GP line specific line information further comprises an index for each of the candidate GP lines, and the GP parameter further includes an index of the selected GP line.

12. The method according to claim 11, further comprises:

selecting the candidate GP line from the template according to the decoded index of the selected GP line.

13. The method according to claim 8, wherein the offset information comprises a step size and a quantized offset value, wherein an offset between the final GP line and the selected GP line is determined based on a product of the step size and the quantized offset value.

17. A non-transitory computer-readable medium having processor-executable instructions stored thereon, which when executed by a computer or a digital signal processor, cause the computer or the digital signal processor to implement the method according to claim 8.

14. An encoder for encoding a frame in a video sequence, comprising a processor, and a memory coupled to the processor and having processor-executed instructions stored thereon, which when executed cause the processor to:

receive a current block of the frame;

obtain a template list including line information representing one or more candidate geometric partitioning lines;

determine a final GP line that partitions the current block into two segments;

select a GP line from the template list of one or more GP lines to obtain a selected GP line;

generate a GP parameter for the current block, wherein the GP parameter includes offset information indicating an offset between the final GP line and the selected GP line; and

encode the current block and the geometric partitioning parameter.

20. The encoder according to claim 14, wherein the template list comprises, for each candidate GP line of the one or more candidate GP lines, a candidate GP line specific line information,

wherein the candidate GP line specific line information comprises one of the following (a) and (b):

(a) a coordinate (x,y) indicating a start point and a coordinate indicating an end point of the respective candidate GP line of the one or more candidate GP lines; and

(b) a distance between the respective candidate GP line of the one or more candidate GP lines and a center of a template block, and an angle of the respective candidate GP line of the one or more candidate GP lines.

15. A decoder for decoding a frame in a video sequence, comprising a processor, and a memory coupled to the processor and having processor-executed instructions stored thereon, which when executed cause the processor to:

obtain a template list including line information representing one or more candidate geometric partitioning (GP) lines;

select a GP line from the template list of the one or more GP lines to obtain a selected GP line;

decode an encoded GP parameter for the current block, wherein the GP includes an offset information indicating offset between a final GP line and the selected GP line; and

obtain, based on the decoded GP parameter and the selected GP line, the final GP line that partitions the current block into two segments.

22. The decoder according to claim 15, wherein the template list comprises, for each candidate GP line of the one or more candidate GP lines, a candidate GP line specific line information,

wherein the candidate GP line specific line information comprises one of the following (a) and (b):

(a) a coordinate (x,y) indicating a start point and a coordinate indicating an end point of the respective candidate GP line of the one or more candidate GP lines; and

(b) a distance between the respective candidate GP line of the one or more candidate GP lines and a center of a template block, and an angle of the respective candidate GP line of the one or more candidate GP lines.

18. (canceled)

21. The encoder according to claim 18, wherein the offset between the final GP line and the selected GP line comprises an offset between the start point of the selected GP line and a start point of the final GP line, and an offset between the end point of the selected GP line and an end point of the final GP line.

19. (canceled)