Method and apparatus for encoding/decoding the motion vectors of a plurality of reference pictures, and apparatus and method for image encoding/decoding using same

• US 10,491,920 B2
• Filed: 03/10/2017
• Issued: 11/26/2019
• Est. Priority Date: 10/14/2008
• Status: Active Grant

• Current Assignee: SK Telecom Co., Ltd.
• Original Assignee: SK Telecom Co., Ltd.
• Inventors: Won, Kwanghyun, Kim, Hayoon, Jeon, Byeungwoo, Moon, Joohee, Lee, Yunglyul, Kim, Haekwang, Yang, Jungyoup
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Abimbola, Kehinde
• Application Number:
  US15/455,891
• Publication Number:
  US 20170188047A1
• Time in Patent Office: 991 Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/567 Motion estimation based on rate distortion criteria
• CPC Class Codes: H04N 19/573 Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A video decoding method using an inter prediction, includes: reconstructing a first differential motion vector and a second differential motion vector of a current block by decoding encoded data; deriving a first predicted motion vector and a second predicted motion vector of the current block from one or more neighboring blocks of the current block; generating a first motion vector of the current block by adding the first candidate motion vector to the first differential motion vector, and a second motion vector of the current block by adding the second candidate motion vector to the second differential motion vector; generating a predicted block of the current block by using the first and second motion vectors; reconstructing a residual block by decoding residual signals included in the encoded data; and adding each pixel value of the predicted block to a corresponding pixel value of the residual block.

Claims

1. A video encoding method for encoding a current block in a current picture using an inter prediction, the method comprising:

determining motion information of the current block including a first current motion vector and a second current motion vector of the current block, wherein the first current motion vector is displacement between a location of the current block in the current picture and a location of a first reference block in a first reference picture which is included in a first reference picture list, and the second current motion vector is displacement between a location of the current block in the current picture and a location of a second reference block in a second reference picture which is included in a second reference picture list,

encoding, into a bitstream, mode information indicating which mode is used for encoding the motion information of the current block among a plurality of motion information encoding modes; and

when a first motion information encoding mode is used for encoding the motion information of the current block, performing a process comprising;

deriving, by using motion vectors of neighboring blocks of the current block, a first set of candidate motion vectors and a second set of candidate motion vectors;

selecting a first predicted motion vector of the first current motion vector from the first set of candidate motion vectors, and a second predicted motion vector of the second current motion vector from the second set of candidate motion vectors;

generating a first differential motion vector by subtracting the first predicted motion vector from the first current motion vector of the current block;

generating a second differential motion vector by subtracting the second predicted motion vector from the second current motion vector of the current block;

encoding, into the bitstream, the first differential motion vector, a first reference picture index for indicating the first reference picture in the first reference picture list, the second differential motion vector, and the second reference picture index for indicating the second reference picture in the second reference picture list; and

encoding, into the bitstream, a residual signals that is differences between pixels in the current block and pixels in a predicted block of the current block, wherein the predicted block is generated by predicting the current block using the first current motion vector, the first reference picture in the first reference picture list, the second current motion vector, and the second reference picture in the second reference picture list,

wherein the encoding of the residual signals comprises;

identifying one or more conditions for enabling transform and quantization;

skipping both of the transform and the quantization for the residual signals to thereby encode the residual signals which are neither transformed nor quantized, when the identified one or more conditions indicate skipping of both the transform and the quantization;

skipping the transform for the residual signals and quantizing the residual signals to thereby encode the quantized residual signals, when the identified one or more conditions indicate skipping of the transform; and

transforming and then quantizing the residual signals to thereby encode the transformed and quantized residual signals, when the identified one or more conditions indicate non-skipping of both the transform and the quantization.

2. The method of claim 1, wherein the spatially neighboring blocks include one or more of blocks located at left, upper, upper right and upper left sides of the current block.

3. The method of claim 1, wherein information for indicating the first predicted motion vector and the second predicted motion vector is encoded into the bitstream.

4. The method of claim 1, wherein each candidate motion vector in the first set or each candidate motion vector in the second set is derived from either a motion vector of a neighboring block referring to the first reference picture list or a motion vector of a neighboring block referring to the second reference picture list.

5. The method of claim 1, wherein each candidate motion vector in the first set is derived by scaling a motion vector of a neighboring block based on temporal distance between the first reference picture and a reference picture which is included either in the first reference picture list or in the second reference picture list and is referred to by the motion vector of the neighboring block.

6. The method of claim 1, wherein each candidate motion vector in the second set is derived by scaling a motion vector of a neighboring block based on temporal distance between the second reference picture and a reference picture which is included either in the first reference picture list or in the second reference picture list and is referred to by the motion vector of the neighboring block.

7. The method of claim 1, further comprising:

when a second motion information encoding mode is used for encoding the motion information of the current block,

encoding information on predefined first and second motion vectors; and

encoding a residual block that is a difference between the current block and a predicted block generated by the predefined first and second motion vectors.

8. A video encoding apparatus for encoding a current block in a current picture using an inter prediction, the apparatus comprising:

a motion vector encoder configured to

determine motion information of the current block including a first current motion vector and a second current motion vector of the current block, wherein the first current motion vector is displacement between a location of the current block in the current picture and a location of a first reference block in a first reference picture which is included in a first reference picture list, and the second current motion vector is displacement between a location of the current block in the current picture and a location of a second reference block in a second reference picture which is included in a second reference picture list,

encode, into a bitstream, mode information indicating which mode is used for encoding the motion information of the current block among a plurality of motion information encoding modes, and

in response to encoding of the mode information indicating a first motion information encoding mode,

derive, by using motion vectors of neighboring blocks of the current block, a first set of candidate motion vectors and a second set of candidate motion vectors,

select a first predicted motion vector of the first current motion vector from the first set of candidate motion vectors and a second predicted motion vector of the second current motion vector from the second set of candidate motion vectors,

generate a first differential motion vector by subtracting the first predicted motion vector from the first current motion vector of the current block,

generate a second differential motion vector by subtracting the second predicted motion vector from the second current motion vector of the current block, and

encode, into the bitstream, the first differential motion vector, a first reference picture index for indicating the first reference picture in the first reference picture list, the second differential motion vector, and the second reference picture index for indicating the second reference picture in the second reference picture list; and

a motion compensator configured to generate a predicted block by predicting the current block using the first current motion vector, the first reference picture in the first reference picture list, the second current motion vector, and the second reference picture in the second reference picture list; and

a residual encoder configured to encode a residual signals that are differences between pixels in the current block and pixels in the predicted block,

wherein the residual encoder is configured to encode the residual signals by

identifying whether to enable transform and quantization,

skipping both of the transform and the quantization for the residual signals to thereby encode the residual signals which are neither transformed nor quantized, in response to identifying skipping of both the transform and the quantization;

skipping the transform for the residual signals and quantizing the residual signals to thereby encode the quantized residual signals, in response to identifying skipping of the transform; and

transforming and then quantizing the residual signals to thereby encode the transformed and quantized residual signals, in response to identifying non-skipping of both the transform and the quantization.

9. The apparatus of claim 8, wherein the spatially neighboring blocks include one or more of blocks located at left, upper, upper right and upper left sides of the current block.

10. The apparatus of claim 8, wherein the motion vector encoder is configured to encode information for indicating the first predicted motion vector and the second predicted motion vector.

11. The apparatus of claim 8, wherein each of the candidate motion vectors in the first set or each of the candidate motion vectors in the second set is derived from either a motion vector of a neighboring block referring to the first reference picture list or a motion vector of a neighboring block referring to the second reference picture list.

12. The apparatus of claim 8, wherein each of the candidate motion vectors in the first set is derived by scaling a motion vector of a neighboring block based on temporal distance between the first reference picture and a reference picture which is included either in the first reference picture list or in the second reference picture list and is referred to by the motion vector of the neighboring block.

13. The apparatus of claim 8, wherein each of the candidate motion vectors in the second set is derived by scaling a motion vector of a neighboring block based on temporal distance between the second reference picture and a reference picture which is included either in the first reference picture list or in the second reference picture list and is referred to by the motion vector of the neighboring block.

14. The apparatus of claim 8, wherein the neighboring blocks are selected from at least one spatially neighboring block of the current block and at least one temporally neighboring block of the current block, and

wherein, when the at least one temporally neighboring block is selected, the at least one temporally neighboring block is located within a reference picture included either in the first reference picture list or in the second reference picture list, and a position of the at least one temporally neighboring block within the reference picture is obtained based on a position of the current block within a current picture including the current block.

15. The apparatus of claim 8, wherein the motion vector encoder is configured to derive the first set of candidate motion vectors or the second set of candidate motion vectors by

comparing values of two candidate motion vectors derived from the at least one spatially neighboring block;

and

adding only one of the two candidate motion vectors into the first set or the second set, when the values of the two candidate motion vectors are equal to each other.

16. A video decoding apparatus for decoding a current block in a current picture using an inter prediction, the apparatus comprising:

an information extractor configured to

reconstruct, from a bitstream, mode information indicating which mode has been used for encoding motion information of the current block among a plurality of motion information encoding modes, and

in response to the mode information indicating a first motion information encoding mode among the plurality of motion information encoding modes, reconstruct a first and a second differential motion vectors of the current block, a first reference picture index for indicating a first reference picture in the first reference picture list, and a second reference picture index for indicating a second reference picture in the second reference picture list, from the bitstream,;

an inter predictor configured to

derive, by using motion vectors of neighboring blocks of the current block, a first set of candidate motion vectors and a second set of candidate motion vectors,

select a first candidate motion vector from the first set of candidate motion vectors and a second candidate motion vector from the second set of candidate motion vectors,

generate a first current motion vector of the current block by adding the first candidate motion vector to the first differential motion vector, and a second current motion vector of the current block by adding the second candidate motion vector to the second differential motion vector, and

generate a predicted block of the current block by using the first current motion vector, the first reference picture indicated by the first reference picture index, the second current motion vector, and the second reference picture indicated by the second reference picture index;

a residual decoder configured to reconstruct residual signals from encoded residual signals included in the bitstream; and

an adder configured to add the reconstructed residual signals to corresponding pixels in the predicted block,

wherein the residual decoder is configured to

identify one or more conditions for enabling inverse quantization and inverse transform; and

skip both of the inverse quantization and the inverse transform for the encoded residual signals to thereby reconstruct the residual signals from the encoded residual signals, when the identified one or more conditions indicate skipping of both the inverse quantization and the inverse transform,

inversely quantize the encoded residual signals and skip the inverse transform for the inversely quantized residual signals to thereby reconstruct the residual signals from the inversely quantized residual signals, when the identified one or more conditions indicate skipping of the inverse transform, and

inversely quantize and then inversely transform the encoded residual signals to thereby reconstruct the residual signals from the inversely quantized and inversely transformed residual signals, when the identified one or more conditions indicate non-skipping of both the inverse quantization and the inverse transform.

17. The apparatus of claim 16, wherein the neighboring blocks are selected from at least one spatially neighboring block of the current block and at least one temporally neighboring block of the current block, and

wherein, when the at least one temporally neighboring block is selected, the at least one temporally neighboring block is located within a reference picture included either in the first reference picture list or in the second reference picture list, and a position of the at least one temporally neighboring block within the reference picture is obtained based on a position of the current block within a current picture including the current block.

18. The apparatus of claim 16, wherein the inter predictor is configured to derive the first set of candidate motion vectors or the second set of candidate motion vectors by

comparing values of two candidate motion vectors derived from the at least one spatially neighboring block;

and

adding only one of the two candidate motion vectors into the first set or the second set, when the values of the two candidate motion vectors are equal to each other.