Video encoding and decoding

• US 10,554,996 B2
• Filed: 07/18/2018
• Issued: 02/04/2020
• Est. Priority Date: 03/09/2011
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: LaRoche, Guillaume, Onno, Patrice
• Primary Examiner(s): Nawaz, Talha M
• Application Number:
  US16/039,235
• Publication Number:
  US 20190014339A1
• Time in Patent Office: 566 Days
• Field of Search: None
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/43 Hardware specially adapted for motion estimation or compensation
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A temporal motion vector predictor is includable, together with one or more spatial motion vector predictors, in a set of motion vector predictors for a block to encode of a current frame. A method of determining the temporal motion vector predictor comprises selecting as the temporal predictor one motion vector from among motion vectors in a reference block of a reference frame different from the current frame. The reference block is a block of the reference frame collocated with the block to encode or a block of the reference frame neighboring the collocated block. The selection is based on a diversity criterion for achieving diversity among the predictors of the set. This can reduce the motion vector memory requirements with no or no significant additional coding efficiency penalty. Alternatively, even if the motion vector memory is not reduced in size, coding efficiency improvements can be achieved.

Claims

1. A method of encoding a sequence of digital images into a bitstream, at least one block being encoded by inter prediction, the method comprising:

generating a set of motion vector predictor candidates for a block to encode of a current frame, the set of motion vector predictor candidates being permitted to include, if available, at least one spatial motion vector predictor candidate and no more than one temporal motion vector predictor candidate, the generating comprising, if available, selecting as said temporal motion vector predictor candidate a motion vector at a predetermined position in a block of a reference frame, the reference frame being different from the current frame, wherein the block of the reference frame is located in vicinity of a bottom right position of an area, wherein the block of the reference frame is neighboring the area, and wherein the area has the same position and the same size as the block to encode;

selecting a motion vector predictor candidate from the generated set as a motion vector predictor for encoding a motion vector associated with the block to encode; and

encoding in the bitstream information identifying the selected motion vector predictor candidate,

wherein the generating comprises, if available, selecting as the spatial motion vector predictor candidate a motion vector associated with a block neighboring and diagonally below and to the left of the block to encode.

2. A method as claimed in claim 1, wherein the block of the reference frame is diagonally below and to the right of the area, and the predetermined position in the block of the reference frame is a top left position in the block of the reference frame.

3. A method as claimed in claim 1, wherein the spatial motion vector predictor candidate is selected before the temporal motion vector predictor candidate is selected, and the selection of the temporal motion vector predictor candidate is carried out in dependence upon the spatial motion vector predictor candidate included in the set.

4. A method as claimed in claim 1, wherein the selection of the temporal motion vector predictor candidate is carried out in dependence of availability of the at least one spatial motion vector predictor candidate from the set.

5. A method of decoding a bitstream comprising an encoded sequence of digital images, at least one block having been encoded by inter prediction, the method comprising:

generating a set of motion vector predictor candidates for a block to decode of a current frame, the set of motion vector predictor candidates being permitted to include, if available, at least one spatial motion vector predictor candidate and no more than one temporal motion vector predictor candidate, the generating comprising, if available, selecting as said temporal motion vector predictor candidate a motion vector at a predetermined position in a block of a reference frame, the reference frame being different from the current frame, wherein the block of the reference frame is located in vicinity of a bottom right position of an area, wherein the block of the reference frame is neighboring the area, and wherein the area has the same position and the same size as the block to decode;

selecting a motion vector predictor candidate from the generated set as a motion vector predictor for the block to decode based on information decoded from the bitstream; and

determining a motion vector for the block to decode based on the motion vector predictor,

wherein the generating comprises, if available, selecting as the spatial motion vector predictor candidate a motion vector associated with a block neighboring and diagonally below and to the left of the block to decode.

6. A method as claimed in claim 5, wherein the block of the reference frame is diagonally below and to the right of the area, and the predetermined position in the block of the reference frame is a top left position in the block of the reference frame.

7. A method as claimed in claim 5, wherein the spatial motion vector predictor candidate is selected before the temporal motion vector predictor candidate is selected, and the selection of the temporal motion vector predictor candidate is carried out in dependence upon the spatial motion vector predictor candidate included in the set.

8. A method as claimed in claim 5, wherein the selection of the temporal motion vector predictor candidate is carried out in dependence of availability of the at least one spatial motion vector predictor candidate from the set.

9. An apparatus for encoding a sequence of digital images into a bitstream, at least one block being encoded by inter prediction, the apparatus comprising:

a generating unit configured to generate a set of motion vector predictor candidates for a block to encode of a current frame, the set of motion vector predictor candidates being permitted to include, if available, at least one spatial motion vector predictor candidate and no more than one temporal motion vector predictor candidate, wherein, if available, the generating unit selects as said temporal motion vector predictor candidate a motion vector at a predetermined position in a block of a reference frame, the reference frame being different from the current frame, wherein the block of the reference frame is located in vicinity of a bottom right position of an area, wherein the block of the reference frame is neighboring the area, and wherein the area has the same position and the same size as the block to encode;

a selecting unit configured to select a motion vector predictor candidate from the generated set as a motion vector predictor for encoding a motion vector associated with the block to encode; and

an encoding unit configured to encode in the bitstream information identifying the selected motion vector predictor candidate,

wherein, if available, the generating unit selects as the spatial motion vector predictor candidate a motion vector associated with a block neighboring and diagonally below and to the left of the block to encode.

10. An apparatus for decoding a bitstream comprising an encoded sequence of digital images, at least one block having been encoded by inter prediction, the apparatus comprising:

a generating unit configured to generate a set of motion vector predictor candidates for a block to decode of a current frame, the set of motion vector predictor candidates being permitted to include, if available, at least one spatial motion vector predictor candidate and no more than one temporal motion vector predictor candidate, wherein, if available, the generating unit selects as said temporal motion vector predictor candidate a motion vector at a predetermined position in a block of a reference frame, the reference frame being different from the current frame, wherein the block of the reference frame is located in vicinity of a bottom right position of an area, wherein the block of the reference frame is neighboring the area, and wherein the area has the same position and the same size as the block to decode;

a selecting unit configured to select a motion vector predictor candidate from the generated set as a motion vector predictor for the block to decode based on information decoded from the bitstream; and

a determining unit configured to determine a motion vector for the block to decode based on the motion vector predictor,

wherein, if available, the generating unit selects as the spatial motion vector predictor candidate a motion vector associated with a block neighboring and diagonally below and to the left of the block to decode.

11. A non-transitory computer-readable medium storing a program which, when executed, causes a computer to execute a process of encoding a sequence of digital images into a bitstream, at least one block being encoded by inter prediction, the process comprising:

generating a set of motion vector predictor candidates for a block to encode of a current frame, the set of motion vector predictor candidates being permitted to include, if available, at least one spatial motion vector predictor candidate and no more than one temporal motion vector predictor candidate, the generating comprising, if available, selecting as said temporal motion vector predictor candidate a motion vector at a predetermined position in a block of a reference frame, the reference frame being different from the current frame, wherein the block of the reference frame is located in vicinity of a bottom right position of an area, wherein the block of the reference frame is neighboring the area, and wherein the area has the same position and the same size as the block to encode;

selecting a motion vector predictor candidate from the generated set as a motion vector predictor for encoding a motion vector associated with the block to encode; and

encoding in the bitstream information identifying the selected motion vector predictor candidate,

wherein the generating comprises, if available, selecting as the spatial motion vector predictor candidate a motion vector associated with a block neighboring and diagonally below and to the left of the block to encode.

12. A non-transitory computer-readable medium storing a program which, when executed, causes a computer to execute a process of decoding a bitstream comprising an encoded sequence of digital images, at least one block having been encoded by inter prediction, the process comprising:

generating a set of motion vector predictor candidates for a block to decode of a current frame, the set of motion vector predictor candidates being permitted to include, if available, at least one spatial motion vector predictor candidate and no more than one temporal motion vector predictor candidate, the generating comprising, if available, selecting as said temporal motion vector predictor candidate a motion vector at a predetermined position in a block of a reference frame, the reference frame being different from the current frame, wherein the block of the reference frame is located in vicinity of a bottom right position of an area, wherein the block of the reference frame is neighboring the area, and wherein the area has the same position and the same size as the block to decode;

selecting a motion vector predictor candidate from the generated set as a motion vector predictor for the block to decode based on information decoded from the bitstream; and

determining a motion vector for the block to decode based on the motion vector predictor,

wherein the generating comprises, if available, selecting as the spatial motion vector predictor candidate a motion vector associated with a block neighboring and diagonally below and to the left of the block to decode.