Motion vector predictive encoding method, motion vector predictive decoding method, moving picture encoding apparatus, moving picture decoding apparatus, and programs thereof

• US 9,838,709 B2
• Filed: 02/07/2011
• Issued: 12/05/2017
• Est. Priority Date: 02/09/2010
• Status: Active Grant

• Current Assignee: Nippon Telegraph and Telephone Corporation
• Original Assignee: Nippon Telegraph and Telephone Corporation
• Inventors: Kitahara, Masaki, Shimizu, Atsushi, Watanabe, Mayuko
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): Uhl, Lindsay
• Application Number:
  US13/576,620
• Publication Number:
  US 20120307908A1
• Time in Patent Office: 2,493 Days
• CPC Class Codes: H04N 19/52 by predictive encoding
• CPC Class Codes: H04N 19/521 for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
• CPC Class Codes: H04N 19/533 Motion estimation using multistep search, e.g. 2D-log search or one-at-a-time search [OTS]
• CPC Class Codes: H04N 19/56 Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search

Abstract

In a moving picture encoding apparatus, a primary candidate reference motion vector-setting unit sets N primary candidate reference motion vectors. A degree of reliability calculation unit calculates the reliability of each primary candidate reference motion vector, which represents effectiveness in predicting a motion vector of a block to be decoded, using coded or decoded image information. A reference motion vector determination unit selects M (M<N) secondary candidate reference motion vectors in accordance with degree of reliability from among the N primary candidate reference motion vectors. A motion vector prediction unit creates a predictive motion vector of a block to be coded using M secondary candidate reference motion vectors with high reliability.

Claims

1. A motion vector predictive encoding method in a moving picture encoding scheme in which a picture to be encoded is divided into a plurality of blocks and encoding is performed using motion compensation for each of the blocks, the method comprising:

a step of performing a motion search for a block to be encoded in the picture to be encoded using an encoded reference picture to calculate a motion vector;

a step of extracting N (N is an integer equal to or more than

     2) motion vectors including motion vectors used in encoding encoded blocks and motion vectors which designate positions within a predetermined range from a position designated by each of the motion vectors used in encoding the encoded blocks or motion vectors having a predetermined value as primary candidate reference motion vectors;

a step of calculating degrees of reliability of each of the N primary candidate reference motion vectors which quantitatively represent effectiveness in motion vector prediction of the block to be encoded, using a decoded signal of the picture to be encoded for each of the primary candidate reference motion vectors;

a step of selecting top M (M is a predetermined integer greater than or equal to 1 and less than N) primary candidate reference motion vectors with highest degrees of reliability from the N primary candidate reference motion vectors as secondary candidate reference motion vectors; and

a step of setting a secondary candidate reference motion vector having a value nearest the motion vector obtained by the motion search among the secondary candidate reference motion vectors as a predictive motion vector of the block to be encoded, encoding an identifier of the set secondary candidate reference motion vector, and encoding a residual between the motion vector obtained through the motion search of the block to be encoded and the predictive motion vector as encoded information of the motion vector,

wherein the step of calculating degrees of reliability of each of the N primary candidate reference motion vectors using the decoded signal of the picture to be encoded being a different manner from a manner used in the step of setting the secondary candidate reference motion vector as the prediction motion vector of the block to be encoded.

2. The motion vector predictive encoding method according to claim 1, wherein when the number of the highly reliable reference motion vectors is M′

that is smaller than M, M′

highly reliable reference motion vectors are selected as the secondary candidate reference motion vectors.

3. The motion vector predictive encoding method according to claim 1, wherein, in the step of calculating the degrees of reliability of the primary candidate reference motion vectors, a set of encoded pixels adjacent to the block to be encoded is used as a template, an area obtained by shifting an area of the template by a primary candidate reference motion vector on the reference picture is set as an area to be matched, and a degree of similarity between the set of the encoded pixels of the template and a set of pixels in the area to be matched is calculated as a degree of reliability.

4. The motion vector predictive encoding method according to claim 1, wherein, in the step of selecting the secondary candidate reference motion vectors from the N primary candidate reference motion vectors, a plurality of top primary candidate reference motion vectors with higher degrees of reliability are selected as the secondary candidate reference motion vectors.

13. A non-transitory computer readable storage medium which stores a motion vector prediction encoding program for allowing a computer to execute the motion vector predictive encoding method according to claim 1.

5. A motion vector predictive decoding method in a moving picture decoding scheme in which a picture to be decoded of a moving picture being divided into a plurality of blocks and encoded is decoded, using motion compensation for each of the blocks, the method comprising:

a step of decoding a motion vector prediction residual of a block to be decoded;

a step of extracting N (N is an integer equal to or more than

     2) motion vectors including motion vectors used in decoding decoded blocks or motion vectors which designate positions within a predetermined range from a position designated by each of the motion vectors used in decoding the decoded blocks or motion vectors having a predetermined value as primary candidate reference motion vectors;

a step of calculating degrees of reliability of each of the N primary candidate reference motion vectors which quantitatively represent effectiveness in motion vector prediction of the block to be decoded, using a decoded signal of the picture to be decoded for each of the primary candidate reference motion vectors;

a step of selecting top M (M is a predetermined integer greater than or equal to 1 and less than N) primary candidate reference motion vectors with highest degrees of reliability from the N primary candidate reference motion vectors as secondary candidate reference motion vectors; and

a step of setting a secondary candidate reference motion vector corresponding to an identifier designated by an encoding end among the secondary candidate reference motion vectors as a predictive motion vector of the block to be decoded, and adding the predictive motion vector to the decoded motion vector prediction residual to calculate a motion vector of the block to be decoded,

wherein the step of calculating degrees of reliability of each of the N primary candidate reference motion vectors using the decoded signal of the picture to be decoded being a different manner from a manner used in the step of setting the secondary candidate reference motion vector as the prediction motion vector of the block to be decoded.

6. The motion vector predictive decoding method according to claim 5, wherein when the number of the highly reliable reference motion vectors is M′

that is smaller than M, M′

highly reliable reference motion vectors are selected as the secondary candidate reference motion vectors.

7. The motion vector predictive decoding method according to claim 5, wherein, in the step of calculating the degrees of reliability of the primary candidate reference motion vectors, a set of decoded pixels adjacent to the block to be decoded is used as a template, an area obtained by shifting an area of the template by a primary candidate reference motion vector on a decoded reference picture is set as an area to be matched, and a degree of similarity between the set of the decoded pixels of the template and a set of pixels in the area to be matched is calculated as a degrees of reliability.

8. The motion vector predictive decoding method according to claim 5, wherein, in the step of selecting the secondary candidate reference motion vectors from the N primary candidate reference motion vectors, a plurality of top primary candidate reference motion vectors with higher degrees of reliability are selected as the secondary candidate reference motion vectors.

14. A non-transitory computer readable storage medium which stores a motion vector prediction decoding program for allowing a computer to execute the motion vector predictive decoding method according to claim 5.

9. A moving picture encoding apparatus which divides a picture to be encoded into a plurality of blocks and encodes a moving picture using motion compensation for each of the blocks, the apparatus comprising:

a motion search processor programmed to perform a motion search for a block to be encoded in the picture to be encoded using an encoded reference picture to calculate a motion vector;

a primary candidate reference motion vector determination processor programmed to extract N (N is an integer equal to or more than

     2) motion vectors including motion vectors used in encoding encoded blocks or motion vectors which designate positions within a predetermined range from a position designated by each of the motion vectors used in encoding the encoded blocks or motion vectors having a predetermined value as primary candidate reference motion vectors;

a degree of reliability calculation processor programmed to calculate degrees of reliability of each of the N primary candidate reference motion vectors which quantitatively represent effectiveness in motion vector prediction of the block to be encoded, using a decoded signal of the picture to be encoded for each of the primary candidate reference motion vectors;

a reference motion vector determination processor programmed to select top M (M is a predetermined integer greater than or equal to 1 and less than N) primary candidate reference motion vectors with highest degrees of reliability from the N primary candidate reference motion vectors as secondary candidate reference motion vectors; and

a motion vector encoding processor programmed to set a secondary candidate reference motion vector having a value nearest the motion vector obtained by the motion search among the secondary candidate reference motion vectors as a predictive motion vector of the block to be encoded, programmed to encode an identifier of the set secondary candidate reference motion vector, and programmed to encode a residual between the motion vector obtained through the motion search of the block to be encoded and the predictive motion vector as encoded information of the motion vector,

wherein the degrees of reliability of each of the N primary candidate reference motion vectors calculated using the decoded signal of the picture to be encoded by the degree of reliability calculation processor being calculated in a different manner from a manner used in the motion vector encoding processor to set the secondary candidate reference motion vector as the prediction motion vector of the block to be encoded.

10. The moving picture encoding apparatus according to claim 9, wherein the reference motion vector determination processor is programmed to select a plurality of top primary candidate reference motion vectors with higher degrees of reliability from the N primary candidate reference motion vectors as the secondary candidate reference motion vectors.

11. A moving picture decoding apparatus which decodes a picture to be decoded of a moving picture being divided into a plurality of blocks and encoded, using motion compensation for each of the blocks, the apparatus comprising:

an information source-decoding processor programmed to decode a motion vector prediction residual of a block to be decoded;

a primary candidate reference motion vector determination processor programmed to extract N (N is an integer equal to or more than

     2) motion vectors including motion vectors used in decoding decoded blocks or motion vectors which designate positions within a predetermined range from a position designated by each of the motion vectors used in decoding the decoded blocks or motion vectors having a predetermined value as primary candidate reference motion vectors;

a degree of reliability calculation processor programmed to calculate degrees of reliability of each of the N primary candidate reference motion vectors which quantitatively represent effectiveness in motion vector prediction of the block to be decoded, using a decoded signal of the picture to be decoded for each of the primary candidate reference motion vectors;

a reference motion vector determination processor programmed to select top M (M is a predetermined integer greater than or equal to 1 and less than N) primary candidate reference motion vectors with highest degrees of reliability from the N primary candidate reference motion vectors as secondary candidate reference motion vectors; and

a motion vector calculation processor programmed to set a secondary candidate reference motion vector corresponding to an identifier designated by an encoding end among the secondary candidate reference motion vectors as a predictive motion vector of the block to be decoded, and programmed to add the predictive motion vector to the decoded motion vector prediction residual to calculate a motion vector of the block to be decoded,

wherein the degrees of reliability of each of the N primary candidate reference motion vectors calculated using the decoded signal of the picture to be decoded by the degree of reliability calculation processor being calculated in a different manner from a manner used in the motion vector encoding processor to set the secondary candidate reference motion vector as the prediction motion vector of the block to be decoded.

12. The moving picture decoding apparatus according to claim 11, wherein the reference motion vector determination processor is programmed to select a plurality of top primary candidate reference motion vectors with higher degrees of reliability from the N primary candidate reference motion vectors as the secondary candidate reference motion vectors.