Image motion vector detecting apparatus

• US 5,111,511 A
• Filed: 06/16/1989
• Issued: 05/05/1992
• Est. Priority Date: 06/24/1988
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Ishii, Hirofumi, Morimura, Atsushi
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): Cammarata, Michael R.
• Application Number:
  US07/367,366
• Time in Patent Office: 1,054 Days
• Field of Search: 382/1, 382/42, 358/105, 358/125, 358/126
• US Class Current: 382/107
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: H04N 19/523 with sub-pixel accuracy
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

An image motion vector detecting apparatus includes a low-pass filter having a non-zero impulse response for at least one of a delay of a predetermined interval LX in the horizontal direction and a delay of a predetermined interval LY in the vertical direction of input image signals, a memory for storing image signals corresponding to a plurality of representative points arranged at a predetermined horizontal direction interval LX and at a predetermined vertical direction interval LY within a motion vector detection area for input image signals of a given frame, a subtracter for obtaining differences between the stored image signals corresponding to each of the plurality of representative points and input image signals of frames subsequent to the given frame which input image signals correspond to points neighboring each of the plurality of representative point within the motion vector detection area, an adder which adds up the differences thus obtained, a unit for obtaining correlation values for shafts within the motion vector detection area, and a unit for determining a point providing a minimum value among the correlation values, estimating continuous correlation values by making linear interpolation using a correlation value between the minimum value point and four neighboring points in the horizontal direction and the vertical direction of the minimum value point, and detecting a motion vector by calculating a shift quantity which provides a minimum value among the estimated continuous correlation values.

Claims

1. A motion vector detecting apparatus comprising:

a low-pass filter means for receiving and filtering input image signals;

a representative point memory means, receiving an output of said low-pass filter means, for storing image signals corresponding to a plurality of representative points arranged within a motion vector detection area for input image signals of a given frame, said representative points being arranged at a predetermined horizontal direction interval LX and at a predetermined vertical direction interval LY;

a subtraction means, receiving stored image signals from said representative point memory means and the input image signals, for obtaining differences between (i) stored image signals stored in said representative point memory means corresponding to each of said plurality of representative points and (ii) input image signals of frames subsequent to the given frame, said subsequent input image signals corresponding to points neighboring each of said plurality of representative points within the motion vector detection area;

a cumulative addition means, responsive to said subtraction means, for adding up the differences obtained by said subtraction means;

a means for obtaining correlation values for shifts within the motion vector detection area based on said differences added up by said cumulative addition means;

a motion vector outputting means, responsive to said correlation values obtaining means, for determining a point constituting a minimum value among said correlation values and outputting the minimum value point as a motion vector; and

wherein said low-pass filter means has a non-zero impulse response for at least one of a delay of said predetermined horizontal direction interval LX and a delay of said predetermined vertical direction interval LY with respect to said input image signals.

2. A motion vector detecting apparatus according to claim 1, further comprising a high-pass filter means interconnected between said low-pass filter means and said representative point memory means, said high-pass filter means suppressing a DC component and a low frequency component at least in one of the horizontal direction and the vertical direction of the input image signals.

3. A motion vector detecting apparatus comprising:

a low-pass filter means for receiving and filtering input image signals;

a representative point memory means, receiving an output of said low-pass filter means, for storing image signals corresponding to a plurality of representative points arranged within a motion vector detection area for input image signals of a given frame, said representative points being arranged at a predetermined horizontal direction interval LX and at a predetermined vertical direction interval LY;

a subtraction means, receiving stored image signals from said representative point memory means and the input image signals, for obtaining differences between (i) stored image signals stored in said representative point memory means corresponding to each of said plurality of representative points and (ii) input image signals of frames subsequent to the given frame, said subsequent input image signals corresponding to points neighboring each of said plurality of representative points within the motion vector detection area;

a cumulative addition means, responsive to said subtraction means, for adding up the differences obtained by said subtraction means;

a means for obtaining correlation values for discrete shifts of predetermined intervals IX and IY in the horizontal and vertical directions, respectively, within the motion vector detection area based on said differences added up by said cumulative addition means;

a motion vector outputting means, responsive to said correlation values obtaining means, for determining a minimum value point (i'"'"', j'"'"') corresponding to a minimum value among said correlation values, interpolating the correlation values in accordance with an interpolation polynominal by using a correlation value Σ

|Δ

L| between the minimum value point and points neighboring the minimum value point, and outputting, as a motion vector, a minimum value point corresponding to a minimum value among the interpolated correlation values obtained in accordance with the interpolation polynominal; and

wherein said low-pass filter means has a non-zero impulse response for at least one of a delay of said predetermined horizontal direction interval LX and a delay of said predetermined vertical direction interval LY with respect to said input image signals.

4. A motion vector detecting apparatus according to claim 3, further comprising a frequency divider means connected to said low-pass filter means for dividing a sampling frequency of the input image signals by a factor of 1/IX.

5. A motion vector detecting apparatus comprising:

a low-pass filter means for receiving and filtering input image signals;

a representative point memory means, receiving an output of said low-pass filter means, for storing image signals corresponding to a plurality of representative points arranged within a motion vector detection area for input image signals of a given frame, said representative points being arranged at a predetermined horizontal direction interval LX and at a predetermined vertical direction interval LY;

a subtraction means, receiving stored image signals from said representative point memory means and the input image signals, for obtaining differences between (i) stored image signals stored in said representative point memory means corresponding to each of said plurality of representative points and (ii) input image signals of frames subsequent to the given frame, said subsequent input image signals corresponding to points neighboring each of said plurality of representative points within the motion vector detection area;

a cumulative addition means, responsive to said subtraction means, for adding up the differences obtained by said subtraction means;

a means for obtaining correlation values for discrete shifts of predetermined intervals IX and IY in the horizontal and vertical directions, respectively, within the motion vector detection area based on said differences added up by said cumulative addition means;

a motion vector outputting means, responsive to said correlation values obtaining means, for determining a minimum value point (i'"'"', j'"'"') corresponding to a minimum value among said correlation values, obtaining a shift quantity (dx, dy) in accordance with the following equations by using a correlation value Σ

|Δ

L| between the minimum value point and four neighboring points in the horizontal and vertical directions of the minimum value point, and outputting, as a motion vector, a value obtained by further adding the shift quantity (dx, dy) to the minimum value point (i'"'"', j'"'"'), where the equations include ##EQU8## and wherein said low-pass filter has a non-zero impulse response for at least one of a delay of said predetermined horizontal direction interval LX and a delay of said predetermined vertical direction interval LY with respect to said input image signals.