Maskable bilevel correlators

• US 5,020,113 A
• Filed: 08/08/1988
• Issued: 05/28/1991
• Est. Priority Date: 08/08/1988
• Status: Expired due to Fees

• Current Assignee: Raytheon Company (Rtx Corporation)
• Original Assignee: Hughes Aircraft Company (Rtx Corporation)
• Inventors: Simoni, Wayne P., Hosokawa, Kazuo R., Lee, Leonard A., Quan, Andy L., Karlin, Lynne M., Nguyen, Harrison, Lo, Thomas K., Sacks, Jack M.
• Primary Examiner(s): Moore, David K.
• Assistant Examiner(s): Mancuso, Joseph
• Application Number:
  US07/229,407
• Time in Patent Office: 1,023 Days
• Field of Search: 382/42, 382/32, 382/33, 364/728.03, 364/728.05, 364/819, 364/820, 364/822
• US Class Current: 382/209
• CPC Class Codes: G06F 17/153 Multidimensional correlation or convolution
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 19/43 Hardware specially adapted for motion estimation or compensation
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation

Abstract

A method and apparatus for correlating two signals representing a live image and a reference image are disclosed. The reference signal is processed to provide a polarity bit and mask bit for each pixel position in the reference image. The processed video signal is stored in a memory 20 and used in a convolver and summer section 18 in which the polarity bits between the reference and live images are gated by gate 17 and are used in generating a correlation output from summer 23. However, the polarity bits do not affect the correlation output if the logical output from gate 19 is of a given state which occurs if the associated mask bits indicate that the gradient value at the particular pixel position does not exceed certain minimum threshold values.

Claims

1. In a method of correlating two input signals associated with a live image and a reference image, the improvement which includes the steps of:

(a) processing at least the reference image associated signal to provide a polarity bit and a mask bit for each pixel position therein, the value of the mask bit being one digital state defining an off condition if the amplitude of the signal falls between two preselected threshold levels thereby substantially filtering out noisy pixels with amplitudes between the two threshold levels, and being of an opposite state defining an on condition if the amplitude is outside of the threshold levels, the value of the polarity bit being one digital state if the amplitude is positive with respect to a predetermined reference level and being of an opposite state if the amplitude is negative with respect to a predetermined reference level at that pixel position; and

(b) using the polarity and mask bits of the processed reference signal to generate a correlation output wherein the pixel positions with a mask bit in the on condition are used in the correlation while the pixel positions with a mask bit in the off condition are not used in the correlation process, thereby producing a correlation output that is minimally affected by noise in the input signal.

3. The method of claim 1 wherein a signal representing a live image is also similarly processed, with step (b) including the step of logically gating the polarity bits of the processed reference and live signals, and using the output thereof to generate a correlation function unless masked by associated mask bits in the off condition.

4. The method of claim 3 wherein the polarity bits are gated in an EXCLUSIVE-OR gate.

5. The method of claim 4 wherein the output of the EXCLUSIVE-OR gate is coupled to an input of a NOR gate, another input of the NOR gate being coupled for receipt of the mask bit of the reference signal.

6. The method of claim 5 wherein the output of the NOR gate is coupled to a summer for summing the number of logical ones from the NOR gate, the output of the summer providing an output which will peak when the live image is correlated with the reference image.

2. The method of claim wherein step (b) includes measuring the density of mask bits defining the on condition;

and

using those regions in the reference image with the highest density of such mask bits to correlate against the live image.

7. A method of correlating two gradient image signals associated with a live image and a reference image, the method comprising the steps of:

(a) processing the reference gradient image associated signal to provide a polarity bit and mask bit for each pixel position in the reference image, the value of the mask bit being of one digital state defining an off condition if the amplitude of the signal falls between two preselected threshold levels, thereby substantially filtering out noisy pixels with amplitudes between the two threshold levels and being an opposite state defining an on condition if the amplitude is outside of the threshold levels, the value of the polarity bit being one digital state if the amplitude is positive with respect to a predetermined reference level and being of an opposite state if the amplitude is negative with respect to a predetermined reference level at that pixel position;

(b) processing the live gradient image associated signal to provide a polarity bit and a mask bit for each pixel position in the live image, the value of the mask bit being one digital state defining an off condition if the amplitude of the signal falls between two preselected threshold levels, thereby substantially filtering out noisy pixels with amplitudes between the two threshold levels and being of an opposite state defining an on condition if the amplitude is outside of the threshold levels, the value of the polarity bit being one digital state if the amplitude is positive with respect to a predetermined reference level and being assigned an opposite state if the amplitude is negative with respect to a predetermined reference level at that pixel position; and

(c) using the polarity bits and mask bits of the processed reference and live images to generate a correlation function wherein the pixel positions with a mask bit in the on condition are used in the correlation while the pixel positions with a mask bit in the off condition are not used in the correlation process thereby producing a correlation output that is minimally affected by noise in the input signals.

8. The method of claim 7 wherein step (c) includes the step of logically gating the polarity bits of the processed reference and live images while ignoring the result if the associated mask bit in the reference image defines said off condition.

9. The method of claim 8 wherein the polarity bits are gated in an EXCLUSIVE-OR gate.

10. THe method of claim 9 wherein the output of the EXCLUSIVE-OR gate is coupled to an input of a NOR gate, another input of the NOR gate being coupled for receipt of the mask bit of the processed reference image.

11. The method of claim 10 wherein the output of the NOR gate is coupled to a summer for summing the number of logical ones from the NOR gate, the output of the summer providing an output which will peak when the live image is correlated with the reference image.

12. In an apparatus for correlating two input signals associated with a live image and a reference image, the improvement comprising:

(a) first means for processing at least the reference image associated signal to provide a polarity bit and a mask bit for each pixel position therein, the value of the mask bit being one digital state defining an off condition of the amplitude of the signal falls between two preselected threshold levels, thereby substantially filtering out noisy pixels with amplitudes between the two threshold levels, and being of an opposite state defining an on condition if the amplitude is outside the threshold levels, the value of the polarity bit being one digital state if the amplitude is positive with respect to a predetermined reference level and being of an opposite state if the amplitude is negative with respect to a predetermined reference level at that pixel position; and

(b) second means for using the polarity and mark bits of the processed reference signal to generate a correlation output wherein the pixel positions with a mask bit in the on condition are used in the correlation while the pixel positions with a mask bit in the off condition are not used in the correlation process thereby producing a correlation output that is minimally affected by noise in the input signal.

13. The apparatus of claim 12 which further comprises:

means for measuring the density of mask bits defining the on condition; and

means for using those regions in the reference image with the highest density of such mask bits to correlate against the live image.

14. The apparatus of claim 12 wherein the means for processing also similarly processes the live image;

and

wherein the second means logically gates the polarity bits of the processed reference and live signals to provide an output, the output being used to generate a correlation function unless masked by associated mask bits in the off condition.

15. The apparatus of claim 14 wherein an exclusive-OR gate is used to gate the polarity bits.

16. The apparatus of claim 15 wherein an output of the exclusive-OR gate is coupled to an input of a NOR gate, another input of the NOR gate being coupled for receipt of the mask bit of the reference signal.

17. The apparatus of claim 16 wherein an output of the NOR gate is coupled to a summer for summing the number of logical ones from the NOR gate, the output of the summer providing an output which will peak when the live image is correlated with the reference image.

18. A bilevel correlator for correlating an input signal associated with a live image and an input signal associated with a reference image of a scene, said bilevel correlator comprising:

means for defining a mean gradient amplitude for the scene;

positive threshold value means for defining a positive threshold value above the means gradient amplitude;

negative threshold value means for defining a negative threshold value below the means gradient amplitude;

preprocessing means for generating a polarity bit and a mask bit for each pixel position in the reference image, the value of the polarity bit being a logical one if the amplitude of the reference image input signal is above the means gradient amplitude and being a logical zero value if the amplitude of the input signal is below the means gradient amplitude, said preprocessing means also providing the mask bit with a value of zero if the amplitude of the input signal falls between said positive threshold value and the negative threshold value, with the value of the mask bit being a logical one if the amplitude of the input signal is above the positive threshold value or below the negative threshold value;

said preprocessing means further generating a polarity bit and a mask bit for each pixel position in the live image, the value of the polarity bit being a logical one if the amplitude of the live image input signal is above the means gradient amplitude and being a logical zero value if the amplitude of the input signal is below the mean gradient amplitude, said preprocessing means also providing the mask bit with a value of zero if the amplitude of the input signal falls between said positive threshold value and the negative threshold value, with the value of the mask bit being a logical one if the amplitude of the input signal is above the positive threshold value or below the negative threshold value;

gating means for generating a logical output signal as a function of a comparison of the polarity bits for given pixel positions of the reference and live images;

means for masking said logical output signal if the mask bit for the given pixel position is a logical zero thereby indicating that the amplitude of the input signal at that pixel position is relatively small; and

summation means or summing together the unmasked logical output signals of the gating means to provide a correlation function that is minimally affected by noise in the input signal.