Method and apparatus for picture motion measurement whereby two pictures are correlated as a function of selective displacement

• US 4,985,765 A
• Filed: 08/02/1989
• Issued: 01/15/1991
• Est. Priority Date: 09/05/1988
• Status: Expired due to Fees

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Fernando, Gerard M. X.
• Primary Examiner(s): Kostak, Victor R.
• Application Number:
  US07/388,422
• Time in Patent Office: 531 Days
• Field of Search: 358/105, 358/140, 358/138, 358/135, 358/136, 358/180
• US Class Current: 348/699
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: H04N 19/523 with sub-pixel accuracy
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

A region from two frames of a television picture is subjected to Fourier transform in processing stages (3 and 4) one via a picture memory (2), and the resulting transforms compared in a comparator (5) whose output is subjected to inverse Fourier transform in a processing stage (6). The output of comparator (5) is also applied to a sample rate modifier (7) in which this output is enlarged prior to being subjected to inverse Fourier transform in a further processing stage (8). The outputs of processing stages (6 and 8) are respectively low and higher correlation functions to one pixel and one-quarter pixel resolution respectively. A given number, say 20, of sample points of greatest magnitude in the low resolution correlation function are selected in a largest vector selector (9) whose coordinates are used in a peak locator (10) which locates the peaks in the higher resolution correlation function associated with the selected samples to produce coordinates for these peaks to quarter pixel accuracy. A limited number of these, say 10, can be selected by a vector limiter (11) if used with a system having limited data capacity for motion vectors.

Claims

1. A method of picture motion measurement for the production of motion vectors, said method being characterized by the steps of:

(i) correlating two pictures to determine low resolution correlation as a function of displacement thereby to determine sample correlation values to a low resolution,

(ii) correlating said two pictures to determine higher resolution correlation as a function of displacement thereby to determine sample correlation values to a higher resolution,

(iii) determining the positions of a given number of sample points of greatest magnitude in said low resolution correlation function,

(iv) applying the positions found for said given number of sample points to said higher resolution correlation function to identify the corresponding sample points in said higher resolution correlation function,

(v) determining the locations of peaks associated with the said number of sample points in said higher resolution correlation function which locations are defined to sub-sample interval accuracy.

2. A method as claimed in claim 1, wherein the locations of the peaks in said higher resolution correlation function are found by examining the gradients between adjacent higher resolution sample points starting from the said given number of corresponding sample points.

3. A method as claimed in claim 1, wherein sample points in said low resolution correlation function have an interval of one pixel while sample points in said higher resolution correlation function have an interval of one quarter of a pixel.

4. A method as claimed in claim 3, wherein the locations of the peaks in said higher resolution correlation are found by examining the gradients between adjacent higher resolution sample points starting from the said given number of corresponding sample points.

5. A method as claimed in claim 1, wherein said method additionally comprises selecting from the locations of the peaks so found up to a limited number, which limited number is less than said given number, of said locations whose coordinates form said motion vectors.

6. A method as claimed in claim 5, wherein sample points in said low resolution correlation function have an interval of one pixel while sample points in said higher resolution correlation function have an interval of one quarter of a pixel.

7. A method as claimed in claim 5, wherein the locations of the peaks in said higher resolution correlation are found by examining the gradients between adjacent higher resolution sample points starting from the said given number of corresponding sample points.

8. Apparatus for picture motion measurement, comprising means for correlating two pictures to determine low resolution correlation as a function of displacement thereby to determine sample correlation values to a low resolution, means for correlating said two pictures to determine higher resolution correlation as a function of displacement thereby to determine sample correlation values to a higher resolution, means for determining the positions of a given number of sample points of greatest magnitude in said low resolution correlation function, means for applying the positions found for said given number of sample points to said higher resolution correlation function to identify the corresponding sample points in said higher resolution correlation function, and means for determining the locations of peaks associated with the said number of sample points in said higher resolution correlation function which locations are defined to sub-sample interval accuracy.

9. The apparatus of claim 8 wherein the means for determining the locations of peaks associated with the said number of sample points in said higher resolution correlation function comprises means for examining the gradients between adjacent higher resolution sample points starting from said given number of corresponding sample points.

10. The apparatus of claim 8 wherein said sample points and said low resolution correlation function have an interval of one pixel while sample points in said higher resolution correlation function have an interval of one quarter of a pixel.

11. The apparatus of claim 10 wherein the means for determining the locations of peaks associated with the said number of sample points in said higher resolution correlation function comprises means for examining the gradients between adjacent higher resolution sample points starting from said given number of corresponding sample points.

12. Apparatus as claimed in claim 8, further comprising means for selecting from the locations of the peaks so formed up to a limited number, which limited number is less than said given number, of said locations whose coordinates form the motion vectors.

13. The apparatus of claim 12 wherein the means for determining the locations of peaks associated with the said number of sample points in said higher resolution correlation function comprises means for examining the gradients between adjacent higher resolution sample points starting from said given number of corresponding sample points.

14. The apparatus of claim 12 wherein said sample points and said low resolution correlation function have an interval of one pixel while sample points in said higher resolution correlation function have an interval of one quarter of a pixel.

15. The apparatus of claim 14 wherein the means for determining the locations of peaks associated with the said number of sample points in said higher resolution correlation function comprises means for examining the gradients between adjacent higher resolution sample points starting from said given number of corresponding sample points.