Digital image motion correction method

• US 4,654,876 A
• Filed: 12/19/1984
• Issued: 03/31/1987
• Est. Priority Date: 12/19/1984
• Status: Expired due to Fees

• Current Assignee: ITEQ Corporation
• Original Assignee: ITEQ Corporation
• Inventors: Atkins, Arland A.
• Primary Examiner(s): Birmiel, Howard A.
• Application Number:
  US06/683,831
• Time in Patent Office: 832 Days
• Field of Search: 382/54, 382/34, 382/44, 382/42, 358/109, 358/105
• US Class Current: 382/236
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

A method of image motion distortion correction involving the steps of electronically scanning an optical image to produce first and second lines of stored digital pixel data indicative of the intensity of picture elements of the optical image, registering within a corresponding scanning window position the difference between each second line picture element value of a number of sets of second line picture elements, and a number of first individual line picture elements, each corresponding to an associated set, thereafter utilizing that particular window position having the minimum accumulated difference value to produce an image shift signal having a value corresponding to that particular window position, shifting the storage position of the second line with respect to the first line by an amount proportional to the value of the shift signal, and utilizing the shifted lines of data to modulate an image producing readout device such as a CRT to reproduce the optical image.

Claims

1. A method of enabling the transformation of the position of a second line of image data with respect to a first line of image data comprising the steps of:

a. defining a scanning window having a first, second and nth position therein corresponding to a first, second and nth position of sets of first, second and nth second line picture elements scanned by said window, n being an integer;

b. registering data indicative of the differences between second line picture element values of a first set of second line picture elements and the picture element value of a first picture element of said first line;

c. registering data indicative of the differences between second line picture element values of a second set of second line picture elements and the picture element value of a second picture element of said first line, and so forth with respect to subsequent sets of second line picture elements and other first line picture elements scanned by said window;

d. identifying that particular window position having data associated therewith indicative of the minimum accumulated differences upon the completion of steps b and c; and

e. utilizing said particular window position identified in accordance with step d to produce an image shift signal having a value corresponding to said particular window position identified in accordance with step d.

2. The method of claim 1 including the step of shifting the position of said second line with respect to said first line by an amount proportional to the value of said image shift signal.

3. The method of claim 2 wherein said image shift signal is stored along with said second line picture elements to tag said second line for later image shifting.

4. The method of claim 1, 2, or 3 wherein the steps thereof are repeated with respect to subsequent lines of picture elements until an entire image frame is processed.

5. The method of claim 1, 2, or 3 wherein said picture elements are pixels.

6. The method of claim 1, 2, or 3 wherein said picture elements are sub-pixels produced by interpolation of pixels.

7. The method of claim 4 wherein said picture elements are sub-pixels produced by interpolation of pixels.

22. The method of claims 1, 2, 3, 8, 9, 10, 15, 16 or 17 wherein adjacent sets of said second line picture elements have picture elements in common.

8. A method of enabling the transformation of the position of a second line of image data with respect to a first line of image data comprising the steps of:

a. defining a scanning window having a first, second and nth position therein corresponding to a first, second and nth position of sets of first, second and nth second line picture elements scanned by said window, n being an integer;

b. registering within a corresponding window position the difference between each second line picture element value of a first set of second line picture elements and the picture element value of a first picture element of said first line;

c. registering within a corresponding window position the difference between each second line picture element value of a second set of second line picture elements and the picture element value of a second picture element of said first line, and so forth with respect to subsequent sets of second line picture elements and other first line picture elements;

d. identifying that particular window position having the minimum accumulated difference value upon the completion of steps b and c; and

e. utilizing said particular window position identified in accordance with step d to produce an image shift signal having a value corresponding to said particular window position identified in accordance with step d.

9. The method of claim 8 including the step of shifting the position of said second line with respect to said first line by an amount proportional to the value of said shift signal.

10. The method of claim 9 wherein said image shift signal is stored along with said second line picture elements to tag said second line for later image shifting.

11. The method of claim 8, 9, or 10 wherein the steps thereof are repeated with respect to subsequent lines of picture elements until an entire image frame is processed.

12. The method of claim 8, 9, or 10 wherein said picture elements are pixels.

13. The method of claim 8, 9, or 10 wherein said picture elements are sub-pixels produced by interpolation of pixels.

14. The method of claim 11 wherein said picture elements are sub-pixels produced by interpolation of pixels.

15. A method of enabling the transformation of the position of a second line of image data with respect to a first line of image data comprising the steps of:

a. defining a scanning window having a first, second and nth position therein corresponding to a first, second and nth position of sets of first, second and nth second line picture elements scanned by said window, n being an integer;

b. comparing each picture element value of a first set of second line picture elements with a first picture element of said first line and determining which window position has the minimum difference value and registering a correlation signal corresponding to that particular window position having the minimum difference value;

c. repeating step b with respect to second and subsequent sets of second line picture elements and corresponding differing individual picture elements of said first line;

d. thereafter identifying which particular window position has registered the maximum number of correlation signals; and

e. generating a shift signal having a value corresponding to the identification of said particular window position, identified in accordance with step d.

16. The method of claim 15 including the step of shifting the position of said second line with respect to said first line to the extent indicated by the value of said shift signal.

17. The method of claim 16 wherein said image shift signal is stored along with said second line picture elements to tag said second line for later image shifting.

18. The method of claim 15, 16, or 17 wherein the steps thereof are repeated with respect to subsequent lines of picture elements until an entire image frame is processed.

19. The method of claim 15, 16, or 17 wherein said picture elements are pixels.

20. The method of claim 15, 16, or 17 wherein said picture elements are sub-pixels produced by interpolation of pixels.

21. The method of claim 18 wherein said picture elements are sub-pixels produced by interpolation of pixels.

23. A method of enabling the transformation of the position of a second line of image data with respect to a first line of image data comprising the steps of:

a. scanning an optical image to produce said first and second line of image data indicative of the intensity of picture elements of said optical image;

b. defining a scanning window having a first, second and nth position therein corresponding to a first, second and nth position of sets of first, second and nth second line picture elements scanned by said window, n being an integer;

c. registering within a corresponding window position the difference between each second line picture element value of a first set of second line picture elements and the picture element value of a first picture element of said first line;

d. registering within a corresponding window position the difference between each second line picture element value of a second set of second line picture elements and the picture element value of a second picture element of said first line, and so forth with respect to subsequent sets of second line picture elements and other first line picture elements;

e. identifying that particular window position having the minimum accumulated difference value upon the completion of steps b and c;

f. utilizing said particular window position identified in accordance with step d to produce an image shift signal having a value corresponding to said particular window position identified in accordance with step d;

g. shifting the position of said second line with respect to said first line by an amount proportional to the value of said shift signal; and

h. utilizing the lines of data shifted in accordance with step g to modulate an image producing readout device to reproduce said optical image.

24. The method of claim 23 wherein said picture elements are pixels.

25. The method of claim 23 wherein said picture elements are sub-pixels produced by interpolation of pixels.

26. The method of claim 23, 24 or 25 wherein adjacent sets of said second line picture elements have picture elements in common.

27. A method of enabling the transformation of the position of a second line of image data with respect to a first line of image data comprising the steps of:

a. scanning an optical image to produce said first and second line of image data indicative of the intensity of picture elements of said optical image;

b. defining a scanning window having a first, second and nth position therein corresponding to a first, second and nth position of sets of first, second and nth second line picture elements scanned by said window, n being an integer;

c. comparing each picture element value of a first set of second line picture elements with a first picture element of said first line and determining which window position has the minimum difference value, and registering a correlation signal corresponding to that particular window position having the minimum difference value;

d. repeating step b with respect to second and subsequent sets of second line picture elements and corresponding differing individual picture elements of said first line;

e. thereafter identifying which particular window position has registered the maximum number of correlation signals;

f. generating a shift signal having a value corresponding to the identification of said particular window position, identified in accordance with step e;

g. shifting the position of said second line with respect to said first line to the extent indicated by the value of said shift signal; and

h. utilizing the lines of data shifted in accordance with step g to modulate an image producing readout device to reproduce said optical image.

28. The method of claim 27 wherein said picture elements are pixels.

29. The method of claim 27 wherein said picture elements are sub-pixels produced by interpolation of pixels.

30. The method of claim 27, 28 or 29 wherein adjacent sets of said second line picture elements have picture elements in common.