Motion detection and image acquisition apparatus and method of detecting the motion of and acquiring an image of an object

• US 5,588,067 A
• Filed: 02/19/1993
• Issued: 12/24/1996
• Est. Priority Date: 02/19/1993
• Status: Expired due to Fees

• Current Assignee: Fred M. Peterson, James A. Yee
• Original Assignee: Fred M. Peterson, James A. Yee
• Inventors: Peterson, Fred M., Yee, James A.
• Primary Examiner(s): Couso, Jose L.
• Assistant Examiner(s): Bella, Matthew C.
• Application Number:
  US08/019,847
• Time in Patent Office: 1,404 Days
• Field of Search: 382/41, 382/42, 382/278, 382/197, 382/280, 382/103, 382/107, 348/352, 348/431, 348/154, 348/97, 348/47, 348/129, 348/134, 348/139, 348/142, 348/350, 348/700, 348/701
• US Class Current: 382/103
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

An image acquisition device for microfiche images which uses solid state sensor and supporting electronics to continuously digitize the image at high frame rates, and uses the correlation function of the current frame with respect to the previously saved reference frame to derive the image motion vector, keeping only frames whose image motion vector indicates motion of more than 1 unit of resolution, and reconstruct the acquired image as a mosaic of the save image frames and its associated motion vector.

Claims

1. Apparatus for capturing images of a record of micro-images, the record of micro-images including non-sparse images, the apparatus comprising:

image acquisition means for repeatedly acquiring and at least temporarily storing successive non-sparse images from the record of micro-images;

the image acquisition means including an area sensor disposed to receive light from the non-sparse images;

and the apparatus further including a second sensor disposed to receive light from the record of micro-images, the second sensor being operatively connected to the storage means for supplying images to the storage means;

correlation means for correlating successive non-sparse images from the record of micro-images to create a correlation matrix and determine if motion of the record of micro-images has occurred between successive images of the record of micro-images;

the correlation means including means to;

(i) calculate the Fourier transform of the correlation matrix to produce a phase spectrum, the Fourier transform defining a frequency space having axes and the phase spectrum defining a plane in the frequency space; and

(ii) calculate the degree of movement of the current image from the reference image using the projection of the plane onto the axes of the frequency space; and

storage means for permanently storing an image of the record of micro-images when motion has occurred between successive images.

2. The apparatus of claim 1 in which the non-sparse image is created by a reference grid superimposed on the record of micro-images in which the grid is sufficiently dense that elements of the grid appear in every areal subset of the record of micro-images from which the reference and current digital signals are obtained.

3. The apparatus of claim 1 in which:

the second sensor is a linear sensor.

4. The apparatus of claim 1 in which:

the second sensor is a linear sensor;

the area sensor operates at wavelengths outside of the visible light range;

the reference grid is formed from a material that is opaque at the wavelengths at which the area sensor operates; and

the reference grid is not visible to the linear sensor.

5. The apparatus of claim 4 in which the reference grid is out of the focal plane of the linear sensor.

6. A method of controlling a device using an area sensor to detect motion of an object, the method comprising the steps of:

repeatedly acquiring and at least temporarily storing successive electronic images of at least a non-sparse part of the object, the successive electronic images including at least a reference electronic image and a current electronic image;

correlating the reference electronic image with the current electronic image in a computing device to determine if motion has occurred between them including the steps of;

(a) correlating the electronic reference image with the current electronic image to yield a correlation matrix;

(b) calculating the Fourier transform of the correlation matrix to produce a phase spectrum, the Fourier transform defining a frequency space having axes and the phase spectrum defining a plane in the frequency space; and

(c) calculating the degree of movement of the current electronic image from the reference electronic image using the projection of the plane onto the axes of the frequency space;

producing control signals upon calculating the degree of movement of the current electronic image from the reference electronic image; and

providing the control signals to a controller to control operation of the device using the control signals.

7. The method of claim 6 in which the device has a field of view and the object is in the field of view of the device.

8. The method of claim 6 further including storing a signal representing the degree of movement of the object.

9. The method of claim 6 further including:

permanently storing an electronic image of the object when motion of the object has occurred.

10. The method of claim 9 further including calculating the velocity of the object by dividing the degree of movement by the sampling interval between the current electronic image and the reference electronic image.

11. The method of claim 9 in which:

the successive electronic images are acquired using an area sensor and the electronic image that is permanently stored is acquired using a second sensor.

12. The method of claim 11 in which the second sensor is a linear sensor.

13. Apparatus for controlling a device using an area sensor to detect motion of an object, the apparatus comprising:

an area sensor for repeatedly acquiring and at least temporarily storing successive electronic images of at least a non-sparse part of the object, the successive electronic images including at least a reference electronic image and a current electronic image;

computing means connected to receive signals from the area sensor for correlating the reference electronic image with the current electronic image to determine if motion has occurred between the reference electronic image and the current electronic image including;

(a) means for correlating the electronic reference image with the current electronic image to yield a correlation matrix;

(b) means for calculating the Fourier transform of the correlation matrix to produce a phase spectrum, the Fourier transform defining a frequency space having axes and the phase spectrum defining a plane in the frequency space; and

(c) means for calculating the degree of movement of the current electronic image from the reference electronic image using the projection of the plane onto the axes of the frequency space;

an interface for producing control signals upon calculating the degree of movement of the current electronic image from the reference electronic image; and

a controller operatively connected to the interface and the device to control operation of the device using the control signals.

14. The apparatus of claim 13 in which the device has a field of view and the object is in the field of view of the device.

15. The apparatus of claim 14 in which the device is a linear sensor.

16. The apparatus of claim 15 further including:

a memory for permanently storing an electronic image of the object produced by the linear sensor when motion of the object has occurred.

17. The apparatus of claim 16 in which the object is a record of micro-images.

18. The apparatus of claim 17 further including a non-sparse device immobilized in relation to the record of micro-images.

19. The apparatus of claim 13 further including a memory containing a signal representing the degree of motion of the object.

20. A method of controlling a device using an area sensor to detect motion of an object, the method comprising the steps of:

repeatedly acquiring with an area sensor and at least temporarily storing successive electronic images of only a non-sparse areal subset of the object, the successive electronic images including at least a reference electronic image and a current electronic image;

determining when movement has occurred between successive images of the object by correlation of the reference electronic image with the current electronic image and producing a control signal when movement has occurred;

correlation of the reference electronic image and the current electronic image including;

(a) correlating the electronic reference image with the current electronic image to yield a correlation matrix;

(b) calculating the Fourier transform of the correlation matrix to produce a phase spectrum, the Fourier transform defining a frequency space having axes and the phase spectrum defining a plane in the frequency space; and

(c) calculating the degree of movement of the current electronic image from the reference electronic image using the projection of the plane onto the axes of the frequency space; and

providing the control signals to a controller to control operation of the device using the control signals.

21. A method of controlling a device using an area sensor to detect motion of an object, the device having a field of view and the object being in the field of view of the device, the method comprising the steps of:

repeatedly acquiring with an area sensor and at least temporarily storing successive electronic images of only a non-sparse areal subset of the object, the successive electronic images including at least a reference electronic image and a current electronic image;

determining when movement has occurred between successive images of the object by correlation of the reference electronic image with the current electronic image and producing a control signal when movement has occurred;

providing the control signals to a controller to control operation of the device using the control signals; and

permanently storing an electronic image of the object by acquiring the electronic image using a second sensor when motion of the object has occurred.

22. The method of claim 21 in which the second sensor is a linear sensor.

23. The method of claim 21 in which the object is a record of micro-images and further including moving the object through the field of view of the area sensor and the second sensor.

24. The method of claim 23 in which the area sensor is focused on a grid superimposed on the record of micro-images in which the grid is sufficiently dense that elements of the grid appear in every areal subset of the record of micro-images from which the reference and current electronic signals are obtained.

25. The method of claim 24 further including reconstructing the record of micro-images from the images acquired with the second sensor and the degree of motion of the record of micro-images.

26. The method of claim 23 in which the second sensor is a linear sensor.

27. Apparatus for controlling a first sensor using an area sensor to detect motion of an object, the first sensor having a field of view and the object being observable in the field of view of the first sensor, the apparatus comprising:

an area sensor for repeatedly acquiring and at least temporarily storing successive electronic images of only a non-sparse areal subset of the object, the successive electronic images including at least a reference electronic image and a current electronic image;

a computer connected to receive electronic images from the area sensor for determining when movement has occurred between successive images of the object by correlation of the reference electronic image with the current electronic image;

an interface operatively connected to the computer for producing control signals when movement has occurred between successive images; and

a controller operatively connected to the interface and the first sensor to control operation of the first sensor using the control signals.

28. The apparatus of claim 27 further including:

a memory for permanently storing an electronic image of the object produced by the second sensor when motion of the object has occurred.

29. The apparatus of claim 28 in which the object is a record of micro-images.

30. The apparatus of claim 29 in which the second sensor is a linear sensor.

31. The apparatus of claim 29 in which the area sensor is focused on a grid superimposed on the record of micro-images in which the grid is sufficiently dense that elements of the grid appear in every areal subset of the record of micro-images from which the reference and current electronic images are obtained.

32. The apparatus of claim 29 in which:

the second sensor is a linear sensor;

the area sensor operates at wavelengths outside of the visible light range;

the reference grid is formed from a material that is opaque at the wavelengths at which the area sensor operates; and

the reference grid is not visible to the linear sensor.

33. The apparatus of claim 32 in which the reference grid is out of the focal plane of the linear sensor.

34. The apparatus of claim 29 further including a non-sparse device immobilized in relation to the record of micro-images, the area sensor is focused on the non-sparse device and the second sensor is a linear sensor is focused on the object.

35. The apparatus of claim 27 further including a memory containing a signal representing the degree of motion of the object.