Wide area imaging system and method

• US 9,813,618 B2
• Filed: 11/04/2013
• Issued: 11/07/2017
• Est. Priority Date: 11/02/2012
• Status: Active Grant

• Current Assignee: Diversified Innovations Fund, LLP
• Original Assignee: Diversified Innovations Fund, LLP
• Inventors: Griffis, Andrew J., Powell, Michael B., Howell, Mark J.
• Primary Examiner(s): Li, Tracy Y
• Application Number:
  US14/070,934
• Publication Number:
  US 20140247323A1
• Time in Patent Office: 1,464 Days
• Field of Search: 348 36
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The present invention provides a new and useful paradigm in wide area imaging, in which wide area imaging is provided by a step/dwell/image capture process and system to capture images and produce from the captured images a wide area image. The image capture is by a sensor that has a predetermined image field and provides image capture at a predetermined frame capture rate, and by a motorized step and dwell sequence of the sensor, where image capture is during a dwell, and the step and dwell sequence of the sensor is synchronized with the image capture rate of the sensor.

Claims

1. A wide area imaging system for performing surveillance of an area, comprising a sensor that uses a rotational step/dwell/image capture sequence to capture images of the area under surveillance, wherein the sensor provides image capture of a predetermined image field at a predetermined image capture rate, wherein the said rotational step and dwell motion is by closed-loop motion control, wherein the said step/dwell/image capture sequence is controlled by a processor to synchronize motion in a direction of rotation of the system and image capture to the image capture rate of the sensor, wherein the predetermined image field advances in the direction of rotation as the system rotates, and wherein the captured images are used to produce a wide-area image of the area under surveillance.

2. The system of claim 1, wherein the sensor is located on a movable platform such as a vehicle, and one or more inertial devices measure movement of the platform that affect the wide area image produced from the captured image and produce output that can be used to provide image compensation that is related to such movement of the platform.

3. The system of claim 1, wherein the system is configured to provide surveillance that identifies a human subject in the area under surveillance and includes a means to hail or notify a subject identified in the wide area image of the area under surveillance that the subject'"'"'s presence has been detected.

4. The system of claim 1, wherein a processor uses object detection on the wide area image or the frame captures that produce the image capture, to extract and localize objects of interest in the wide area image.

5. The system of claim 1, wherein the system is configured to provide variable closed-loop motion controlled step and dwell sequences of the sensor, to produce the wide area image.

6. The system of claim 1, wherein the system is configured to provide variable closed-loop motion controlled step and dwell sequences of the sensor, to enable the processor to localize the sensor on selected image fields in the area under surveillance.

7. The system of claim 1, wherein the system is configured to provide an image stitch step that is processor controlled and designed to combine position encoder and/or inertial data with images captured by the sensor in a manner that produces the wide area image.

8. The system of claim 1, wherein the step/dwell/image capture sequence is configured to synchronize the initiation of frame capture by the sensor to a position to which the sensor is selectively moved under servo motor control.

9. The system of claim 8, wherein the step/dwell/image capture sequence is configured to synchronize movement of the sensor to a selected position to the timing with which the sensor is controlled to initiate frame capture.

10. The system of claim 1, wherein a processor is configured to use successive hypothesis testing of detected objects in the wide area image to determine the step and dwell sequences of the sensor.

11. The system of claim 1, wherein the sensor is configured to produce image capture in a manner that is useful in producing high density imagery in the wide area image.

12. The system of claim 1, wherein the system is coupled to a control center via an interface and is configured to allow the control center access to subsets of the captured images, via the interface.

13. The system of claim 1, wherein the sensor is configured with one of the following sensing techniques:

infrared, visible or other wavelengths to form an image using sensor pixels, including the collection of multiple wavelength images at the same time (multiple FPAs) such that wide area images from multiple wavelengths are generated at the same time, either individually or as wide area images generated by combining multiple wavelength wide area images into a single wide area image.

14. The system of claim 1, wherein the system is configured to store image data produced from the step/dwell/image capture sequence, and to use the stored image data as a reference for comparison with image data produced from a subsequent step/dwell/image capture sequence.

15. The system of claim 1, wherein the system is configured to estimate the size and range of an object produced in a wide area image.

16. The system of claim 1, wherein the system includes an RF transceiver, and the system is configured to provide a synthetic aperture radar (SAR) using step/dwell/image capture sequence with the transceiver.

17. The system of claim 1, wherein the system is configured to process the wide area image data from the step/dwell/image capture sequence to detect the presence of an object and the predetermined state characteristics of the object.

18. The system of claim 1, wherein the lens used to form an image on an FPA is constructed of one or more anamorphic elements or is a zoom lens having its predetermined field of view set by a processor.

19. The system of claim 1, wherein a plurality of sensors is used to form one or more wide area images.

20. The system of claim 1, wherein physical attributes, including apparent temperature and patterns of observed apparent temperature, of objects imaged by the invention are detected and measured over time.

21. The system of claim 1, wherein a processor uses object tracking on the wide area image or the individual images of which it is comprised, to record the behavior of one or more objects of interest in one or more wide area images.

22. A wide area imaging method for performing surveillance of an area, comprising operating a sensor that uses a rotational step/dwell/image capture sequence to capture images of the area under surveillance, wherein the sensor provides image capture of a predetermined image field at a predetermined image capture rate, wherein the said rotational step and dwell motion is by closed-loop motion control, wherein the said step/dwell/image capture sequence is controlled by a processor to synchronize motion in a direction of rotation of the system and image capture to the image capture rate of the sensor, wherein the predetermined image field advances in the direction of rotation as the system rotates, and wherein the captured images are used to produce a wide-area image of the area under surveillance.

23. The method of claim 22, wherein the sensor is located on a moveable platform such as a vehicle, and movements of the platform under closed-loop motion control that enable the sensor to scan the area under surveillance and affect the wide area image produced from the captured image are measured and used to provide image compensation that is related to such movements of the platform.

24. The method of claim 22, which is further configured to provide surveillance that identifies a human subject in the area under surveillance and to hail or notify a human subject identified in the wide area image that his/her presence has been detected.

25. The method of claim 22 wherein the step/dwell/image capture sequence that is under closed-loop motion control synchronizes the initiation of image capture by the sensor to a position to which the sensor is selectively moved under servo motor control.

26. The method of claim 25, wherein the step/dwell/image capture sequence also synchronizes movement of the sensor to a selected position to the timing with which the sensor is controlled to initiate image capture.