Direct digital airborne panoramic camera system and method

• US 5,604,534 A
• Filed: 05/24/1995
• Issued: 02/18/1997
• Est. Priority Date: 05/24/1995
• Status: Expired due to Term

• Current Assignee: ImageAmerica, Inc. (Alphabet Inc.)
• Original Assignee: Omni Solutions International, Ltd.
• Inventors: Speasl, Jerry A., Hedges, Thomas M., Weir, David G.
• Primary Examiner(s): Tran, Thai Q.
• Assistant Examiner(s): Snow, Frank
• Application Number:
  US08/449,350
• Time in Patent Office: 636 Days
• Field of Search: 348/61, 348/106, 348/113, 348/116, 348/117, 348/135, 348/144, 348/145, 364/449, 395/127
• US Class Current: 348/144
• CPC Class Codes: G01C 11/025 by scanning the object
• CPC Class Codes: G01V 8/10 Detecting, e.g. by using light barriers by reflection from the object G01S17/00
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/6842 by controlling the scanning position, e.g. windowing
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An airborne direct digital panoramic camera system and method in which an in-line electro-optical sensor eliminates the need for photographic film and film transport apparatus normally associated with prior art airborne reconnaissance cameras and yet still retains the very high image resolution quality which is so important in intelligence operations and commercial geographic information systems (GIS), mapping and other remote sensing applications. The system provides a simpler, more efficient and less costly panoramic camera by utilizing a lens in conjunction with the electro-optical line array sensor wherein the lens can be simpler and less expensive than a framing camera because it essentially requires quality focus in only one dimension and by eliminating the burden and delay necessitated in film processing and development. The massive amounts of digital data generated by the camera are compressed and any motion or panoramic errors are easily correctable in the digital data, while such errors were nearly impossible to correct in a cost effective fashion from film images. The compressed digital image data may be stored and retrieved later for utilization in computer type networks or alternatively can be transmitted from the aircraft to a ground station for prompt utilization.

Claims

1. In a direct digital airborne whisk broom-type panoramic camera having an optical system for focusing a ground area to be imaged onto a focal plane, image motion compensation means for correcting aircraft motion during camera operation, a rockably mounted sensor arm for housing a lens and optical train, drive means for moving said sensor arm across the line of flight of the aircraft during camera operation, the improvement comprising:

electro-optical multi-port line array sensor means for converting images of said ground area to be imaged into analog electric image signals having an analog initial image data rate in the order of 150 to 450 million pixel signals per second,

means for fixedly mounting said electro-optical sensor means on said sensing arm at the focal plane of the camera,

image signal processing means for digitizing said analog image signals,

data compression means for compressing said digitized image signals, and

memory means for storing said compressed digitized image signals whereby the overall image data rate is substantially reduced before storage.

2. The improved airborne panoramic camera of claim 1 wherein said electro-optical multi-port line array sensor means comprises a plurality of pixel elements wherein the pixel pitch is in the range of 5 to 20 microns and additionally including buffer memory means for temporarily storing said digitized image signals and for slowing said data rate as a function of a frame duty cycle rate of said camera.

3. The improved airborne panoramic camera of claim 1 wherein said electro-optical multi-port line array sensor means has at least 8 output ports.

4. The improved airborne panoramic camera of claim 1 wherein said electro-optical multi-port line array sensor means comprises a plurality of parallel lines of pixel elements and wherein each of said plurality of parallel lines of pixel elements has a plurality of separate output ports.

5. The improved airborne panoramic camera of claim 4 wherein at least one group of said plurality of pixel lines are arranged in a staggered, overlapping arrangement with at least one of the others of said plurality of lines of pixel elements and wherein the overlapping pixel elements generate like image signals at different time intervals during each frame operation of the camera.

6. The improved panoramic camera of claim 2 wherein said multi-port line array includes a plurality of stages of time domain integration for each pixel element.

7. The improved airborne panoramic camera of claim 1 wherein said mounting means comprises means for mounting a plurality of front-side illuminated charge coupled devices comprising the electro-optical multi-port line array sensor means and for mounting a plurality of image signal amplifiers for amplifying said analog image signals generated by said sensor means.

8. The improved airborne panoramic camera of claim 7 wherein said plurality of image signal amplifiers includes signal conditioning means for performing a correlated double sampling process to reduce noise in the analog image signals.

9. The improved airborne panoramic camera of claim 8 wherein said signal conditioning means includes a plurality of sample-and-hold circuits and an analog subtracting amplifier for reducing noise from said analog image signals.

10. The improved airborne panoramic camera of claim 7 wherein said plurality of front-side illuminated charge couple devices are arranged in a plurality of offset parallel lines.

11. The improved airborne panoramic camera of claim 10 wherein one of said plurality of offset lines overlap operationally with others of said plurality of lines and thus generate like image signals at different times during each frame operation of the camera.

12. The improved airborne panoramic camera of claim 1 wherein the analog image signals have a peak data rate in the order of 300 to 1000 million pixel signals per second and wherein the maximum input data rate of said memory means is in the order of 8 to 32 megabits per second.

13. The improved airborne panoramic camera of claim 1 additionally including leveling buffer memory means for storing digitized image signals at a first data rate and for delivering the digitized image signals from the buffer memory at a second data rate which is substantially lower than said first data rate.

14. The improved airborne panoramic camera of claim 13 wherein said first data rate is in the order of 4000 megabits per second and said second data rate is in the order of 1400 megabits per second, thus effecting a data compression ratio in the order of 3 to 1.

15. The improved airborne panoramic camera of claim 1 wherein a differential data rate between the maximum data rate out of the camera of image signal data and the maximum input data rate for the memory means is in the order of 4000 megabits per second.

16. The improved airborne panoramic camera of claim 15 wherein the camera image signal data rate is in the order of 5000 megabits per second and the input data rate of said memory means is in the order of 4000 megabits per second.

17. The improved airborne panoramic camera of claim 2 additionally including optical filter means functionally associated with said array of pixel elements.

18. The improved airborne panoramic camera of claim 4 additionally including a plurality of optical filter means functionally associated with said pixel elements.

19. The improved airborne panoramic camera of claim 18 where one of said plurality of optical filter means have different spectral response characteristics and additionally including means for selecting ones of said plurality of optical filter means relative to ones of said pixel means.

20. The improved airborne panoramic camera of claim 1 additionally including differential global position system means for determining position data for said sensor arm in terms of latitude and longitude coordinates for each picture frame operation of the camera and data addressing means for tagging digitized image signals corresponding to a particular frame as a function of the determined latitude-longitude coordinate data.

21. The improved airborne panoramic camera of claim 20, additionally including a plurality of parallel data processing path means for processing in parallel segments of the digitized image signals and subframe addressing means for tagging each of said plurality of segments of a frame of image signals with its respective data address.

40. The improved panoramic camera of claim 1 additionally including means for generating latitude/longitude data associated with each initiation of picture frame of camera operation, and

means for tagging each portion of said compressed digital data associated with each frame of camera operation with its associated latitude/longitude data.

42. The improved panoramic camera of claim 1 wherein said sensor means comprises a plurality of parallel lines of sensor elements arrayed in a staggered, overlapped arrangement, and additionally including means for correcting panoramic type errors in said digital image signals as a function of data from said overlapped sensor elements.

22. A method for generating and processing remote image data from a direct digital air-borne panoramic camera having a predetermined frame and picture cycle time of operation comprising the steps of:

generating analog image signals by exposing a multi-output port line array of pixel elements having in the order of 8 to 16 output data ports to illumination from an area to be imaged,

converting said analog image signals into digital image signals,

first reducing the output data rate of said digital image signals as a function of the frame cycle time and picture cycle time of said camera operations,

further reducing the rate of said digital image data by subjecting the digital data to a compression algorithm process, and recording the compressed digital data in a digital memory device whereby the image data rate is substantially reduced before storage.

23. The method of claim 22 wherein the step of first reducing comprises the steps of reading said digital image signals into a digital memory at an input data rate in the order of 4000 megabits per second and reading said stored digital image signals out from said digital memory at an output data rate in the order of 1400 megabits per second.

24. The method of claim 22 further including the steps of

generating a static calibrating data table with unique values for each pixel element,

correcting said digital image signals as a function of said static calibrating data for each pixel element, and further reducing the data rate of said digital image signals by utilizing individual pixel calibration data.

25. The method of claim 22 further including the steps of

generating static calibrating data with data conversion values for each pixel element,

generating dynamic calibrating data with data derived from setup picture data representative of actual mission conditions, and

correcting said digital image signals as a function of a differential between said static calibrating data and said dynamic calibrating data.

26. The method of claim 22 further including the steps of

determining the exact latitude and longitude coordinates for the location of said line array of pixel elements by differential global position system techniques, and

designating a memory storage location for digital image signals for each picture line sub-frame of camera operations as a function of the latitude-longitude coordinates data corresponding to the initiation of each respective picture line sub-frame operation of the camera.

27. The method of claim 26 further including the steps of

determining the exact latitude and longitude coordinates of said pixel element array by triangulation calculations by a global position system receiver located on the airborne platform,

determining an exact position of a predetermined point on the earth by means of triangulation calculation by a global position system receiver located on the ground in the area to be imaged, and

determining the exact location of the ground sample to be imaged at the initiation of a camera photo frame operation by differential triangulation between the data from the airborne global position system receiver and the global position system receiver located on the ground in the area to be imaged.

28. The process of claim 24 including the additional steps of

determining the magnitude of any motion of the pixel element array by comparing the differential outputs of three ADF receivers fixedly mounted on the airborne platform and the output of an inertial guidance system monitoring the motion of said pixel element array, and

correcting any panoramic errors introduced into the digital image signals by any roll, pitch or yaw movements of the airborne platform or pixel element array.

29. The process of claim 28 wherein the step of correcting is within the range of 50 to 200 micro radians.

38. The method of claim 22 additionally including the steps of

generating latitude/longitude coordinate data associated with each frame of camera operation, and

accessing a portion of said compressed digital data stored in said digital memory utilizing said latitude/longitude coordinate data for a specific frame of compressed data.

39. The method of claim 38 wherein the step of accessing includes the step of determining the latitude/longitude data for the center of a frame said compressed data.

41. The method of claim 22 wherein the step of generating analog image signals includes the step of converting image-wise radiation into analog image signals utilizing a plurality of parallel, offset sensor arrays to generate gap image data signals, and additionally including the step of correcting panoramic type errors in said digital image signals as a function of said gap image data.

30. An improved direct digital airborne panoramic camera comprising:

lens means for focusing a ground area to be imaged onto a focal plane,

image motion compensation means for compensating for aircraft motion during camera operations,

a movably mounted sensor arm for housing said lens means,

drive means for moving said sensor arm during camera operation,

multi-port line array sensor means responsive to incident radiation through said lens means for converting images of said ground area into analog electric image signals having an analog output image data rate in the order of 150 to 450 million pixel signals per second,

means for fixedly mounting said sensor means on said sensor arm at the focal plane of the camera,

image signal processing means for digitizing said analog image signals,

data compression means for compressing said digitized image signals, and

memory means for storing said digitized image signals whereby the output data rate of said compressed digitized image signals is substantially reduced before storage.

31. The improved airborne panoramic camera of claim 30 wherein said multi-port line array sensor means comprises a plurality of parallel lines of pixel elements, each line including a plurality of pixel elements wherein the pixel pitch is in the range of 5 to 20 microns.

32. The improved panoramic camera of claim 30 additionally including output controller processor means for controlling the input and output data rate of said memory means.

33. The improved camera of claim 31 wherein each said parallel line of pixel elements of said sensor means includes at least 8 output signal ports.

34. The improved camera of claim 30 wherein said sensor means comprises a plurality of parallel line arrays and wherein at least one line array is arranged in a spaced apart overlapped arrangement with at least another one of said plurality of line arrays.

35. The improved camera of claim 33 wherein at least one of said sensor means comprises an infrared sensing element.

36. The improved camera of claim 30 additionally including a plurality of color filter means for filtering portions of the spectrum of incident radiation passing through said lens means.

37. The improved camera of claim 30 additionally including buffer memory means for storing said digitized image signals at a first data rate and for delivering said digitized image signals from said memory at a second data rate which is substantially lower than said first data rate.