Electro-optical imaging array with motion compensation

• US 5,155,597 A
• Filed: 11/28/1990
• Issued: 10/13/1992
• Est. Priority Date: 11/28/1990
• Status: Expired due to Term

• Current Assignee: Goodrich Corporation (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Recon/Optical, Inc. (Bourns Incorporated)
• Inventors: Lund, John A., Pfister, William R., Beran, Stephen R., Lareau, Andre G.
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Metjahic, Safet
• Application Number:
  US07/619,219
• Time in Patent Office: 685 Days
• Field of Search: 358/222, 358/109, 358/108, 358/209, 358/213.11, 358/213.24, 358/213.31, 358/213.25, 358/213.28, 358/212, 358/213.19, 358/213.27, 358/213.26 , 358/213.29, 358/87, 358/88, 357/24 LR, 250/578.1
• US Class Current: 348/311
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/53 Control of the integration time
• CPC Class Codes: H04N 25/625 for the control of smear
• CPC Class Codes: H04N 25/71 Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
• CPC Class Codes: H04N 25/713 Transfer or readout registers; Split readout registers or multiple readout registers
• CPC Class Codes: H04N 3/1568 for disturbance correction or prevention within the image-sensor, e.g. biasing, blooming, smearing correction circuits H04N25/62
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An electro-optical area array reconnaissance detector is disclosed which accomplishes forward motion compensation electronically and without moving parts. The array is made of photo-sensitive cells arranged in rows and columns, the columns being organized into one or more column groups. Charge packets collected in the cells representing scene information are transferred down the columns at the same rate as the image motion in the plane of the array. In a side oblique reconnaissance scenario, the columns may be organized into 16 column groups, each column group having its own charge transfer rate corresponding to the image motion rate in that column group.

Claims

1. Apparatus for processing pixel information representing an image of a scene comprising at least a first image portion and a second image portion occurring simultaneously, said apparatus compensating for image motion in a predetermined direction and comprising:

an array of cells arranged in rows and columns capable of storing at least said pixel information corresponding to said first image portion in a first column of said columns and for storing said pixel information corresponding to said second image portion in a second column of said columns; and

column transfer means for transferring pixel information corresponding to said first image portion in said first column at a first predetermined transfer rate and for transferring pixel information corresponding to said second image portion in said second column at a second predetermined transfer rate different from said first predetermined transfer rate, whereby resolution of an image created from the pixels can be preserved.

2. Apparatus, as claimed in claim 1, and further comprising:

adjusting means for adjusting said predetermined transfer rate depending on the changes in rates of motion of said at least first and second image portions relative to said array.

3. Apparatus, as claimed in claim 2, and further comprising imaging means for placeng said image on said array.

4. Apparatus, as claimed in claim 3, and further comprising a shutter for enabling said imaging means to place said image on said array during a predetermined exposure time period, and wherein said column transfer means is operative during said predetermined exposure time period.

5. Apparatus, as claimed in claim 1, wherein said array comprises a charge-coupled device.

6. Apparatus, as claimed in claim 2, wherein said column transfer means comprises:

means for organizing said columns of said array into at least a first column group storing pixel information corresponding to said first image portion and a second column group storing pixel information corresponding to said second image portion; and

two or more transfer control circuits, each of said transfer control circuits transferring pixel information in one of said at least first and second column groups.

7. Apparatus, as claimed in claim 1, wherein said column transfer means organizes the columns of said array into a plurality of column groups including a first column group and a second column group and wherein said first predetermined transfer rate is proportional to a first rate of image motion relative to the said first column group and said second predetermined transfer rate is proportional to a second rate of image motion relative to said second column group.

8. Apparatus, as claimed in claim 7, wherein a line connecting a point in the array with a point in said scene is substantially perpendicular to a vector intersecting said line and defining said predetermined direction of image motion, and wherein said transfer rates are inversely proportional to the distances between said array and different parts of said scene along said line.

9. Apparatus, as claimed in claim 3, wherein said array, column transfer means, adjusting means and imaging means are installed in a vehicle capable of motion in a predetermined direction.

10. Apparatus, as claimed in claim 9, wherein said imaging means further comprises lens means for placing said scene on said array, said lens means having a central axis perpendicular to a vector defining said predetermined direction of vehicle motion, and wherein said predetermined transfer rate for a first point of said scene is proportional to ##EQU9## where F is the distance from said lens means to the column containing the pixel representing said first point, V is the rate of motion of the vehicle in said predetermined direction and D is the distance from said vehicle to said first point.

11. Apparatus, as claimed in claim 5, and further comprising a discrete array of diode detector elements.

12. Apparatus, as claimed in claim 1, wherein said array comprises a charge injection device.

13. Apparatus for processing pixel information representing an image of a scene comprising at least a first image portion and a second image portion, said apparatus compensating for image motion in a predetermined direction and comprising:

an array of cells capable of storing said pixel information corresponding to said at least first image portion and second image portion of said scene, said array being arranged in rows and columns; and

column transfer means for transferring pixel information corresponding to said first image portion at a first predetermined transfer rate and for transferring pixel information corresponding to said second image portion at a second predetermined transfer rate different from said first predetermined transfer rate, said column transfer means comprising;

means for organizing said columns of said array into at least a first column group storing pixel information corresponding to said first image portion and a second column group storing pixel information corresponding to said second image portion;

two or more transfer control circuits, each of said transfer control circuits transferring pixel information in one of said at least first and second column groups and comprising a master clock providing clock signals at a master clock frequency and a counter and a clock driver, said clock driver transferring pixel information in one of said at least first and second column groups when said counter counts a predetermined number of counts in response to said clock signals; and

adjusting means for adjusting said predetermined transfer rates depending on the changes in rates of motion of said at least first and second image portions relative to said array.

14. Apparatus, for processing pixel information representing an image of a scene which compensates for image motion in a predetermined direction comprising:

an array of cells capable of storing said pixel information corresponding to said scene, said array being arranged in rows and columns;

column transfer means for organizing said columns of the array into one or more column groups and for transferring pixel information located in said one or more column groups at one or more predetermined transfer rates depending on the rate of motion of portions of said image relative to said array, said column transfer means comprising a master clock providing clock signals at a master clock frequency and one or more transfer control circuits responsive to said clock signals, each of said column transfer control circuits transferring pixel information in one of said one or more column groups, each of said transfer control circuit comprising a counter and a clock driver, said clock driver transferring pixel information in one of said one or more column groups when said counter counts a predetermined number of counts; and

adjusting means for adjusting said one or more predetermined transfer rates depending on the changes in rate of motion of said image relative to said array and for providing said predetermined number of counts to each of said counters.

15. Apparatus, as claimed in claim 14, wherein said predetermined number of counts provided to each of counter of each column group is proportional to ##EQU10## where X is said master clock frequency and f_i is said predetermined transfer rate for each column group.

16. Apparatus for processing pixel information representing an image of a scene which compensates for image motion in a predetermined direction comprising:

an array of cells capable of storing said pixel information corresponding to said scene, said array being arranged in rows and columns; and

column transfer means for organizing said columns of the array into one or more column groups and for transferring pixel information located in said one or more column groups at one or more predetermined transfer rates depending on the rate of motion of portions of said image relative to said array, said one or more column groups comprising a first column group and a second column group, said one or more predetermined transfer rates including a first predetermined transfer rate proportional to a first rate of image motion relative to said first column group and a second predetermined transfer rate proportional to a second rate of image motion relative to said second column group, said predetermined transfer rates varying monotonically from one column group to the next across said array.

17. Apparatus for processing pixel information representing an image of a scene which compensates for image motion in a predetermined direction comprising:

an array of cells capable of storing said pixel information corresponding to said scene, said array being arranged in rows and columns; and

column transfer means for organizing said columns of the array into N column groups, including a first column group, and for transferring pixel information at a predetermined transfer rate for each column group, f_i, proportional to the image motion relative to said array by being proportional to

space="preserve" listing-type="equation">f.sub.1 +(i-1) (f.sub.n -f.sub.1)/(n-1)

where i is an integer between 1 and N, f₁ is the transfer rate for the first column group, and f_n is the transfer rate for the n^th column group, f₁ and f_n being previously determined.

18. Apparatus carried by an aircraft capable of motion in a predetermined direction and defining a reference plane that is horizontal during level-flight, said apparatus being capable of processing pixel information representing an image of a scene forward of said aircraft and of compensating for image motion in said predetermined direction comprising:

an array of cells installed in said aircraft capable of storing said pixel information corresponding to said scene, said array being arranged in rows and columns, said columns of said array defining a column direction;

imaging means installed in said aircraft for placing said image on said array, said imaging means comprising a lens having a focal length and having a central axis making a forward depression angle φ

with said reference plane;

column transfer means installed in said aircraft for organizing said columns of said array into at least one column group and for transferring pixel information located in said at least one column group at least one predetermined transfer rate depending on the rate of motion of portions of said image relative to said array, said at least one column group having pixel information which is transferred at one transfer rate that is proportional to ##EQU11## where F is the focal length of said lens,

P_x is the pixel size in said column direction,

V is the velocity of said aircraft,

H is the height of said aircraft above said scene, and

(φ

±

Θ

_i) is the forward depression angle of the point chosen for synchronization for forward motion correction; and

adjusting means installed in said aircraft for adjusting said at least one predetermined transfer rate depending on the change in rate of motion of said image relative to said array.

19. In a system comprising an array of cells arranged in rows and columns for storing pixel information representing at least first and second simultaneously occurring image portions of a scene, said array storing pixel information corresponding to said first image portion in a first column of said columns and storing said pixel information corresponding to said second image portion in a second column of said columns, a method of processing said pixel information in order to compensate for image motion in a predetermined direction comprising the steps of:

transferring in said array said pixel information representing said first image portion in said first column at a first predetermined transfer rate; and

transferring in said array said pixel information representing said second image portion in said second column at a second transfer rate different from said first transfer rate, whereby resolution of an image created from said pixel information can be improved.

20. The method, as claimed in claim 19 and further comprising the step of:

adjusting said first and second predetermined transfer rates depending on the changes in rate of motion of said first and second image portions relative to said array.

21. The method, as claimed in claim 20, and further comprising the step of placing said image on said array.

22. The method, as claimed in claim 21, and further comprising the steps of:

placing said image on said array during a predetermined exposure period; and

transferring pixel information within said array during said predetermined exposure period.

23. The method, as claimed in claim 19, wherein said array is a charge-coupled device.

24. The method, as claimed in claim 20, wherein the step of transferring pixel information comprises:

organizing said columns of said array into at least a first column group storing pixel information corresponding to said first image portion and a second column group storing pixel information corresponding to said second image portion; and

transferring pixel information in said at least first and second column groups at different transfer rates.

25. The method, as claimed in claim 19, and further comprising the step of organizing said columns of said array into a plurality of column groups including a first column group and a second column group, wherein said first predetermined transfer rate is proportional to a first rate of motion of said first image portion relative to said first column group and wherein said second predetermined transfer rate is proportional to a second rate of image motion of said second image portion relative to said second column group.

26. The method, as claimed in claim 25, wherein a line connecting a point in said array with a point in said scene is substantially perpendicular to a vector intersecting said line and defining said predetermined direction of image motion, and wherein said transfer rates are inversely proportional to the distances between said array and different parts of said scene along said line.

27. The method, as claimed in claim 21, wherein said array is installed in a vehicle capable of motion in a predetermined direction and the steps of transferring are performed aboard said vehicle.

28. The method, as claimed in claim 27, wherein the system further comprises lens means for placing said scene on said array, said lens means having a central axis perpendicular to a vector defining said predetermined direction of vehicle motion, and wherein the step of transferring comprises the step of calculating said predetermined transfer rate for a first point of said scene to be proportional to ##EQU12## where F is the distance from the lens means to the column containing the pixel representing the first point, V is the rate of motion of the vehicle in said predetermined direction and D is the distance from said vehicle to said first point.

29. The method, as claimed in claim 23, and further comprising a discrete array of diode detector elements.

30. In a system comprising an array of cells capable of storing pixel information representing at least first and second image portions of a scene, said array being arranged in rows and columns, a method of processing said pixel information in order to compensate for image motion in a predetermined direction comprising the steps of:

transferring in said array said pixel information representing said first image portion at a first predetermined transfer rate;

transferring in said array said pixel information representing said second image portion at a second transfer rate different from said first transfer rate, said step of transferring pixel information comprising the steps of

organizing said columns of said array into at least a first column group storing pixel information corresponding to said first image portion and a second column group storing pixel information corresponding to said second image portion;

transferring pixel information in said at least first and second column groups at different transfer rates;

providing clock signals at a master clock frequency; and

initiating transfer of pixel information in each of said at least first and second column groups in response to said clock signals by counting a predetermined number of counts for that column group; and

adjusting said first and second predetermined transfer rates depending on the changes in rate of motion of said first and second image portions relative to said array, whereby resolution of an image created from said pixel information can be improved.

31. The method, as claimed in claim 30, wherein said predetermined number of counts provided for each of said at least first and second columns groups is proportional to ##EQU13## where X is said master clock frequency and f_i is said predetermined transfer rate for each of said at least first and second column groups.

32. In a system comprising an array of cells capable of storing pixel information representing an image, said array being arranged in rows and columns, a method of processing said pixel information in order to compensate for image motion in a predetermined direction comprising the steps of:

organizing said columns of said array into at least a first column group and a second column group; and

transferring pixel information located in said first column group at a first predetermined transfer rate proportional to a first rate of image motion relative to said first column group and transferring pixel information in said second column group at a second predetermined transfer rate different from said first predetermined transfer rate proportional to a second rate of image motion relative to said second column group, said predetermined transfer rates varying monotonically from one column group to the next across the array.

33. In a system comprising an array of cells capable of storing pixel information representing an image, said array being arranged in rows and columns, a method of processing said pixel information in order to compensate for image motion in a predetermined direction comprising the steps of:

organizing said columns of said array into N column groups, including a first column group, and

transferring pixel information at a predetermined transfer rate for each column group, f_i, proportional to the image motion relative to said array by being proportional to

space="preserve" listing-type="equation">f.sub.1 +(i-1)(f.sub.n -f.sub.1)/(n-1)

where i is an integer between 1 and N, f₁ is the transfer rate for said first column group, and f_n is the transfer rate for said n^th column group, f₁ and f_n being previously determined.

34. In a system comprising an array of cells capable of storing pixel information representing an image, said array being arranged in rows and columns, said columns defining a column direction, said array being installed in an aircraft defining a reference plane that is horizontal during level flight, said system further comprising a lens having a focal length and a central axis, said central axis making a depression angle φ

with said reference plane, a method of processing pixel information representing a scene in order to compensate for image motion in a predetermined direction comprising the steps of;

organizing said columns of said array into at least one column group;

transferring pixel information located in said at least one column group at least one predetermined transfer rate depending on the rate of motion of portions of said image relative to said array, said at least one column group having pixel information which is transferred at one transfer rate, f, that is proportional to ##EQU14## where F is the focal length of said lens,

P_x is the pixel size in said column direction,

V is the velocity of said aircraft,

H is the height of said aircraft above said scene, and

(φ

±

Θ

_i) is the forward depression angle of the point chosen for synchronization for forward motion compensation;

adjusting said at least one predetermined transfer rate depending on the change in rate of motion of said image relative to said array; and

placing said image on said array;

wherein said scene is forward of said aircraft and said steps of organizing and transferring are performed aboard said aircraft.