System for determining the attitude of a moving imaging sensor platform or the like
First Claim
1. A method of determining changes in the yaw, pitch, roll or elevation of an airborne sensor which moves along a flight path above the earth and records successive two-dimensional images of the earth'"'"'s surface along said flight path, comprising the steps of:
- (A) generating a first set of data representing picture elements of a first two-dimensional image of said surface at a first point along said flight path such that the data representing all of the picture elements of said first image are generated simultaneously;
(B) generated a second set of data representing picture elements of a second two-dimensional image of said surface at a second point along said flight path closely spaced from said first point such that at least a portion of said images overlap each other, and wherein the data representing all of the picture elements of said second image are generated simultaneously,said picture elements varying in intensity in accordance with their respective locations on the corresponding images, the corresponding picture elements of the first and second images in the overlapping portions thereof being offset from each other by an amount related to changes in the yaw, pitch, roll or elevation of said sensor;
(C) correlating a plurality of corresponding picture elements of the first and second images in the overlapping portions thereof, the relative positions of the correlated picture elements representing the changes in the yaw, pitch, roll or elevation of said sensor, and whereinthe step of correlating is performed at least in part by selecting at least three spaced apart N×
M arrays of picture elements in one of said images, selecting at least three spaced apart reference picture elements in the other of said images which are respectively associated with said at least three N×
M arrays, and comparing the at least three reference picture elements with the picture elements in the associated N×
M arrays.
1 Assignment
0 Petitions
Accused Products
Abstract
A system for determining the attitude of an airborne platform such as a terrain image sensor includes a digital image correlator for comparing successive overlapping, instantaneous images of the terrain which are recorded by a second, two-dimensional image sensor whose image plane is oriented parallel to that of the terrain image sensor. The second sensor generates an instantaneous master image and a subsequent slave image which at least partially overlaps the master image in terms of the terrain which is viewed. The master and slave images are approximately registered and a correlation is performed. A plurality of points on the slave image are correlated with the corresponding terrain points on the master image. The correlation is performed by selecting a plurality of spatially distributed patches of pixel arrays which are mathematically superimposed on and are moved about the slave image to determine the locations where the maximum of gray scale correlation occurs. These correlation points on the slave image are recorded and the coplanarity condition of photogrammetry determines the relative orientation of the slave with respect to the master. The relative orientation of the slave image with respect to the master image characterizes the attitude change of the platform. The technique also reveals changes in altitude and velocity of the platform when mean altitude and velocity are known. The image produced by the terrain image sensor can be altered on a real time basis using the information relating to the changes in platform attitude, or the master and slave image data can be recorded for subsequent use in modifying the image data recorded by the terrain image sensor.
-
Citations
23 Claims
-
1. A method of determining changes in the yaw, pitch, roll or elevation of an airborne sensor which moves along a flight path above the earth and records successive two-dimensional images of the earth'"'"'s surface along said flight path, comprising the steps of:
-
(A) generating a first set of data representing picture elements of a first two-dimensional image of said surface at a first point along said flight path such that the data representing all of the picture elements of said first image are generated simultaneously; (B) generated a second set of data representing picture elements of a second two-dimensional image of said surface at a second point along said flight path closely spaced from said first point such that at least a portion of said images overlap each other, and wherein the data representing all of the picture elements of said second image are generated simultaneously, said picture elements varying in intensity in accordance with their respective locations on the corresponding images, the corresponding picture elements of the first and second images in the overlapping portions thereof being offset from each other by an amount related to changes in the yaw, pitch, roll or elevation of said sensor; (C) correlating a plurality of corresponding picture elements of the first and second images in the overlapping portions thereof, the relative positions of the correlated picture elements representing the changes in the yaw, pitch, roll or elevation of said sensor, and wherein the step of correlating is performed at least in part by selecting at least three spaced apart N×
M arrays of picture elements in one of said images, selecting at least three spaced apart reference picture elements in the other of said images which are respectively associated with said at least three N×
M arrays, and comparing the at least three reference picture elements with the picture elements in the associated N×
M arrays. - View Dependent Claims (2, 3, 4, 6, 7, 8, 9)
-
-
5. The method of claim 5, wherein the step of predicting the locations of said selected picture elements is performed by determining the locations of selected picture elements in previously generated images of said surface.
-
10. A method of determining changes in the yaw, pitch, roll or elevation of an airborne or orbiting platform which moves along a flight path above the earth, comprising the steps of:
-
(A) generating a first set of data representing picture elements of a first two-dimensional image of said surface at a first point along said flight path such that the data representing all of the picture elements of said first image are generated simultaneously; (B) generating a second set of data representing picture elements of a second two-dimensional image of said surface at a second point along said flight path closely spaced from said first point such that at least a portion of said images overlap each other, and wherein the data representing all of the picture elements of said second image are generated simultaneously, said picture elements varying in intensity in accordance with their respective locations on the corresponding images, the corresponding picture elements of the first and second images in the overlapping portions thereof being offset from each other by an amount related to changes in the yaw, pitch, roll or elevation of said platform; and (C) correlating at least five corresponding spaced apart picture elements of the first and second images in the overlapping portions thereof, the relative positions of the correlated picture elements representing the changes in the yaw, pitch, roll or elevation of said platform, and wherein the step of correlating is performed at least in part by selecting at least five spaced apart N×
M arrays of picture elements in one of said images, selecting at least five spaced apart reference picture elements in the other of said images which are respectively associated with said at least five N×
M arrays, and comparing the at least five reference picture elements with the picture elements in the associated N×
M arrays. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A digital image processing method for determining changes in the location, yaw, pitch, roll or elevation of an airborne or orbiting platform which moves along a flight path above a surface and transports an imaging sensor, comprising the steps of:
-
(A) generating a first synoptic set of image data of said surface from the perspective of a first point along said flight path, and using an imaging sensor which incorporates one two-dimensional imaging array used to simultaneously acquire an array of picture elements of a first two-dimensional image of said surface consisting of N number of lines, with M picture elements each; (B) generating a second set of data using said imaging sensor from the new perspective of a second point along said flight path, said second set of data representing a new array of picture elements of a second two-dimensional image of said surface simultaneously acquired at a second point some distance along the flight path from said first point such that said image arrays overlap each other; said picture elements varying in intensity in accordance with the emissivity or reflectivity of a diverse collection of elements on said surface, the corresponding sets of picture elements in the overlapping portions in the first and second image arrays thereof being offset from each other by an amount related to changes in the location, yaw, pitch, roll or elevation of said platform; and
,(C) comparing at least five spatially dispersed patches of picture elements in the overlapping portion of the first and second images and identifying at least five highly correlated picture element match points in the overlapping portion of said first and second images, the relative portions of the highly correlated picture elements'"'"' match points with respect to their individual locations on their respective image data arrays being a unique function of the changes in the location, yaw, pitch, roll or elevation of said platform. - View Dependent Claims (18, 19, 20, 21, 22, 23)
-
Specification