System and method for automatically determining the position of landmarks in digitized images derived from a satellite-based imaging system

• US 6,084,989 A
• Filed: 11/15/1996
• Issued: 07/04/2000
• Est. Priority Date: 11/15/1996
• Status: Expired due to Term

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Inventors: Eppler, Walter G.
• Primary Examiner(s): Bella, Matthew C.
• Assistant Examiner(s): CHAWAN, SHEELA C
• Application Number:
  US08/749,804
• Time in Patent Office: 1,327 Days
• Field of Search: 348/144, 382/106, 382/103, 382/108, 382/109, 382/203, 382/181, 382/157, 382/190, 382/199, 382/204, 382/209, 382/217, 382/213, 382/295, 382/299, 382/298, 382/151, 382/254, 364/456
• US Class Current: 382/293
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

A system and method for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system using landmark geodetic coordinates on the Earth. The system and method use landmarks in symbolic form, such as perimeters of lakes and islands that are stored in a database. A digitized image generated by the satellite-based imaging system is processed to extract a patch of the image containing a landmark. The image patch is then upsampled (magnified). The landmark boundary is processed using a mathematical model of the imaging system to generate absolute coordinates of the boundary pixels, which are upsampled and rasterized to produce a landmark mask. The landmark mask and the upsampled image patch are then processed by one or more matching algorithms to generate line and pixel offset error values indicative of the offset between the predicted position of the landmark and the actual position of the landmark in the image. A match figure of merit is also generated that is indicative of the reliability and accuracy of the computed offset. Optionally, the upsampled image patch is processed using an image enhancement algorithm that increases the contrast and robustness of the images by converting pixel gray scale values into likelihood ratios.

Claims

1. A method of determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by a passive imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said method comprising the steps of:

defining and storing a plurality of landmarks in a landmark database that are each defined as having a perimeter comprising a plurality of boundary vertices;

generating a digitized image of a softcopy map derived from a database that is viewed on a display;

selecting a landmark in the softcopy map for processing;

reading out the plurality of boundary vertices of the landmark stored in the landmark database that corresponds to the selected landmark in the softcopy map;

processing the plurality of boundary vertices of the stored landmark using a mathematical model of the passive imaging system to generate absolute coordinates of boundary pixels of the stored landmark;

upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask;

processing the digitized image derived from the passive imaging system to extract an image patch containing the selected landmark;

upsampling the image patch so that it has the same magnification as the upsampled landmark mask; and

processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images.

2. The method of claim 1 further comprising the step of:

processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.

3. The method of claim 1 wherein the step of processing the upsampled image patch and the upsampled landmark mask by an imaging matching algorithm further comprising generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.

4. The method of claim 1 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.

5. The method of claim 1 which further comprises the step of:

processing the offset errors to adjust the pointing direction of the imaging system.

6. The method of claim 1 wherein the step of processing the offset errors further comprises the steps of:

processing the offset errors using an orbit and attitude tracking system that generates coefficients used for spacecraft orbit and attitude prediction;

processing the coefficients onboard the spacecraft using an orbit and attitude computation system to generate predicted orbit and attitude compensation data; and

generating pointing coordinates using an image motion compensation system to adjust the pointing direction of the imaging system.

7. A system for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by a passive imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said system comprising:

a landmark database that stores a plurality of landmarks that are each defined as having a perimeter comprising a plurality of boundary vertices;

a display for viewing the digitized image generated from softcopy map databases;

imaging extraction means for processing the digitized image derived from the passive imaging system to extract an image patch therefrom that contains a selected landmark; and

a landmark position system comprising a computer for reading the plurality of boundary vertices of the landmark in the landmark database that corresponds to the selected landmark in the digitized image derived from the passive imaging system, for processing the plurality of boundary vertices of the stored landmark using the mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark, for upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask, for processing the digitized image derived from the passive imaging system to extract an image patch containing the selected landmark, for upsampling the image patch so that it has the same magnification as the upsampled landmark mask, and for processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images.

8. The system of claim 7 wherein the computer further comprises means for processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.

9. The system of claim 7 wherein the computer further comprises means for generating a figure of merit is also generated that is indicative of the reliability and accuracy of the computed offset values.

10. The system of claim 7 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.

11. The system of claim 7 further comprising means for processing the offset errors to adjust the pointing direction of the imaging system.

12. The system of claim 11 wherein the means for processing the offset errors comprises:

an orbit and attitude tracking system for processing the offset errors to generate coefficients used for spacecraft orbit and attitude prediction;

an orbit and attitude computation system disposed on the spacecraft for processing the coefficients to generate predicted orbit and attitude compensation data; and

an image motion compensation system disposed on the spacecraft for generating pointing commands that adjust the pointing direction of the imaging system.

19. The system of claim 7 wherein the computer further comprises means for processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.

20. The system of claim 7 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.

13. A method of determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said method comprising the steps of:

defining and storing a plurality of landmarks in a landmark database that are each defined as having a perimeter comprising a plurality of boundary vertices;

generating a digitized image of a softcopy map derived from a database that is viewed on a display;

selecting a landmark in the softcopy map for processing;

reading out the plurality of boundary vertices of the landmark stored in the landmark database that corresponds to the selected landmark in the softcopy map;

processing the plurality of boundary vertices of the stored landmark using a mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark;

upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask;

processing the digitized image to extract an image patch containing the selected landmark;

upsampling the image patch so that it has the same magnification as the upsampled landmark mask; and

processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images, which processing includes generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.

14. The method of claim 13 further comprising the step of:

processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.

15. The method of claim 13 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.

16. The method of claim 13 which further comprises the step of:

processing the offset errors to adjust the pointing direction of the imaging system.

17. The method of claim 13 wherein the step of processing the offset errors further comprises the steps of:

processing the offset errors using an orbit and attitude tracking system that generates coefficients used for spacecraft orbit and attitude prediction;

processing the coefficients onboard the spacecraft using an orbit and attitude computation system to generate predicted orbit and attitude compensation data; and

generating pointing coordinates using an image motion compensation system to adjust the pointing direction of the imaging system.

18. A system for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said system comprising:

a landmark database that stores a plurality of landmarks that are each defined as having a perimeter comprising a plurality of boundary vertices;

a display for viewing the digitized image generated from softcopy map databases;

imaging extraction means for processing the digitized image to extract an image patch therefrom that contains a selected landmark; and

a landmark position system comprising a computer for reading the plurality of boundary vertices of the landmark in the landmark database that corresponds to the selected landmark in the digitized image, for processing the plurality of boundary vertices of the stored landmark using the mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark, for upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask, for processing the digitized image to extract an image patch containing the selected landmark, for upsampling the image patch so that is has the same magnification as the upsampled landmark mask, and for processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images including generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.