Replacement sensor model for optimal image exploitation

• US 7,310,440 B1
• Filed: 01/08/2002
• Issued: 12/18/2007
• Est. Priority Date: 07/13/2001
• Status: Active Grant

• Current Assignee: BAE Systems Information and Electronic Systems Integration Incorporated (BAE Systems Plc)
• Original Assignee: BAE Systems Information and Electronic Systems Integration Incorporated (BAE Systems Plc)
• Inventors: Dolloff, John Thomas
• Primary Examiner(s): Desire; Gregory M
• Application Number:
  US10/038,644
• Time in Patent Office: 2,170 Days
• Field of Search: 382/154, 382/293, 382/294, 382/295, 382/103, 345/427
• US Class Current: 382/154
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 20/13 Satellite images

Abstract

A replacement sensor model for optimally exploiting imaging data obtained by an image sensor. The replacement sensor model includes a ground-to-image function such as a polynomial for converting three-dimensional ground point data to two-dimensional image (pixel) data. Coefficients of the polynomial can be determined from a rigorous sensor model of the image sensor, which reflects physical characteristics of the particular image sensor. The polynomial can be adjusted by an adjustment vector. The adjustment vector can be determined from a pre-determined list of possible adjustment components having particular characteristics relating to the image sensor and reflecting errors in the physical characteristics of the image sensor as included in the rigorous sensor model. Finally, an error covariance associated with the adjustment vector can be determined from an error covariance associated with the rigorous sensor model. The adjusted polynomial and error covariance of the replacement sensor model permit optimal image exploitation, including error propagation and geopositioning.

Claims

1. A method for generating a replacement sensor model data file for use in processing image data produced by an image sensor, the method comprising:

generating parameters of a ground-to-image transformation function based on a sensor model of the image sensor, the sensor model including support data describing physical characteristics of the image sensor;

defining adjustable parameters of the ground-to-image transformation function to reflect errors in the support data;

generating an adjustment error covariance based on the adjustable parameters and containing information approximately equivalent to information contained in a support data error covariance; and

outputting the data file, wherein the data file includes the parameters, the adjustable parameters and the adjustment error covariance.

2. The method of claim 1, wherein the ground-to-image transformation function is a polynomial and its parameters are coefficients of the polynomial.

3. The method of claim 1, wherein the ground-to-image transformation function is a grid of ground point-image point correspondences and characteristics of the grid reflect interpolations of the grid.

4. The method of claim 1, wherein the ground-to-image function is a ratio of polynomials and its parameters are coefficients of the polynomials.

5. The method of claim 1, wherein values of the adjustable parameters are initially assumed to be zero.

6. The method of claim 1, wherein said defining adjustable parameters of the ground-to-image transformation function to reflect errors in the support data further comprises:

selecting the adjustable parameters from a pre-determined list of possible adjustable parameters.

7. The method of claim 6, wherein said generating an adjustment error covariance based on the adjustable parameters and containing information approximately equivalent to information contained in a support data error covariance further comprises:

computing the adjustment error covariance that minimizes a difference between its projection onto image space and a projection of the support data error covariance onto image space.

8. The method of claim 7, wherein the adjustable parameters are chosen so as to optimize the minimization of the difference between the projections of the two error covariances.

9. The method of claim 7, wherein the adjustments form an adjustment vector, and further wherein non-zero values of the adjustment vector are solved for and applied to a ground side or an image side of the ground-to-image transformation function, so as to reduce an effect of support data errors on future operations of the replacement sensor model.

10. The method of claim 1, wherein said generating an adjustment error covariance based on the adjustable parameters and containing information approximately equivalent to information contained in a support data error covariance further comprises:

generating a ground point grid varying in both horizontal and vertical position within a footprint of an image corresponding to the image data;

calculating a first partial derivative matrix representing an incremental change in an output of the sensor model with respect to the support data, evaluated at each ground point within the ground point grid; and

calculating a second partial derivative matrix representing an incremental change of the ground-to-image transformation function with respect to the adjustable parameters, evaluated at each ground point within the ground point grid.

11. The method of claim 10, wherein said generating an adjustment error covariance based on the adjustable parameters and containing information approximately equivalent to information contained in a support data error covariance further comprises:

generating the adjustment error covariance based on the first and second partial derivatives matrices and the support data error covariance.

12. A replacement sensor model for generating a replacement sensor model data file for use in image data processing, comprising:

A ground-to-image function for processing ground data obtained by an image sensor, the function being generated from data describing physical characteristics of the image sensor;

An adjustment vector for adjusting the function so as to reflect errors in the data;

An error covariance associated with the adjustment vector that contains approximately the same information as an error covariance of a rigorous sensor model of the image sensor; and

An output function for outputting the data file.

13. A system for generating a replacement sensor model data file for use in processing image data produced by an image sensor, the system comprising:

a processor;

a memory, operatively coupled to the processor, for storing logical instructions wherein execution of the logical instructions by the processor results in the performing of at least the following operations;

generating parameters of a ground-to-image transformation function based on a sensor model of the image sensor, the sensor model including support data describing physical characteristics of the image sensor;

defining adjustable parameters of the ground-to-image transformation function to reflect errors in the support data;

generating an adjustment error covariance based on the adjustable parameters and containing information approximately equivalent to information contained in a support data error covariance; and

outputting the data file, wherein the data file includes the parameters, the adjustable parameters and the adjustment error covariance.

14. The system of claim 13, wherein the operations further comprise selecting the adjustable parameters from a pre-determined list of possible adjustable parameters.

15. The system of claim 13, wherein the operations further comprise selecting adjustable parameters which minimize a difference between a projection of the support data error covariance onto image space and a projection of the adjustment error covariance onto image space, whereby an optimal adjustment error covariance is generated.

16. The system of claim 13, wherein the operations further comprise:

generating a ground point grid varying in both horizontal and vertical position within a footprint of an image corresponding to the image data;

calculating a first partial derivative matrix representing an incremental change in an output of the sensor model with respect to the support data, evaluated at each ground point within the ground point grid; and

calculating a second partial derivative matrix representing an incremental change of the ground-to-image transformation function with respect to the adjustable parameters, evaluated at each ground point within the ground point grid.