SYSTEM AND ARCHITECTURE FOR AUTOMATIC IMAGE REGISTRATION

• US 20060215935A1
• Filed: 05/10/2006
• Published: 09/28/2006
• Est. Priority Date: 04/02/2004
• Status: Abandoned Application

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Oldroyd, Lawrence A.
• Application Number:
  US11/382,523
• Publication Number:
  US 20060215935A1
• Time in Patent Office: Days
• US Class Current: 382/294
• CPC Class Codes: G01C 11/00 Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 20/13 Satellite images

Abstract

Image registration methods and systems for automatically registering images of different perspectives, and where a sensor image is registered with a more precise reference image such that the geocoding of the reference image can be transferred to the sensor image.

Claims

1. A system, comprising:

a sensor to generate a sensor image of a first scene; and

a reference image database to include a reference image of a second scene, the reference image encompassing the sensor image; and

at least one processor to

identify the portion of the reference image depicted in the sensor image,

define an area of the reference image based on the reference image portion,

conform the sensor image and the reference image area to a common perspective by transforming a perspective of at least one of the sensor image and the reference image area, and

match the images of common perspective.

2. The system of claim 1 wherein said reference image is geocoded.

3. The system of claim 1 wherein the sensor image and reference image are of different internal geometry.

4. The system of claim 1 wherein the perspective of the sensor image is transformed using the at least one processor to substantially the perspective of the reference image area.

5. The system of claim 1 wherein the perspective of the reference image is transformed using the at least one processor to substantially the perspective of the sensor image.

6. The system of claim 1 wherein both the sensor image and the reference image area are transformed using the at least one processor to a common perspective.

7. The system of claim 1 wherein the transforming includes enhancing the fidelity of the transformed image using a 3-D surface model of the scene.

8. The system of claim 1 wherein the at least one processor further determines the translation offset between the images of common perspective, and maps locations in at least one of the sensor image and reference image by combining geometric transforming functions and functions representing the translation offset.

9. The system of claim 8 wherein the reference image is geocoded, and the at least one processor determines geocoded location in the sensor image corresponding to the gecoding of the location in the reference image.

10. The system of claim 1 wherein the transforming includes removing perspective distortion from the reference image area to produce a substantially orthographic image of the area.

11. The system of claim 10 wherein the removing includes performing an inverse perspective transform to remove the perspective distortion.

12. The system of claim 10 wherein the transforming further includes aligning the reference chip with the azimuth direction of the sensor.

13. The system of claim 1 wherein the system is associated with an aircraft.

14. A method implemented by a computer having memory and at least one processor, said method comprising the steps of:

generating a sensor image of a first scene with a sensor mounted on a platform;

accessing a reference image of a second scene, said reference image encompassing said sensor image;

identifying the portion of the reference image depicted in the sensor image;

defining an area of the reference image based on said reference image portion; and

conforming said sensor image and said reference image area to a common perspective by transforming the perspective of at least one of said sensed image and said reference image area; and

matching said images of common perspective.

15. The method of claim 14 wherein said reference image is geocoded.

16. The method of claim 14 wherein the sensor image and reference image are of different internal geometry.

17. The method of claim 14 wherein the perspective of said reference image area is transformed to substantially the perspective of the sensor image.

18. The method of claim 14 wherein the perspective of the sensed image is transformed to substantially the perspective of the reference image area.

19. The method of claim 14 wherein both the sensor image and the reference image area are transformed to a common perspective.

20. The method of claim 14 wherein the transforming step further comprises the step of enhancing the fidelity of the transformed image using a 3-D surface model of the scene.