System for mosaicing digital ortho-images

• US 6,928,194 B2
• Filed: 09/19/2002
• Issued: 08/09/2005
• Est. Priority Date: 09/19/2002
• Status: Expired due to Term

• Current Assignee: VI Technologies, LLC (VI GP LLC (f/k/a M7 Visual Intelligence GP LLC))
• Original Assignee: M7 Visual Intelligence, LP
• Inventors: Smitherman, Chester L., Mai, Tuy Vu
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): CARTER, AARON W
• Application Number:
  US10/247,441
• Publication Number:
  US 20040057633A1
• Time in Patent Office: 1,055 Days
• Field of Search: 382/276, 382/284, 382/167, 345630-641, 348584-588
• US Class Current: 382/284
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images

Abstract

The present invention provides a system for mosaicing multiple input images, captured by one or more remote sensors, into a seamless mosaic of an area of interest. Each set of input images captured by the remote sensors within a capture interval are ortho-rectified and mosaiced together into a composite image. Successive composite images, along a given flight path, are then mosaiced together to form a strip. Adjacent strips are then mosaiced together to form a final image of the area of interest.

Claims

1. A method of maintaining a desired image intensity in an imaging system, comprising the steps of:

evaluating a target image captured by the imaging system to identify green-dominant pixels in the target image;

determining an average intensity of the target image based on the green-dominant pixels;

evaluating the difference between the average intensity and the desired image intensity; and

adjusting exposure time of the imaging system responsive to the difference between the average intensity and the desired image intensity.

2. A system for rendering multiple, partially-overlapping input images of a target terrain, taken successively along a flight line over the target terrain, into a seamless image strip of the target terrain, comprising:

a system for providing a reference image and a secondary image, having a partially overlapping area and a boundary area with the reference image;

a system for dividing the secondary image, along the boundary with the reference image, into segments, cooperatively engaged with the system for providing a reference image and a secondary image;

a system for computing a balancing correlation matrix for each such segment, cooperatively engaged with the system for providing a reference and secondary images and the system for dividing the boundary area into segments;

a system for modifying pixel values within each segment, along a gradient that starts at the boundary and terminates at a predetermined transition distance, by the balancing correlation matrix for that segment, cooperatively engaged with the system for providing a reference and secondary images, the system for dividing the boundary area into segments, and the system for computing the balancing correlation matrix; and

a system for feathering pixels at the boundary to eliminate any visible seam, cooperatively engaged with the other systems.

3. The system of claim 2, wherein the reference and secondary images are orthorectified composite images.

4. The system of claim 2 further comprising a system for controlling exposure time of the input images based on relative intensity of the input images, cooperatively engaged with the other systems.

5. The system of claim 2, wherein pixel values at the boundary of two adjacent segments are scaled based on the distance-weighted average of the two corresponding balancing correlation matrix to provide smooth transition from one segment to the next.

6. The system of claim 4, wherein the system for controlling the exposure time analyzes relative intensity using only green-dominant pixels.

7. A method for rendering multiple, partially-overlapping input images of a target terrain into a seamless image mosaic of the target terrain, comprising the steps of:

normalizing the intensity of each input image to a desired mean and standard deviation;

determining a reference image and a secondary image, having a partially overlapping area and a boundary area with the reference image;

establishing a segmented seam line between the reference and secondary images that minimizes imaging effects of elevated features in those images;

dividing the secondary images, along the boundary with the reference image, into segments;

computing a balancing correlation matrix for each such segment;

modifying pixel values within each segment, along a gradient that starts at the boundary and terminates at a predetermined transition distance, by the balancing correlation matrix for that segment; and

feathering pixels at the boundary to eliminate any visible seam.

8. The method of claim 7, wherein the secondary images are divided into segments along the boundary with the reference image corresponding to the segments of the seam line.

9. The method of claim 7, wherein pixel values at the boundary of two adjacent segments of the secondary image are scaled based on the distance-weighted average of the two corresponding balancing correlation matrices to provide smooth transition from one segment to the next.

10. The method of claim 7, wherein each input image is an image strip corresponding to a flight line.

11. A method of processing color input images to reduce bias caused by man-made structures or water bodies, comprising the steps of:

selecting green-dominant pixels from a first input image and computing an average intensity value thereof;

selecting green-dominant pixels from a second input image and computing an average intensity value thereof;

comparing the average intensity values of the first and second input images; and

processing the first or second input image responsive to the comparison.

12. A method of mosaicing two overlapping digital input images together to form an output image, comprising the steps of:

providing a reference image, comprising a number of pixels having certain intensity;

providing a secondary image, comprising a number of pixels having certain intensity that overlaps the reference image in an overlap area, wherein the reference and secondary images are correlated to compute a balancing correlation matrix; and

scaling pixel values of the secondary image within the overlap area such that the intensity of the secondary image pixels within the overlap area is equivalent to the intensity of the reference image pixels within the overlap area.

13. A method of mosaicing two overlapping digital input images together to from an output image, comprising the steps of:

providing a reference image, comprising a number of pixels having certain intensity;

providing a secondary image, comprising a number of pixels having certain intensity that overlaps the reference image in an overlap area, wherein the reference and secondary images are correlated to compute a balancing correlation matrix and are further computed for each color channel; and

scaling pixel values of the secondary image within the overlap area such that the intensity of the secondary image pixels within the overlap area is equivalent to the intensity of the reference image pixels within the overlap area.