Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening

• US 6,011,875 A
• Filed: 04/29/1998
• Issued: 01/04/2000
• Est. Priority Date: 04/29/1998
• Status: Expired due to Term

• Current Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Eastman Kodak Company
• Inventors: Laben, Craig A., Brower, Bernard V.
• Primary Examiner(s): Kelley, Christopher S.
• Assistant Examiner(s): PATEL, KANJIBHAI B
• Application Number:
  US09/069,232
• Time in Patent Office: 615 Days
• Field of Search: 382/275, 382/276, 382/254, 382/278, 382/299
• US Class Current: 382/276
• CPC Class Codes: G06T 2207/10036 Multispectral image; Hyperspectral image
• CPC Class Codes: G06T 3/4061 by injecting details from different spectral ranges
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening

Abstract

The spatial resolution of a multispectral digital image is enhanced in a process of the type wherein a higher spatial resolution panchromatic image is merged with a plurality of lower spatial resolution spectral band images. A lower spatial resolution panchromatic image is simulated and a Gram-Schmidt transformation is performed on the simulated lower spatial resolution panchromatic image and the plurality of lower spatial resolution spectral band images. The simulated lower spatial resolution panchromatic image is employed as the first band in the Gram-Schmidt transformation. The statistics of the higher spatial resolution panchromatic image are adjusted to match the statistics of the first transform band resulting from the Gram-Schmidt transformation and the higher spatial resolution panchromatic image (with adjusted statistics) is substituted for the first transform band resulting from the Gram-Schmidt transformation to produce a new set of transform bands. Finally, the inverse Gram-Schmidt transformation is performed on the new set of transform bands to produce the enhanced spatial resolution multispectral digital image.

Claims

1. A method of enhancing the spatial resolution of a multispectral digital image of the type wherein a higher spatial resolution panchromatic image is merged with a plurality of lower spatial resolution spectral band images, comprising the steps of:

a) simulating a lower spatial resolution panchromatic image;

b) performing a Gram-Schmidt transformation on the simulated lower spatial resolution panchromatic image and the plurality of lower spatial resolution spectral band images, employing the simulated lower spatial resolution panchromatic image as the first band in the Gram-Schmidt transformation, to produce a plurality of transformed bands;

c) adjusting the statistics of the higher spatial resolution panchromatic image to match the statistics of the first transform band resulting from the Gram-Schmidt transformation to produce a modified higher spatial resolution panchromatic image;

d) substituting the modified higher spatial resolution panchromatic image for the first transform band resulting from the Gram-Schmidt transformation to produce a new set of transform bands; and

e) inverse Gram-Schmidt transforming the new set of transform bands to produce the enhanced spatial resolution multispectral digital image.

2. The method claimed in claim 1, wherein the higher spatial resolution panchromatic image differs slightly in scene content from the plurality of lower spatial resolution spectral band images, and wherein the lower spatial resolution panchromatic image is simulated by forming a linear combination of the lower spatial resolution spectral band images.

3. The method claimed in claim 1, wherein lower spatial resolution panchromatic image is simulated by reducing the resolution of the higher spatial resolution panchromatic image.

4. The method claimed in claim 1, wherein the statistics of the higher spatial resolution panchromatic image that are adjusted are the mean and standard deviation.

5. A computer program product, comprising a computer readable storage medium having a computer program stored thereon for enhancing the spatial resolution of a multispectral digital image of the type wherein a higher spatial resolution panchromatic image is merged with a plurality of lower spatial resolution spectral band images, by performing the steps of:

a) simulating a lower spatial resolution panchromatic image;

b) performing a Gram-Schmidt transformation on the simulated lower spatial resolution panchromatic image and the plurality of lower spatial resolution spectral band images, employing the simulated lower spatial resolution panchromatic image as the first band in the Gram-Schmidt transformation, to produce a plurality of transformed bands;

c) adjusting the statistics of the higher spatial resolution panchromatic image to match the statistics of the first transform band resulting from the Gram-Schmidt transformation to produce a modified higher spatial resolution panchromatic image;

d) substituting the modified higher spatial resolution panchromatic image for the first transform band resulting from the Gram-Schmidt transformation to produce a new set of transform bands; and

e) inverse Gram-Schmidt transforming the new set of transform bands to produce the enhanced spatial resolution multispectral digital image.

6. The computer program product claimed in claim 5, wherein the higher spatial resolution panchromatic image differs slightly in scene content from the plurality of lower spatial resolution spectral band images, and wherein the lower spatial resolution panchromatic image is simulated by forming a linear combination of the lower spatial resolution spectral band images.

7. The computer program product claimed in claim 5, wherein lower spatial resolution panchromatic image is simulated by reducing the resolution of the higher spatial resolution panchromatic image.

8. The computer program product claimed in claim 5, wherein the statistics of the higher spatial resolution panchromatic image that are adjusted are the mean and standard deviation.