Apparatus and method for color image fusion

• US 20020015536A1
• Filed: 04/24/2001
• Published: 02/07/2002
• Est. Priority Date: 04/24/2000
• Status: Abandoned Application

• Current Assignee: Dean Scribner, John G. Howard, Jonathon M. Schuler, Melvin R. Kruer, Michael P. Satyshur, Penny G. Warren, Richard B. Klein
• Original Assignee: Dean Scribner, John G. Howard, Jonathon M. Schuler, Melvin R. Kruer, Michael P. Satyshur, Penny G. Warren, Richard B. Klein
• Inventors: Klein, Richard B., Howard, John G., Schuler, Jonathon M., Satyshur, Michael P., Warren, Penny G., Kruer, Melvin R., Scribner, Dean
• Application Number:
  US09/840,235
• Publication Number:
  US 20020015536A1
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An apparatus for processing imaging data in a plurality of spectral bands and fusing the data into a color image includes one or more imaging sensors and at least two image-acquiring sensor areas located on the imaging sensors. Each sensor area is sensitive to a different spectral band than at least one of the other sensor area or areas, and each sensor area will generate an image output representative of an acquired image in the spectral band to which it is sensitive. The apparatus further includes a software program that runs on a computer and executes a registration algorithm for registering the image outputs pixel-to-pixel, an algorithm to scale the images into a 24-bit true color image for display, and a color fusion algorithm for combining the image outputs into a single image. The system architecture and software includes the registration and color fusion algorithms and preferably a color monitor for displaying an operator interface that includes pull-down menus to facilitate a terminal operator carrying out registration and/or adjustment of the scaled and other images on-screen in order to produce a desired color fusion image output.

Claims

1. An image processing apparatus for processing imaging data in a plurality of spectral bands and fusing the data into a color image, comprising:

one or more imaging sensors;

at least two image-acquiring sensor areas located on said one or more imaging sensors, wherein each said sensor area is sensitive to a different spectral band than at least one other of said sensor areas and generates an image output representative of an acquired image in the spectral band to which the sensor area is sensitive;

a registration algorithm for scaling and registering said image outputs; and

a color fusion algorithm for combining said image outputs into a single image.

2. An apparatus as in claim 1, further comprising a frame grabber.

3. An apparatus as in claim 1, wherein said registration algorithm and said color fusion algorithm are resident programs in a central processor of a general purpose computer.

4. An apparatus as in claim 1, further comprising a screen display.

5. An apparatus as in claim 4, further comprising an operator interface for allowing operator input in processing of said image outputs.

6. An apparatus as in claim 1, wherein said color fusion algorithm is SCF.

7. An apparatus as in claim 1, wherein said color fusion algorithm is PCCF.

8. An apparatus as in claim 7, wherein said PCCF de-saturates said fused output image.

9. An apparatus as in claim 1, further comprising one or more additional sensors on which some of said plurality of imaging sensor areas are located.

10. An apparatus as in claim 1, wherein said apparatus is configured to acquire images in real time.

11. An apparatus as in claim 1, wherein said plurality of sensors comprises three sensors, and each said sensor is configured to map its image to an associated color channel, and wherein said algorithm is configured to combine said color channels into a color image.

12. An apparatus as in claim 11, wherein said three sensors are respectively sensitive to the visible, LWIR, and SWIR spectral bands.

13. An apparatus as in claim 1, wherein said processing and fusing of said image occurs in real time.

15. A method as in claim 14, further comprising the step of providing a frame grabber for acquiring said image.

16. A method as in claim 14, wherein said registration algorithm and said color fusion algorithm are resident programs in a central processor of a general purpose computer.

17. A method as in claim 14, further comprising displaying said image outputs on a screen display.

18. A method as in claim 17, further comprising providing an operator interface for allowing operator input in processing of said image outputs.

19. A method as in claim 14, wherein said color fusing is SCF.

20. A method as in claim 14, wherein said color fusing is PCCF.

21. A method as in claim 14, wherein said image is acquired by three sensors, each said sensor is configured to map its image to an associated color channel, and wherein said fusing combines said color channels into a color image.

22. A method as in claim 14, wherein said three sensors are respectively sensitive to the visible, LWIR, and SWIR spectral bands.

23. A method as in claim 14, wherein said processing and fusing of said image occurs in real time.

14. A method for producing a real-time color fused image, comprising te steps of:

providing one or more imaging sensors including at least two image-acquiring sensor areas located on said one or more imaging sensors, wherein each said sensor area is sensitive to a different spectral band than at least one other of said sensor areas;

exposing said at least two sensor-areas to an image, said at least two sensor areas thereby each acquiring said image and generating and generating an image output representative of said acquired image in the spectral band to which the sensor area is sensitive;

scaling said image outputs of said sensor areas;

registering said image outputs; and

color fusing said image outputs into a single image.