Multi-spectral fusion for video surveillance

• US 7,613,360 B2
• Filed: 02/01/2006
• Issued: 11/03/2009
• Est. Priority Date: 02/01/2006
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Bazakos, Michael E., Ma, Yunqian
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US11/345,203
• Publication Number:
  US 20070177819A1
• Time in Patent Office: 1,371 Days
• Field of Search: 382/284, 382/294, 382/276, 382/312, 382/318, 382/191, 382/100, 382/154, 348/33, 348/47, 348/48
• US Class Current: 382/284
• CPC Class Codes: G06F 18/251 of input or preprocessed data
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/803 of input or preprocessed data
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths

Abstract

A multi-spectral imaging surveillance system and method in which a plurality of imaging cameras is associated with a data-processing apparatus. A module can be provided, which resides in a memory of said data-processing apparatus. The module performs fusion of a plurality images respectively generated by varying imaging cameras among said plurality of imaging cameras. Fusion of the images is based on a plurality of parameters indicative of environmental conditions in order to achieve enhanced imaging surveillance thereof. The final fused images are the result of two parts: an image fusion portion, and a knowledge representation part. For the final fusion, many operators can be utilized, which can be applied between the image fusion result and the knowledge representation portion.

Claims

1. A multi-spectral imaging surveillance system, comprising:

a plurality of imaging cameras associated with a data-processing apparatus; and

a module residing in a memory of said data-processing apparatus for fusion of a plurality images respectively generated by varying imaging cameras among said plurality of imaging cameras, wherein said fusion of images is based on a plurality of parameters indicative of environmental conditions in order to achieve enhanced imaging surveillance thereof.

2. The system of claim 1, wherein said fusion of images is further based on implementation of Principal Component Analysis (PCA).

3. The system of claim 1 wherein said plurality of imaging cameras comprises:

a visible color video camera;

a near IR camera;

a mid wave IR camera; and

a long wave IR camera associated with said visible color video camera, said near IR camera, and said mid wave IR camera, wherein said visible color video camera, said near IR camera, said mid wave IR camera and said long wave IR camera communicate with one another and with said data-processing apparatus.

4. The system of claim 3 wherein at least one imaging camera among said plurality of imaging cameras is calibrated utilizing Digital Acquisition System (DAS) electronics.

5. The system of claim 3 wherein said visible color video camera operates based on a visible wavelength in a range of approximately 0.4 μ

m to 0.8 μ

m.

6. The system of claim 3 wherein said near IR camera operates based on a wavelength in a range of approximately 0.9 μ

m to 1.7 μ

m.

7. The system of claim 6 wherein said near IR camera comprises an Indium Gallium Arsenide (InGaAs) focal plane array (FPA).

8. The system of claim 3 wherein said mid wave IR camera operates based on a wavelength in a range of approximately 3 μ

m to 5 μ

m.

9. The system of claim 3 wherein said long wave IR camera operates based on a wavelength in a range of approximately 7.5 μ

m to 13.5 μ

m.

10. A multi-spectral imaging surveillance method, comprising:

placing a plurality of imaging cameras aimed at a target, wherein said plurality of imaging cameras generate images of said target;

fusing said images in a module which resides in a data-processing apparatus, wherein said fusing said images is based on a plurality of parameters indicative of environmental conditions in order to achieve enhanced imaging surveillance thereof;

displaying a plurality of fused images on a monitor associated with said data-processing apparatus; and

storing said plurality of fused images in a computer readable memory of said data-processing apparatus.

11. The method of claim 10 wherein said fusing said images is further based on implementation of Principal Component Analysis (PCA).

12. The method of claim 10 wherein said plurality of imaging cameras comprise:

a visible color video camera;

a near IR camera;

a mid wave IR camera; and

a long wave IR camera associated with said visible color video camera, said near IR camera, and said mid wave IR camera, wherein said visible color video camera, said near IR camera, said mid wave IR camera and said long wave IR camera communicate with one another and with said data-processing apparatus.

13. The method of claim 12 further comprising calibrating at least one imaging camera among said plurality of imaging cameras utilizing Digital Acquisition System (DAS) electronics.

14. The method of claim 12 wherein said visible color video camera operates based on a visible wavelength in a range of approximately 0.4 μ

m to 8.9 μ

m.

15. The method of claim 12 wherein said near IR camera operates based on a wavelength in a range of approximately 0.9 μ

m to 1.7 μ

m.

16. The method of claim 12 wherein said mid wave IR camera operates based on a wavelength in a range of approximately 3 μ

m to 5 μ

m.

17. The method of claim 12 wherein said long wave IR camera operates based on a wavelength in a range of approximately 7.5 μ

m to 13.5 μ

m.