System for multi-sensor image fusion

• US 20030231804A1
• Filed: 06/11/2003
• Published: 12/18/2003
• Est. Priority Date: 06/12/2002
• Status: Active Grant

• Current Assignee: L3 Technologies, Inc. (L3Harris Technologies, Inc.)
• Original Assignee: Litton Systems Incorporated
• Inventors: DENK, Gabriel H., SHORT, Jeffrey C., HOGAN, Timothy B., OSTROMEK, Timothy E., BACARELLA, Antonio V., LUND, Robert F.
• Granted Patent: US 7,274,830 B2
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 3/4061 by injecting details from different spectral ranges
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen

Abstract

A method and system for fusing image data includes an electronic circuit (L) for synchronizing image frames. An adaptive lookup table unit (302a, 302b) receives the image frame data sets and applies correction factors to individual pixels. The size of an image is then scaled or otherwise manipulated as desired by data formatting processors (312a and 312b). Multiple images communicated within parallel circuit branches (P1 and P2) are aligned and registered together with sub-pixel resolution.

Claims

1. A method for fusing image data from two or more data sets into an output data stream, the method including the steps of:

synchronizing image frame data records;

using an adaptive lookup table to apply correction factors to individual pixels in an image to be processed; and

aligning and registering multiple selected synchronized images together.

3. The method of claim 1 further including scaling the size of an image record that has been processed with the adaptive lookup table.

2. The method of claim [claim Reference] wherein a fusion decision processor aligns and registers the multiple synchronized images.

4. The method of claim [claim Reference] wherein individual data streams are formatted following look up table processing and before the multiple data streams are fused.

5. The method of claim [claim Reference] wherein the correction factors applied are selected from the group consisting of gamma correction, brightness adjustment, contrast adjustment, pixel bit-width conversion or image fusion ratio.

6. An image data set fusion system for producing an output data stream by fusing image data records from two or more data sets comprising:

_Ref42655739

a plurality of parallel circuit branches each of which branches receive a data stream to be processed;

a data fusion processor component for controllably fusing image data records communicated from the parallel circuit branches; and

at least one of the parallel circuit branches having a look up table correction processing module to receive an input data stream corresponding to the parallel circuit branch and to apply desired correction parameters to the input data stream.

7. The invention of claim [claim Reference] wherein the fusion decision processor aligns and registers the multiple synchronized images.

8. The invention of claim [claim Reference] further including scaling the size of an image record that has been processed with the adaptive lookup table.

9. The invention of claim [claim Reference] wherein the correction factors applied by the look up table correction processing module are selected from the group consisting of gamma correction, brightness adjustment, contrast adjustment, pixel bit-width conversion or image fusion ratio.