Method and apparatus for producing a fused image

• US 20070247517A1
• Filed: 08/23/2005
• Published: 10/25/2007
• Est. Priority Date: 08/23/2004
• Status: Abandoned Application

• Current Assignee: Sarnoff Corporation (SRI International, Inc.)
• Original Assignee: Sarnoff Corporation (SRI International, Inc.)
• Inventors: Zhang, Chao, Camus, Theodore, Southall, John
• Application Number:
  US11/209,969
• Publication Number:
  US 20070247517A1
• Time in Patent Office: Days
• US Class Current: 348/30
• CPC Class Codes: G06T 3/153 using elastic snapping
• CPC Class Codes: G06T 3/4061 by injecting details from different spectral ranges
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 5/2226 Determination of depth image, e.g. for foreground/background separation determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A method and apparatus for producing a fused image is described. In one embodiment, a first image at a first wavelength and a second image at a second wavelength are generated. Next, range information is generated and subsequently used to warp the first image in a manner that correlates to the second image. In turn, the warped first image is fused with the second image to produce the fused image.

Claims

1. A method for producing a fused image, comprising:

generating a first image at a first wavelength;

generating a second image at a second wavelength, wherein said second wavelength is different from said first wavelength;

generating range information;

warping said first image to correlate with said second image using said range information; and

fusing said warped first image with said second image to produce said fused image.

2. The method of claim 1, wherein said warping step comprises:

producing transformation data using said range information; and

warping said first image to correlate with said second image using said transformation data.

3. The method of claim 2, wherein said transformation data comprises a transformation matrix.

4. The method of claim 1, wherein said range information comprises a two-dimensional depth map.

5. The method of claim 1, wherein said first image comprises a thermal image.

6. The method of claim 1, wherein said second image comprises a visible image.

7. The method of claim 1, further comprising blending said fused image.

8. The method of claim 1, wherein said second image is used in generating said range information.

9. An apparatus for producing a fused image in a platform, comprising:

means for generating a first image at a first wavelength;

means for generating a second image at a second wavelength, wherein said second wavelength is different from said first wavelength;

means for generating range information;

means for warping said first image to correlate with said second image using said range information; and

means for fusing said warped first image with said second image to produce said fused image.

10. The apparatus of claim 9, wherein said warping means comprises:

means for producing transformation data using said range information; and

means for warping said first image to correlate with said second image using said transformation data.

11. The apparatus of claim 10, wherein said transformation data comprises a transformation matrix.

12. The apparatus of claim 9, wherein said range information comprises a two-dimensional depth map.

13. The apparatus of claim 9, wherein said first image comprises a thermal image.

14. The apparatus of claim 9, wherein said second image comprises a visible image.

15. The apparatus of claim 9, further comprising blending said fused image.

16. The apparatus of claim 9, wherein said platform is at least one of:

an automobile, an airplane, a boat, an unmanned vehicle, or a security and surveillance camera system.

17. The apparatus of claim 9, wherein said means for generating a first image comprises an infrared sensor.

18. The apparatus of claim 9, wherein said means for generating a second image comprises a visible camera.

19. A computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions including instructions which, when executed by a processor, cause the processor to perform the steps of a method for producing a fused image, comprising:

generating a first image at a first wavelength;

generating a second image at a second wavelength, wherein said second wavelength is different from said first wavelength;

generating range information;

warping said first image to correlate with said second image using said range information; and

fusing said warped first image with said second image to produce said fused image.

20. The computer-readable medium of claim 19, wherein said warping step comprises:

producing transformation data using said range information; and

warping said first image to correlate with said second image using said transformation data.