Digitally enhanced night vision device

• US 7,969,462 B2
• Filed: 03/28/2006
• Issued: 06/28/2011
• Est. Priority Date: 03/30/2005
• Status: Active Grant

• Current Assignee: L3 Technologies, Inc. (L3Harris Technologies, Inc.)
• Original Assignee: L-3 Communications Corporation (L3Harris Technologies, Inc.)
• Inventors: Hoodswain, Bruce V., May, Lee S. Jr., Ostromek, Timothy E., Hogan, Timothy B., Short, Jeffrey C., Estrera, Joseph P.
• Primary Examiner(s): Ometz; David L
• Assistant Examiner(s): Le; Quang V
• Application Number:
  US11/308,461
• Publication Number:
  US 20060221180A1
• Time in Patent Office: 1,918 Days
• Field of Search: 348/53, 348/48, 382/276, 382/284, 382/254
• US Class Current: 348/53
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths

Abstract

A user portable viewing device includes a plurality of non-coaxially aligned sensors for sensing a scene. A processing element combines electronic images into a single electronic image. A display displaying the combined electronic image is adaptable for mounting in an optical axis including an eye of the user and an input end of the first sensor for direct view. In a second embodiment, a system for fusing images comprises sensors for generating sets of image data. An information processor receives and samples the sets of image data to generate sample data for computing a fused image array. A display receives the fused image array and displays a fused colorized image generated from the fused image array.

Claims

1. A system for fusing images of a scene received by a plurality of sensors into a displayable colorized image, the system comprising:

two or more sensors for generating two or more corresponding sets of image data;

each set of image data comprising an array of datapoints with each datapoint being representative of at least one information factor mapped to a pre-determined area of the scene as received by the sensor;

an information processor for receiving and sampling the sets of image data to generate corresponding mapped sample data arrays for each set of image data and for computing a fused colorized image array to be displayed from the sample data;

each sample data array comprising a mapping of datapoints from an image data set mapped to a corresponding datapoint in the related sample data array using a pre-determined function;

the mapping function being computed by assigning a point along a color vector in a two or more dimensional colorspace to a selected value of the information factor; and

a fused colorized image to be displayed being computed from combining corresponding datapoints from each of the information factored mapped sample data arrays using a pre-selected arithmetic vector function; and

a display for receiving the fused colorized image array and displaying the fused colorized image generated from the fused colorized image array.

2. The system of claim 1 wherein the plurality of sensors include an image intensifier tube and an infrared camera.

3. The system of claim 1 wherein the combining function to compute the fused colorized image is addition.

4. The system of claim 1 wherein the combining function to compute the fused colorized image is a linear combination.

5. The system of claim 1 wherein the combining function to compute the fused colorized image is a non-linear combination.

6. The system of claim 1 wherein the vector chosen in the multi-dimensional colorspace is a selected vector formed in a CIE 1931 colorspace.

7. The system of claim 1 wherein the combining function to compute the fused colorized image is a class of image fusion algorithms that perform additive or subtractive functions.

8. The system of claim 1 wherein the display for displaying a fused colorized image generated from the fused colorized image array and the plurality of sensors are mounted within a housing.

9. A method for fusing images, the method comprising the steps of:

receiving two or more sets of image data generated by two or more sensors;

each set of image data comprising an array of datapoints with each datapoint being representative of at least one information factor mapped to a pre-determined area of the scene as received by the sensor;

sampling the sets of image data to produce corresponding information factored mapped sample data arrays for each set of image data and for use in computing a fused colorized image array to be displayed from the mapped sample data;

each sample data array comprising a mapping of datapoints from an image data set mapped to a corresponding datapoint in the related sample data array using a pre-determined function;

the mapping function being computed by assigning a point along a color vector in a two or more dimensional colorspace to a selected value of the information factor;

computing a fused colorized image array from the sample data arrays by combining corresponding datapoints from each of the sample data arrays using a pre-selected arithmetic vector function; and

displaying a fused colorized image generated from the fused colorized image array.

10. The method of claim 9 wherein the plurality of sensors include an image intensifier tube and an infrared camera.

11. The method of claim 10 wherein the vector chosen in the multi-dimensional colorspace is a selected vector formed in a CIE 1931 colorspace.

12. The method of claim 9 wherein a display for displaying a fused colorized image and a plurality of sensors for generating the set(s) of image data are mounted within a housing.