Thermal imager with large dynamic range and improved signal-to-noise ratio

• US 9,635,283 B2
• Filed: 10/26/2015
• Issued: 04/25/2017
• Est. Priority Date: 10/04/2013
• Status: Active Grant

• Current Assignee: Fluke Corporation (Fortive Corp.)
• Original Assignee: Fluke Corporation (Fortive Corp.)
• Inventors: Heinke, Thomas
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US14/923,041
• Publication Number:
  US 20160044254A1
• Time in Patent Office: 547 Days
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A system for producing thermal images acquires at least first and second thermal images comprising a plurality of pixels and a first and second dynamic range, respectively. The second dynamic range is such that its upper limit is higher than that of the first, and at least partially overlaps the first. A final thermal image is created comprising pixels from the first thermal image that are not saturated or nearly saturated with respect to the first dynamic range, and pixels from the second thermal image that are saturated or nearly saturated with respect to the first dynamic range. The resulting final image generally comprises both a large dynamic range and high signal-to-noise ratio.

Claims

1. A non-transitory computer readable medium containing executable instructions causing one or more processors to perform a method of creating a final thermal image from at least a first and second thermal image of a scene, the second thermal image having a larger dynamic range than the first thermal image, the method comprising:

defining a first set of pixels in the second thermal image, the first set of pixels consisting of pixels not saturated or nearly saturated with respect to the dynamic range of the first thermal image;

defining a second set of pixels in the second thermal image, the second set of pixels consisting of pixels not saturated or nearly saturated with respect to the dynamic range of the second thermal image;

constructing a final thermal image comprising the first set of pixels from the first thermal image and the second set of pixels from the second thermal image.

2. The non-transitory computer-readable medium of claim 1, wherein the dynamic range of the first thermal image is within the dynamic range of the second thermal image;

and

the method comprises;

analyzing a plurality of pixels in the second thermal image, and for each analyzed pixel,

if the pixel within the second thermal image is within the first dynamic range of the first thermal image, considering such pixel to be in the first set of pixels such that the first set of pixels comprises pixels in the second thermal image that are within the dynamic range of the first thermal image.

3. The non-transitory computer-readable medium of claim 2, wherein

the method further comprises defining a third set of pixels in the second thermal image;

and wherein

the final thermal image comprises the first set of pixels form the first thermal image, the second set of pixels from the second thermal image, and the third set of pixels from a third thermal image.

4. The non-transitory computer-readable medium of claim 3, wherein the dynamic range of the third thermal image is within the dynamic range of the first thermal image, within the dynamic range of the second thermal image, or within both the first dynamic range and the second dynamic range.

5. The non-transitory computer-readable medium of claim 1, wherein the dynamic ranges of the first and second thermal images are defined by a number of digital counts.

6. The non-transitory computer-readable medium of claim 1, wherein the method further comprises presenting the final thermal image on a display.

7. The non-transitory computer-readable medium of claim 6, further comprising executable instructions causing the one or more processors to:

repeatedly perform the method for a plurality of sets of first and second thermal images; and

repeatedly update the generated display.

8. A thermal imaging system comprising:

an infrared camera module configured to capture thermal images;

a processor configured to;

capture a first thermal image of a target scene via the infrared camera module, the first thermal image having a first dynamic range;

capture a second thermal image of the target scene via the infrared camera module, the second thermal image having a second dynamic range different from the first;

designate a first set of pixels and a second set of pixels representative of portions of the target scene such that the first set of pixels are not saturated or nearly saturated with respect to the first dynamic range and the second set of pixels are not saturated or nearly saturated with respect to the second dynamic range; and

generate a final image comprising the first set of pixels from the first thermal image and the second set of pixels from the second thermal image.

9. The thermal imaging system of claim 8, wherein the processor is further configured to:

capture a third thermal image of the target scene via the infrared camera module, the third thermal image having a third dynamic range; and

designate a third set of pixels representative of portions of the target scene; and

wherein the generated final image comprises the third set of pixels from the third thermal image.

10. The thermal imaging system of claim 9, wherein the third dynamic range contains the first and second dynamic ranges, and wherein the processor is further configured to analyze a plurality of pixels in the third thermal image, and wherein

if the pixel is not saturated or nearly saturated with respect to the first thermal image, designating such pixel to be in the first group of pixels, and

if the pixel is not within the first group of pixels and is not saturated or nearly saturated with respect to the second dynamic range, designating such pixel to be in the second group of pixels.

11. The thermal imaging system of claim 8, further comprising user interface, and wherein a user can select at least one of the first and second dynamic ranges via the user interface.

12. The thermal imaging system of claim 11, further comprising a housing supporting the processor, the user interface, and the infrared camera module.

13. The thermal imaging system of claim 11, wherein the user can select a number of thermal images to capture for generating the final image, and wherein the processor is configured to:

acquire the selected number of thermal images of the target scene, each of the acquired thermal images having a different dynamic range; and

designate an equal number of sets of pixels as the selected number of thermal images, each set of pixels corresponding to an acquired thermal image;

wherein

the final image comprises, from each of the acquired thermal images, the set pixels corresponding to that thermal image.

14. The thermal imaging system of claim 8, wherein designating the first set of pixels comprises analyzing a plurality of pixels in the first thermal image, and, for each analyzed pixel, if the pixel is not saturated or nearly saturated in the first thermal image, designating such pixel to be in the first set of pixels.

15. The thermal imaging system of claim 8, wherein designating the first set of pixels comprises analyzing a plurality of pixels in the second thermal image, and, for each analyzed pixel, if the pixel in the second thermal image is not saturated or nearly saturated with respect to the first dynamic range, designating such pixel to be in the first set of pixels.

16. The thermal imaging system of claim 8, further comprising a visible light camera module configured to generate visible light image data, and wherein the final image comprises visible light image data.

17. The thermal imaging system of claim 8, wherein the first dynamic range is within the second dynamic range.

18. A thermal image generation system comprising:

a memory configured to store a plurality of thermal images; and

a processor in communication with the memory and configured to generate a final image from a plurality of thermal images of a target scene, each of the plurality of thermal images having a different dynamic range and wherein the largest dynamic range contains each of the smaller dynamic ranges; and

wherein generating the final image comprises;

analyzing, pixel by pixel, the thermal image having the largest dynamic range;

for each pixel, selecting a thermal image from the plurality of thermal images in which the pixel is not saturated or nearly saturated; and

constructing a final image using, for each pixel in the final image, the corresponding pixel from the selected thermal image.

19. The thermal image generation system of claim 18, wherein selecting a thermal image from the plurality of thermal images for each pixel comprises determining which thermal image in the plurality of thermal images includes the smallest dynamic range in which the pixel is not saturated or nearly saturated and selecting such thermal image, whereby

constructing the final image comprises using, for each pixel, the corresponding pixel from the thermal image having the smallest dynamic range and in which the pixel is not saturated.

20. The thermal image generation system of claim 18, further comprising an infrared camera module configured to capture the plurality of thermal images.