Thermal anomaly detection

• US 10,375,325 B2
• Filed: 06/23/2016
• Issued: 08/06/2019
• Est. Priority Date: 06/23/2016
• Status: Active Grant

• Current Assignee: Fluke Corporation (Fortive Corp.)
• Original Assignee: Fluke Corporation (Fortive Corp.)
• Inventors: Schmidt, Matthew F.
• Primary Examiner(s): Natnael, Paulos M
• Application Number:
  US15/190,792
• Publication Number:
  US 20170374296A1
• Time in Patent Office: 1,139 Days
• Field of Search: 348164, 348125, 348135-137
• CPC Class Codes: G01J 2005/0077 Imaging
• CPC Class Codes: G01J 5/025 Interfacing a pyrometer to an external device or network; User interface
• CPC Class Codes: G01J 5/10 using electric radiation detectors
• CPC Class Codes: G01N 25/72 Investigating presence of flaws
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: H04N 23/23 from thermal infrared radiation
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Systems and methods can be used to detect thermal anomalies in a target scene of an infrared image. Acquired thermal image data can be compared to a statistical thermal profile to detect thermal anomalies in the image data. Anomaly data based on the comparison can be used to generate an image representing locations and/or severity of detected anomalies. Systems can be used to acquire thermal image data for generating and/or updating statistical thermal profiles for use in anomaly detection processes. Auxiliary measurement devices can provide measurement data representative of one or more parameters of the target scene. The measurement data can be used to select from a plurality of possible statistical thermal profiles associated with the target scene to best match the current parameters of the scene.

Claims

1. A thermal analysis system comprising:

a memory comprising a statistical thermal profile representing typical thermal behavior of each of a plurality of regions of a target scene and determined from a plurality of thermal images of the target scene over time;

an infrared (IR) camera module capable of receiving IR radiation from a target scene and generating corresponding thermal image data representative of a heat pattern across the target scene based on the received IR radiation; and

a processor in communication with the memory and the IR camera module and configured to;

receive thermal image data from the IR camera module representative of the heat pattern of the target scene;

for each of the plurality of regions in the received thermal image data, compare the thermal image data of the region to a corresponding region in the statistical thermal profile of the target scene;

generate anomaly image data comprising a plurality of regions, each region in the anomaly image data corresponding to a respective region in the received thermal image data and representative of the degree of anomalousness of the received thermal image data with respect to the statistical thermal profile in that region; and

generate a display image comprising the anomaly image data blended with one or more additional data streams.

2. The system of claim 1, wherein the statistical thermal profile comprises, in each of the plurality of regions, at least two statistical parameters representative of typical thermal image data in the target scene.

3. The system of claim 2, wherein the statistical thermal profile comprises a mean temperature value and a standard deviation for each of the plurality of regions from the plurality of thermal images over time.

4. The system of claim 3, wherein the degree of anomalousness of the received thermal image data with respect to the statistical thermal profile comprises the number of standard deviations the thermal image data differs from the mean temperature value in the statistical thermal profile in each region.

5. The system of claim 4, further comprising a display in communication with the processor, and wherein the processor is further configured to present the display image on the display.

6. The system of claim 1, wherein the one or more additional data streams comprises at least one from the list consisting of:

thermal image data, visible light image data, and modified image data including enhanced features.

7. The system of claim 1, wherein the processor is further configured to:

determine if the received thermal image data is considered anomalous based on the anomaly image data in the plurality of regions; and

if the thermal image data is considered anomalous, save the received thermal image data and/or the generated display image in memory.

8. The system of claim 7, further comprising an external device, and wherein saving the received thermal image data and/or the generated display image in memory if the thermal image data is considered anomalous comprises uploading the received thermal image data and/or the generated display image to the external device.

9. The system of claim 1, further comprising an auxiliary measurement device configured to measure one or more parameters associated with the target scene, and wherein the statistical thermal profile is associated with the one or more parameters.

10. The system of claim 9, wherein the memory comprises a plurality of statistical thermal profiles and the processor is further configured to:

receive measurement data from the sensor representative of one or more parameters of the target scene; and

select a statistical thermal profile from the memory for comparison with the thermal image data based on the received measurement data.

11. The system of claim 1, wherein the processor is further configured to update the statistical thermal profile with the received thermal image data.

12. The system of claim 1, wherein the thermal camera module is fixed proximate a device under test so that the target scene comprises the device under test and so that acquired thermal image data is representative of approximately the same vantage point of the device under test.

13. The system of claim 1, wherein the IR camera module is housed in a hand-held thermal imaging camera.

14. A thermal analysis system comprising:

an infrared (IR) camera module capable of receiving IR radiation from a target scene and generating corresponding IR image data representative of the heat pattern across the target scene based on the received IR radiation;

a memory in communication with the IR camera module;

an auxiliary measurement device configured to generate measurement data representative of at least one parameter of the target scene

a processor in communication with the auxiliary measurement device, the IR camera module, and the memory, the processor being configured to;

(a) at a plurality of times, capture thermal image data from a target scene using the IR camera module and acquire measurement data from the auxiliary measurement device at approximately the same time as capturing the thermal image data; and

(b) generate a statistical thermal profile of the target scene based on the thermal image data captured at the plurality of times;

wherein

the statistical thermal profile comprises, for each of a plurality of regions in the thermal image data, at least two statistical parameters representative of the typical thermal behavior in the target scene in each of the plurality of regions, and

generating the statistical thermal profile comprises associating the captured thermal image data with an operating condition based on the acquired measurement data and generating a statistical thermal profile corresponding to the operating condition.

15. The system of claim 14, wherein the processor is further configured to:

(c) capture further thermal image data from the target scene using the IR camera module;

(d) compare at least a portion of the captured further thermal image data from step (c) to a corresponding portion of the generated statistical thermal profile of the target scene; and

(e) in the event that the portion of the captured further thermal image data is considered sufficiently anomalous with respect to the corresponding portion of the statistical thermal profile of the target scene, perform at least one action.

16. The system of claim 15, further comprising an external device in communication with the processor, and wherein the performing the at least one action comprises alerting a system operator of a detected anomaly via the external device.

17. The system of claim 14, wherein the processor is further configured to:

(c) capture further thermal image data from the target scene using the IR camera module;

(d) acquire measurement data at approximately the same time as capturing further thermal image data from the target scene in step (c) to determine an operating condition of the target scene;

(e) select a statistical thermal profile from memory corresponding to the determined operating condition;

(f) compare at least a portion of the captured further thermal image data from step (c) to a corresponding portion of the selected statistical thermal profile of the target scene; and

(g) in the event that the portion of the captured further thermal image data is considered sufficiently anomalous with respect to the corresponding portion of the selected statistical thermal profile of the target scene, perform at least one action.

18. The system of claim 14, wherein generating the statistical thermal profile comprises determining, for each of a plurality of regions in the captured thermal image data, an average value and a standard deviation.

19. The system of claim 14, further comprising a user interface by which a user can manually exclude captured thermal image data from contributing to the statistical thermal profile.

20. The system of claim 14, wherein the processing steps of (a) capturing thermal image data from a target scene using the IR camera module and (b) generating a statistical thermal profile of the target scene based on the captured thermal image data comprise:

capturing thermal image data;

determining the at least two statistical parameters from the captured thermal image data;

aggregating the determined statistical parameters from the captured thermal image data;

generating the statistical thermal profile using the aggregated statistical parameters; and

discarding the captured thermal image data.

21. A thermal analysis system comprising:

an infrared (IR) camera module capable of receiving IR radiation from a target scene and generating corresponding IR image data representative of the heat pattern across the target scene based on the received IR radiation;

a memory in communication with the IR camera module;

a processor in communication with the IR camera module and the memory, the processor being configured to;

(a) at a plurality of times, capture thermal image data from a target scene using the IR camera module; and

(b) generate a statistical thermal profile of the target scene based on the thermal image data captured at the plurality of times;

wherein

the statistical thermal profile comprises, for each of a plurality of regions in the thermal image data, at least two statistical parameters representative of the typical thermal behavior in the target scene in each of the plurality of regions; and

the processing steps of (a) capturing thermal image data from a target scene using the IR camera module and (b) generating a statistical thermal profile of the target scene based on the captured thermal image data comprise;

capturing thermal image data;

determining the at least two statistical parameters from the captured thermal image data;

aggregating the determined statistical parameters from the captured thermal image data;

generating the statistical thermal profile using the aggregated statistical parameters; and

discarding the captured thermal image data.

22. The system of claim 21, wherein the processor is further configured to:

(c) capture further thermal image data from the target scene using the IR camera module;

(d) compare at least a portion of the captured further thermal image data from step (c) to a corresponding portion of the generated statistical thermal profile of the target scene; and

(e) in the event that the portion of the captured further thermal image data is considered sufficiently anomalous with respect to the corresponding portion of the statistical thermal profile of the target scene, perform at least one action.

23. The system of claim 22, further comprising an external device in communication with the processor, and wherein the performing the at least one action comprises alerting a system operator of a detected anomaly via the external device.

24. The system of claim 21, further comprising an auxiliary measurement device in communication with the processor and configured to generate measurement data representative of at least one parameter of the target scene;

and

wherein the processor is further configured to acquire measurement data at approximately the same time as capturing thermal image data from the target scene in step (a); and

generating the statistical thermal profile comprises associating the captured thermal image data with an operating condition based on the acquired measurement data and generating a statistical thermal profile corresponding to the operating condition.

25. The system of claim 24, wherein the processor is further configured to:

(c) capture further thermal image data from the target scene using the IR camera module;

(d) acquire measurement data at approximately the same time as capturing further thermal image data from the target scene in step (c) to determine an operating condition of the target scene;

(e) select a statistical thermal profile from memory corresponding to the determined operating condition;

(f) compare at least a portion of the captured further thermal image data from step (c) to a corresponding portion of the selected statistical thermal profile of the target scene; and

(g) in the event that the portion of the captured further thermal image data is considered sufficiently anomalous with respect to the corresponding portion of the selected statistical thermal profile of the target scene, perform at least one action.

26. The system of claim 21, wherein generating the statistical thermal profile comprises determining, for each of a plurality of regions in the captured thermal image data, an average value and a standard deviation.

27. The system of claim 21, further comprising a user interface by which a user can manually exclude captured thermal image data from contributing to the statistical thermal profile.