Techniques to compensate for calibration drifts in infrared imaging devices

• US 9,900,526 B2
• Filed: 06/25/2015
• Issued: 02/20/2018
• Est. Priority Date: 06/10/2011
• Status: Active Grant

• Current Assignee: Teledyne FLIR LLC (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Kostrzewa, Joseph, Nguyen, Vu L., Hoelter, Theodore R., Hgasten, Nicholas, Nussmeier, Mark, Kurth, Eric A., Strandemar, Katrin, Boulanger, Pierre, Sharp, Barbara
• Primary Examiner(s): Werner, David N
• Application Number:
  US14/749,886
• Publication Number:
  US 20150312488A1
• Time in Patent Office: 971 Days
• Field of Search: None
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/50 Control of the SSIS exposure
• CPC Class Codes: H04N 25/63 applied to dark current
• CPC Class Codes: H04N 25/674 based on the scene itself, e.g. defocusing
• CPC Class Codes: H04N 25/677 for reducing the column or line fixed pattern noise
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Various techniques are provided to compensate for and/or update ineffective (e.g., stale) calibration terms due to calibration drifts in infrared imaging devices. For example, a virtual-shutter non-uniformity correction (NUC) procedure may be initiated to generate NUC terms to correct non-uniformities when appropriate triggering events and/or conditions are detected that may indicate presence of an object or scene to act as a shutter (e.g., a virtual shutter). Scene-based non-uniformity correction (SBNUC) may be performed during image capturing operations of the infrared imaging device, for example, when a virtual-shutter scene is not available. Further, snapshots of calibration data (e.g., NUC terms) produced during the virtual-shutter NUC procedure, the SBNUC process, and/or other NUC process may be taken. Such snapshots may be utilized to provide useful NUC data when the infrared imaging device starts up or is otherwise reactivated, so that the SBNUC or other NUC methods may produce effective results soon after the start-up. Such snapshots may also be utilized to update ineffective calibration terms.

Claims

1. A method comprising:

receiving image frames of a scene captured by a focal plane array (FPA) of an infrared imaging device;

detecting an external condition associated with a virtual-shutter non-uniformity correction (NUC) procedure;

processing at least one of the image frames in response to the detected external condition to obtain NUC teams without the use of a temperature controlled black body; and

storing the obtained NUC terms as one or more snapshots of NUC terms.

2. The method of claim 1, further comprising checking whether the stored snapshots are valid or not.

3. The method of claim 1, further comprising selecting, upon a startup of the infrared imaging device, from one or more snapshots of NUC terms to apply to the image frames captured by the FPA.

4. The method of claim 3, wherein the snapshot is selected based on a temperature associated with the snapshot and/or on recency of the snapshot.

5. The method of claim 1, wherein the infrared imaging device is adapted to store calibration terms to be applied to reduce noise introduced by the infrared imaging device prior to application of the NUC terms, the method further comprising selecting, upon a startup of the infrared imaging device, from one or more snapshots of NUC terms to update the calibration terms.

6. The method of claim 5, further comprising:

converting the selected snapshot of NUC terms into new calibration terms; and

storing the new calibration terms in the infrared imaging device.

7. The method of claim 6, further comprising, prior to storing the new calibration terms, comparing the new calibration terms with calibration terms previously stored in the infrared imaging device to determine whether to use the new calibration terms, wherein the storing the new calibration terms is performed or not based on the determination.

8. The method of claim 1,

wherein the scene is a substantially uniform scene provided by an external object acting as a virtual shutter.

9. The method of claim 8, wherein the detecting the external condition comprises detecting that a host device comprising the infrared imaging device is holstered and/or a field-of-view of the infrared imaging device is substantially blocked.

10. The method of claim 8, wherein the detecting the external condition comprises analyzing uniformity of the image frames, a temperature associated with the infrared imaging device, and/or stability of the infrared imaging device.

11. The method of claim 1, wherein the obtaining the NUC terms comprises:

receiving an intentionally blurred image frame of the scene; and

processing the blurred image frame to determine the NUC tetins to reduce spatially uncorrelated fixed pattern noise (FPN) introduced by the infrared imaging device.

12. The method of claim 1, wherein the FPA comprises an array of microbolometers, the method further comprising:

providing a bias voltage to the microbolometers selected from a range of approximately 0.2 volts to approximately 0.7 volts.

13. The method of claim 1, wherein the method is performed using components of a mobile phone, a tablet device, or a portable infrared camera.

14. A device comprising:

an infrared imaging device comprising a focal plane array (FPA) adapted to capture image frames of a scene;

a memory adapted to store information; and

a processor adapted to communicate with the infrared imaging device and the memory, the processor further adapted to;

detect an external condition associated with a virtual-shutter non-uniformity correction (NUC) procedure,

process at least one of the image frames in response to the detected external condition to obtain NUC teens without the use of a temperature controlled black body, and

store, in the memory, the obtained NUC terms as one or more snapshots of NUC terms.

15. The device of claim 14, wherein the processor is further adapted to check whether the stored snapshots are valid or not.

16. The device of claim 14, wherein the processor is further adapted to select, upon a startup of the infrared imaging device, from one or more snapshots of NUC terms in the memory to apply to the image frames captured by the FPA.

17. The device of claim 16, wherein the snapshot is selected based on a temperature associated with the snapshot and/or on recency of the snapshot.

18. The device of claim 14, further comprising a non-volatile memory adapted to store calibration terms to be applied to reduce noise introduced by the infrared imaging device prior to application of the NUC terms, wherein the processor is further adapted to select, upon a startup of the infrared imaging device, from one or more snapshots of NUC terms to update the calibration terms.

19. The device of claim 18, wherein the processor is further adapted to:

convert the selected snapshot of NUC terms into new calibration terms; and

store the new calibration terms in the non-volatile memory.

20. The device of claim 19, wherein the processor is further adapted to:

compare the new calibration terms with calibration terms previously stored in the non-volatile memory to determine whether to use the new calibration terms; and

store the new calibration terms or not based on the determination.

21. The device of claim 14,

wherein the scene is a substantially uniform scene provided by an external object acting as a virtual shutter.

22. The device of claim 21, wherein the processor is adapted to detect the external condition by detecting that the device is holstered and/or a field-of-view of the infrared imaging device is substantially blocked.

23. The device of claim 21, wherein the processor is further adapted to detect the external condition by analyzing uniformity of the image frames, a temperature associated with the infrared imaging device, and/or stability of the infrared imaging device.

24. The device of claim 14, wherein:

the infrared imaging device is adapted to capture an intentionally blurred image frame of the scene; and

the processor is adapted to use the blurred image frame to obtain the NUC terms to reduce spatially uncorrelated fixed pattern noise (FPN) introduced by the infrared imaging device.

25. The device of claim 14, wherein the FPA comprises an array of microbolometers adapted to receive a bias voltage selected from a range of approximately 0.2 volts to approximately 0.7 volts.

26. The device of claim 14, wherein the device is a mobile phone, a tablet device, or a portable infrared camera.