Smart non-uniformity correction systems and methods

• US 10,412,273 B2
• Filed: 03/06/2018
• Issued: 09/10/2019
• Est. Priority Date: 03/13/2017
• Status: Active Grant

• Current Assignee: Flir Systems AB (Teledyne Technologies Incorporated)
• Original Assignee: Flir Systems AB (Teledyne Technologies Incorporated)
• Inventors: Hager, Pontus, Strandemar, Katrin
• Primary Examiner(s): Owens, Tsion B
• Application Number:
  US15/912,770
• Publication Number:
  US 20180262658A1
• Time in Patent Office: 553 Days
• CPC Class Codes: G05D 1/0253 extracting relative motion information from a plurality of images taken successively, e.g. visual odometry, optical flow determining position or orientation from images G06T7/70
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 25/63 applied to dark current
• CPC Class Codes: H04N 25/67 applied to fixed-pattern noise, e.g. non-uniformity of response
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction
• CPC Class Codes: H04N 25/673 by using reference sources
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Various embodiments of the present disclosure may include an imaging device configured to determine appropriate conditions for updating non-uniformity correction (NUC) terms. In certain embodiments, the imaging device may determine when the imaging device is likely not in use and update NUC terms during the times when the imaging device is likely not in use. Data from various position sensors such as gyroscopes, accelerometers, global positioning system receivers, and/or other data may be used to determine when the imaging device is likely not in use. Such position sensors may be coupled to the imaging device and/or may be remote from the imaging device. In certain embodiments, while NUC terms are updated, imaging data obtained may be modified with historical data to provide usable data.

Claims

1. An infrared camera comprising:

an image sensor configured to acquire a plurality of image frames of at least a first scene and output image data associated with the plurality of image frames of at least the first scene; and

a processor, communicatively coupled to the image sensor, and configured to;

receive positioning data associated with the infrared camera,

make a determination, from at least the positioning data, that a likelihood of current use of the infrared camera is lower than a threshold current likelihood, and

update non-uniformity correction (NUC) terms of the infrared camera in response to the determination.

2. The infrared camera of claim 1, further comprising:

a positioning sensor configured to output the positioning data to the processor, wherein the positioning sensor is a gyroscope, an accelerometer, and/or a global positioning receiver.

3. The infrared camera of claim 1, wherein the processor is configured to receive the positioning data from a secondary positioning data source comprising at least one of a positioning sensor coupled to a vehicle, a remote secondary data source, and/or a memory of the infrared camera.

4. The infrared camera of claim 1, wherein the processor is configured to determine the positioning data from the image data, store the positioning data in a memory of the infrared camera, and receive the positioning data from the memory.

5. The infrared camera of claim 1, wherein the processor is configured to receive the positioning data from an orientation sensor, wherein the positioning data is directed to an orientation of the infrared camera, and wherein the determination comprises a determination that the infrared camera is in a non-upright orientation.

6. The infrared camera of claim 1, wherein the processor is configured to receive the positioning data from a motion sensor, wherein the positioning data is directed to motion of the infrared camera, and wherein the determination comprises a determination that the camera is in motion.

7. The infrared camera of claim 1, wherein the processor is configured to receive the positioning data from a location sensor, wherein the positioning data is directed to a location of the infrared camera, and wherein the determination comprises a determination that the infrared camera is located outside of an area of interest.

8. The infrared camera of claim 1, wherein the processor is further configured to:

make a determination that a likelihood of future use of the infrared camera is higher than a threshold future likelihood; and

prevent updating of the NUC terms in response to the determination of the likelihood of future use.

9. The infrared camera of claim 1, wherein the processor is further configured to:

make a determination, from at least the positioning data, that the likelihood of current use of the infrared camera is higher than the threshold current likelihood;

make a determination that a time period greater than a maximum NUC timespan has elapsed since a previous NUC term update; and

update the NUC terms in response to the determination that the time period greater than the maximum NUC timespan has elapsed.

10. The infrared camera of claim 1, wherein the processor is further configured to:

receive the image data from the image sensor;

store the image data as historical image data; and

display an approximated image from the historical image data when the NUC terms are updating.

11. A method comprising:

receiving positioning data associated with an infrared camera;

making a determination, from at least the positioning data, that a likelihood of current use of the infrared camera is lower than a threshold current likelihood; and

updating non-uniformity correction (NUC) terms of the infrared camera in response to the determination.

12. The method of claim 11, wherein the positioning data is received from a positioning sensor coupled to the infrared camera and configured to output the positioning data associated with the camera to the processor, wherein the positioning sensor is a gyroscope, an accelerometer, and/or a global positioning receiver.

13. The method of claim 11, wherein the positioning data is received from a secondary positioning data source comprising at least one of a positioning sensor coupled to a vehicle, a remote secondary data source, and/or a memory of the infrared camera.

14. The method of claim 11, further comprising:

determining the positioning data from image data; and

storing the positioning data in a memory;

wherein the receiving positioning data comprises receiving the positioning data from the memory.

15. The method of claim 11, wherein the positioning data is directed to an orientation of the infrared camera, and wherein the determination comprises a determination that the infrared camera is in a non-upright orientation.

16. The method of claim 11, wherein the positioning data is directed to motion of the infrared camera, and wherein the determination comprises a determination that the camera is in motion.

17. The method of claim 11, wherein the positioning data is directed to a location of the infrared camera, and wherein the determination comprises a determination that the infrared camera is located outside of an area of interest.

18. The method of claim 11, further comprising:

making a determination that a likelihood of future use of the infrared camera is higher than a threshold future likelihood; and

preventing the updating of the NUC terms in response to the determination of the likelihood of future use.

19. The method of claim 11, further comprising:

making a determination, from at least the positioning data, that the likelihood of current use of the infrared camera is higher than the threshold current likelihood;

making a determination that a time period greater than a maximum NUC timespan has elapsed since a previous NUC term update; and

updating the NUC terms in response to the determination that the time period greater than the maximum NUC timespan has elapsed.

20. The method of claim 11, further comprising:

receiving image data from an image sensor of the infrared camera;

storing the image data as historical image data; and

displaying an approximated image from the historical image data when the NUC terms are updating.