Alignment of visible light sources based on thermal images

• US 9,058,653 B1
• Filed: 03/13/2013
• Issued: 06/16/2015
• Est. Priority Date: 06/10/2011
• Status: Active Grant

• Current Assignee: Teledyne FLIR LLC (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Kostrzewa, Joseph, Jepson, Shawn, Hgasten, Nicholas, Hoelter, Theodore R., Strandemar, Katrin
• Primary Examiner(s): Gaworecki, Mark R
• Application Number:
  US13/802,578
• Publication Number:
  US 20150146009A1
• Time in Patent Office: 825 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 25/63 applied to dark current
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction
• CPC Class Codes: H04N 25/677 for reducing the column or line fixed pattern noise
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Various techniques are disclosed for providing systems for providing alignment guide information to selectively direct a visible light source to substantially align the visible light source with a desired subject and to project a visible light beam substantially on the desired subject. For example, a system may include a small form factor infrared imaging module to capture thermal images of a scene, which may be received by a processor to generate alignment guide information such as a user-viewable image of the scene, a user-viewable cue, and a framing reticle. In another example, such a system may be implemented as a camera. In yet another example, such a system may be implemented as a spotlight.

Claims

1. A system comprising:

an infrared imaging module comprising a focal plane array (FPA) configured to capture an unblurred thermal image of a scene and an intentionally blurred image of the scene;

a processor configured to determine a plurality of non-uniform correction (NUC) terms based on the intentionally blurred thermal image, apply the NUC terms to the unblurred thermal image to remove noise form the unblurred thermal image, and generate alignment guide information from the unblurred thermal image; and

a visible light source configured to be selectively directed based on the alignment guide information to substantially align the visible light source with a desired subject and project a visible light beam substantially on the subject.

2. The system of claim 1, wherein the infrared imaging module is oriented so that an optical axis of the infrared imaging module is substantially parallel to the visible light beam.

3. The system of claim 1, further comprising a display configured to present the alignment guide information to a user.

4. The system of claim 3, wherein the alignment guide information comprises a user-viewable image of the scene based on the unblurred thermal image.

5. The system of claim 3, wherein the alignment guide information comprises a user-viewable cue indicating how the visible light source should be directed to project the visible light beam substantially on the subject.

6. The system of claim 1, wherein the system is a camera and the visible light source is a flash of the camera.

7. The system of claim 1, wherein the system is a spotlight.

8. The system of claim 1, wherein the visible light source is selectively directed by a user of the system.

9. The system of claim 1, wherein the visible light source is selectively directed by the system without requiring direction by a user.

10. The system of claim 1, wherein the system is a shutterless system configured to determine the NUC terms without blocking the FPA from the scene.

11. A method of operating a system, the method comprising:

capturing an unblurred thermal image of a scene and an intentionally blurred image of the scene at a focal plane array (FPA) of an infrared imaging module;

determining a plurality of non-uniform correction (NUC) terms based on the intentionally blurred thermal image;

applying the NUC terms to the unblurred thermal image to remove noise form the unblurred thermal image;

generating, from the unblurred thermal image, alignment guide information;

receiving a force to selectively direct a visible light source to substantially align the visible light source with a desired subject based on the alignment guide information; and

projecting a visible light beam from the visible light source substantially on the subject while the visible light source is aligned based on the alignment guide information.

12. The method of claim 11, wherein the infrared imaging module is oriented so that an optical axis of the infrared imaging module is substantially parallel to the visible light beam.

13. The method of claim 11, further comprising displaying the alignment guide information to a user.

14. The method of claim 13, wherein the alignment guide information comprises a user-viewable image of the scene based on the unblurred thermal image.

15. The method of claim 13, wherein the alignment guide information comprises a user-viewable cue indicating how the visible light source should be directed to project the visible light beam substantially on the subject.

16. The method of claim 11, wherein the system is a camera, the infrared imaging module is part of the camera, and the visible light source is a flash of the camera.

17. The method of claim 11, wherein the system is a spotlight.

18. The method of claim 11, wherein the force is provided by a user of the system.

19. The method of claim 11, wherein the force is provided by the system without requiring direction by a user.

20. The method of claim 11, wherein the determining is performed without blocking the FPA from the scene.