SMART SURVEILLANCE CAMERA SYSTEMS AND METHODS

• US 20140218520A1
• Filed: 04/04/2014
• Published: 08/07/2014
• Est. Priority Date: 06/03/2009
• Status: Active Grant

• Current Assignee: Teledyne FLIR LLC (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Teich, Andrew C., Hgasten, Nicholas, Hoelter, Theodore R., Strandemar, Katrin
• Granted Patent: US 9,674,458 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Various techniques are disclosed for smart surveillance camera systems and methods using thermal imaging to intelligently control illumination and monitoring of a surveillance scene. For example, a smart camera system may include a thermal imager, an IR illuminator, a visible light illuminator, a visible/near IR (NIR) light camera, and a processor. The camera system may capture thermal images of the scene using the thermal imager, and analyze the thermal images to detect a presence and an attribute of an object in the scene. In response to the detection, various light sources may be selectively operated to illuminate the object only when needed or desired, with a suitable type of light source, with a suitable beam angle and width, or in otherwise desirable manner. The visible/NIR light camera may also be selectively operated based on the detection to capture or record surveillance images containing objects of interest.

Claims

1. A system comprising:

a thermal imager comprising a focal plane array (FPA) configured to capture thermal images of a scene;

a light source configured to illuminate the scene;

a camera configured to capture additional images of the scene; and

a processor configured to;

analyze the thermal images to determine an attribute associated with an object in the scene, and

selectively operate the light source and the camera based on the attribute of the object.

2. The system of claim 1, wherein the light source is a visible light source, the system further comprising an infrared (IR) tight source, wherein the processor is configured to selectively operate either the visible light source or the IR light source based on the attribute of the object.

3. The system of claim 1, wherein:

the attribute is a position of the object in the scene; and

the processor is configured to selectively direct the light source toward the object in response to a change of the position of the object in the scene.

4. The system of claim 1, wherein:

the attribute is a size of the object in the scene; and

the processor is configured to selectively adjust a beam width of the light source based on the size of the object in the scene.

5. The system of claim 1, wherein:

the camera is a non-thermal camera; and

the light source is configured to provide illumination over at least a portion of a spectrum associated with the additional images.

6. The system of claim 5, wherein the spectrum comprises at least a portion of a near infrared (NIR) spectrum.

7. The system of claim 6, wherein the processor is configured to combine the thermal images and the additional images to generate blended images of the scene.

8. The system of claim 1, wherein the processor is configured to selectively start and stop a recording of the thermal images and/or the additional images based on the attribute of the object, the system further comprising a storage device positioned at a remote location relative to the thermal imager and configured to record the thermal images and/or the additional images in response to the processor.

9. The system of claim 1, wherein the processor is configured to selectively start and stop a recording of the thermal images and/or the additional images based on the attribute of the object, wherein the camera is a first camera having a first field of view (FOV), the system further comprising a second camera configured to capture other additional images of the scene, and having a second FOV, wherein:

the attribute is a position of the object, and

the processor is configured to;

determine whether to record the additional images and/or the other additional images based on the position of the object relative to the first and second FOVs, and

selectively start and stop a recording of the additional images and/or the other additional images based on the determination.

10. The system of claim 1, wherein the processor is further configured to selectively operate an external device based on the attribute of the object.

11. The system of claim 1, wherein:

the thermal images are unblurred thermal images of the scene;

the thermal imager is configured to capture intentionally blurred thermal images of the scene; and

the processor is configured to determine a plurality of non-uniform correction (NUC) terms based on the intentionally blurred thermal images and apply the NUC terms to the unblurred thermal images to remove noise from the unblurred thermal images.

12. A method comprising:

capturing, at a focal plane array (FPA) of a thermal imager, thermal images of a scene;

analyzing the thermal images to determine an attribute associated with an object in the scene; and

selectively operating a light source and a camera based on the attribute of the object, wherein;

the light source is configured to illuminate the scene, and

the camera is configured to capture additional images of the scene.

13. The method of claim 12, wherein the light source is a visible light source, the method further comprising selectively operating either the visible light source or an infrared (IR) light source based on the attribute of the object, wherein the IR light source is configured to illuminate the scene.

14. The method of claim 12, wherein:

the attribute is a position of the object in the scene; and

the selectively operating the light source comprises selectively directing the light source toward the object in response to a change of the position of the object in the scene.

15. The method of claim 12, wherein:

the attribute is a size of the object in the scene; and

the selectively operating the light source comprises selectively adjusting a beam width of the light source based on the size of the object in the scene.

16. The method of claim 12, further comprising

combining the thermal images and the additional images to generate blended images of the scene, wherein:

the camera is a non-thermal camera, and

the light source is configured to provide illumination over at least a portion a spectrum associated with the additional images.

17. The method of claim 12, wherein the selectively operating the camera comprises selectively starting and stopping a recording of the thermal images and/or the additional images based on the attribute of the object, wherein the selectively starting and stopping a recording comprises recording the thermal images and/or the additional images to a storage device positioned at a remote location relative to the thermal imager.

18. The method of claim 12, wherein:

the selectively operating the camera comprises selectively starting and stopping a recording of the thermal images and/or the additional images based on the attribute of the object;

the camera is a first camera having a first field of view (FOV);

the attribute is a position of the object; and

the selectively starting and stopping a recording comprises;

determining whether to record the additional images and/or other additional images of the scene captured by a second camera having a second FOV, based on the position of the object relative to the first and second FOVs, and

selectively starting and stopping a recording of the additional images and/or the other additional images based on the determination.

19. The method of claim 12, further comprising selectively operating an external device based on the attribute of the object.

20. The method of claim 12, wherein the thermal images are unblurred thermal images, the method further comprising:

capturing intentionally blurred thermal images of the scene;

determining a plurality of non-uniform correction (NUC) terms based on the intentionally blurred thermal images; and

applying the NUC terms to the unblurred thermal images to remove noise from the unblurred thermal images.