Smart surveillance camera systems and methods

• US 9,674,458 B2
• Filed: 04/04/2014
• Issued: 06/06/2017
• Est. Priority Date: 06/03/2009
• Status: Active Grant

• Current Assignee: Teledyne FLIR LLC (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Hgasten, Nicholas, Hoelter, Theodore R., Teich, Andrew C., Strandemar, Katrin
• Primary Examiner(s): YEH, EUENG NAN
• Application Number:
  US14/246,006
• Publication Number:
  US 20140218520A1
• Time in Patent Office: 1,159 Days
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Various techniques are disclosed for smart surveillance camera systems and methods using thermal imaging to intelligently control illumination and monitoring of a surveillance scene. For example, a smart camera system may include a thermal imager, an IR illuminator, a visible light illuminator, a visible/near IR (NIR) light camera, and a processor. The camera system may capture thermal images of the scene using the thermal imager, and analyze the thermal images to detect a presence and an attribute of an object in the scene. In response to the detection, various light sources may be selectively operated to illuminate the object only when needed or desired, with a suitable type of light source, with a suitable beam angle and width, or in otherwise desirable manner. The visible/NIR light camera may also be selectively operated based on the detection to capture or record surveillance images containing objects of interest.

Claims

1. A system comprising:

a thermal imager comprising a focal plane array (FPA) configured to capture thermal images of a scene;

a light source configured to illuminate the scene;

a camera configured to capture additional images of the scene; and

a processor configured to;

determine a presence of an object in the scene based on the thermal images,

in response to the determined presence of the object, identify the object from among a desired object and a spurious object by analyzing temperature distribution captured in the thermal images to determine geometric characteristics and thermal characteristics of the object, and

selectively operate the light source and the camera in response to identifying the desired object in the scene and according to a predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera.

2. The system of claim 1, wherein the light source comprises a visible light source and an infrared (IR) light source, wherein the processor is configured to selectively operate either the visible light source or the IR light source in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

3. The system of claim 1, wherein the processor is further configured to:

analyze the thermal images to determine a position of the desired object in the scene; and

selectively direct the light source toward the desired object in response to a change of the position of the desired object in the scene.

4. The system of claim 1, wherein the processor is further configured to:

analyze the thermal images to determine a size of the desired object in the scene; and

selectively adjust a beam width of the light source based on the size of the desired object in the scene.

5. The system of claim 1, wherein:

the camera is a non-thermal camera configured to captured the additional images of the scene in a visible light (VL) and/or near-infrared (NIR) spectrum; and

the light source is configured to illuminate the scene with light having wavelengths that overlap at least a portion of the VL and/or NIR spectrum associated with the additional images captured by the non-thermal camera in response to control signals from the processor.

6. The system of claim 5, wherein the processor is configured to combine the thermal images and the additional images to generate blended images of the scene.

7. The system of claim 1, wherein:

the desired object comprises a person or a vehicle; and

the predefined association between the identified desired object and the corresponding operations to be triggered for the light source and the camera comprises deactivating the light source and/or the camera as a corresponding operation triggered in response to the identifying that the object is the spurious object.

8. The system of claim 1, wherein the processor is configured to selectively start and stop a recording of the thermal images and/or the additional images in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association, the system further comprising a storage device positioned at a remote location relative to the thermal imager and configured to record the thermal images and/or the additional images in response to the processor.

9. The system of claim 1, wherein:

the camera is a first camera having a first field of view (FOV);

the system further comprises a second camera configured to capture other additional images of the scene and having a second FOV; and

the processor is further configured to;

analyze the thermal images to determine a position of the desired object;

determine whether to record the additional images and/or the other additional images based on the position of the desired object relative to the first and second FOVs, and

selectively start and stop a recording of the additional images and/or the other additional images based on the determination of whether to record the additional images and/or the other additional images.

10. The system of claim 1, wherein the processor is further configured to selectively operate an external device in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

11. The system of claim 1, further comprising a memory communicatively coupled to the processor, wherein the processor is further configured to:

update the predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera based on a user definition; and

store in the memory the updated predefined association.

12. A method comprising:

capturing, at a focal plane array (FPA) of a thermal imager, thermal images of a scene;

determining a presence of an object in the scene based on the thermal images;

in response to the determined presence of the object, identifying the object from among a desired object and a spurious object by analyzing temperature distribution captured in the thermal images to determine geometric characteristics and thermal characteristics of the object; and

selectively operating a light source and a camera in response to identifying the desired object in the scene and according to a predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera, wherein;

the light source is configured to illuminate the scene, and

the camera is configured to capture additional images of the scene.

13. The method of claim 12, wherein the light source comprises a visible light source and an infrared (IR) light source configured to illuminate the scene, the method further comprising selectively operating either the visible light source or the IR light source in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

14. The method of claim 12, further comprising analyzing the thermal images to determine a position and a size of the desired object in the scene, wherein:

the selectively operating the light source comprises;

selectively directing the light source toward the desired object in response to a change of the position of the desired object in the scene, and

selectively adjusting a beam width of the light source based on the size of the desired object in the scene.

15. The method of claim 12, wherein:

the desired object comprises a person or a vehicle; and

the predefined association between the identified desired object and the corresponding operations to be triggered for the light source and the camera comprises deactivating the light source and/or the camera as a corresponding operation triggered in response to the identifying that the object is the spurious object.

16. The method of claim 12, further comprising

combining the thermal images and the additional images to generate blended images of the scene, wherein:

the camera is a non-thermal camera, and

the light source is configured to provide illumination over at least a portion a spectrum associated with the additional images.

17. The method of claim 12, wherein the selectively operating the camera comprises selectively starting and stopping a recording of the thermal images and/or the additional images in response to the determined presence of the object and the identifying of the desired object in the scene and according to the predefined association, wherein the selectively starting and stopping a recording comprises recording the thermal images and/or the additional images to a storage device positioned at a remote location relative to the thermal imager.

18. The method of claim 12, further comprising analyzing the thermal images to determine a position of the desired object, wherein:

the camera is a first camera having a first field of view (FOV); and

the selectively operating the camera comprises;

determining whether to record the additional images and/or other additional images of the scene captured by a second camera having a second FOV, based on the position of the desired object relative to the first and second FOVs, and

selectively starting and stopping a recording of the additional images and/or the other additional images based on the determination of whether to record the additional images and/or the other additional images.

19. The method of claim 12, further comprising selectively operating an external device in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

20. The method of claim 12, further comprising updating the predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera based on a user definition.