MODIFICATION OF AT LEAST ONE PARAMETER USED BY A VIDEO PROCESSING ALGORITHM FOR MONITORING OF A SCENE

• US 20160117837A1
• Filed: 10/12/2015
• Published: 04/28/2016
• Est. Priority Date: 10/23/2014
• Status: Active Grant

• Current Assignee: Axis AB (Canon Inc.)
• Original Assignee: Axis AB (Canon Inc.)
• Inventors: BALTSEN, Joakim, Bylander, Mats
• Granted Patent: US 10,032,283 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/20004 Adaptive image processing
• CPC Class Codes: G06T 2207/20036 Morphological image processing
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 20/194 using hyperspectral data, i.e. more or other wavelengths than RGB
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/23 from thermal infrared radiation
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

There is provided a method, a device and a system for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene (102). The method comprises: receiving a first (105a) and a second (105b) video sequence of the scene (102), wherein the first video sequence (105a) is captured using a thermal camera (104a) such that the first video sequence (105a) comprises thermal information being indicative of temperatures in the scene (102), and applying the video processing algorithm to the second video sequence (105b), wherein at least one parameter used by the video processing algorithm is modified based on the thermal information comprised in the first video sequence (105a).

Claims

1. A method for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene, comprising:

receiving a first and a second video sequence of the scene, wherein the first video sequence is captured using a thermal camera such that the first video sequence comprises thermal information being indicative of temperatures in the scene, and

applying video processing algorithm to the second video sequence, wherein at least one parameter used by the video processing algorithm is modified based on the thermal information comprised in the first video sequence, such that said at least one parameter of the video processing algorithm is made temperature dependent.

2. The method of claim 1, wherein the at least one parameter used by the video processing algorithm is modified with respect to regions in images of the second video sequence based on thermal information of corresponding regions in images of the first video sequence.

3. The method of claim 1, wherein the thermal information comprises intensity values of images in the first video sequence, the intensity values being indicative of temperatures in the scene, and wherein the at least one parameter used by the video processing algorithm is modified based on the intensity values of images in the first video sequence.

4. The method of claim 3, further comprising:

in images of the first video sequence captured by the thermal camera, identifying pixels having an intensity value indicating a temperature in one or more predetermined temperature ranges of interest,

wherein the at least one parameter used by the video processing algorithm is modified with respect to regions of the images of the second video sequence that correspond to the pixels that were identified in the images of the first video sequence.

5. The method of claim 4, wherein the one or more predetermined temperature ranges of interest comprise a temperature range corresponding to the body temperature of a human.

6. The method of claim 3, wherein the at least one parameter used by the video processing algorithm is modified based on the intensity values of the images of the first video sequence such that the at least one parameter vary across images of the second video sequence as a function of the intensity values of the images of the first video sequence.

7. The method of claim 1, wherein the video processing algorithm comprises comparing differences in intensity values between subsequent images in the second video sequence to a threshold, wherein the threshold is modified based on the thermal information in the first video sequence.

8. The method of claim 1, wherein the video processing algorithm comprises smoothing filtering, wherein at least one parameter of said smoothing filtering is modified based on the thermal information in the first video sequence.

9. The method according to claim 8, wherein said smoothing filtering comprises morphologic filtering of images of the second video sequence using a structuring element, wherein the structuring element is modified based on the thermal information in the first video sequence.

10. The method of claim 1, wherein the thermal camera comprises a long wave infrared, LWIR, sensor.

11. The method of claim 1, wherein the second video sequence is captured by a visual light camera.

12. The method of claim 1, wherein the second video sequence is captured by the thermal camera.

13. A computer program product comprising a computer-readable storage medium with instructions adapted to carry out the method of claim 1 when executed by a processor.

14. A processing device for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene, comprising:

a receiver configured to receive a first and a second video sequence of the scene, wherein the first video sequence is captured using a thermal camera such that the first video sequence comprises thermal information being indicative of temperatures in the scene,

a video processing component configured to apply the video processing algorithm to the second video sequence in order to monitor the scene, wherein the video processing component is configured to modify at least one parameter used by the video processing algorithm based on the thermal information comprised in the first video sequence, such that the at least one parameter of the video processing algorithm is made temperature dependent.

15. A system for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene, comprising:

one or more cameras configured to capture a first and a second video sequence of the scene, wherein the one or more cameras comprise a thermal camera adapted to capture the first video sequence such that the first video sequence comprises thermal information being indicative of temperatures in the scene,

a processing device according to claim 14 configured to receive and process the first and the second video sequence in order to modify parameters used by a video processing algorithm.