MONITORING METHOD AND CAMERA

• US 20140334676A1
• Filed: 05/08/2014
• Published: 11/13/2014
• Est. Priority Date: 05/08/2013
• Status: Active Grant

• Current Assignee: Axis AB (Canon Inc.)
• Original Assignee: Axis AB (Canon Inc.)
• Inventors: Johannesson, Anders, SKANS, Markus, Chen, Jiandan, Baltsen, Joakim
• Granted Patent: US 9,536,154 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20112 Image segmentation details
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 13/19652 Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
• CPC Class Codes: G08B 13/19686 Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates

Abstract

A method of monitoring a scene by a camera (7) comprises marking a part (14) of the scene with light having a predefined spectral content and a spatial verification pattern. An analysis image is captured of the scene by a sensor sensitive to the predefined spectral content. The analysis image is segmented based on the predefined spectral content, to find a candidate image region. A spatial pattern is detected in the candidate image region, and a characteristic of the detected spatial pattern is compared to a corresponding characteristic of the spatial verification pattern. If the characteristics match, the candidate image region is identified as a verified image region corresponding to the marked part (14) of the scene. Image data representing the scene is obtained, and image data corresponding to the verified image region is processed in a first manner, and remaining image data is processed in a second manner.

Claims

1. A method of masking part of an image of a scene captured by a camera monitoring the scene, comprising the steps of

mounting a light source such that it illuminates a part of the scene with light having a predefined spectral content and a spatial verification pattern,

capturing an analysis image of the scene by a sensor sensitive to the predefined spectral content,

segmenting the analysis image, based on the predefined spectral content, to find a candidate image region,

detecting a spatial pattern in the candidate image region,

comparing a characteristic of the detected spatial pattern to a corresponding characteristic of the spatial verification pattern, and, if the characteristics match,

identifying the candidate image region as a verified image region corresponding to the part of the scene which is illuminated by the light source,

obtaining image data representing the scene, and

hiding image data, corresponding to the verified image region, from being displayed, such as by blurring or substituting, and displaying remaining image data, thereby providing a privacy mask for the part of the scene which is illuminated by the light source, or

displaying image data corresponding to the verified image region, and hiding remaining image data from being displayed, such as by blurring or substituting, thereby providing a privacy mask for the non-illuminated part of the scene.

2. The method of claim 1, further comprising the step of capturing a monitoring image by a sensor insensitive to the predefined spectral content, and wherein the image data is obtained from the monitoring image.

3. The method of claim 1, wherein the spatial verification pattern is a signature pattern associated with one or more cameras.

4. The method of claim 1, further comprising the steps of

modulating the spatial verification pattern between at least a first and a second spatial verification pattern according to a temporal modulation sequence, and

with a respective one of the first and the second spatial verification pattern, in accordance with the temporal modulation sequence, repeating the steps of marking, capturing, segmenting, detecting and comparing.

5. The method of claim 4, wherein the characteristic of the detected spatial pattern is a ratio between a spatial frequency of the detected pattern and a spatial frequency of a previously detected pattern, and the characteristic of the spatial verification pattern is a ratio between a spatial frequency of the first spatial verification pattern and a spatial frequency of the second spatial verification pattern.

6. The method of claim 4, wherein the temporal modulation sequence is generated based on a pseudo-random sequence.

7. The method of claim 5, wherein the temporal modulation sequence is generated based on a pseudo-random sequence.

8. The method of claim 1, wherein a prestored background image is used for the substituting.

9. The method of claim 1,

wherein image data corresponding to the verified image region is included in input to a motion detection unit, and the remaining image data is excluded from input to the motion detection unit, or

wherein the remaining image data is included in input to a motion detection unit, and image data corresponding to the verified image region is excluded from input to the motion detection unit.

10. The method of claim 1,

wherein image data corresponding to the verified image region is included in input to an object detection unit arranged to detect or identify a human, an animal, a vehicle, a license plate, text or visual information, or other object type,

and wherein the remaining image data is excluded from input to the object detection unit, or,

wherein the remaining image data is included in input to an object detection unit arranged to detect or identify a human, an animal, a vehicle, a license plate, text or visual information, or other object type,

and wherein the image data corresponding to the verified image region is excluded from input to the object detection unit.

11. The method of claim 1, wherein image data representing the verified image region is compressed at a first compression rate, and wherein remaining image data is compressed at a second compression rate, wherein the first compression rate is different to the second compression rate.

12. A camera arranged to monitor a scene, comprising

a sensor arranged to sense a predefined spectral content and capture an analysis image of a scene,

an image processing unit arranged to

segment the analysis image, based on the predefined spectral content, to find a candidate image region,

detect a spatial pattern in the candidate image region,

compare a characteristic of the detected spatial pattern to a corresponding characteristic of a spatial verification pattern, and, if the characteristics match,

identify the candidate region as a verified image region corresponding to a part of the scene illuminated by a light source with light having the predefined spectral content and the spatial verification pattern,

obtain image data representing the scene, and

hide image data, corresponding to the verified image region, from being displayed, such as by blurring or substituting, and display remaining image data, to thereby provide a privacy mask for the part of the scene which is illuminated by the light source, or

display image data corresponding to the verified image region, and hide remaining image data from being displayed, such as by blurring or substituting, to thereby provide a privacy mask for the non-illuminated part of the scene.

13. The camera of claim 12, wherein the sensor comprises a first group of sensor elements sensitive to light having the predefined spectral content and a second group of sensor elements insensitive to light having the predefined spectral content.

14. A camera system for monitoring a scene, comprising

a light source mounted to illuminate a part of the scene with light having a predefined spectral content and a spatial verification pattern, and

a camera according to claim 12.

15. The camera system according to claim 14, further comprising a temporal modulator arranged to

generate a temporal modulation sequence, and

transmit the temporal modulation sequence to the illumination unit and the camera in a synchronized manner.