System and method for detecting an invalid camera in video surveillance

• US 7,751,647 B2
• Filed: 12/08/2006
• Issued: 07/06/2010
• Est. Priority Date: 12/08/2005
• Status: Active Grant

• Current Assignee: UTC Fire & Security Americas Corporation, Inc. (Carrier Global Corporation)
• Original Assignee: Lenel Systems International Incorporated (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Pikaz, Arie
• Primary Examiner(s): Kassa; Yosef
• Application Number:
  US12/086,063
• Publication Number:
  US 20090212946A1
• Time in Patent Office: 1,306 Days
• Field of Search: 382/209, 382/219, 382/278
• US Class Current: 382/278
• CPC Class Codes: G08B 13/19604 involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
• CPC Class Codes: G08B 29/046 prevention of tampering with detection circuits

Abstract

A system having a camera (18) for capturing video images of a scene in successive image frames, and a computer system (14 or 20) for receiving such video images. The computer system periodically generates a background image of the scene from multiple successive image frames (23) and extracts features in the background image (26), and extracts features for each new image frame received from the camera (28). For each new image frames, the new image frame and the last periodically generated background image are correlated at common locations (parts or regions) associated with the features extracted from the last periodically generated background image and features of the new image frame (30), to determine non-correlated features in the new image frame with respect to the last periodically generated background image (31). If the number and/or percentage of non-correlated features are sufficiently high, and/or the spatial distribution of non-correlated features is sufficiently low, the image frame is determined to have an invalid background (32, 33). When multiple successive frames are determined as having invalid backgrounds, the camera (20) represents an invalid camera.

Claims

1. A method for detecting when a camera providing video surveillance of a scene in successive image frames is an invalid camera, said method comprising the steps of:

periodically generating a background image from a plurality of said successive image frames from the camera;

extracting first features from the background image;

extracting second features from new image frames from said camera;

correlating, for each of said new image frames, at common locations in the new image frame and the last periodically generated background image, in which said locations are associated with said first features extracted from the last periodically generated background image and second features of the new image frame, to determine non-correlated features in the new image frame with respect to the last periodically generated background image; and

determining said camera as representing an invalid camera in accordance with one or more of the number, percentage, or spatial distribution of said non-correlated features in a plurality of ones of said new images.

2. The method according to claim 1 further comprising the step of generating an invalid camera alarm when said camera is determined invalid.

3. The method according to claim 1 wherein said camera determined invalid is associated with one of movement of said camera or at least partial blocking of view of said camera of said scene.

4. The method according to claim 1 wherein said determining step further comprises the step of:

determining for each of said correlated new image frames as having an invalid background in accordance with at least one of the number of said non-correlated features, a percentage of said non-correlated features, or spatial distribution of said non-correlated features of the new image frame; and

determining said camera invalid when a number of said plurality of ones of said new image frames are consecutively determined as having invalid background.

5. The method according to claim 4 wherein said step of determining said camera invalid when a number of said plurality of ones of said new images are consecutively determined as having invalid background further comprises the step of:

determining for each of said correlated new image frames as having an invalid background in accordance with at least one of the number of said non-correlated features of the new image frame is above a first threshold, or a percentage of said non-correlated features in the new frame is above a second threshold, or spatial distribution of said non-correlated features is below a third threshold.

6. The method according to claim 5 wherein at least one said first, second, and third thresholds are selectable by a user via a user interface.

7. The method according to claim 1 further comprising the step of:

providing a user interface to view said new image frames from said camera which indicates at least the non-correlated features at least in one of correlated new image frames.

8. The method according to claim 1 wherein each of said image frames is composed of pixels having a value, and said correlating step further comprises the steps of:

determining, for each of said new image frames, a matching score for each of said locations associated with said first features from the background image and said second features of the new image frame by correlating values of pixels in the last periodically generated background image with the values of pixels in the new image frame about a common region associated with the location; and

classifying, for each of said new image frames, said first features and second features of the new image as a non-correlated feature by comparing their respective matching score with a threshold score value.

9. The method according to claim 1 wherein said extracted first features represent a location associated with one or more of corners, edges, or boundaries in the scene of said background image, and second features for each of said new images represent a location associated with one or more of corners, edges, or boundaries in the new image.

22. The method according to claim 1 wherein said method is carried out by a computer system.

10. A method for detecting an invalid background in video images of a scene from a camera useful for determining when said camera is invalid, said method comprising the steps of:

(a) generating a background image of the scene from a plurality of said images provided from a camera over a period of time;

(b) extracting feature locations in the background image;

(c) extracting feature locations from one of said images from said camera;

(d) correlating regions of the background image and said one of said images with respect to each of said extracted feature locations from steps (b) and (c) to characterize each of the feature locations as representing a correlated feature or a non-correlated feature in the scene, thereby providing a plurality of correlated features and a plurality of non-correlated features associated with the scene in said one of said images; and

(e) determining said one of said image as having an invalid background in accordance with at least one of the number of said non-correlated features, a percentage of said non-correlated features to a total number of non-correlated features and correlated features, or spatial distribution of said non-correlated features.

11. The method according to claim 10 further comprising the step of:

(f) repeating steps (c), (d), and (e) with respect to successive ones of said images from said camera.

12. The method according to claim 11 further comprising the step of:

(g) determining said camera invalid when a number of consecutive images from said camera image are determined as having an invalid background at step (e).

13. The method according to claim 12 further comprising the step of:

(h) generating an invalid camera alarm when said camera is determined invalid.

14. The method according to claim 12 wherein said camera determined invalid is associated with one of movement of said camera or at least partial blocking of view of said camera of said scene.

15. The method according to claim 10 further comprising the step of:

(i) periodically repeating steps (a) and (b) using another plurality of said images to provide an updated background image and said updated background image represents said background image at steps (d) and (e) with respect to a next successive ones of said images of step (f).

16. The method according to claim 10 wherein said method is carried out by a computer system.

17. The method according to claim 16 wherein said computer system is part of a facility security system.

18. A system for detecting an invalid camera in video surveillance comprising:

a camera for capturing video images of a scene; and

a computer system for received said images and determining when said camera represents an invalid camera in accordance with sufficient change occurring in the background of said scene in said images.

19. The system according to claim 18 wherein said computer system to determine when said camera represents an invalid camera periodically generates a background image from a plurality of successive images from the camera, extracts first features of the scene from the periodically generated background image and extracts second features of the scene from current images from the camera, and correlates parts of the last generated background image with corresponding parts from the current images with respect to locations associated with a plurality of said first and second features to determine non-correlated extracted features in the current images, and wherein said camera represents an invalid camera in accordance with one or more of the number, percentage, or spatial distribution of said non-correlated extracted feature in the current images which is associated with sufficient change occurring in the background of the scene.

20. The system according to claim 18 wherein said computer system is part of a facility security system.

21. The system according to claim 18 wherein said computer system generates an invalid camera alarm when said camera is determined invalid.