THREAT-DETECTION IN A DISTRIBUTED MULTI-CAMERA SURVEILLANCE SYSTEM

• US 20080198231A1
• Filed: 02/16/2007
• Published: 08/21/2008
• Est. Priority Date: 02/16/2007
• Status: Active Grant

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Lee, Kuo Chu, OZDEMIR, Hasan Timucin
• Granted Patent: US 8,760,519 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A method is provided for detecting a threat in a distributed multi-camera surveillance system. The method includes: monitoring movement of an object in a field of view of a first camera using software installed at the first camera; detecting a suspicious object at the first camera when movement of the object does not conform with a motion flow model residing at the first camera; sending a tracking request from the first camera to a second camera upon detecting the suspicious object at the first camera; monitoring movement of the object in a field of view of the second camera using software installed at the second camera; assigning threat scores at the second camera when the movement of the object does not conform with a motion flow model residing at the second camera; and generating an alarm based in part on the threat scores detected at the first camera and the second camera.

Claims

1. A distributed multi-camera surveillance system, comprising:

a first camera having a field of view and an associated data store for storing a motion flow model for objects moving in the field of view of the first camera, the first camera operable to detect a threat when movement of an object in its field of view does not conform to the motion flow model and transmit a tracking request for the object over a network to a second camera; and

the second camera having a field of view and an associated data store for storing a motion flow model for objects moving in the field of view of the second camera, the second camera operable to detect a threat when movement of an object in its field of view does not conform to the motion flow model and generate an alarm based on the threat detected at the first and second cameras.

2. The surveillance system of claim 1 further comprises a tracking algorithm embodied in software installed at the first camera for monitoring movement of objects in its field of view.

3. The surveillance system of claim 1 further comprise a model building algorithm embodied in software installed at the first camera for constructing the motion flow model for the first camera.

4. The surveillance system of claim 1 further comprises a camera association algorithm embodied in software installed a the first camera for learning associations with other camera in the system.

5. The surveillance system of claim 1 further comprises a threat detection algorithm embodied in software installed at the first camera for comparing object movements to the motion flow model.

6. The surveillance system of claim 1 wherein the motion flow model residing at the first camera defines directional paths for objects moving in the field of view of the first camera.

7. The surveillance system of claim 1 further comprises a remote monitoring station connected to the network and adapted to receive the alarm generated by the second camera.

8. A method for detecting a threat in a distributed multi-camera surveillance system, comprising:

monitoring movement of an object in a field of view of a first camera using software installed at the first camera;

detecting a threat at the first camera when movement of the object does not conform with a motion flow model residing at the first camera;

sending a tracking request for the object from the first camera to a second camera upon detecting the threat at the first camera;

monitoring movement of the object in a field of view of the second camera using software installed at the second camera;

detecting a threat at the second camera when the movement of the object does not conform with a motion flow model residing at the second camera; and

generating an alarm based in part on the threat detected at the first camera and the second camera.

9. The method of claim 8 further comprises monitoring movement of objects in the field of view of the first camera and building the motion flow model from the monitored object movements using software installed at the first camera.

10. The method of claim 8 wherein building the motion flow model further comprises

defining tracks for objects moving in the field of view of the first camera using an object tracking algorithm;

determining entry areas and exit areas in the field of view of the first camera by applying a clustering algorithm to beginning points and end points of the tracks;

defining directional flows between the entry areas and the exit areas; and

assigning each track to a directional flow using a begin point and an end point associated with a given track.

11. The method of claim 8 further comprises learning motion flow of objects between the first camera and other cameras in the system;

and storing camera associations in a data store at the first camera.

12. The method of claim 8 further comprises:

assigning a threat score for the object detected at the first camera;

sending the threat score in the tracking request from the first camera to the second camera; and

generating the alarm based in part on the threat score from the first camera.

13. The method of claim 8 further comprises assigning threat scores to the object detected at the second camera and generating the alarm based on the threat scores associated with the threat detected at the first and second cameras.

14. The method of claim 8 wherein generating an alarm further comprises sending an alarm message from the second camera to a remote monitoring location.

15. The method of claim 14 further comprises sending video data showing the object in a field of view of the first camera from the first camera over the network to the remote monitoring location and sending video data showing the object in the field of view of the second camera from the second camera over the network to the remote monitoring location.

16. The method of claim 8 further comprises:

sending a tracking request from the second camera to a third camera upon detecting the suspicious object at the second camera;

monitoring movement of the object in a field of view of the third camera using software installed at the third camera; and

generating an alarm when the movement of the object does not conform with a motion flow model residing at the third camera.

17. A method for learning motion flow of objects amongst two or more cameras in a distributed multi-camera surveillance system, comprising:

detecting an object moving in a field of view of a first camera using software installed at the first camera;

sending a tracking request from the first camera across a network to other cameras in the network, wherein the tracking request provides an identifier for the first camera, an identifier for the object and visual attributes associated with the object;

searching for the object in a field of view of a second camera in response to the tracking request received from the first camera; and

associating the second camera with the first camera when the object is detected in the field of view of the second camera.

18. The method of claim 17 further comprises searching for the object at the second camera during a window of time defined in the tracking request.

19. The method of claim 17 further comprises sending a message from the second camera to the first camera when the object is detected in the field of view of the second camera and associating the second camera with the first camera based on the message.

20. The method of claim 19 further comprises sending a subsequent tracking message from the first camera to the second camera based on the associate between the two cameras.

21. The method of claim 17 further comprises maintaining a confidence metric regarding the associate of the first camera with second camera at the first camera and updating the confidence metric upon receipt of the message sent by the second camera to the first camera.

22. The method of claim 17 further comprises sending a message which includes a confidence measure that the detected object correlates to the object detected by the first camera from the second camera to the first camera.

23. The method of claim 17 further comprises receiving feedback messages at the first camera from multiple cameras, where each feedback message includes a confidence measure that the object detected by a given camera correlates to the object detected by the first camera, and associating the first camera with one of the multiple cameras based on the confidence measures.

24. The method of claim 17 further comprises reporting the associate between the first and second cameras to a remote monitoring location.

25. The method of claim 17 further comprises retrieving the associate between the first and second cameras from the first camera by a remote monitoring location.

26. The method of claim 17 further comprises learning where an object traversing a given flow in the field of field of the first camera will re-appear in the system.

27. The method of claim 26 further comprises maintaining a record in a list for each location the object re-appears and updating a probability the object appeared at each location based on feedback messages received from other cameras in the system.

28. The method of claim 17 further comprises learning where an object was prior to appearing in an entry regions of its field of view.

29. The method of claim 28 further comprises maintaining a record in a list for each location the object was and updating a probability the object came from each location based on feedback messages received from other cameras in the system.