Method for incorporating facial recognition technology in a multimedia surveillance system

• US 20040117638A1
• Filed: 11/21/2003
• Published: 06/17/2004
• Est. Priority Date: 11/21/2002
• Status: Active Grant

• Current Assignee: e-Watch, Inc. (Cision Ltd.)
• Original Assignee: e-Watch, Inc. (Cision Ltd.)
• Inventors: Monroe, David A.
• Granted Patent: US 7,634,662 B2
• Time in Patent Office: Days
• US Class Current: 713/186
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 2201/05 Recognition of patterns representing particular kinds of hidden objects, e.g. weapons, explosives, drugs
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G07C 1/20 Checking timed patrols, e.g. of watchman
• CPC Class Codes: G07C 2011/02 related to amusement parks
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition
• CPC Class Codes: G07C 9/38 with central registration
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19691 Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
• CPC Class Codes: G08B 25/016 Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12
• CPC Class Codes: G08B 25/14 Central alarm receiver or annunciator arrangements

Abstract

Facial recognition technology is integrated into a multimedia surveillance system for enhancing the collection, distribution and management of recognition data by utilizing the system'"'"'s cameras, databases, monitor stations, and notification systems. At least one camera, ideally an IP camera is provided. This IP camera performs additional processing steps to the captured video, specifically the captured video is digitized and compressed into a convenient compressed file format, and then sent to a network protocol stack for subsequent conveyance over a local or wide area network. The compressed digital video is transported via Local Area Network (LAN) or Wide Area Network (WAN) to a processor which performs the steps of Facial Separation, Facial Signature Generation, and Facial Database Lookup. The utility of the system may be enhanced by the increased use of networking techniques. In this enhancement, a group of networked processors perform the steps of Facial Separation and Facial Signature generation. The Facial Processors function as network resources, and are configured to process video from any networked camera, as required. This improves the flexibility and economics of the system. For example, during periods when a particular area is not used, Facial Processors may be diverted from analysis of that particular camera to an area of higher traffic. Also, the workload of a failed Facial Processor may be diverted to a different processor. The Facial Database may be treated as a general-purpose network resource, allowing a greater number of cameras and Facial Processors to perform Facial Signature lookups at any given time. Moreover, the digital IP surveillance network is often part of a larger “network of networks”, thus allowing the Facial Database to be consulted by devices on a different network.

Claims

1. A multi-media surveillance system having a plurality of sensors each adapted to produce an IP sensor signal when activated, the IP sensor signal adapted for being transmitted over an IP network to a remote monitor station for managing the signal to provide surveillance data to authorized personnel, the system comprising:

a. an biometric data collection device adapted for converting the collected data to an IP protocol for generating a biometric signal for distribution over a network;

b. a remote station for receiving and managing the biometric data.

2. The system of claim 1, further comprising a server at the remote station for receiving and managing the biometric data.

3. The system of claim 1, wherein the biometric collection device is an image collector.

4. The system of claim 3, wherein the image collector is a camera for collecting a facial image and wherein the biometric data is a facial image data.

5. The system of claim 4, further including a plurality of cameras throughout a network for collecting facial image data throughout the network.

6. The system of claim 3, including a server at the remote station for receiving and managing the facial image data.

7. The system of claim 6, the server including a facial image data base and adapted for comparing the facial image data with data in the facial image data base.

8. The system of claim 6, the remote station adapted for sending and receiving facial image data to a third party controlled data base.

9. The system of claim 1, wherein the remote station is a wireless monitor.

10. The system of claim 1, wherein the remote station is a PDA.

11. The system of claim 1, wherein the remote station is a desktop personal computer.

12. The system of claim 1, wherein the remote station is a laptop computer.

13. The system of claim 1, further including an access control device responsive to an activation signal and wherein the control device is activated upon confirmation of biometric data collected by the biometric collector.

14. The system of claim 1, the remote station further including a system map database and a display monitor for displaying the system map, the map including an icon for identifying the location of the biometric data collection device.

15. The system of claim 14, wherein there are a plurality of biometric data collection devices and wherein there is an identifying icon for each of said plurality of biometric data collection devices.

16. The system of claim 15, further including a tracking system for tracking the progress of an individual as he moves from one biometric collection device to the next biometric collection device.

17. The system of claim 2, wherein there is further included a storage device for archiving the collected data.

18. The system of claim 17, the server including a data mining system for mining the archived collected data.