Self-Configuring and Self-Adjusting Distributed Surveillance System

• US 20160132722A1
• Filed: 10/26/2015
• Published: 05/12/2016
• Est. Priority Date: 05/08/2014
• Status: Abandoned Application

• Current Assignee: Santa Clara University
• Original Assignee: Santa Clara University
• Inventors: Yarp, Christopher, Amer, Ahmed, Wood, Sally, Fox, Nathan M., Rapa, Christopher J., Kelley, Matthew J.
• Application Number:
  US14/922,997
• Publication Number:
  US 20160132722A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Improved facial recognition tracking of individuals throughout a space is provided, as is identification of unexpected behavior. The system can configure itself upon setup and adjust to changing conditions, and is able to intelligently reduce the workload on the facial recognition system. Cameras are placed throughout a building and learn what typical traffic within the building looks like. Over time, the system can track multiple users throughout the system and can automatically learn the average time between cameras. A probability function for each camera can also be determined that give probabilities for each camera to camera path. This approach provides for both limiting the bandwidth and processing power required for facial recognition and also allows for behavioral analysis. This system could be implemented as a distributed system of cameras, each performing its own facial recognition and tracking, and/or with distributed cameras combined with central processing for facial recognition.

Claims

1. A surveillance method comprising:

providing two or more cameras;

installing the two or more cameras in a target region;

automatically constructing at least one database that includes at least typical transit times between camera locations and transition probabilities between camera locations;

wherein the at least one database is automatically constructed from observations of normal traffic in the target region combined with automatic facial recognition;

performing real-time anomaly identification by comparing real-time surveillance data with the at least one database.

2. The method of claim 1, wherein the real-time anomaly identification is triggered by an observed transit time that falls outside a corresponding predetermined transit time range, and wherein the predetermined transit time range is +/−

two standard deviations from a mean transit time.

3. The method of claim 1, wherein the real-time anomaly identification is triggered by an observed transition having a corresponding transition probability in the database that is less than a predetermined transition probability threshold, and wherein the predetermined transition probability threshold is 5%.

4. The method of claim 1, wherein the real-time anomaly identification is triggered by two or more observations being jointly anomalous.

5. The method of claim 1, wherein the target region comprises one or more buildings in a secure facility.

6. The method of claim 1, wherein the real-time anomaly identification is triggered by recognition of an individual at a selected camera location who was not recognized at any camera having a transition probability to the selected camera greater than a predetermined appearance threshold, and wherein the predetermined appearance threshold is 5%.

7. The method of claim 1, wherein the real-time anomaly identification is triggered by recognition of an individual at a selected camera location who was not recognized at any camera having a transition probability from the selected camera greater than a predetermined disappearance threshold, and wherein the predetermined disappearance threshold is 5%.

8. The method of claim 1, further comprising comparing recognized faces to a predetermined black list of unauthorized individuals.

9. The method of claim 1, further comprising comparing recognized faces to a predetermined white list of authorized individuals.

10. The method of claim 1, further comprising comparing recognized faces to a maintained list of individuals who have passed a perimeter check for access and have not exited through the perimeter.

11. The method of claim 1, further comprising performing an initialization run where individuals having markers to facilitate automatic identification walk throughout the target region.

12. The method of claim 1, wherein the at least one database includes two or more databases corresponding to two or more different modes of the target region.

13. The method of claim 1, wherein the modes of the target region are selected from the group consisting of:

workday start, workday end, shift change, lunchtime, night, weekend, and holiday.

14. The method of claim 1, wherein the at least one database includes two or more individual databases corresponding to two or more individuals associated with the target region.

15. The method of claim 1, wherein the at least one database includes two or more databases corresponding to two or more employment categories associated with the target region.

16. The method of claim 1, further comprising passing information from one camera to another about likely future events, thereby facilitating real-time face recognition.

17. The method of claim 1, wherein the at least one database further includes typical dwell times that individuals remain in view of each of the one or more cameras.

18. The method of claim 17, wherein the real-time anomaly identification is triggered by recognition of an individual at a selected camera who remains in view of the selected camera for a time that falls outside a corresponding and predetermined dwell time range, and wherein the predetermined dwell time range is +/−

two standard deviations from a mean dwell time.

19. The method of claim 14, wherein anomaly identification is performed by comparing observations to the individual databases and to a general database of overall facility traffic.

20. The method of claim 1, further comprising automatically updating the at least one database according to observations of normal traffic in the target region combined with automatic facial recognition.