CLASSIFIER ANOMALIES FOR OBSERVED BEHAVIORS IN A VIDEO SURVEILLANCE SYSTEM
First Claim
1. A computer-implemented method for analyzing a sequence of video frames depicting a scene captured by a video camera, the method comprising:
- receiving a set of data inputs derived by a computer vision engine configured to analyze pixels depicting a plurality of foreground objects in the sequence of video frames;
modeling behavior of the foreground objects in the scene by passing the received sensory data inputs to a first cluster layer of a plurality of layers, wherein the plurality of layers alternate between cluster layers and sequence layers and wherein the cluster layers generate clusters of sequences and the sequence layers generate sequences of clusters;
evaluating one or more of the cluster layers to identify an occurrence of a behavioral anomaly based on an input to one of the cluster layers; and
publishing an alert message indicating the occurrence of the behavioral anomaly.
6 Assignments
0 Petitions
Accused Products
Abstract
Techniques are disclosed for a video surveillance system to learn to recognize complex behaviors by analyzing pixel data using alternating layers of clustering and sequencing. A combination of a self organizing map (SOM) and an adaptive resonance theory (ART) network may be used to identify a variety of different anomalous inputs at each cluster layer. As progressively higher layers of the cortex model component represent progressively higher levels of abstraction, anomalies occurring in the higher levels of the cortex model represent observations of behavioral anomalies corresponding to progressively complex patterns of behavior.
-
Citations
1 Claim
-
1. A computer-implemented method for analyzing a sequence of video frames depicting a scene captured by a video camera, the method comprising:
-
receiving a set of data inputs derived by a computer vision engine configured to analyze pixels depicting a plurality of foreground objects in the sequence of video frames; modeling behavior of the foreground objects in the scene by passing the received sensory data inputs to a first cluster layer of a plurality of layers, wherein the plurality of layers alternate between cluster layers and sequence layers and wherein the cluster layers generate clusters of sequences and the sequence layers generate sequences of clusters; evaluating one or more of the cluster layers to identify an occurrence of a behavioral anomaly based on an input to one of the cluster layers; and publishing an alert message indicating the occurrence of the behavioral anomaly.
-
Specification