METHOD AND SYSTEM FOR AUTOMATICALLY DETECTING ANOMALIES AT A TRAFFIC INTERSECTION

• US 20130286198A1
• Filed: 04/25/2012
• Published: 10/31/2013
• Est. Priority Date: 04/25/2012
• Status: Abandoned Application

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Fan, Zhigang, Bala, Raja, Mo, Xuan
• Application Number:
  US13/455,687
• Publication Number:
  US 20130286198A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors

Abstract

A method, system and processor-readable medium for automatically detecting anomalies at a traffic intersection. A set of clusters of nominal vehicle paths and a set of clusters of nominal trajectories within the nominal vehicle paths can be derived in an offline process. A set of features within each nominal trajectory among the set of clusters of nominal trajectories can be selected. A probability distribution for features indicative of nominal vehicle behavior within the nominal trajectories can be derived. An input video sequence can be received and presence of the anomaly in the vehicle path, trajectories and features within the input video sequence can be detected utilizing the derived path clusters, trajectory clusters, and feature distributions.

Claims

1. A multi-stage method for detecting anomalies in video footage of vehicle traffic, said method comprising:

deriving in an offline process a set of clusters of nominal vehicle paths and a set of clusters of nominal trajectories within said nominal vehicle paths;

selecting in an offline process a set of features within each nominal trajectory among said set of clusters of nominal trajectories and deriving a probability distribution for features indicative of nominal vehicle behavior within said nominal trajectories; and

detecting in three successive stages, anomalies in an input video sequence, said anomalies corresponding respectively to a path, a trajectory, and feature distributions.

2. The method of claim 1 further comprising reporting said anomalies via a user interface.

3. The method of claim 1 wherein deriving in said offline process a set of clusters of nominal vehicle paths, further comprises:

utilizing a background subtraction to differentiate stationary from moving portions of said input video sequence;

utilizing a blob analysis to remove noise and identify a moving vehicle;

tracking a blob centroid to identify a vehicle path;

defining a length-based distance metric between two paths; and

clustering vehicle paths utilizing said distance metric.

4. The method of claim 3 wherein said background subtraction employs a Gaussian mixture model.

5. The method of claim 3 further comprising computing said length-based distance metric between said two paths by:

generating a sampling of points along each path among said two paths;

identifying a corresponding point on a second path among said two paths as being a closest of all points on said second path for each point on a first path among said two paths; and

defining a distance between paths as an average of distances between all pairs of corresponding points.

6. The method of claim 3 wherein clustering vehicle paths utilizing said distance metric, further comprises:

establishing a threshold on an inter-cluster distance; and

assigning two paths to a same cluster if a distance of said two paths is less than said threshold; and

assigning said two paths to different clusters if a distance of said two paths is greater than said threshold.

7. The method of claim 1 wherein said deriving said set of clusters of nominal trajectories within said nominal vehicle paths, further comprises:

assigning a monotonically increasing sequence of indices to sample points along a vehicle path;

defining a trajectory as an order by which said sequence of indices is visited by a vehicle along the said vehicle path;

defining a distance metric between two trajectories; and

clustering trajectories according to said distance metric.

8. The method of claim 1 wherein the selected features within nominal trajectories comprise at least one of a speed of motion and a direction of motion.

9. The method of claim 1 wherein said probability distribution for said features is based on a Gaussian mixture model.

10. The method of claim 1 further comprising determining said three successive stages by:

computing a path for a vehicle;

determining if said path belongs to at least one of a precomputed path class, and if so labeling said path as a nominal path, and if not, labeling said path as an anomalous path;

computing a trajectory for each nominal path;

determining if said trajectory belongs to at least one of a precomputed trajectory class, and if so labeling said trajectory as a nominal trajectory, and if not labeling said trajectory as an anomalous trajectory;

computing selected features along said nominal trajectory and a statistical distance between computed features and pre-computed feature distributions for each nominal trajectory;

labeling a feature as nominal feature if a distance is less than a predetermined threshold, and if not labeling, said feature as an anomalous feature.

11. The method of claim 2 wherein reporting said anomalies comprises marking frames and spatial locations of said anomalies in said user interface.

12. A multi-stage system for detecting anomalies in video footage of vehicle traffic, said system comprising:

a processor;

a data bus coupled to said processor; and

a computer-usable medium embodying computer code, said computer-usable medium being coupled to said data bus, said computer program code comprising instructions executable by said processor and configured for;

deriving in an offline process a set of clusters of nominal vehicle paths and a set of clusters of nominal trajectories within said nominal vehicle paths;

selecting in an offline process a set of features within each nominal trajectory among said set of clusters of nominal trajectories and deriving a probability distribution for features indicative of nominal vehicle behavior within said nominal trajectories; and

detecting in three successive stages, anomalies in an input video sequence, said anomalies corresponding respectively to a path, a trajectory, and feature distributions.

13. The system of claim 12 wherein said instructions are further configured for reporting said anomalies via a user interface.

14. The system of claim 12 wherein said instructions for deriving in said offline process a set of clusters of nominal vehicle paths, further comprises instructions configured for:

utilizing a background subtraction to differentiate stationary from moving portions of said input video sequence;

utilizing a blob analysis to remove noise and identify a moving vehicle;

tracking a blob centroid to identify a vehicle path;

defining a length-based distance metric between two paths; and

clustering vehicle paths utilizing said distance metric.

15. The system of claim 14 said background subtraction employs a Gaussian mixture model.

16. The system of claim 14 wherein said instructions are further configured for computing said length-based distance metric between said two paths by:

generating a sampling of points along each path among said two paths;

identifying a corresponding point on a second path among said two paths as being a closest of all points on said second path for each point on a first path among said two paths; and

defining a distance between paths as an average of distances between all pairs of corresponding points.

17. The system of claim 14 wherein said instructions for clustering vehicle paths utilizing said distance metric, further comprises:

establishing a threshold on an inter-cluster distance; and

assigning two paths to a same cluster if a distance of said two paths is less than said threshold; and

assigning said two paths to different clusters if a distance of said two paths is greater than said threshold.

18. The system of claim 12 wherein said instructions for deriving said set of clusters of nominal trajectories within said nominal vehicle paths, further comprises instructions for:

assigning a monotonically increasing sequence of indices to sample points along a vehicle path;

defining a trajectory as an order by which said sequence of indices is visited by a vehicle along the said vehicle path;

defining a distance metric between two trajectories; and

clustering trajectories according to said distance metric.

19. The system of claim 12 wherein said instructions are further configured for determining said three successive stages by:

computing a path for a vehicle;

determining if said path belongs to at least one of a precomputed path class, and if so labeling said path as a nominal path, and if not, labeling said path as an anomalous path;

computing a trajectory for each nominal path;

determining if said trajectory belongs to at least one of a precomputed trajectory class, and if so labeling said trajectory as a nominal trajectory, and if not labeling said trajectory as an anomalous trajectory;

computing selected features along said nominal trajectory and a statistical distance between computed features and pre-computed feature distributions for each nominal trajectory; and

labeling a feature as nominal feature if a distance is less than a predetermined threshold, and if not labeling, said feature as an anomalous feature.

20. A processor-readable medium storing code representing instructions to cause a process to perform a multi-stage method for detecting anomalies in video footage of vehicle traffic, said code comprising code to:

derive in an offline process a set of clusters of nominal vehicle paths and a set of clusters of nominal trajectories within said nominal vehicle paths;

select in an offline process a set of features within each nominal trajectory among said set of clusters of nominal trajectories and deriving a probability distribution for features indicative of nominal vehicle behavior within said nominal trajectories; and

detect in three successive stages, anomalies in an input video sequence, said anomalies corresponding respectively to a path, a trajectory, and feature distributions.