Usual event detection in a video using object and frame features
First Claim
Patent Images
1. A method for detecting usual events in a video, the video including a plurality of items, comprising:
- extracting a set of features for each item in the video;
constructing an affinity matrix for each feature according to the items;
aggregating the affinity matrices into an aggregate affinity matrix;
decomposing the aggregate affinity matrix into an set of eigenvectors, in a first to last order;
reconstructing a plurality of approximate aggregate affinity matrices, wherein a first approximate aggregate affinity matrix is reconstructed from the first eigenvector, and each next approximate aggregate affinity matrix includes one additional one of the eigenvectors in the first to last order, and a last approximate aggregate affinity matrix is reconstructed from all of the eigenvectors;
clustering items associated with each approximate aggregate affinity matrix into clusters;
evaluating each approximate aggregate affinity matrix to determine a validity score for each approximate aggregate affinity matrix; and
selecting the approximate aggregate affinity matrix with a highest validity score as the clustering of the items associated with usual events.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention provides a method for detecting usual events in a video. The events are detected by first constructing an aggregate affinity matrix from features of associated items extracted from the video. The affinity matrix is decomposed into eigenvectors, and the eigenvectors are used to reconstruct approximate estimates of the aggregate affinity matrix. Each matrix is clustered and scored, and the clustering that yields the highest scores is used to detect usual events.
76 Citations
10 Claims
-
1. A method for detecting usual events in a video, the video including a plurality of items, comprising:
-
extracting a set of features for each item in the video;
constructing an affinity matrix for each feature according to the items;
aggregating the affinity matrices into an aggregate affinity matrix;
decomposing the aggregate affinity matrix into an set of eigenvectors, in a first to last order;
reconstructing a plurality of approximate aggregate affinity matrices, wherein a first approximate aggregate affinity matrix is reconstructed from the first eigenvector, and each next approximate aggregate affinity matrix includes one additional one of the eigenvectors in the first to last order, and a last approximate aggregate affinity matrix is reconstructed from all of the eigenvectors;
clustering items associated with each approximate aggregate affinity matrix into clusters;
evaluating each approximate aggregate affinity matrix to determine a validity score for each approximate aggregate affinity matrix; and
selecting the approximate aggregate affinity matrix with a highest validity score as the clustering of the items associated with usual events. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
Specification