Video skimming system utilizing the vector rank filter
First Claim
1. A method of identifying a key video frame within a plurality of video frames comprising the steps of:
- (a) dividing said plurality of video frames into at least two segments;
(b) characterizing said plurality of video frames as a plurality of feature vectors;
(c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment;
(d) identifying a second level key feature vector that minimizes distortion of a set of first level key feature vectors; and
(e) identifying a video frame corresponding to said second level key feature vector as said key video frame.
1 Assignment
0 Petitions
Accused Products
Abstract
Automated summarization of digital video sequences is accomplished using a vector rank filter. The consecutive frames of a digital video sequence can be represented as feature vectors which are successively accumulated in a set of vectors. The distortion of the set by the addition of each successive vector or the cumulative distance from each successive vector to all other vectors in the set is determined by a vector rank filter. When the distortion exceeds a threshold value the end of a video segment is detected. Each frame in a video segment can be ranked according to its relative similarity to the other frames of the set by applying the vector rank filter to the feature vectors representing the video frames. To produce a summary of a video sequence which is most representative of the content of the sequence, frames are chosen that correspond to vectors that are the least distant to or produce the least distortion of the set of vectors representing the segment. The ranking of the relative distortion can be used as the basis for selecting more than one frame from each segment to produce a hierarchy of summaries containing greater numbers of the frames having the most representative content.
-
Citations
11 Claims
-
1. A method of identifying a key video frame within a plurality of video frames comprising the steps of:
-
(a) dividing said plurality of video frames into at least two segments;
(b) characterizing said plurality of video frames as a plurality of feature vectors;
(c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment;
(d) identifying a second level key feature vector that minimizes distortion of a set of first level key feature vectors; and
(e) identifying a video frame corresponding to said second level key feature vector as said key video frame. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of identifying a key video frame within a plurality of video frames comprising the steps of:
-
(a) dividing said plurality of video frames into at least two segments;
(b) characterizing said plurality of video frames as a plurality of feature vectors;
(c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment;
(d) accumulating a set of said first level key feature vectors corresponding to said segments occurring in a predetermined period;
(e) identifying a second level key feature vector that minimizes distortion of said set of first level key feature vectors; and
(f) identifying a video frame corresponding to said second level key feature vector as said key video frame.
-
-
9. A method of summarizing of a plurality of video frames comprising the steps of:
-
(a) dividing said plurality of video frames into at least two segments, each segment comprising at least one video frame;
(b) defining a feature vector representative of each of said video frames;
(c) identifying as a key feature vector a feature vector that minimizes a distortion of said feature vectors included in said segment;
(d) ranking a saliency of a key feature vector relative to other key feature vectors;
(f) selecting a video frame for said summary on a basis of said saliency ranking of a corresponding a key feature vector. - View Dependent Claims (10, 11)
-
Specification