Detecting and indexing characters of videos by NCuts and page ranking
First Claim
1. An apparatus, comprising:
- a feature extraction module to identify images of a video as a plurality of faces of characters of the video and features associated with the plurality of faces; and
a cast indexing module coupled with the feature extraction module to create a cast of characters of the video based upon the plurality of faces of characters of the video, the cast indexing module to partition the plurality of faces into sets of faces by forming clusters of the faces based upon the features, partitioning the clusters, and detecting the cast of characters based upon partitions, wherein;
the sets of faces represent the cast of characters of the video;
different sets of faces represent different characters of the cast of characters; and
the faces within a set of faces represent the faces of a single character of the cast of characters.
2 Assignments
0 Petitions
Accused Products
Abstract
Apparatuses, systems, and computer program products that detect and/or index characters of videos are disclosed. One or more embodiments comprise an apparatus an apparatus having a feature extraction module and a cast indexing module. The feature extraction module may extract features of a scale invariant feature transform (SIFT) for face sets of a video and the cast indexing module may detect one or more characters of the video via one or more associations of clusters of the features. Some alternative embodiments may include a cast ranking module to sort characters of the video, considering such factors as appearance times of the characters, appearance frequencies of the characters, and page rankings of the characters. The apparatus may associate or partition the clusters based on a normalized cut process, as well as detect the characters based on measures of distances of nodes associated with the features. Numerous embodiments may detect the characters based upon partitioning the clusters via solutions for eigenvalue systems for matrices of nodes of the clusters.
-
Citations
23 Claims
-
1. An apparatus, comprising:
-
a feature extraction module to identify images of a video as a plurality of faces of characters of the video and features associated with the plurality of faces; and a cast indexing module coupled with the feature extraction module to create a cast of characters of the video based upon the plurality of faces of characters of the video, the cast indexing module to partition the plurality of faces into sets of faces by forming clusters of the faces based upon the features, partitioning the clusters, and detecting the cast of characters based upon partitions, wherein; the sets of faces represent the cast of characters of the video; different sets of faces represent different characters of the cast of characters; and the faces within a set of faces represent the faces of a single character of the cast of characters. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system, comprising:
-
storage medium to store video, wherein the video comprises faces of characters of the video; a feature extraction module to identify images of a video as a plurality of faces of characters of the video and features associated with the plurality of faces and to group the faces into face sets of the characters of the video, wherein; a face set comprises a set of faces of a single character in a shot; and a shot comprises a set of video frames captured by a single camera in a consecutive recording session; and the feature extraction module comprises a shot detection module to detect shots of the video; and a cast indexing module coupled with the feature extraction module to detect characters of the video to determine a cast of the characters of the video by forming clusters of faces based upon the features, partitioning the clusters, and detecting the characters based upon partitions. - View Dependent Claims (19, 20)
-
-
21. A computer program product comprising a non-transitory computer usable medium having computer usable program code for identifying characters of a video, wherein the video comprises a plurality of video frames, the computer program product including:
-
computer usable program code to identify images of a video as a plurality of faces of characters of the video and features associated with the plurality of faces; and computer usable program code to create a cast of characters of the video based upon the plurality of faces of characters of the video, the computer usable program code to partition the plurality of faces into sets of faces by forming clusters of the faces based upon the features, partitioning the clusters, and detecting the cast of characters based upon partitions, wherein; the sets of faces represent the cast of characters of the video; different sets of faces represent different characters of the cast of characters; and the faces within a set of faces represent the faces of a single character of the cast of characters. - View Dependent Claims (22, 23)
-
Specification