Method and Device for Automatic Generation of Summary of a Plurality of Images
First Claim
1. A method for providing a summary of a plurality of images (1), the method comprising:
- a) dividing the plurality of images (1) into a plurality of segments (s1, s2, s3, s4), each segment (s1, s2, s3, s4) comprising at least one image,b) analyzing each segment (s1, s2, s3, s4) with respect to content and associating a set of content descriptors resulting from the analysis of said segment (s1, s2, s3, s4),c) establishing relations between the segments (s1, s2, s3, s4) based on the content descriptors, wherein each relation between first and second segments (s1, s2) has one or more weights (w12) associated thereto, the one or more weights (w12) representing a measure of relation between the first and second segments (s1, s2),d) determining for each segment (s1) a measure of relevance based on the weights (w12, w13, w14) associated with relations to said segment (s1),e) generating a summary (130) by selecting a subset of segments (s2, s4) from the plurality of segments (s1, s2, s3, s4) based on the relevance parameters associated with the segments (s1, s2, s3, s4).
1 Assignment
0 Petitions
Accused Products
Abstract
Method and device for providing a summary of a plurality of images, e.g. a video sequence. The method includes dividing the video sequence into a plurality of segments. The segments are analyzed with respect to content and a set of content descriptors are associated to the segments. Preferably, additional textual information about the segments, screenplay etc., is used to determine the content descriptors. A graph representing relations between the segments is constructed indicating relations between segments. Weights are associated to the relations so as to represent a measure of relation, e.g. a logical correlation, between segments. The weights are based on the calculated content descriptors. A relevance measure for a segment is determined based on all weights associated with relations to said segment. Finally, a summary is generated by selecting the most relevant segments. The method can create an automatic summary of a film that preserves all the logical plot of the original but is shorter in duration (e.g. 70% of the original film) while the original playback rate is preserved.
43 Citations
19 Claims
-
1. A method for providing a summary of a plurality of images (1), the method comprising:
-
a) dividing the plurality of images (1) into a plurality of segments (s1, s2, s3, s4), each segment (s1, s2, s3, s4) comprising at least one image, b) analyzing each segment (s1, s2, s3, s4) with respect to content and associating a set of content descriptors resulting from the analysis of said segment (s1, s2, s3, s4), c) establishing relations between the segments (s1, s2, s3, s4) based on the content descriptors, wherein each relation between first and second segments (s1, s2) has one or more weights (w12) associated thereto, the one or more weights (w12) representing a measure of relation between the first and second segments (s1, s2), d) determining for each segment (s1) a measure of relevance based on the weights (w12, w13, w14) associated with relations to said segment (s1), e) generating a summary (130) by selecting a subset of segments (s2, s4) from the plurality of segments (s1, s2, s3, s4) based on the relevance parameters associated with the segments (s1, s2, s3, s4). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 18, 19)
-
-
16. A device (210) adapted to generate a summary (220) of a plurality of images (201), the device comprising processing means (211) including
dividing means (211a) arranged to divide the plurality of images (201) into a plurality of segments, each segment comprising at least one image, analyzing means (211b) arranged to analyze each segment with respect to content and associating a set of content descriptors resulting from the analysis of said segment, relation analyzing means (211c) arranged to establish relations between the segments, wherein each relation between first and second segments has one or more weights based on the content descriptors associated thereto, the one or more weights representing a measure of relation between the first and second segments, relevance determining means (211d) arranged to determine for each segment a measure of relevance based on the weights associated with relations to said segment, a summary generator (211e) arranged to generate the summary (220) by selecting a subset of segments from the plurality of segments based on the relevance parameters associated with the segments.
Specification