Method and apparatus for personalized multimedia summarization based upon user specified theme
First Claim
Patent Images
1. A method for creating a multimedia summarization, said method comprising:
- retrieving multimedia imagery;
choosing a theme for said multimedia summarization, whereby said theme selects a plurality of multimedia scene shots from said multimedia imagery;
setting a time length limit for said multimedia summarization;
extracting multimedia features from said plurality of multimedia scene shots based upon said theme;
setting relevance thresholds for determining which of said plurality of multimedia scene shots will be included in said multimedia summarization based upon said multimedia features;
selecting multimedia scene shots from said plurality of multimedia scene shots, wherein multimedia scene shots with a relevance equal to or higher than said relevance thresholds are selected for said multimedia summarization; and
allotting a portion of said time length limit to each selected multimedia scene shot, wherein the amount of time allotted to a selected multimedia scene shot is proportional to its relevance.
3 Assignments
0 Petitions
Accused Products
Abstract
An automatic video content summarization system that is able to create personalized multimedia summary based on the user-specified theme. The invention employs both natural language processing and video analysis techniques to extract important keywords from the closed caption text as well as prominent visual features from the video footage. The invention uses a Bayesian statistical framework that naturally integrates the user theme, the heuristics and the theme-relevant video characteristics within a unified platform.
118 Citations
25 Claims
-
1. A method for creating a multimedia summarization, said method comprising:
-
retrieving multimedia imagery;
choosing a theme for said multimedia summarization, whereby said theme selects a plurality of multimedia scene shots from said multimedia imagery;
setting a time length limit for said multimedia summarization;
extracting multimedia features from said plurality of multimedia scene shots based upon said theme;
setting relevance thresholds for determining which of said plurality of multimedia scene shots will be included in said multimedia summarization based upon said multimedia features;
selecting multimedia scene shots from said plurality of multimedia scene shots, wherein multimedia scene shots with a relevance equal to or higher than said relevance thresholds are selected for said multimedia summarization; and
allotting a portion of said time length limit to each selected multimedia scene shot, wherein the amount of time allotted to a selected multimedia scene shot is proportional to its relevance. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A computer system adapted to creating a multimedia summarization, said system comprising:
-
a processor;
a memory including software instructions adapted to enable the computer system to perform the steps of;
receiving a theme for the multimedia summarization input by the user;
receiving relevance thresholds for determining if a particular multimedia scene shot will be included in the multimedia summarization requested by the user;
receiving a time length limit for the multimedia summarization;
retrieving multimedia imagery;
extracting a plurality of multimedia scene shots from said multimedia imagery;
extracting multimedia features from said plurality of multimedia scene shots based upon said theme;
measuring the relevance of said plurality of multimedia scene shots; and
selecting multimedia scene shots from said plurality of multimedia scene shots, wherein multimedia scene shots with a relevance equal to or higher than said relevance thresholds are selected for said multimedia summarization; and
allotting a portion of said time length limit to each selected multimedia scene shot, wherein the amount of time allotted to a selected multimedia scene shot is proportional to its relevance.
-
-
25. A computer program product for enabling a computer to create a multimedia summarization, comprising:
-
software instructions for enabling the computer to perform predetermined operations, and a computer readable medium bearing the software instructions;
the predetermined operations including the steps of;
receiving a theme for the multimedia summarization input by the user;
receiving relevance thresholds for determining if a particular multimedia scene shot will be included in the multimedia summarization requested by the user;
receiving a time length limit for the multimedia summarization;
retrieving multimedia imagery;
extracting a plurality of multimedia scene shots from said multimedia imagery;
extracting multimedia features from said plurality of multimedia scene shots based upon said theme;
measuring the relevance of said plurality of multimedia scene shots; and
selecting multimedia scene shots from said plurality of multimedia scene shots, wherein multimedia scene shots with a relevance equal to or higher than said relevance thresholds are selected for said multimedia summarization; and
allotting a portion of said time length limit to each selected multimedia scene shot, wherein the amount of time allotted to a selected multimedia scene shot is proportional to its relevance.
-
Specification