APPARATUS AND SOFTWARE SYSTEM FOR AND METHOD OF PERFORMING A VISUAL-RELEVANCE-RANK SUBSEQUENT SEARCH
First Claim
1. A method of identifying a video comprising the steps of:
- identifying sequences of frames of the video as comprising respective scenes;
determining visual relevance rank of each of the scenes;
selecting a number of the scenes based on the visual relevance rank associated with each of the scenes;
identifying, within each of the selected scenes, a representative thumbnail frame; and
displaying (i) a first thumbnail corresponding to one of the representative thumbnail frames based on the visual relevance rank of the associated scene and (ii) a filmstrip including an ordered sequence of the representative thumbnail frames.
4 Assignments
0 Petitions
Accused Products
Abstract
A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).
-
Citations
43 Claims
-
1. A method of identifying a video comprising the steps of:
-
identifying sequences of frames of the video as comprising respective scenes; determining visual relevance rank of each of the scenes; selecting a number of the scenes based on the visual relevance rank associated with each of the scenes; identifying, within each of the selected scenes, a representative thumbnail frame; and displaying (i) a first thumbnail corresponding to one of the representative thumbnail frames based on the visual relevance rank of the associated scene and (ii) a filmstrip including an ordered sequence of the representative thumbnail frames. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. An apparatus for identifying a video comprises:
-
a scene detection engine operating to identify sequences of frames of the video as comprising respective scenes; a scoring engine operating to determine a visual relevance rank of each of the scenes; a scene selection engine operating to select a number of the scenes based on the visual relevance rank associated with each of the scenes; a frame extraction engine operating to identify, within each of the selected scenes, a representative thumbnail frame; and a display engine operating to generate a visual display including (i) a first thumbnail corresponding to one of the representative thumbnail frames based on the visual relevance rank of the associated scene and (ii) a filmstrip including an ordered sequence of the representative thumbnail frames. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)
-
-
43. A computer program comprising:
-
a computer usable medium having computer readable program code embodied therein, the computer readable program code including; computer readable program code for causing the computer to identify sequences of frames of the video as comprising respective scenes; computer readable program code for causing the computer to determine a visual relevance rank of each of the scenes; computer readable program code for causing the computer to select a number of the scenes based on the visual relevance rank associated with each of the scenes; computer readable program code for causing the computer to identify, within each of the selected scenes, a representative thumbnail frame; and computer readable program code for causing the computer to display (i) a first thumbnail corresponding to one of the representative thumbnail frames based on the visual relevance rank of the associated scene and (ii) a filmstrip including an ordered sequence of the representative thumbnail frames.
-
Specification