Apparatus and software system for and method of performing a visual-relevance-rank subsequent search
First Claim
1. A method comprising the steps of:
- receiving a search query specifying search criteria;
searching for videos satisfying the search criteria;
identifying one or more visual objects in each of the videos of video search results returned by the search query;
determining a visual relevance for each of the visual objects in each of the videos within the video search results, wherein determining the visual relevance for each of the visual objects comprises ranking the visual objects and increasing a ranking of the videos of the video search results containing the ranked visual objects based on the rankings of the visual objects;
grouping the visual objects present in multiple of the videos of the video search results;
displaying an image for each visual object grouping along with the video search results;
receiving a selection of one of the visual objects from a user; and
displaying a reorder of the video search results responsive to the selection comprising generating a new set of video search results comprising a new set of videos and a new set of visual objects, in accordance with the visual relevance of the visual object selected by the user.
3 Assignments
0 Petitions
Accused Products
Abstract
A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).
92 Citations
15 Claims
-
1. A method comprising the steps of:
-
receiving a search query specifying search criteria; searching for videos satisfying the search criteria; identifying one or more visual objects in each of the videos of video search results returned by the search query; determining a visual relevance for each of the visual objects in each of the videos within the video search results, wherein determining the visual relevance for each of the visual objects comprises ranking the visual objects and increasing a ranking of the videos of the video search results containing the ranked visual objects based on the rankings of the visual objects; grouping the visual objects present in multiple of the videos of the video search results; displaying an image for each visual object grouping along with the video search results; receiving a selection of one of the visual objects from a user; and displaying a reorder of the video search results responsive to the selection comprising generating a new set of video search results comprising a new set of videos and a new set of visual objects, in accordance with the visual relevance of the visual object selected by the user. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. An apparatus comprising:
-
an interface operating to receive a search query specifying search criteria; a search engine operating to search for videos satisfying the search criteria; a recognition engine operating to identify one or more visual objects in each of the videos of a first set of video search results returned by the search query and determine a visual relevance for each of the visual objects in each of the videos within the first set of video search results; a formatting engine operating to group the visual objects present in multiple of the videos of the first set of video search results; and
a display engine operating to;display an image for each visual object grouping along with the first set of video search results; receive a selection of one of one of the visual objects from a user; generate a second set of video search results comprising a second set of videos responsive to the selection, wherein the visual relevance of the second set of videos appearing in the second set of video search results is different from the visual relevance of the videos appearing in the first set of video search results, the visual relevance for each of the visual objects being determined by ranking the visual objects and increasing a ranking of the videos of the video search results containing the ranked visual objects based on the rankings of the visual objects; and display the second set of video search results comprising the second set of videos to the user. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer usable medium having computer readable program code embodied therein, the computer readable program code including:
-
computer readable program code for causing the computer to receive a search query specifying search criteria; computer readable program code for causing the computer to search for videos satisfying the search criteria; computer readable program code for causing the computer to analyze video search results returned by the search query to identify one or more visual objects in each of the videos of the video search results returned by the search query; computer readable program code for causing the computer to determine a visual relevance for each of the visual objects in each of the videos based on a visual significance of the visual objects within the video search results, the visual relevance for each of the visual objects being determined by ranking the visual objects and increasing a ranking of the videos of the video search results containing the ranked visual objects based on the rankings of the visual objects; computer readable program code for causing the computer to group the visual objects present in multiple of the videos of the video search results; computer readable program code for causing the computer to display an image for each visual object grouping along with the video search results; computer readable program code for causing the computer to receive a selection of one of the images from a user; and computer readable program code for causing the computer to display a new set of video search results comprising a new set of videos to the user, in accordance with the visual relevance of the image selected by the user.
-
Specification