SYSTEM AND METHOD FOR MULTIMEDIA INFORMATION RETRIEVAL
First Claim
1. A method for multimedia information retrieval comprising:
- querying a multimedia collection with a first component of a multimedia query to generate first comparison measures between the first query component and respective objects in the collection for a first media type;
querying at least a part of the multimedia collection with a second component of the multimedia query to generate second comparison measures between the second query component and respective objects in the collection for a second media type;
computing an aggregated score for each of a set of objects in the collection based on the first comparison measure and the second comparison measure for the object, the computing comprising applying an aggregating function to the first and second comparison measures in which a first confidence weighting is applied to the first comparison measure and a second confidence weighting is applied to the second comparison measure, the first confidence weighting is independent of the second comparison measure and the second confidence weighting is dependent on the first comparison measure; and
outputting information based on the aggregated scores.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for information retrieval are disclosed. The method includes querying a multimedia collection with a first component of a multimedia query (e.g., a text-based part of the query) to generate first comparison measures between the first component of the query and respective objects in the collection for a first media type (e.g., text). The multimedia collection is queried with a second component of the multimedia query (e.g., an image-based part of the query) to generate second comparison measures between the second component of the query and respective objects in the collection for a second media type (e.g., visual). An aggregated score for each of a set of objects in the collection is computed, based on the first comparison measure and the second comparison measure for the object. This includes applying an aggregating function to the first and second comparison measures in which a first confidence weighting is applied to the first comparison measure and a second confidence weighting is applied to the second comparison measure. The first confidence weighting is independent of the second comparison measure. The second confidence weighting is dependent on the first comparison measure. Information based on the aggregated scores is output.
-
Citations
26 Claims
-
1. A method for multimedia information retrieval comprising:
-
querying a multimedia collection with a first component of a multimedia query to generate first comparison measures between the first query component and respective objects in the collection for a first media type; querying at least a part of the multimedia collection with a second component of the multimedia query to generate second comparison measures between the second query component and respective objects in the collection for a second media type; computing an aggregated score for each of a set of objects in the collection based on the first comparison measure and the second comparison measure for the object, the computing comprising applying an aggregating function to the first and second comparison measures in which a first confidence weighting is applied to the first comparison measure and a second confidence weighting is applied to the second comparison measure, the first confidence weighting is independent of the second comparison measure and the second confidence weighting is dependent on the first comparison measure; and outputting information based on the aggregated scores. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A system for multimedia information retrieval comprising:
-
a search engine for querying an associated multimedia collection with a first component of a multimedia query and for querying at least a part of the queried multimedia collection with a second component of the multimedia query; a first comparison component for generating a first comparison measure between the first query component and a respective object in the collection for a first media type; a second comparison component for generating a second comparison measure between the second query component and a respective object in the collection for the second media type; a multimedia scoring component for generating aggregated scores for each of a set of objects in the collection based on the first comparison measure and the second comparison measure for the respective object, the multimedia scoring component applying an aggregating function to the first and second comparison measure in which a first confidence weighting is applied to the first comparison measure which is independent of the second comparison measure and a second confidence weighting is applied to the second comparison measure which is dependent on the first comparison measure; and a processor for implementing the search engine, first and second comparison components, and multimedia scoring component. - View Dependent Claims (23, 24, 25)
-
-
26. An information retrieval method comprising:
-
retrieving a set of objects from a collection based on computed text-based scores for the objects; computing image-based scores for the retrieved objects; with a processor, computing an aggregated score for objects in the retrieved set of objects based on the respective text-based and image-based scores in which a first confidence weighting is applied to the text-based score which is independent of the image-based score and a second confidence weighting is applied to the image-based score which is dependent on the text-based score; and outputting information based on the aggregated scores.
-
Specification