Cross-media similarity measures through trans-media pseudo-relevance feedback and document reranking
First Claim
1. A multimedia information retrieval method performed by an electronic device, the method comprising:
- pre-computing values of at least one monomodal pairwise similarity measure for document pairs of a multimedia reference repository and storing the pre-computed values of at least one monomodal pairwise similarity measure for the document pairs of the multimedia reference repository in a storage of or accessible by the electronic device;
after storing the pre-computed values of at least one monomodal pairwise similarity measure for the document pairs of the multimedia reference repository, performing an initial information retrieval process respective to the multimedia reference repository to return a set of initial repository documents;
selecting and retrieving from the storage pre-computed values of the at least one monomodal pairwise similarity measure for candidate documents of the multimedia reference repository respective to repository documents of the set of initial repository documents; and
identifying a set of top-ranked documents of the multimedia reference repository based at least in part on the retrieved pre-computed values of the at least one monomodal pairwise similarity measure for the candidate documents of the multimedia reference repository respective to repository documents of the set of initial repository documents.
7 Assignments
0 Petitions
Accused Products
Abstract
A multimedia information retrieval system includes a storage and an electronic processing device. The latter is configured to perform a process including: computing values of a pairwise similarity measure quantifying pairwise similarity of documents of a multimedia reference repository; storing the computed values in the storage; performing an initial information retrieval process respective to the multimedia reference repository to return a set of initial repository documents; and identifying a set of top ranked documents of the multimedia reference repository based at least on the stored computed values pertaining to the set of initial repository documents.
-
Citations
18 Claims
-
1. A multimedia information retrieval method performed by an electronic device, the method comprising:
-
pre-computing values of at least one monomodal pairwise similarity measure for document pairs of a multimedia reference repository and storing the pre-computed values of at least one monomodal pairwise similarity measure for the document pairs of the multimedia reference repository in a storage of or accessible by the electronic device; after storing the pre-computed values of at least one monomodal pairwise similarity measure for the document pairs of the multimedia reference repository, performing an initial information retrieval process respective to the multimedia reference repository to return a set of initial repository documents; selecting and retrieving from the storage pre-computed values of the at least one monomodal pairwise similarity measure for candidate documents of the multimedia reference repository respective to repository documents of the set of initial repository documents; and identifying a set of top-ranked documents of the multimedia reference repository based at least in part on the retrieved pre-computed values of the at least one monomodal pairwise similarity measure for the candidate documents of the multimedia reference repository respective to repository documents of the set of initial repository documents. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A multimedia information retrieval method performed by an electronic device, the method comprising:
-
pre-computing pairwise similarity measure values respective to different first and second media modalities for all pairs of documents in a multimedia reference repository and storing the pre-computed values in a storage of or accessible by the electronic device; performing an initial monomodal information retrieval process operating on the first media modality using pre-computed pairwise similarity measure values respective to the first media modality retrieved from the storage to retrieve a set of initial repository documents from the multimedia reference repository; and identifying a set of top-ranked documents of the multimedia reference repository based at least in part on pre-computed pairwise similarity measure values respective to the second media modality retrieved from the storage for document pairs that include documents of the set of initial repository documents. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A multimedia information retrieval system comprising:
-
a storage that stores; (i) a multimedia reference repository of multimedia documents and corresponding image and text content feature representations, (ii) precomputed pairwise document text similarity measure values indicative of text content similarity for all pairs of documents in the multimedia reference repository, and (iii) precomputed pairwise document image similarity measure values indicative of image content similarity for all pairs of documents in the multimedia reference repository; and an electronic processing device configured to perform a process including; performing an initial monomodal information retrieval process respective to the multimedia reference repository to return a set of initial repository documents, the monomodal information retrieval process operating on one member of the group consisting of text content and image content, and identifying a set of top-ranked documents of the multimedia reference repository based at least on precomputed pairwise similarity measure values indicative of similarity with documents of the set of initial repository documents, the precomputed pairwise similarity measure values being indicative of similarity respective to the other member of the group consisting of text content and image content, the identifying operation retrieving the precomputed pairwise similarity measure values from the storage. - View Dependent Claims (17, 18)
-
Specification