Method, system, and medium for retrieving photo using multimodal information
First Claim
1. A photo retrieval method implemented by a computing device, comprising:
- assigning an object category based on a query;
retrieving photos associated with an expanded query term extracted from the query;
determining a ranking of the retrieved photos based on the assigned object category; and
arranging and displaying the photos in response to the determined ranking.
1 Assignment
0 Petitions
Accused Products
Abstract
A photo retrieval method, system, and medium using multimodal information which prevents a photo of an irrelevant category to be retrieved having a high ranking due to an unfavorable side effect from a query expansion, by reflecting a level of consistency between an object category of a query and a category of a photo retrieved by expansion retrieval using ontology, to a photo retrieval result ranking is provided. The photo retrieval method using the multimodal information includes: assigning an object category with respect to a query; retrieving photos associated with an expanded query term extracted from the query; determining a ranking of the retrieved photo by reflecting the assigned object category; and arranging and displaying the photos in response to the determined ranking.
-
Citations
26 Claims
-
1. A photo retrieval method implemented by a computing device, comprising:
-
assigning an object category based on a query; retrieving photos associated with an expanded query term extracted from the query; determining a ranking of the retrieved photos based on the assigned object category; and arranging and displaying the photos in response to the determined ranking. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 22)
-
-
11. At least one computer readable medium storing instructions that control at least one processor for executing a photo retrieval method, the method comprising:
-
assigning an object category based on a query; retrieving photos associated with an expanded query term extracted from the query; determining a ranking of the retrieved photos based on the assigned object category; and arranging and displaying the photos in response to the determined ranking.
-
-
12. A photo retrieval system using multimodal information, the system comprising:
-
a category assignor to assign an object category based on a query; an expansion retriever to retrieve photos associated with an expanded query term extracted from the query; a ranking determiner to determine a ranking of the retrieved photos based on the assigned object category; and a photo arranger to arrange and display the photos in response to the determined ranking. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
23. A photo retrieval method implemented by a computing device, comprising:
-
extracting a query term from a query; assigning an object category based on the query; expanding the query term to form an expanded query term; retrieving photos associated with the expanded query term extracted from the query; and determining a ranking of the retrieved photos based on the assigned object category. - View Dependent Claims (24, 25)
-
-
26. At least one computer readable medium storing instructions that control at least one processor for executing a photo retrieval method, the method comprising:
-
extracting a query term from a query; assigning an object category based on the query; expanding the query term to form an expanded query term; retrieving photos associated with the expanded query term extracted from the query; and determining a ranking of the retrieved photos based on the assigned object category.
-
Specification