User Intention Modeling For Interactive Image Retrieval
First Claim
1. A method, comprising:
- receiving an image from a user via a first user interface;
inferring a search intention of the user from visual contents of the image;
selecting a search method based on the inferred search intention;
deriving one or more image features from the image as search criteria;
training a support vector machine (SVM) ranking method with the search method and the image features; and
retrieving images from a database by applying the search method and the SVM ranking method.
2 Assignments
0 Petitions
Accused Products
Abstract
A system performs user intention modeling for interactive image retrieval. In one implementation, the system uses a three stage iterative technique to retrieve images from a database without using any image tags or text descriptors. First, the user submits a query image and the system models the user'"'"'s search intention and configures a customized search to retrieve relevant images. Then, the system extends a user interface for the user to designate visual features across the retrieved images. The designated visual features refine the intention model and reconfigure the search to retrieve images that match the remodeled intention. Third, the system extends another user interface through which the user can give natural feedback about the retrieved images. The three stages can be iterated to quickly assemble a set of images that accurately fulfills the user'"'"'s search intention. They system can be used for image searching without text tags, can be used for initial text tag generation, or can be used to complement a conventional tagged-image platform.
-
Citations
20 Claims
-
1. A method, comprising:
-
receiving an image from a user via a first user interface; inferring a search intention of the user from visual contents of the image; selecting a search method based on the inferred search intention; deriving one or more image features from the image as search criteria; training a support vector machine (SVM) ranking method with the search method and the image features; and retrieving images from a database by applying the search method and the SVM ranking method. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method, comprising:
-
crawling images in local files; remotely crawling image on a network; indexing the images by visual features parsed from the images, wherein the visual features are indicative of user search intentions modeled in an intention model; and creating an images database structured by the visual features. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. A system, comprising:
-
an intention-modeling engine to receive a query image from a user and iteratively refine a search intention of the user based on visual features of the query image; and a retrieval engine to configure an image search based on a current state of the modeled search intention. - View Dependent Claims (19, 20)
-
Specification