SYSTEM AND METHODS OF INTEGRATING VISUAL FEATURES AND TEXTUAL FEATURES FOR IMAGE SEARCHING
First Claim
Patent Images
1. A system for image searching in a vertical content area to generate a ranked image search list, comprising:
- a memory;
a display;
a processor connected to said memory and said database; and
a data input device configured to permit input one or more text queries into said memory;
said processor processing the one or more text queries by;
providing a ranked list of relevant items as an initial result set;
constructing an expanded query by integrating textual features and visual features for each result in the initial result set;
evaluating each expanded query to determine items that are similar in the ranked list of relevant items to generate the ranked image search list, wherein a weighted vector representing visual perception of one of the one or more text queries is enforced during the evaluating of each expanded query; and
displaying the ranked image search list on said display.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention includes a system and methods for image searching. Embodiments of the system integrate textual features and visual features for improved search performance. The system represents text terms in the visual feature space and develops a text-guided weighting scheme for visual features. The weighting scheme infers intention from query terms and enhances the visual features that are significant in light of such intention.
-
Citations
20 Claims
-
1. A system for image searching in a vertical content area to generate a ranked image search list, comprising:
-
a memory; a display; a processor connected to said memory and said database; and a data input device configured to permit input one or more text queries into said memory; said processor processing the one or more text queries by; providing a ranked list of relevant items as an initial result set; constructing an expanded query by integrating textual features and visual features for each result in the initial result set; evaluating each expanded query to determine items that are similar in the ranked list of relevant items to generate the ranked image search list, wherein a weighted vector representing visual perception of one of the one or more text queries is enforced during the evaluating of each expanded query; and displaying the ranked image search list on said display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for an improved search, comprising the steps of:
-
inputting a text query using a data input device; crawling a network of information to obtain pages from the network, wherein each page includes an image and text information; analyzing the image using an image processor to ascertain at least one visual feature including shape, color, or texture of an image; assessing the text information using a parser to obtain a text feature including a keyword of the text information; calculating a weight vector for each keyword by integrating the visual features and text features; preparing an initial data set based using a text-based search method; ranking the initial data set using the weight vector to obtain ranked items; and displaying the ranked items in a user interface context shown in a display unit. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification