K-nearest neighbor re-ranking
First Claim
1. A method for object retrieval and localization, comprising:
- performing, by one or more computing devices;
obtaining an initial ranking of a collection of a plurality of images, with regard to a query object included in a query image, the initial ranking based on a similarity score for each of the images of the collection to the query object, the similarity score determined using a spatially-constrained similarity measure;
generating a ranking of the collection with regard to each of one or more nearest neighbors to the query object as indicated by the initial ranking of the collection, said generating the ranking comprising;
for each of the one or more nearest neighbors, searching the collection according to a localized object of the respective nearest neighbor to determine the similarity scores for the collection, the localized object being a best match object of the respective nearest neighbor to the query object in the query image;
ranking the collection according to the similarity scores; and
generating a new ranking of the collection with regard to the query object according to the initial ranking and the generated rankings with regard to each of the one or more nearest neighbors.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, apparatus, and computer-readable storage media for k-NN re-ranking. Based on retrieved images and localized objects, a k-NN re-ranking method may use the k-nearest neighbors of a query to refine query results. Given the top k retrieved images and their localized objects, each k-NN object may be used as a query to perform a search. A database image may have different ranks when using those k-nearest neighbors as queries. Accordingly, a new score for each database image may be collaboratively determined by those ranks, and re-ranking may be performed using the new scores to improve the search results. The k-NN re-ranking technique may be performed two or more times, each time on a new set of k-nearest neighbors, to further refine the search results.
78 Citations
18 Claims
-
1. A method for object retrieval and localization, comprising:
performing, by one or more computing devices; obtaining an initial ranking of a collection of a plurality of images, with regard to a query object included in a query image, the initial ranking based on a similarity score for each of the images of the collection to the query object, the similarity score determined using a spatially-constrained similarity measure; generating a ranking of the collection with regard to each of one or more nearest neighbors to the query object as indicated by the initial ranking of the collection, said generating the ranking comprising; for each of the one or more nearest neighbors, searching the collection according to a localized object of the respective nearest neighbor to determine the similarity scores for the collection, the localized object being a best match object of the respective nearest neighbor to the query object in the query image; ranking the collection according to the similarity scores; and generating a new ranking of the collection with regard to the query object according to the initial ranking and the generated rankings with regard to each of the one or more nearest neighbors. - View Dependent Claims (2, 3, 4, 5, 6)
-
7. A system, comprising:
-
one or more processors; and a memory comprising program instructions that are executable by at least one of the one or more processors to; obtain an initial ranking of a collection of a plurality of images, with regard to a query object included in a query image, the initial ranking based on a similarity score for each of the images of the collection to the query object, the similarity score determined using a spatially-constrained similarity measure; generate a ranking of the collection with regard to each of one or more nearest neighbors to the query object as indicated by the initial ranking of the collection; and generate a new ranking of the collection with regard to the query object according to the initial ranking and the generated rankings with regard to each of the one or more nearest neighbors, the generation of the new ranking comprises; for each image in the collection, generate a score according to a weighted sum of the rankings; and re-rank the collection with regard to the query object according to the generated scores. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A non-transitory computer-readable storage medium storing program instructions that are computer-executable to implement:
-
obtaining an initial ranking of a collection of a plurality of images, with regard to a query object included in a query image, the initial ranking based on a similarity score for each of the images of the collection to the query object, the similarity score determined using a spatially-constrained similarity measure; generating a ranking of the collection with regard to each of one or more nearest neighbors to the query object as indicated by the initial ranking of the collection, said generating the ranking comprising; for each of the one or more nearest neighbors, searching the collection according to a localized object of the respective nearest neighbor to determine the similarity scores for the collection, the localized object being a best match object of the respective nearest neighbor to the query object in the query image; ranking the collection according to the similarity scores; and generating a new ranking of the collection with regard to the query object according to the initial ranking and the generated rankings with regard to each of the one or more nearest neighbors. - View Dependent Claims (14, 15, 16, 17, 18)
-
Specification