Query image search
First Claim
1. A computer-implemented method, comprising:
- accessing a plurality of images referenced by initial image search results responsive to a query image, each of the plurality of images having a visual similarity score that satisfies an initial similarity threshold, the visual similarity score being generated by an image similarity model that has been trained based on user similarity feedback from a plurality of users and feature distances between images referenced by the user similarity feedback, the user similarity feedback specifying a reference query image and a first of two training images that was identified, by the plurality of users, as more visually similar than a second of the two training images to the reference query image, each of the feature distances indicative of a visual distance between corresponding image feature scores for the reference query image and the first of the two training images;
selecting, in a data processing system and as a result image for the query image, a first image from the plurality of images, the first image having a visual similarity score that satisfies a first similarity threshold, the first similarity threshold being more selective than the initial similarity threshold;
determining that a second image from the plurality of images has a first degree of visual similarity relative to the query image;
determining that the second image from the plurality of images has a second degree of visual similarity relative to the first image from the plurality of images;
determining, based on the first degree of visual similarity and the second degree of visual similarity, that the second image satisfies a similarity condition specifying required degrees of visual similarity between the second image, the query image, and the first image; and
selecting, in the data processing system and as another result image for the query image, the second image from the plurality of images in response to determining that the second image satisfies the similarity condition, wherein a result image is an image for which a reference to the image is identified as a final image search result for the query image.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems and apparatus for identifying result images for a query image. One or more labels that are associated with the query image are obtained. Candidate images matching the query labels are identified. Visual similarity scores are generated for the candidate images. Each visual similarity score represents the visual similarity of a respective candidate image to the query image. Relevance scores are generated for each of the candidate images based on the visual similarity scores. Each relevance score represents a measure of relevance of the respective candidate images to the query image. The candidate images are ranked based on the relevance scores, a highest ranking subset of the candidate images being identified as result images and referenced by image search results. The result images can be candidate images that satisfy a similarity condition relative to the query image and other result images.
-
Citations
15 Claims
-
1. A computer-implemented method, comprising:
-
accessing a plurality of images referenced by initial image search results responsive to a query image, each of the plurality of images having a visual similarity score that satisfies an initial similarity threshold, the visual similarity score being generated by an image similarity model that has been trained based on user similarity feedback from a plurality of users and feature distances between images referenced by the user similarity feedback, the user similarity feedback specifying a reference query image and a first of two training images that was identified, by the plurality of users, as more visually similar than a second of the two training images to the reference query image, each of the feature distances indicative of a visual distance between corresponding image feature scores for the reference query image and the first of the two training images; selecting, in a data processing system and as a result image for the query image, a first image from the plurality of images, the first image having a visual similarity score that satisfies a first similarity threshold, the first similarity threshold being more selective than the initial similarity threshold; determining that a second image from the plurality of images has a first degree of visual similarity relative to the query image; determining that the second image from the plurality of images has a second degree of visual similarity relative to the first image from the plurality of images; determining, based on the first degree of visual similarity and the second degree of visual similarity, that the second image satisfies a similarity condition specifying required degrees of visual similarity between the second image, the query image, and the first image; and selecting, in the data processing system and as another result image for the query image, the second image from the plurality of images in response to determining that the second image satisfies the similarity condition, wherein a result image is an image for which a reference to the image is identified as a final image search result for the query image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer system, comprising:
-
a data store storing a plurality of images referenced by initial image search results responsive to a query image, each of the plurality of images having a visual similarity score that satisfies an initial similarity threshold, the visual similarity score being generated by an image similarity model that has been trained based on user similarity feedback from a plurality of users and feature distances between images referenced by the user similarity feedback, the user similarity feedback specifying a reference query image and a first of two training images that was identified, by the plurality of users, as more visually similar than a second of the two training images to the reference query image, each of the feature distances indicative of a visual distance between corresponding image feature scores for the reference query image and the first of the two training images; and one or more computers that interact with the data store and identify final result images for the query image, the final result images including at least a first image and a second image, wherein the one or more computers determine a first degree of visual similarity between the first image and the query image, identify the first image as a final result image based on the first degree of visual similarity satisfying a first similarity threshold, determine a second degree of visual similarity between a second image and the first image, and identify the second image as another final result image based on the second degree of visual similarity meeting a required degree of similarity between the second image and the first image and based on the second image having a third degree of visual similarity, relative to the query image, that meets the first similarity threshold. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
Specification