IMAGE OBJECT RETRIEVAL BASED ON AGGREGATION OF VISUAL ANNOTATIONS
First Claim
1. A computer-implemented method comprising steps of:
- receiving a query, wherein the query identifies a set of one or more query terms;
selecting, from an image corpus, a set of three or more sample images that are associated with annotations that match one or more of the query terms;
for each particular sample image in the set of sample images, selecting, from the image corpus, a separate set of candidate images that are visually similar to that particular sample image, and associating that set of candidate images with the particular sample image;
determining that a first set of candidate images, associated with a first sample image of the set of sample images, and a second set of candidate images, associated with a second sample image of the set of sample images, both contain at least a threshold number of candidate images in common;
determining that a third set of candidate images, associated with a third sample image of the set of sample images, contains less than the threshold number of candidate images in common with the first and second sets of candidate images; and
in response to determining that the third set of candidate images contains less than the threshold number of candidate images in common with the first and second sets of candidate images, generating an aggregated set of images based on the first and second sets of candidate images;
wherein the steps are performed by at least one computing device.
9 Assignments
0 Petitions
Accused Products
Abstract
An approach for responding to a text-based query for a digital image is provided. A request that identifies one or more keywords is received. A number of annotated digital images are selected based on a previously determined optimum quantity of annotated digital images. Composite data is gathered from each annotated digital image and a set of candidate digital images is selected based on the composite data. The set of candidate images are the digital images, of a set of digital images, which have a visual appearance that is most similar to the composite data. A response is generated that identifies those digital images which are most responsive to the one or more keywords. Alternatively, a partitioned response is generated which identifies dissimilar sets of digital images.
-
Citations
20 Claims
-
1. A computer-implemented method comprising steps of:
-
receiving a query, wherein the query identifies a set of one or more query terms; selecting, from an image corpus, a set of three or more sample images that are associated with annotations that match one or more of the query terms; for each particular sample image in the set of sample images, selecting, from the image corpus, a separate set of candidate images that are visually similar to that particular sample image, and associating that set of candidate images with the particular sample image; determining that a first set of candidate images, associated with a first sample image of the set of sample images, and a second set of candidate images, associated with a second sample image of the set of sample images, both contain at least a threshold number of candidate images in common; determining that a third set of candidate images, associated with a third sample image of the set of sample images, contains less than the threshold number of candidate images in common with the first and second sets of candidate images; and in response to determining that the third set of candidate images contains less than the threshold number of candidate images in common with the first and second sets of candidate images, generating an aggregated set of images based on the first and second sets of candidate images; wherein the steps are performed by at least one computing device. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A computer-implemented method comprising steps of:
-
receiving a set of one or more query terms; selecting, from an image corpus, a set of sample images that are associated with annotations that match one or more of the query terms; based on the sample images in the set of sample images, generating composite data that represents at least one visual characteristic that the sample images in the set of sample images have in common; determining a set of candidate images that possess visual characteristics that are similar to the at least one visual characteristics represented by the composite data; and returning at least a subset of candidate images in the set of candidate images as results of a query that contained the set of query terms; wherein the steps are performed by at least one computing device. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14)
-
-
15. A computer-implemented method comprising steps of:
-
for each particular sample image of a first set of sample images, selecting, from an image corpus, a separate set of candidate images that are visually similar to that particular sample image of the first set of sample images, thereby producing a first set of sets of candidate images;
aggregating the sets of candidate images in the first set of sets of candidate images to produce a first aggregated list of images;determining a first precision score that is based on a measure of relevance of images in the first aggregated list of images to a specified set of query terms; for each particular sample image of a second set of sample images, selecting, from the image corpus, a separate set of candidate images that are visually similar to that particular sample image of the second set of sample images, thereby producing a second set of sets of candidate images; aggregating the sets of candidate images in the second set of sets of candidate images to produce a second aggregated list of images; determining a second precision score that is based on a measure of relevance of images in the second aggregated list of images to the specified set of query terms; wherein a quantity of sample images in the second set of sample images is greater than a quantity of sample images in the first set of sample images; and based at least in part on the first precision score and the second precision score, determining a quantity of sample images to be used in performing future searches for images in the image corpus; wherein the steps are performed by at least one computing device. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification