Image classification
First Claim
1. A computer-implemented method, comprising:
- obtaining text associated with an image;
obtaining a feature vector representing visual features of the image;
parsing, in one or more processing devices, the text into candidate labels for the image, each candidate label being a unique n-gram of text;
determining, in the one or more processing devices, that an image classification model has been trained for an n-gram matching one or more of the candidate labels, wherein the image classification model has been trained to classify images based on the feature vector; and
assigning, in the processing device, at least one of the one or more candidate labels as a label for the image based on the feature vector and the image classification model for the n-gram matching the one or more candidate labels.
2 Assignments
0 Petitions
Accused Products
Abstract
An image classification system trains an image classification model to classify images relative to text appearing with the images. Training images are iteratively selected and classified by the image classification model according to feature vectors of the training images. An independent model is trained for unique n-grams of text. The image classification system obtains text appearing with an image and parses the text into candidate labels for the image. The image classification system determines whether an image classification model has been trained for the candidate labels. When an image classification model corresponding to a candidate label has been trained, the image classification subsystem classifies the image relative to the candidate label. The image is labeled based on candidate labels for which the image is classified as a positive image.
-
Citations
15 Claims
-
1. A computer-implemented method, comprising:
-
obtaining text associated with an image; obtaining a feature vector representing visual features of the image; parsing, in one or more processing devices, the text into candidate labels for the image, each candidate label being a unique n-gram of text; determining, in the one or more processing devices, that an image classification model has been trained for an n-gram matching one or more of the candidate labels, wherein the image classification model has been trained to classify images based on the feature vector; and assigning, in the processing device, at least one of the one or more candidate labels as a label for the image based on the feature vector and the image classification model for the n-gram matching the one or more candidate labels. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A non-transitory computer readable medium encoded with a computer program comprising instructions that when executed cause one or more computers to perform operations comprising:
-
obtaining text associated with an image; obtaining a feature vector representing visual features of the image; parsing the text into candidate labels for the image, each candidate label being a unique n-gram of the text; determining that an image classification model has been trained for an n-gram matching one or more of the candidate labels, wherein the image classification model has been trained to classify images based on the feature vector; and assigning at least one of the one or more candidate labels as a label for the image based on the feature vector and the image classification model for the n-gram matching the one or more candidate labels. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A system comprising:
-
a data store storing images; and one or more computers that interact with the data store and execute instructions that cause the one more computers to perform operations comprising; obtaining text associated with an image; obtaining a feature vector representing visual features of the image; parsing the text into candidate labels for the image, each candidate label being a unique n-gram of the text; determining that an image classification model has been trained for an n-gram matching one or more of the candidate labels, wherein the image classification model has been trained to classify images based on the feature vector; and assigning at least one of the one or more candidate labels as a label for the image based on the feature vector and the image classification model for the n-gram matching the one or more candidate labels. - View Dependent Claims (12, 13, 14, 15)
-
Specification