Real-time computerized annotation of pictures
First Claim
1. An automated image annotation method, comprising the steps of:
- defining a plurality of concepts;
providing one or more images associated with each concept;
extracting a signature for each image based upon a discrete distribution of visual features associated with that image;
constructing a profiling model for each concept by clustering the discrete distributions;
storing the profiling models along with one or more textual descriptions of each concept;
inputting an image to be annotated;
extracting a signature for the image to be annotated based upon a discrete distribution of visual features associated with that image;
computing the probability that the image belongs to at least one of the concepts by comparing the discrete distribution of visual features associated with the image to annotated with the stored profiling models and, if the input image belongs to at least one of the concepts;
computing the probabilities that the textual descriptions stored with the identified profiling model apply to the image to be annotated;
ranking the textual descriptions applied to the image to be annotated; and
outputting one or more of the highest-ranked textual descriptions as an annotation of the image to be annotated.
2 Assignments
0 Petitions
Accused Products
Abstract
A computerized annotation method achieves real-time operation and better optimization properties while preserving the architectural advantages of the generative modeling approach. A novel clustering algorithm for objects is represented by discrete distributions, or bags of weighted vectors, thereby minimizing the total within cluster distance, a criterion used by the k-means algorithm. A new mixture modeling method, the hypothetical local mapping (HLM) method, is used to efficiently build a probability measure on the space of discrete distributions. Thus, in accord with the invention every image is characterized by a statistical distribution. The profiling model specifies a probability law for distributions directly.
-
Citations
7 Claims
-
1. An automated image annotation method, comprising the steps of:
-
defining a plurality of concepts; providing one or more images associated with each concept; extracting a signature for each image based upon a discrete distribution of visual features associated with that image; constructing a profiling model for each concept by clustering the discrete distributions; storing the profiling models along with one or more textual descriptions of each concept; inputting an image to be annotated; extracting a signature for the image to be annotated based upon a discrete distribution of visual features associated with that image; computing the probability that the image belongs to at least one of the concepts by comparing the discrete distribution of visual features associated with the image to annotated with the stored profiling models and, if the input image belongs to at least one of the concepts; computing the probabilities that the textual descriptions stored with the identified profiling model apply to the image to be annotated; ranking the textual descriptions applied to the image to be annotated; and outputting one or more of the highest-ranked textual descriptions as an annotation of the image to be annotated. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
Specification