Bags of visual context-dependent words for generic visual categorization
First Claim
1. An image classifier comprising:
- a vocabulary of visual words;
a patch context analyzer configured to generate a context representation for each of a plurality of patches of an image, each context representation being indicative of occurrence probabilities of context words in a plurality of neighboring patches wherein the plurality of neighboring patches are defined as one of (i) patches satisfying selected distance and size constraints respective to the patch whose context representation is being generated and (ii) pre-selected patches at pre-selected positions respective to the patch whose context representation is being generated; and
an image labeler configured to assign an image category to an image based at least on the context representations of a plurality of patches of the image.
6 Assignments
0 Petitions
Accused Products
Abstract
Category context models (64) and a universal context model (62) are generated including sums of soft co-occurrences of pairs of visual words in geometric proximity to each other in training images (50) assigned to each category and assigned to all categories, respectively. Context information (76) about an image to be classified (70) are generated including sums of soft co-occurrences of pairs of visual words in geometric proximity to each other in the image to be classified. For each category (82), a comparison is made of (i) closeness of the context information about the image to be classified with the corresponding category context model and (ii) closeness of the context information about the image to be classified with the universal context model. An image category (92) is assigned to the image to be classified being based on the comparisons.
14 Citations
14 Claims
-
1. An image classifier comprising:
-
a vocabulary of visual words; a patch context analyzer configured to generate a context representation for each of a plurality of patches of an image, each context representation being indicative of occurrence probabilities of context words in a plurality of neighboring patches wherein the plurality of neighboring patches are defined as one of (i) patches satisfying selected distance and size constraints respective to the patch whose context representation is being generated and (ii) pre-selected patches at pre-selected positions respective to the patch whose context representation is being generated; and an image labeler configured to assign an image category to an image based at least on the context representations of a plurality of patches of the image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. An image classifier comprising:
-
a patch context analyzer configured to generate a context representation for each of a plurality of patches of an image, the patch context analyzer comprising a context histogram generator configured to generate the context representation as a plurality of values each indicative of probabilistic number of occurrences of a corresponding context visual word in a neighborhood of a patch whose context representation is being generated, wherein the context histogram generator determines the probabilistic number of occurrences of each context visual word based on occupancy probabilities of the context visual word in a plurality of neighboring patches that neighbor the patch whose context representation is being generated, wherein the plurality of neighboring patches are defined as one of; patches satisfying selected distance and size constraints respective to the patch whose context representation is being generated, and pre-selected patches at pre-selected positions respective to the patch whose context representation is being generated; and an image labeler including a plurality of comparators each comparing (i) closeness of context representations of a plurality of patches of an image with a category context model and (ii) closeness of the context representations of the plurality of patches of the image with a universal context model, the image labeler being configured to assign an image category to the image based on the outputs of the comparators.
-
-
12. An image classification method comprising:
-
for each patch of a plurality of patches of an image; selecting a plurality of neighboring patches using a closeness measure that is based on criteria including (i) distance between patch centers; and
(ii) similarity of patch sizes or scales, andgenerating a context representation for the patch based at least on occupancy probabilities of context words in the plurality of neighboring patches; for each of a plurality of categories, generating a comparison of (i) closeness of the context representations of the image with a category context model representative of the category and (ii) closeness of the context representations of the image with a universal context model representative of all categories; and assigning an image category to the image based on the generated comparisons; wherein the image classification method is performed by a computing apparatus. - View Dependent Claims (13, 14)
-
Specification