Image segmentation based on approximation of segmentation similarity
First Claim
Patent Images
1. A method for image segmentation comprising:
- learning a projection matrix using segmentation maps and image signatures of a set of training images;
generating an image signature for an input image to be segmented;
projecting the image signature of the image to be segmented into a feature space with the learned projection matrix;
identifying at least one similar image from a set of images, based on the projected image signature of the input image and projected image signatures of images in the set of images projected with the learned projection matrix, the identifying comprising computing a similarity between the projected image signature and the projected image signatures of the images in the set, wherein the set of images comprises a set of license plate images and respective segmentation maps, each segmentation map including a foreground region, which corresponds to an object of interest, and a background region, which corresponds to the rest of the image;
segmenting the input image based on the segmentation map of at least one of the at least one similar images, the segmentation including identifying a foreground region of the input image; and
identifying a license plate number from the foreground region of the segmented input image.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and a method for image segmentation use segmentation maps of one or more similar images as a basis for the segmentation. The method includes generating an image signature for an input image to be segmented and identifying at least one similar image from a set of images, based on the image signature of the input image and image signatures of images in the set of images. The similarity may be computed after first projecting the image signatures into a feature space where similarity is more likely to agree with segmentation map similarity. The input image is segmented, based on the segmentation map of one or more of the at least one identified similar images.
-
Citations
15 Claims
-
1. A method for image segmentation comprising:
-
learning a projection matrix using segmentation maps and image signatures of a set of training images; generating an image signature for an input image to be segmented; projecting the image signature of the image to be segmented into a feature space with the learned projection matrix; identifying at least one similar image from a set of images, based on the projected image signature of the input image and projected image signatures of images in the set of images projected with the learned projection matrix, the identifying comprising computing a similarity between the projected image signature and the projected image signatures of the images in the set, wherein the set of images comprises a set of license plate images and respective segmentation maps, each segmentation map including a foreground region, which corresponds to an object of interest, and a background region, which corresponds to the rest of the image; segmenting the input image based on the segmentation map of at least one of the at least one similar images, the segmentation including identifying a foreground region of the input image; and identifying a license plate number from the foreground region of the segmented input image.
-
-
2. A method for image segmentation comprising:
-
providing a learned projection matrix learned using segmentation maps and image signatures of a set of training images, the learning of the projection matrix including, for a plurality of iterations; drawing a triplet of entries from the set of training images, each entry comprising a segmentation map and an image signature for an image in the training set; computing a similarity between a first pair of the entries, based on their segmentation maps; computing a similarity between a second pair of the entries, based on their segmentation maps; generating a first ranking for the first and second pairs based on the computed segmentation map similarities; computing a similarity between the first pair of the entries, based on their image signatures projected with a current projection matrix; computing a similarity between a second pair of the entries, based on their image signatures projected with the current projection matrix; generating a second ranking for the first and second pairs based on the computed projected image signature similarities; and updating the current projection matrix if the first and second rankings do not agree; and after the plurality of iterations, outputting the updated projection matrix as the projection matrix; generating an image signature for an input image to be segmented; projecting the image signature of the image signature to be segmented into a feature space with the learned projection matrix; identifying at least one similar image from the set of images, based on the image signature of the input image and image signatures of images in the set of images, comprising computing a similarity between the projected image signature and projected image signatures of the images in the set of images, projected with the learned projection matrix; and segmenting the input image based on a segmentation map of at least one of the at least one similar images. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A system for image segmentation comprising:
-
a signature generator configured for generating an image signature for an input image to be segmented; memory which stores a learned projection matrix for projecting image signatures into a feature space in which projected signature similarity is more likely to correlate with a similarity of segmentation maps of images, the learned projection matrix having been estimated using image signatures and segmentation maps of a set of segmented training images, each segmentation map including a foreground region, which corresponds to an object of interest, wherein the learned projection matrix is learned using segmentation maps and image signatures of a set of training images, the learning of the projection matrix including, for a plurality of iterations; drawing a triplet of entries from the set of training images, each entry comprising a segmentation map and an image signature for an image in the training set; computing a similarity between a first pair of the entries, based on their segmentation maps; computing a similarity between a second pair of the entries, based on their segmentation maps; generating a first ranking for the first and second pairs based on the computed segmentation map similarities; computing a similarity between the first pair of the entries, based on their image signatures projected with a current projection matrix; computing a similarity between a second pair of the entries, based on their image signatures projected with the current projection matrix; generating a second ranking for the first and second pairs based on the computed projected image signature similarities; and updating the current projection matrix if the first and second rankings do not agree; and after the plurality of iterations, outputting the updated projection matrix as the projection matrix; a retrieval component configured for identifying at least one similar image from a set of images, based on the image signature of the input image and image signatures of images in the set of images, the signatures being projected with the projection matrix; and a segmentation component configured for segmenting the input image based on a segmentation map of at least one of the at least one similar images; and
;a processor for implementing the signature generator, retrieval component, and segmentation component.
-
Specification