FRAMEWORK FOR IMAGE THUMBNAILING BASED ON VISUAL SIMILARITY
First Claim
1. A method for detecting a region of interest in an image:
- comprising;
for each image in a dataset of images for which a region of interest has been established respectively, storing a dataset image representation based on features extracted from the image;
for an original image for which a region of interest is to be detected;
generating an original image representation for the original image based on features extracted from the image;
identifying a subset of similar images from the images in the dataset, the identified subset being based on a measure of similarity between the original image representation and respective dataset image representations;
training a classifier with information extracted from the established regions of interest of the subset of similar images;
with the trained classifier, identifying a region of interest in the original image.
6 Assignments
0 Petitions
Accused Products
Abstract
An apparatus and method for detecting a region of interest in an image are disclosed. Image representations for a set of images that have been manually annotated with regions of interest are stored, along with positive and negative representations of each image which are similarly derived to the image representations except that they are based on features extracted from patches within the region of interest and outside it, respectively. For an original image for which a region of interest is desired, the stored information for K similar images is automatically retrieved and used to train a classifier. The trained classifier provides, for each patch of the original image, a probability of being in a region of interest, based extracted features of the patch (represented, for example, as a Fisher vector), which can be used to determine a region of interest in the original image.
281 Citations
25 Claims
-
1. A method for detecting a region of interest in an image:
- comprising;
for each image in a dataset of images for which a region of interest has been established respectively, storing a dataset image representation based on features extracted from the image; for an original image for which a region of interest is to be detected; generating an original image representation for the original image based on features extracted from the image; identifying a subset of similar images from the images in the dataset, the identified subset being based on a measure of similarity between the original image representation and respective dataset image representations; training a classifier with information extracted from the established regions of interest of the subset of similar images; with the trained classifier, identifying a region of interest in the original image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
- comprising;
-
23. An apparatus for detecting a region of interest in an image comprising:
-
memory which, for a dataset of images for which a respective region of interest has been established, stores a set of dataset image representations, each dataset image representation being derived from features extracted from a respective one of the images in the dataset; memory which stores instructions which, for an original image for which a region of interest is to be detected; generate an original image representation for the original image based on features extracted from the original image; identify a subset of similar images in the dataset, based on a measure of similarity between the original image representation and each dataset image representation; train a classifier to identify a region of interest in the original image, the classifier being trained with positive and negative examples, each of the positive examples comprising a high level representation based on features extracted from the established region of interest of a respective one of the subset of similar images and each of the negative examples comprising a high level representation based on features extracted from outside the established region of interest of a respective one of the subset of similar images.
-
-
24. A method for detecting a region of interest in an image comprising:
-
storing a set of image representations, each image representation being based on features extracted from patches of a dataset image, where for each dataset image, the patch features are identified as salient or non-salient based on whether or not the patch is within a manually identified region of interest; and for an original image for which a region of interest is to be detected; generating an original image representation for the original image based on features extracted from patches of the image; computing a distance measure between the original image representation and image representations in the set of image representations to identify a subset of similar image representations from the set of image representations; training a classifier with positive and negative examples extracted from the images corresponding to subset of similar image representations, the positive examples each being based on the salient patch features of a respective image and the negative examples being based on non-salient patch features of the respective image; and with the trained classifier, identifying a region of interest in the original image based on the patch features of the original image. - View Dependent Claims (25)
-
Specification