System and method for product identification
First Claim
1. A method for object instance localization in an image comprising:
- detecting keypoints in each of a set of labeled reference images, each of the reference images comprising an object instance;
describing each of the detected keypoints in the reference images with a local descriptor based on a region of pixels local to the respective keypoint;
receiving a target image;
detecting keypoints in the target image;
describing each of the detected keypoints in the target image with a local descriptor based on a region of pixels local to the respective keypoint;
locating candidate regions in the target image, based on matching of keypoints detected in the target image with keypoints detected in the reference images based on their local descriptors; and
computing similarity measures between global descriptors computed for the located candidate regions and global descriptors for the reference images; and
assigning labels to at least some of the candidate regions based on the computed similarity measures;
wherein at least one of the detecting keypoints, locating candidate regions, computing similarity measures, and the assigning of labels is performed with a processor.
4 Assignments
0 Petitions
Accused Products
Abstract
A system and method for object instance localization in an image are disclosed. In the method, keypoints are detected in a target image and candidate regions are detected by matching the detected keypoints to keypoints detected in a set of reference images. Similarity measures between global descriptors computed for the located candidate regions and global descriptors for the reference images are computed and labels are assigned to at least some of the candidate regions based on the computed similarity measures. Performing the region detection based on keypoint matching while performing the labeling based on global descriptors improves object instance detection.
47 Citations
20 Claims
-
1. A method for object instance localization in an image comprising:
-
detecting keypoints in each of a set of labeled reference images, each of the reference images comprising an object instance; describing each of the detected keypoints in the reference images with a local descriptor based on a region of pixels local to the respective keypoint; receiving a target image; detecting keypoints in the target image; describing each of the detected keypoints in the target image with a local descriptor based on a region of pixels local to the respective keypoint; locating candidate regions in the target image, based on matching of keypoints detected in the target image with keypoints detected in the reference images based on their local descriptors; and computing similarity measures between global descriptors computed for the located candidate regions and global descriptors for the reference images; and assigning labels to at least some of the candidate regions based on the computed similarity measures; wherein at least one of the detecting keypoints, locating candidate regions, computing similarity measures, and the assigning of labels is performed with a processor. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17)
-
-
14. A method for object instance localization in an image comprising:
-
detecting keypoints in each of a set of labeled reference images, each of the reference images comprising an object instance; receiving a target image; detecting keypoints in the target image, the detecting including at least one of Difference of Gaussians (DoG) detection, Hessian-Affine detection, corner detection, Harris-Affine detection, and extremal region detection; locating candidate regions in the target image, based on matching of descriptors of the keypoints detected in the target image with descriptors of the keypoints detected in the reference images; computing similarity measures between global descriptors computed for the located candidate regions and global descriptors for the reference images; and assigning labels to at least some of the candidate regions based on the computed similarity measures; wherein at least one of the detecting keypoints, locating candidate regions, computing similarity measures, and the assigning of labels is performed with a processor.
-
-
18. A system for object instance localization in an image comprising:
-
memory which, for each of a set of labeled reference images, stores a global descriptor and a keypoint descriptor for each of a set of keypoints detected in the reference image, each of the reference images comprising an object instance; a keypoint detection component which detects keypoints in a target image; a keypoint description component which describes each of the detected keypoints in the target image with a local descriptor; a keypoint matching component which matches keypoints in the target image to keypoints in the reference images based on their local descriptors; a candidate region detector which locates candidate regions in the target image, based on the matched descriptors; a feature extraction component which computes global descriptors for the located candidate regions; a recognition component which computes similarity measures between the global descriptors computed for the located candidate regions and the global descriptors for the reference images and assigns labels to at least some of the candidate regions based on the computed similarity measures; and a processor which implements the keypoint detection component, keypoint description component, keypoint matching component, candidate region detector, feature extraction component, and recognition component. - View Dependent Claims (19)
-
-
20. A method comprising:
-
with a processor; detecting keypoints in a target image based on the image content of the target image; describing each of the detected keypoints with a local descriptor; associating each of a set of labeled reference images with keypoints detected in the reference image, each of the reference images comprising an object instance; matching keypoints in the target image to keypoints in the reference images based on their local descriptors; locating candidate regions in the target image, based on the matched descriptors; computing global descriptors for the located candidate regions; computing similarity measures between the global descriptors computed for the located candidate regions and global descriptors computed for the reference images; assigning labels to at least some of the candidate regions based on the computed similarity measures; and outputting information based on the assigned labels.
-
Specification