A METHOD OF PROVIDING A FEATURE DESCRIPTOR FOR DESCRIBING AT LEAST ONE FEATURE OF AN OBJECT REPRESENTATION

• US 20150302270A1
• Filed: 08/07/2012
• Published: 10/22/2015
• Est. Priority Date: 08/07/2012
• Status: Abandoned Application

• Current Assignee: Metaio GmbH (Apple Inc.)
• Original Assignee: Metaio GmbH (Apple Inc.)
• Inventors: BenHimane, Selim, Olszamowski, Thomas
• Application Number:
  US14/420,226
• Publication Number:
  US 20150302270A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/56 having vectorial format
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]

Abstract

A method of providing a feature descriptor for describing at least one feature of an object representation includes the steps of providing an original feature descriptor comprising at least one vector or a plurality of K vectors having equal sum of vector entry values and each vector having H entries, projecting each vector on a lower dimensional space of size H-1 or lower to gain a projected feature descriptor comprising projected vectors of H-1 entries or lower, such that it is possible to obtain a similarity measure between two projected feature descriptors equal to the similarity measure between the two corresponding original feature descriptors, and providing the projected feature descriptor as a lossless compressed feature descriptor.

Claims

1. A method of providing a feature descriptor for describing at least one feature of an object representation, comprising the steps of:

a) providing an original feature descriptor comprising at least one vector or a plurality of K vectors having equal sum of vector entry values and each vector having H entries;

b) projecting each vector on a lower dimensional space of size H−

1 or lower to gain a projected feature descriptor comprising projected vectors of H−

1 entries or lower, such that it is possible to obtain a similarity measure between two projected feature descriptors equal to the similarity measure between the two corresponding original feature descriptors; and

c) providing the projected feature descriptor as a lossless compressed feature descriptor.

2. The method according to claim 1, wherein said object representation is an image of a camera, a CAD model, a drawing, a sound, an image from a depth camera, an image of a time-of-flight camera, or a set of images from a multi-camera system.

3. The method according to claim 1, wherein said object representation is an image of a camera, wherein step a) comprises the steps of:

aa) extracting at least one feature from the image;

ab) selecting a region of interest around the extracted feature;

ac) dividing the region of interest into one sub-region or K sub-regions;

ad) for every sub-region, computing a respective vector of H entries; and

ae) providing one vector or K vectors as the original feature descriptor for the extracted feature.

4. The method according to claim 3, wherein step ac) includes dividing the region of interest into K sub-regions with equal number N of pixels, and in the feature descriptor vector created in step ae) the sum of the values of all the entries of each vector in every sub-region is equal to N.

5. The method according to claim 3, wherein step ad) comprises computing a respective vector of H entries containing values obtained with a function operating on an intensity value of a set of neighbors of a plurality of pixels in the respective sub-region.

6. The method according to claim 5, wherein before computing the function results, a morphological image operation or filter, including at least one of an image gradient, image synthetic blurring, image de-noising, image smoothing, or image histogram enhancement, is applied.

7. The method according to claim 5, wherein the function is based on intensity comparisons for pixels in the respective sub-region.

8. The method according to claim 5, wherein the function is based on binned gradient orientations with each of a plurality of entries of the respective vector containing a number of pixels in the respective sub-region that have a particular gradient orientation.

9. The method according to claim 1, wherein step b) comprises dismissing at least one entry of each of the K vectors, wherein the number of entries of the obtained truncated feature descriptor vector becomes K*(H−

1) or less.

10. The method according to claim 9, wherein in a subsequent similarity measure computation during the matching process the dismissed entry of each vector is recomputable.

11. The method according to claim 1, wherein step h) comprises transforming the feature descriptor vector in such a way to correct any distortion caused by the projecting of the feature descriptor vector on a lower dimensional space.

12. The method according to claim 11, wherein step b) comprises transforming the feature descriptor vector in such a way to keep an equal influence of every vector entry in a similarity measure computation of a succeeding matching process.

13. The method according to claim 1, wherein step b) includes the following steps:

providing a vector v₁ in R^H where

14. The method according to claim 1, wherein the projected feature descriptors are scaled by a factor in order to obtain a respective feature descriptor vector composed of integers.

15-19. -19. (canceled)

20. A method of matching at least one feature of an object representation, comprising:

extracting at least one current feature from an object representation and providing at least one current feature descriptor for the extracted current feature;

providing a plurality of feature descriptors, wherein each feature descriptor is configured to be used in matching, at least one feature of an object representation, wherein the feature descriptor is describing at least one feature extruded from an object representation and is indicative of a selected region of interest around the extracted feature, which region is divided into sub-regions, and which feature descriptor includes;

a feature descriptor vector containing information about at least one vector or a plurality of K vectors with concatenation of the vectors of the sub-regions, with at least one respective vector for every sub-region; and

wherein the feature descriptor vector comprises vectors projected onto a lower dimensional space of (H−

1) or lower from a corresponding vector of H entries of an original feature descriptor; and

comparing a first of the plurality of the feature descriptors with at least one of the other feature descriptors for matching the at least one current feature.

21. The method according to claim 20, wherein the step of comparing the first feature descriptor with at least one of the other feature descriptors comprises calculating a similarity measure between the current feature descriptor and at least some of the plurality of feature descriptors;

and

wherein calculating the similarity measure includes calculating sum-of-squared differences (SSD), using a mean-bound SSD algorithm.

22. The method according to claim 20, wherein the object representation is a current image of a camera, the method further including determining a position and orientation of the camera which captures the current image with respect to an object in the current image based on correspondences of feature descriptors determined in the matching process.

26. The method of claim 20, wherein said object representation is an image of a camera, a CAD model, a drawing, a sound, an image of a depth camera, an image of a time-of-flight camera, or a set of images from a multi-camera system.

27. The method of claim 20, wherein the feature descriptor vector is a truncated feature descriptor vector obtained by dismissing at least one entry of each of the vectors of the original feature descriptor vector.

28. The method of claim 20, wherein the feature descriptor vector is a transformed feature descriptor vector containing information for correcting any distortion caused by the projecting of the original feature descriptor vector on a lower dimensional space.

29. The method of claim 20, wherein the feature descriptor vector contains information for keeping an equal influence of every vector entry in a distance computation of a succeeding matching process.

23-24. -24. (canceled)

25. A non-transitory computer readable medium comprising software code sections adapted to perform a method for providing a feature descriptor for describing at least one feature of an object representation, comprising:

a) providing an original feature descriptor comprising at least one vector or a plurality of K vectors having equal sum of vector entity values and each vector having H entries.

b) projecting each vector on a lower dimensional space of size H−

1 or lower to gain a projected feature descriptor comprising projected vectors of H−

1 entries or lower, such that it is possible to obtain a similarity measure between two projected feature descriptors equal to the similarity measure between the two corresponding original feature descriptors; and

c) providing the projected feature descriptor as a lossless compressed feature descriptor.