ROBUST INTEREST POINT DETECTOR AND DESCRIPTOR

• US 20120201466A1
• Filed: 04/17/2012
• Published: 08/09/2012
• Est. Priority Date: 04/28/2006
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Inventors: FUNAYAMA, Ryuji, YANAGIHARA, Hiromichi, VAN GOOL, Luc, TUYTELAARS, Tinne, BAY, Herbert
• Granted Patent: US 8,670,619 B2
• Time in Patent Office: Days
• US Class Current: 382/195
• CPC Class Codes: G06V 10/36 Applying a local operator, i.e. means to operate on image points situated in the vicinity of a given point; Non-linear local filtering operations, e.g. median filtering
• CPC Class Codes: G06V 10/446 using Haar-like filters, e.g. using integral image techniques
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]

Abstract

A method for operating on images is described for interest point detection and/or description working under different scales and with different rotations, e.g. for scale-invariant and rotation-invariant interest point detection and/or description.

Claims

1. A method for deriving a descriptor of an interest point in an image having a plurality of pixels, the interest point having a location in the image and an orientation, the method comprising:

identifying a region in a neighbourhood around the interest point aligned with the orientation of the interest point, the neighbourhood comprising a set of pixels;

examining tiles of the region, and for each tile generating a contrast related response using at least one digital filter,

summing response values from application of the at least one digital filter in at least two orthogonal directions to generate summed values, and

generating a multidimensional descriptor having first elements, each first element being based on the summed values.

2. A method for deriving a descriptor of an interest point in an image having a plurality of pixels, the interest point having a location in the image and an orientation, and a neighbourhood having been defined around the interest point aligned with the orientation of the interest point, the neighbourhood comprising a set of pixels;

the method comprising;

inspecting contrasts in the neighbourhood of the interest point using at least one digital filter,

generating a multidimensional descriptor based on the results of the application of the at least one digital filter and absolute values of these results.

3. The method of claim 2, wherein the descriptor includes the sign of the Laplacian at the interest point.

4. A method for assigning the orientation of an interest point in an image having a plurality of pixels, the interest point having a location, the method comprising:

identifying a region enclosing the interest point,

determining an orientation for the interest point by;

examining a plurality of tiles of the region, each tile comprising a plurality of pixels,

determining for each tile filtered values related to contrast in two directions to thereby determine for that tile an orientation and a magnitude for that orientation, and

assigning an orientation to the interest point by selecting the determined orientation with largest magnitude.

5. A method for determining an interest point in an image having a plurality of pixels suitable for working at different scales and/or rotations, the method comprising:

filtering the image using at least one digital filter, and

selecting an interest point based on determining a measure resulting from application of the at least one digital filter,

the measure being a non-linear combination of the outputs of the at least one digital filter, the measure capturing variations of an image parameter in more than one dimension or direction, the at least one digital filter being a combination of box filters, at least one box filter having a spatial extent greater than one pixel.

6. The method of claim 5 wherein application of the at least one digital filter to the image is performed with integral images.

9. The method of claim 5, wherein the combination of box filters approximates derivatives of a smoothing filter in more than one direction.

10. The method of claim 5, further comprising providing a plurality of filtered images at different scales using the at least one digital filter.

11. The method of claim 5 wherein the measure is the determinant of a Hessian matrix constructed from the results of applying the at least one filter.

12. The method of claim 5 wherein application of the at least one filter comprises application of at least three digital filters.

13. The method of claim 5, wherein the at least one digital filter is derived from the second order derivative of a smoothing filter.

14. The method according to claim 5, wherein the at least one digital filter is applied at different scalings to the image to generate a plurality of filtered images.

15. The method of claim 5 wherein an interest point is determined as a local extreme value of the measure within a neighbourhood including a region of a filtered image.

16. The method of claim 15, wherein the neighbourhood is a space defined by at least three of a plurality of filtered images logically arranged in an image pyramid.

7. A method for determining an interest point in an image having a plurality of pixels suitable for working at different scales and/or rotations, the method comprising:

filtering the image using at least one digital filter, and

selecting an interest point based on determining a measure resulting from application of the at least one digital filter,

the measure being a non-linear combination of the outputs of the at least one digital filter,

the application of the at least one digital filter using integral images.

8. The method of claim 7, wherein the at least one digital filter is a combination of box filters, at least one box filter having a spatial extent greater than one pixel.