LOCATION MEASURING DEVICE AND METHOD
First Claim
1. A location measuring device comprising:
- a feature point extracting section for extracting a plurality of feature points on a photographing object from each of successively photographed images in a plurality of frames obtained with an image obtaining means, a location of the image obtaining means relatively varying to a location of the photographing object with time;
a feature point tracking section for searching each of the successively photographed images for points corresponding to the feature points and tracking the feature points;
a first track determining section for applying robust estimation to residuals, each of the residuals being a residual of a coordinate calculated by using a set of projection parameters between one and another images on a basis of locational relationship between the feature points on the one and the another images from a process of the tracking or results of the tracking by the feature point tracking section and determining an estimated value of the projection parameters;
a second track determining section for determining a residual between a coordinate of the corresponding point corresponding to each of the feature points and an estimated coordinate of the corresponding point by utilizing the estimated value of the projection parameters determined with the first track determining section, applying a threshold process, determining whether or not the each of feature points is incorrect corresponding point, and removing the incorrect corresponding point from the feature points;
a template re-matching section for determining an estimated coordinate of the corresponding point by utilizing the estimated value of the projection parameters determined with the first track determining section, and carrying out template matching in a vicinity of the estimated coordinate to determine a coordinate of each of appropriate corresponding points, anda location measuring section for measuring a coordinate of the photographing object, or the location or a photographing posture of the image obtaining means on a basis of coordinates of the corresponding points other than the incorrect corresponding points determined with the second track determining section and on a basis of the coordinates of the appropriate corresponding points determined with the template re-matching section.
1 Assignment
0 Petitions
Accused Products
Abstract
With apparatus and method for measuring in three dimensions by applying an estimating process to points corresponding to feature points in a plurality of motion image frames, high speed and high accuracy are realized. The apparatus comprises: a first track determining section (4B) that determines corresponding points of feature points extracted from frames of motion images and estimates by robust estimation a coordinate transformation projection parameters between frames using part of the determined corresponding points, a second track determining section (4C) that utilizes the estimated value to determine coordinate values of estimated location of each corresponding point, to determine residuals of the coordinate values relative to the estimated values for each corresponding point, to apply threshold process, and to exclude points of large residuals as incorrect corresponding points. Three-dimensional measurement is carried out by tracking again feature points while removing those incorrect corresponding points.
24 Citations
7 Claims
-
1. A location measuring device comprising:
-
a feature point extracting section for extracting a plurality of feature points on a photographing object from each of successively photographed images in a plurality of frames obtained with an image obtaining means, a location of the image obtaining means relatively varying to a location of the photographing object with time; a feature point tracking section for searching each of the successively photographed images for points corresponding to the feature points and tracking the feature points; a first track determining section for applying robust estimation to residuals, each of the residuals being a residual of a coordinate calculated by using a set of projection parameters between one and another images on a basis of locational relationship between the feature points on the one and the another images from a process of the tracking or results of the tracking by the feature point tracking section and determining an estimated value of the projection parameters; a second track determining section for determining a residual between a coordinate of the corresponding point corresponding to each of the feature points and an estimated coordinate of the corresponding point by utilizing the estimated value of the projection parameters determined with the first track determining section, applying a threshold process, determining whether or not the each of feature points is incorrect corresponding point, and removing the incorrect corresponding point from the feature points; a template re-matching section for determining an estimated coordinate of the corresponding point by utilizing the estimated value of the projection parameters determined with the first track determining section, and carrying out template matching in a vicinity of the estimated coordinate to determine a coordinate of each of appropriate corresponding points, and a location measuring section for measuring a coordinate of the photographing object, or the location or a photographing posture of the image obtaining means on a basis of coordinates of the corresponding points other than the incorrect corresponding points determined with the second track determining section and on a basis of the coordinates of the appropriate corresponding points determined with the template re-matching section. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A location measuring method comprising:
-
a feature point extracting step of extracting a plurality of feature points on a photographing object from each of successively photographed images in a plurality of frames obtained with an image obtaining means, a location of the image obtaining means relatively varying to a location of the photographing object with time; a feature point tracking step of searching each of the successively photographed images for points corresponding to the feature points and tracking the feature points; a first track determination step of applying robust estimation to residuals, each of the residuals being a residual of a coordinate calculated by using the projection parameters between one and another images on a basis of locational relationship between the feature points on the one and another images from a process of the tracking or results of the tracking in the feature point tracking step and determining an estimated value of the projection parameters; a second track determining step of determining a residual between a coordinate of the corresponding point corresponding to each of the feature points and an estimated coordinate of the corresponding point by utilizing the estimated value of the projection parameters determined in the first track determining step, applying a threshold process, determining whether or not the each of feature points is incorrect corresponding point, and removing the incorrect corresponding point from the feature points; a template re-matching step of determining an estimated coordinate of the corresponding point by utilizing the estimated value of the projection parameters determined in the first track determination step , and carrying out template matching in a vicinity of the estimated coordinate to determine a coordinate of each of appropriate corresponding points, and a location measuring step of measuring a coordinate of the photographing object, or the location or a photographing posture of the image obtaining means on a basis of coordinates of the corresponding points other than the incorrect corresponding points determined in the second track determining step and on a basis of the coordinates of the appropriate corresponding points determined in the template re-matching step.
-
Specification