Estimation device and method
First Claim
1. A method executed by a processor, the method comprising:
- acquiring a first image captured by a camera at a first time;
performing a first process that matches a group of first feature points extracted from the first image with map points having three-dimensional coordinates predefined for an object;
estimating, based on a number of map points that match to the first image by the first process, an accuracy of first position and orientation information Obtained by using a result of the first process, the first position and orientation information indicating a position and an orientation of a camera at the first time;
storing, in a memory, keyframe information including information of each of the group of first feature points when the estimated accuracy is higher than or equal to a first threshold;
acquiring a second image captured by the camera at a second time that is after the first time;
performing the first process on a group of second feature points extracted the second image and the map points;
estimating, based on another number of map points matched to the second image by the first process, an accuracy of second position and orientation information obtained by using another result of the first process, the second position and orientation information indicating a position and an orientation of the camera at the second time;
performing a second process that identifies pairs of respective of the group of second feature points with corresponding first feature points based on the keyframe information to generate a plurality of pairs where the estimated accuracy of the second position and orientation is less than the first threshold;
generating vectors for respective of the plurality of pairs;
generating new second position and orientation information by using at least a part of the plurality of pairs when a standard deviation of the lengths of the vectors is less than a second threshold; and
outputting the new second position and orientation information to a display control process that performs display control for displaying additional information on the second image based on the new second position and orientation information.
1 Assignment
0 Petitions
Accused Products
Abstract
A method includes associating a plurality of first feature points with a plurality of second feature points, the plurality of first feature points being included in a keyframe that represents a first captured image at a first time when a position and an orientation of a camera are successfully estimated, the plurality of second feature points being included in a second captured image captured at a second time, calculating vectors based on feature descriptors of the first feature points and feature descriptors of the second feature points for respective pairs of the first feature points and the second feature points, determining whether an association of the first feature points and the second feature points is satisfactory, and performing an estimation process that estimates a new position and a new orientation of the camera at the second time when the association is determined to be satisfactory.
-
Citations
17 Claims
-
1. A method executed by a processor, the method comprising:
-
acquiring a first image captured by a camera at a first time; performing a first process that matches a group of first feature points extracted from the first image with map points having three-dimensional coordinates predefined for an object; estimating, based on a number of map points that match to the first image by the first process, an accuracy of first position and orientation information Obtained by using a result of the first process, the first position and orientation information indicating a position and an orientation of a camera at the first time; storing, in a memory, keyframe information including information of each of the group of first feature points when the estimated accuracy is higher than or equal to a first threshold; acquiring a second image captured by the camera at a second time that is after the first time; performing the first process on a group of second feature points extracted the second image and the map points; estimating, based on another number of map points matched to the second image by the first process, an accuracy of second position and orientation information obtained by using another result of the first process, the second position and orientation information indicating a position and an orientation of the camera at the second time; performing a second process that identifies pairs of respective of the group of second feature points with corresponding first feature points based on the keyframe information to generate a plurality of pairs where the estimated accuracy of the second position and orientation is less than the first threshold; generating vectors for respective of the plurality of pairs; generating new second position and orientation information by using at least a part of the plurality of pairs when a standard deviation of the lengths of the vectors is less than a second threshold; and outputting the new second position and orientation information to a display control process that performs display control for displaying additional information on the second image based on the new second position and orientation information. - View Dependent Claims (2, 3)
-
-
4. A method executed by a processor;
- the method comprising;
associating a plurality of first feature points with a plurality of second feature points, the plurality of first feature points being included in a keyframe that represents a first captured image at a first time when a position of a camera and an orientation of the camera are successfully estimated, the plurality of second feature points being included in a second captured image captured at a second time by the camera; calculating a plurality of vectors based on feature descriptors of the plurality of first feature points and feature descriptors of the plurality of second feature points for respective pairs of the plurality of first feature points and the plurality of second feature points; determining, when a standard deviation of the lengths of the plurality of vectors is less than a first threshold, that an association of the plurality of first feature points and the plurality of second feature points is satisfactory; and performing an estimation process that estimates a new position of the camera and a new orientation of the camera at the second time based on pairs of the plurality of first feature points and the plurality of second feature points. - View Dependent Claims (5, 6, 7, 8, 9, 10)
- the method comprising;
-
11. A device;
- comprising;
a memory; and a processor coupled to the memory and configured to; associate a plurality of first feature points with a plurality of second feature points, the plurality of first feature points being included in a keyframe that represents a first captured image at a first time when a position of a camera and an orientation of the camera are successfully estimated, the plurality of second feature points being included in a second captured image captured at a second time by the camera; calculate a plurality of vectors based on feature descriptors of the plurality of first feature points and feature descriptors of the plurality of second feature points for respective pairs of the plurality f first feature points and the plurality of second feature points; determine, when a standard deviation of the lengths of the plurality of vectors is less than a first threshold, that an association of the plurality of first feature points and the plurality of second feature points is satisfactory; and perform an estimation process that estimates a new position of the camera and a new orientation of the camera at the second time based on pairs of the plurality of first feature points and the plurality of second feature points. - View Dependent Claims (12, 13, 14, 15, 16, 17)
- comprising;
Specification