Systems and methods for computing a relative pose for global localization in a visual simultaneous localization and mapping system
First Claim
1. A method of computing a relative pose for autonomous localization for a mobile device, the method comprising:
- identifying matching features of a stored landmark and of an image, where the image is provided by a visual sensor coupled to the mobile device;
determining 2-dimensional coordinates within the image for the matching features of the image;
retrieving 3-dimensional coordinates of the matching features of the stored landmark;
computing a hypothetical device pose by;
projecting the 3-dimensional coordinates of the matching features of the stored landmark onto new 2-dimensional coordinates of a hypothetical image, where the hypothetical image corresponds to an image that would be observed by the visual sensor if the device were to be re-posed according to the hypothetical device pose;
generating a projection error by comparing the new 2-dimensional coordinates to the 2-dimensional coordinates for the matching features of the image; and
solving for the hypothetical device pose that corresponds to a low projection error; and
using the hypothetical device pose as the computed relative device-pose.
7 Assignments
0 Petitions
Accused Products
Abstract
The invention is related to methods and apparatus that use a visual sensor and dead reckoning sensors to process Simultaneous Localization and Mapping (SLAM). These techniques can be used in robot navigation. Advantageously, such visual techniques can be used to autonomously generate and update a map. Unlike with laser rangefinders, the visual techniques are economically practical in a wide range of applications and can be used in relatively dynamic environments, such as environments in which people move. One embodiment further advantageously uses multiple particles to maintain multiple hypotheses with respect to localization and mapping. Further advantageously, one embodiment maintains the particles in a relatively computationally-efficient manner, thereby permitting the SLAM processes to be performed in software using relatively inexpensive microprocessor-based computer systems.
152 Citations
17 Claims
-
1. A method of computing a relative pose for autonomous localization for a mobile device, the method comprising:
-
identifying matching features of a stored landmark and of an image, where the image is provided by a visual sensor coupled to the mobile device;
determining 2-dimensional coordinates within the image for the matching features of the image;
retrieving 3-dimensional coordinates of the matching features of the stored landmark;
computing a hypothetical device pose by;
projecting the 3-dimensional coordinates of the matching features of the stored landmark onto new 2-dimensional coordinates of a hypothetical image, where the hypothetical image corresponds to an image that would be observed by the visual sensor if the device were to be re-posed according to the hypothetical device pose;
generating a projection error by comparing the new 2-dimensional coordinates to the 2-dimensional coordinates for the matching features of the image; and
solving for the hypothetical device pose that corresponds to a low projection error; and
using the hypothetical device pose as the computed relative device-pose. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A circuit for a mobile device that is configured to compute a relative pose for autonomous localization of the mobile device, the circuit comprising:
-
a means for identifying matching features of a stored landmark and of an image, where the image is provided by a visual sensor coupled to the mobile device;
a means for determining 2-dimensional coordinates within the image for the matching features of the image;
a means for retrieving 3-dimensional coordinates of the matching features of the stored landmark;
a means for computing a hypothetical device pose further comprising;
a means for projecting the 3-dimensional coordinates of the matching features of the stored landmark onto new 2-dimensional coordinates of a hypothetical image, where the hypothetical image corresponds to an image that would be observed by the visual sensor if the device were to be re-posed according to the hypothetical device pose;
a means for generating a projection error by comparing the new 2-dimensional coordinates to the 2-dimensional coordinates for the matching features of the image; and
a means for solving for the hypothetical device pose that corresponds to a low projection error; and
a means for using the hypothetical device pose as the computed relative device pose. - View Dependent Claims (10, 11)
-
-
12. A computer program embodied in a tangible medium for computing a relative pose for autonomous localization for a mobile device, the computer program comprising:
-
a module with instructions configured to identif matching features of a stored landmark and of an image, where the image is provided by a visual sensor coupled to the mobile device;
a module with instructions configured to determine 2-dimensional coordinates within the image for the matching features of the image;
a module with instructions configured to retrieve 3-dimensional coordinates of the matching features of the stored landmark;
a module with instructions configured to compute a hypothetical device pose further comprises;
instructions configured to project the 3-dimensional coordinates of the matching features of the stored landmark onto new 2-dimensional coordinates of a hypothetical image, where the hypothetical image corresponds to an image that would be observed by the visual sensor if the device were to be re-posed according to the hypothetical device pose;
instructions configured to generate a projection error by comparing the new 2-dimensional coordinates to the 2-dimensional coordinates for the matching features of the image; and
instructions configured to solve for the hypothetical device pose that corresponds to a-low projection error; and
a module with instructions configured to use the hypothetical device pose as the computed relative device pose. - View Dependent Claims (13)
-
-
14. A circuit in a mobile device for computing a relative pose for autonomous localization for the mobile device, the circuit comprising:
-
a circuit configured to identify matching features of a stored landmark and of an image, where the image is provided by a visual sensor coupled to the mobile device;
a circuit configured to detennine 2-dimensional coordinates within the image for the matching features of the image;
a circuit configured to retrieve 3-dimensional coordinates of the matching features of the stored landmark;
a circuit configured to compute a hypothetical device pose, further comprising;
a circuit configured to project the 3-dimensional coordinates of the matching features of the stored landmark onto new 2-dimensional coordinates of a hypothetical image, where the hypothetical image corresponds to an image that would be observed by the visual sensor if the device were to be re-posed according to the hypothetical device pose;
a circuit configured to generate a projection error by comparing the new 2-dimensional coordinates to the 2-dimensional coordinates for the matching features of the image; and
a circuit configured to solve for the hypothetical device pose that corresponds to a low projection error; and
where the circuit is configured to use the hypothetical device pose as the computed relative device pose. - View Dependent Claims (15, 16, 17)
-
Specification