Visual odometry and pairwise alignment for high definition map creation
First Claim
Patent Images
1. A method, comprising:
- receiving a plurality of image frames depicting a local area surrounding a vehicle, each image frame corresponding to a point in time, and comprising at least a first image of the local area captured by a first camera and a second image of the local area captured by a second camera;
for each image frame of the plurality of image frames;
identifying a first set of feature points on the first image of the image frame, and a second set of feature points on the second image of the image frame;
determining features of the image frame associated with features within the local area, each feature corresponding to a first feature point of the first set of feature points matched with a second feature point of the second set of feature points; and
for each determined feature, determining a location of the feature based upon the first and second feature points of the feature;
determining a transformation between a first position of the vehicle at a first point in time corresponding to a first image frame of the plurality of image frames, and a second position of the vehicle at a second point in time corresponding to a second image frame of the plurality of image frames, by;
selecting a first subset of features of the first image frame;
identifying a second subset of features of the second image frame corresponding to the first subset of features, based upon a level of similarity between features of the first and second subsets;
determining the transformation based upon a transformation between the determined positions of features of the first and second subsets of features; and
generating a high definition map of the local area based on the transformation, the high definition map for use in driving by one or more autonomous vehicles.
2 Assignments
0 Petitions
Accused Products
Abstract
As an autonomous vehicle moves through a local area, pairwise alignment may be performed to calculate changes in the pose of the vehicle between different points in time. The vehicle comprises an imaging system configured to capture image frames depicting a portion of the surrounding area. Features are identified from the captured image frames, and a 3-D location is determined for each identified feature. The features of different image frames corresponding to different points in time are analyzed to determine a transformation in the pose of the vehicle during the time period between the image frames. The determined poses of the vehicle are used to generate an HD map of the local area.
16 Citations
33 Claims
-
1. A method, comprising:
-
receiving a plurality of image frames depicting a local area surrounding a vehicle, each image frame corresponding to a point in time, and comprising at least a first image of the local area captured by a first camera and a second image of the local area captured by a second camera; for each image frame of the plurality of image frames; identifying a first set of feature points on the first image of the image frame, and a second set of feature points on the second image of the image frame; determining features of the image frame associated with features within the local area, each feature corresponding to a first feature point of the first set of feature points matched with a second feature point of the second set of feature points; and for each determined feature, determining a location of the feature based upon the first and second feature points of the feature; determining a transformation between a first position of the vehicle at a first point in time corresponding to a first image frame of the plurality of image frames, and a second position of the vehicle at a second point in time corresponding to a second image frame of the plurality of image frames, by; selecting a first subset of features of the first image frame; identifying a second subset of features of the second image frame corresponding to the first subset of features, based upon a level of similarity between features of the first and second subsets; determining the transformation based upon a transformation between the determined positions of features of the first and second subsets of features; and generating a high definition map of the local area based on the transformation, the high definition map for use in driving by one or more autonomous vehicles. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer-readable storage medium storing instructions that when executed causes one or more processors to:
-
receive a plurality of image frames depicting a local area of a vehicle, each image frame corresponding to a point in time, and comprising at least a first image of the local area captured by a first camera and a second image of the local area captured by a second camera; for each image frame of the plurality of image frames; identify a first set of feature points on the first image of the image frame, and a second set of feature points on the second image of the image frame; determine features of the image frame associated with features within the local area, each feature corresponding to a first feature point of the first set of feature points matched with a second feature point of the second set of feature points; and for each determined feature, determine a location of the feature based upon the first and second feature points of the feature; determine a transformation between a first position of the vehicle at a first point in time corresponding to a first image frame of the plurality of image frames, and a second position of the vehicle at a second point in time corresponding to a second image frame of the plurality of image frames, by; selecting a first subset of features of the first image frame; identifying a second subset of features of the second image frame corresponding to the first subset of features, based upon a level of similarity between features of the first and second subsets; determining the transformation based upon a transformation between the determined positions of features of the first and second subsets of features; and generate a high definition map of the local area based on the transformation, the high definition map for use in driving by one or more autonomous vehicles. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A computer system for generating a high definition map of a local area based upon sensor readings of a vehicle traveling through the local area, the computer system comprising:
-
one or more computer processors; and a tangible computer-readable storage medium containing computer program code that when executed causes one or more processors to; receive a plurality of image frames depicting a local area of a vehicle, each image frame corresponding to a point in time, and comprising at least a first image of the local area captured by a first camera and a second image of the local area captured by a second camera; for each image frame of the plurality of image frames; identify a first set of feature points on the first image of the image frame, and a second set of feature points on the second image of the image frame; determine features of the image frame associated with features within the local area, each feature corresponding to a first feature point of the first set of feature points matched with a second feature point of the second set of feature points; and for each determined feature, determine a location of the feature based upon the first and second feature points of the feature; determine a transformation between a first position of the vehicle at a first point in time corresponding to a first image frame of the plurality of image frames, and a second position of the vehicle at a second point in time corresponding to a second image frame of the plurality of image frames, by; selecting a first subset of features of the first image frame; identifying a second subset of features of the second image frame corresponding to the first subset of features, based upon a level of similarity between features of the first and second subsets; determining the transformation based upon a transformation between the determined positions of features of the first and second subsets of features; and generate a high definition map of the local area based on the transformation, the high definition map for use in driving by one or more autonomous vehicles. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
Specification