Estimation of panoramic camera orientation relative to a vehicle coordinate frame
First Claim
1. A method for estimating orientation of cameras mounted on vehicles, comprising:
- determining, by one or more processors, an initial pose estimate of a vehicle having a camera mounted thereon, the initial pose estimate being a position and orientation of the vehicle relative to the world;
processing, by the one or more processors, image data from images captured by the camera to obtain one or more tracks, each track including a sequence of matched feature points stemming from a single three-dimensional location;
determining, by the one or more processors, from the initial pose estimate and the tracks, a correction parameter to correct orientations of the images captured by the camera for each of a plurality of subsequences of one or more runs, wherein determining the correction parameter, for each plurality of subsequences of one or more runs, includes evaluating a set of vehicle poses, three-dimensional locations from the one or more tracks, and an orientation of the camera relative to one or more sensors of the vehicle; and
performing statistical analysis on the determined correction parameters for each plurality of subsequences to determine a median value of the determined correction parameters.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method are presented for estimating the orientation of a panoramic camera mounted on a vehicle relative to the vehicle coordinate frame. An initial pose estimate of the vehicle is determined based on global positioning system data, inertial measurement unit data, and wheel odometry data of the vehicle. Image data from images captured by the camera is processed to obtain one or more tracks, each track including a sequence of matched feature points stemming from a same three-dimensional location. A correction parameter determined from the initial pose estimate and tracks can then be used to correct the orientations of the images captured by the camera. The correction parameter can be optimized by deriving a correction parameter for each of a multitude of distinct subsequences of one or more runs. Statistical analysis can be performed on the determined correction parameters to produce robust estimates.
17 Citations
18 Claims
-
1. A method for estimating orientation of cameras mounted on vehicles, comprising:
-
determining, by one or more processors, an initial pose estimate of a vehicle having a camera mounted thereon, the initial pose estimate being a position and orientation of the vehicle relative to the world; processing, by the one or more processors, image data from images captured by the camera to obtain one or more tracks, each track including a sequence of matched feature points stemming from a single three-dimensional location; determining, by the one or more processors, from the initial pose estimate and the tracks, a correction parameter to correct orientations of the images captured by the camera for each of a plurality of subsequences of one or more runs, wherein determining the correction parameter, for each plurality of subsequences of one or more runs, includes evaluating a set of vehicle poses, three-dimensional locations from the one or more tracks, and an orientation of the camera relative to one or more sensors of the vehicle; and performing statistical analysis on the determined correction parameters for each plurality of subsequences to determine a median value of the determined correction parameters. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system, comprising:
-
one or more processors configured to; determine an initial pose estimate of a vehicle having a camera mounted thereon, the initial pose estimate being a position and orientation of the vehicle relative to the world; process image data from images captured by the camera to obtain one or more tracks, each track including a sequence of matched feature points stemming from a single three-dimensional location; determine, from the initial pose estimate and the tracks, a correction parameter to correct orientations of the images captured by the camera for each of a plurality of subsequences of one or more runs, wherein determining the correction parameter, for each plurality of subsequences of one or more runs, includes evaluating a set of vehicle poses, three-dimensional locations from the one or more tracks, and an orientation of the camera relative to one or more sensors of the vehicle; and perform statistical analysis on the determined correction parameters for each plurality of subsequences to determine a median value of the determined correction parameters. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. A non-transitory computer-readable storage medium on which computer readable instructions of a program are stored, the instructions, when executed by one or more processors, cause the one or more processors to perform a method for estimating orientation of cameras mounted on vehicles, the method comprising:
-
determining an initial pose estimate of a vehicle having a camera mounted thereon, the initial pose estimate being a position and orientation of the vehicle relative to the world; processing image data from images captured by the camera to obtain one or more tracks, each track including a sequence of matched feature points stemming from a single three-dimensional location; determining from the initial pose estimate and the tracks, a correction parameter to correct orientations of the images captured by the camera for each of a plurality of subsequences of one or more runs, wherein determining the correction parameter, for each plurality of subsequences of one or more runs, includes evaluating a set of vehicle poses, three-dimensional locations from the one or more tracks, and an orientation of the camera relative to one or more sensors of the vehicle; and performing statistical analysis on the determined correction parameters for each plurality of subsequences to determine a median value of the determined correction parameters.
-
Specification