Incremental motion estimation through local bundle adjustment
First Claim
1. A computer-implemented incremental motion estimation process for estimating the camera pose parameters associated with each of a sequence of images of a scene, comprising using a computer to perform the following process actions:
- establishing a set of triple matching points that depict the same point in the scene across the three successive images of each triplet of images that can be formed from the sequence;
establishing a set of dual matching points that depict the same point in the scene across the latter two images of each triplet of images that can be formed from the sequence;
defining the camera coordinate system associated with the first image in the sequence as coinciding with a 3D world coordinate system for the scene depicted in the sequence of images;
estimating the camera pose parameters associated with the second image in the sequence; and
for each successive triplet of images formable from the sequence starting with the first three images, estimating the camera pose parameters associated with the third image of each triplet from previously-ascertained camera pose parameters associated with the first two images in the triplet, as well as the dual and triple matching points of the triplet.
2 Assignments
0 Petitions
Accused Products
Abstract
An incremental motion estimation system and process for estimating the camera pose parameters associated with each image of a long image sequence. Unlike previous approaches, which rely on point matches across three or more views, the present system and process also includes those points shared only by two views. The problem is formulated as a series of localized bundle adjustments in such a way that the estimated camera motions in the whole sequence are consistent with each other. The result of the inclusion of two-view matching points and the localized bundle adjustment approach is more accurate estimates of the camera pose parameters for each image in the sequence than previous incremental techniques, and providing an accuracy approaching that of global bundle adjustment techniques except with processing times about 100 to 700 times faster than the global approaches.
-
Citations
21 Claims
-
1. A computer-implemented incremental motion estimation process for estimating the camera pose parameters associated with each of a sequence of images of a scene, comprising using a computer to perform the following process actions:
-
establishing a set of triple matching points that depict the same point in the scene across the three successive images of each triplet of images that can be formed from the sequence;
establishing a set of dual matching points that depict the same point in the scene across the latter two images of each triplet of images that can be formed from the sequence;
defining the camera coordinate system associated with the first image in the sequence as coinciding with a 3D world coordinate system for the scene depicted in the sequence of images;
estimating the camera pose parameters associated with the second image in the sequence; and
for each successive triplet of images formable from the sequence starting with the first three images, estimating the camera pose parameters associated with the third image of each triplet from previously-ascertained camera pose parameters associated with the first two images in the triplet, as well as the dual and triple matching points of the triplet. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A local bundling adjustment system for estimating the camera projection matrix associated with each of a sequence of images of a scene, comprising:
-
a general purpose computing device;
a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input the sequence of images, identify points in each image in the sequence of images;
determine which of the identified points depict the same point of the scene so as to be matching points, define the camera coordinate system associated with the first image in the sequence as coinciding with a 3D world coordinate system for the scene depicted in the sequence of images;
compute the camera projection matrix associated with the second image in the sequence, and for each successive triplet of images that can be formed from the sequence starting with the first three images, estimate the camera projection matrix of the third image of each triplet from previously-ascertained camera projection matrices associated with the first two images in the triplet as well as points determined to be matching points across all three images of the of the triplet and points determined to be matching points across at least one pair of images in the triplet. - View Dependent Claims (10, 11, 12, 13)
-
-
14. A computer-readable medium having computer-executable instructions for estimating the camera pose parameters associated with each of a sequence of images of a scene, said computer-executable instructions comprising:
-
identifying points in each image in the sequence of images;
determining which of the identified points depict the same point of the scene so as to be matching points;
defining the camera coordinate system associated with the first image in the sequence as coinciding with a 3D world coordinate system for the scene depicted in the sequence of images;
computing the camera pose parameters associated with the second image in the sequence, and for each successive triplet of images that can be formed from the sequence starting with the first three images, estimate the camera pose parameters of the third image of each triplet from previously-ascertained camera pose parameters associated with the first two images in the triplet as well as points determined to be matching points across all three images of the of the triplet and points determined to be matching points across at least one pair of images in the triplet.
-
-
15. A local bundle adjustment process for estimating the camera pose parameters associated with each of a sequence of images of a scene, comprising the following process actions:
-
identifying points in each image in the sequence of images;
determining which of the identified points depict the same point of the scene so as to be matching points, defining the camera coordinate system associated with the first image in the sequence as coinciding with a 3D world coordinate system for the scene depicted in the sequence of images;
computing the camera pose parameters associated with the second image in the sequence, and for each successive triplet of images that can be formed from the sequence starting with the first three images, estimate the camera pose parameters of the third image of each triplet from previously-ascertained camera pose parameters associated with the first two images in the triplet as well as points determined to be matching points across all three images of the of the triplet and points determined to be matching points across at least one pair of images in the triplet. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification