Automated texture mapping system for 3D models

• US 20090110267A1
• Filed: 08/28/2008
• Published: 04/30/2009
• Est. Priority Date: 09/21/2007
• Status: Abandoned Application

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Ding, Min, Zakhor, Avidoh
• Application Number:
  US12/229,919
• Publication Number:
  US 20090110267A1
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/75 involving models

Abstract

A camera pose may be determined automatically and is used to map texture onto a 3D model based on an aerial image. In one embodiment, an aerial image of an area is first determined. A 3D model of the area is also determined, but does not have texture mapped on it. To map texture from the aerial image onto the 3D model, a camera pose is determined automatically. Features of the aerial image and 3D model may be analyzed to find corresponding features in the aerial image and the 3D model. In one example, a coarse camera pose estimation is determined that is then refined into a fine camera pose estimation. The fine camera pose estimation may be determined based on the analysis of the features. When the fine camera pose is determined, it is used to map texture onto the 3D model based on the aerial image.

Claims

1. A method for mapping texture on 3D models, the method comprising:

determining an aerial image of an area;

determining a 3D model for the aerial image;

automatically analyzing features of the aerial image and the 3D model to determine feature correspondence of features from the aerial image to features in the 3D model; and

determining a camera pose for the aerial image based on the analysis of the feature correspondence, wherein the camera pose allows texture to be mapped onto the 3D model based on the aerial image.

2. The method of claim 1, wherein automatically analyzing features comprising:

determining a coarse camera pose estimation; and

determining a fine camera pose estimation using the coarse camera pose estimation to determine the camera pose.

3. The method of claim 2, wherein determining the coarse camera pose estimation comprises detecting vanishing points in the aerial image to determine a pitch angle and roll angle.

4. The method of claim 3, wherein determining the coarse camera pose comprising:

determining location measurement values taken when the aerial image was captured to determine x, y, z, and yaw angle measurements.

5. The method of claim 2, wherein performing the fine camera pose estimation comprises:

detecting first corner features in the aerial image;

detecting second corner features in the 3D model; and

projecting the first corner features with the second corner features.

6. The method of claim 5, further comprises:

determining putative matches between first corner features and second corner features; and

eliminating matches in the putative matches to determine a feature point correspondence between first corner features and second corner features.

7. The method of claim 6, wherein eliminating matches comprises performing a Hough transform to eliminate a first set of matches in the putative matches to determine a refined set of putative matches.

8. The method of claim 7, wherein eliminating matches comprises performing a generalized m-estimator sample consensus (GMSAC) on the refined set of putative matches to eliminate a second set of matches in the refined set of putative matches to generate a second refined set of putative matches.

9. The method of claim 8, wherein determining the camera pose comprises using the second refined set of putative matches to determine the camera pose.

10. Software encoded in one or more computer-readable media for execution by the one or more processors and when executed operable to:

determine an aerial image of an area;

determine a 3D model for the aerial image;

automatically analyze features of the aerial image and the 3D model to determine feature correspondence of features from the aerial image to features in the 3D model; and

determine a camera pose for the aerial image based on the analysis of the feature correspondence, wherein the camera pose allows texture to be mapped onto the 3D model based on the aerial image.

11. The software of claim 10, wherein the software operable to automatically analyze features comprises software that when executed is operable to:

determine a coarse camera pose estimation; and

determine a fine camera pose estimation using the coarse camera pose estimation to determine the camera pose.

12. The software of claim 11, wherein the software operable to determine the coarse camera pose estimation comprises software that when executed is operable to detect vanishing points in the aerial image to determine a pitch angle and roll angle.

13. The software of claim 12, wherein the software operable to determine the coarse camera pose comprises software that when executed is operable to determine location measurement values taken when the aerial image was captured to determine x, y, z, and yaw angle measurements.

14. The software of claim 11, wherein the software operable to perform the fine camera pose estimation comprises software that when executed is operable to:

detect first corner features in the aerial image;

detect second corner features in the 3D model; and

project the first corner features with the second corner features.

15. The software of claim 14, wherein the software when executed is further operable to:

determine putative matches between first corner features and second corner features; and

eliminate matches in the putative matches to determine a feature point correspondence between first corner features and second corner features.

16. The software of claim 15, wherein the software operable to eliminate matches comprises software that when executed is operable to perform a Hough transform to eliminate a first set of matches in the putative matches to determine a refined set of putative matches.

17. The software of claim 16, wherein software operable to eliminate matches comprises software that when executed is operable to perform a generalized m-estimator sample consensus (GMSAC) on the refined set of putative matches to eliminate a second set of matches in the refined set of putative matches to generate a second refined set of putative matches.

18. The software of claim 17, wherein software operable to determine the camera pose comprises software that when executed is operable to use the second refined set of putative matches to determine the camera pose.

19. An apparatus configured to map texture on 3D models, the apparatus comprising:

means for determining an aerial image of an area;

means for determining a 3D model for the aerial image;

means for automatically analyzing features of the aerial image and the 3D model to determine feature correspondence of features from the aerial image to features in the 3D model; and

means for determining a camera pose for the aerial image based on the analysis of the feature correspondence, wherein the camera pose allows texture to be mapped onto the 3D model based on the aerial image.

20. The apparatus of claim 19, wherein means for automatically analyzing features comprising:

means for determining a coarse camera pose estimation; and

means for determining a fine camera pose estimation using the coarse camera pose estimation to determine the camera pose.