Generating three-dimensional façade models from images
First Claim
Patent Images
1. A method that facilitates image-based faç
- ade modeling, comprising;
determining, by a system comprising a processor, a composite texture image associated with a sequence of captured images, including obtaining camera positions associated with the sequence of captured images and obtaining three dimensional (3D) points associated with the sequence of captured images used to determine the composite texture image;
decomposing, by the system, a data representation of a faç
ade that is based at least in part on the composite texture image, the camera positions, and the 3D points, by recursively subdividing the data representation of the faç
ade into a set of subdivided patches;
bottom-up merging of at least a subset of the set of subdivided patches by merging neighboring subdivided patches based at least in part on a determination that a measure of support to separate neighboring subdivided patches based on architectural bilateral symmetry is not enough;
structuring, after the bottom-up merging, the data representation of the faç
ade into a directed acyclic graph of rectilinear patches; and
augmenting the data representation of the faç
ade with depth information based on the sequence of captured images and a subset of the 3D points by determining, by the system, and assigning an optimized depth to at least one of the subdivided patches.
1 Assignment
0 Petitions
Accused Products
Abstract
The subject disclosure relates to generating three-dimensional façade models from images. In one aspect, a systematic decomposition schema is disclosed for a façade structured into a Direct Acyclic Graph and implemented as a top-down recursive subdivision and bottom-up merging. In a further aspect, optimization of façade depth operating in a façade surface and in the super-pixel level of a whole subdivision region is described.
-
Citations
15 Claims
-
1. A method that facilitates image-based faç
- ade modeling, comprising;
determining, by a system comprising a processor, a composite texture image associated with a sequence of captured images, including obtaining camera positions associated with the sequence of captured images and obtaining three dimensional (3D) points associated with the sequence of captured images used to determine the composite texture image; decomposing, by the system, a data representation of a faç
ade that is based at least in part on the composite texture image, the camera positions, and the 3D points, by recursively subdividing the data representation of the faç
ade into a set of subdivided patches;bottom-up merging of at least a subset of the set of subdivided patches by merging neighboring subdivided patches based at least in part on a determination that a measure of support to separate neighboring subdivided patches based on architectural bilateral symmetry is not enough; structuring, after the bottom-up merging, the data representation of the faç
ade into a directed acyclic graph of rectilinear patches; andaugmenting the data representation of the faç
ade with depth information based on the sequence of captured images and a subset of the 3D points by determining, by the system, and assigning an optimized depth to at least one of the subdivided patches. - View Dependent Claims (2, 3, 4, 5, 6)
- ade modeling, comprising;
-
7. A method, comprising:
-
extracting, by a system comprising a processor, hidden structure from a reference texture image by recovering segmented lines of hidden structure through application of a Hough transform; weighting, by the system, the segmented lines of hidden structure according to the correspondence of the segmented lines of hidden structure with an edge map for the reference texture image to partition the reference texture image; recursively subdividing the reference texture image by the system into a set of subdivided regions based at least in part on the partitioned reference texture image; bottom-up merging, by the system, at least a subset of the set of subdivided regions by merging neighboring subdivided regions based at least in part on a determination that a measure of support to separate neighboring subdivided regions based on architectural bilateral symmetry is not enough; structuring, by the system, the partitioned reference texture image into a directed acyclic graph of rectilinear regions associated with the reference texture image; and augmenting a data representation of a faç
ade with depth information based on the reference texture image and a subset of three dimensional (3D) points associated with the reference texture image by determining and assigning an optimized depth to at least one of the set of subdivided regions. - View Dependent Claims (8, 9)
-
-
10. A method of faç
- ade augmentation in a faç
ade modeling system, comprising;receiving, by a system comprising a processor, data associated with a sequence of captured images, including associated three dimensional (3D) points related to the sequence of captured images, representing a faç
ade structured into a directed acyclic graph and having a set of subdivided regions of a texture image based on the sequence of captured images;determining, by the system, and assigning an optimized depth based on the sequence of captured images and the associated 3D points to at least one subdivision region in the set of subdivided regions based at least in part on a determined maximum a posteriori (MAP) estimation of a Markov Random Field (MRF) graph and a minimized image and viewpoint independent constraint associated with the texture image, wherein the MRF graph is defined based on the at least one subdivision region represented by a single site. - View Dependent Claims (11, 12)
- ade augmentation in a faç
-
13. An image-based faç
- ade modeling system comprising;
a memory to store computer-executable components; and a processor communicatively coupled to the memory that facilitates execution of the computer-executable components, the computer-executable components comprising; a texture compositing component that determines a composite texture image associated with a sequence of captured images, obtains camera positions associated with the sequence of captured images, and obtains three dimensional (3D) points associated with the sequence of captured images used to determine the composite texture image; a faç
ade decomposition component that decomposes a data representation of a faç
ade that is based at least in part on the composite texture image, the camera positions, and the 3D points by recursively subdividing the data representation of the faç
ade into a set of subdivided regions, bottom-up merges at least a subset of the set of subdivided regions by merging neighboring subdivided regions based at least in part on a determination that a measure of support to separate neighboring subdivided regions based on architectural bilateral symmetry is not enough, and structures, after the bottom-up merging, the data representation of the faç
ade into a directed acyclic graph of rectilinear patches; anda faç
ade augmentation component that assigns an optimized depth based on the sequence of captured images and associated 3D points related to the sequence of captured images to at least one subdivision regions in the set of subdivided regions. - View Dependent Claims (14, 15)
- ade modeling system comprising;
Specification