IMAGE-BASED PROCEDURAL REMODELING OF BUILDINGS

• US 20110181589A1
• Filed: 01/20/2011
• Published: 07/28/2011
• Est. Priority Date: 01/28/2010
• Status: Active Grant

• Current Assignee: Hong Kong University of Science and Technology
• Original Assignee: Hong Kong University of Science and Technology
• Inventors: ZHAO, Peng, ZHANG, Honghui, QUAN, Long, FANG, Tian
• Granted Patent: US 9,129,432 B2
• Time in Patent Office: Days
• US Class Current: 345/420
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 2210/04 Architectural design, interior design

Abstract

Systems and methods are provided to facilitate architectural modeling. In one aspect, a modeling system is provided. This includes a processor configured to generate remodeled images associated with one or more architectural structures. A procedural model is configured to integrate an approximate model from aerial images of the architectural structures and a three-dimensional (3D) reconstruction model from ground-level images of the architectural structures.

Claims

1. A modeling system, comprising:

a processor configured to generate remodeled images associated with one or more architectural structures; and

a procedural model configured to integrate an approximate model from aerial images of the one or more architectural structures and a three-dimensional (3D) reconstruction model from ground-level images of the one or more architectural structures.

2. The system of claim 1, wherein the one or more architectural structures are associated with building facades.

3. The system of claim 1, further comprising a structure from motion (SFM) component configured to reconstruct 3D point clouds and camera angles.

4. The system of claim 3, further comprising a registration component configured to associate reconstructed sequences with 3D mesh models.

5. The system of claim 1, further comprising a decomposition component configured to isolate components of building structures of the one or more architectural structures.

6. The system of claim 5, further comprising a first rules component configured to derive mesh rules from the decomposition component, wherein the mesh rules include building roof regions and faç

ade planes.

7. The system of claim 6, further comprising a second rules component configured to derive texture rules from the decomposition component, wherein the texture rules are employed to detect repetitive elements in a facade.

8. The system of claim 1, further comprising a synthesis component configured to determine texture from one or more generated rules.

9. The system of claim 8, wherein the synthesis component is configured to generate one or more remodeled images of shapes or building structures of the one or more architectural structures.

10. The system of claim 1, wherein the processor is further configured to determine one or more contain rules to generate the remodeled images, wherein the contain rules describe items that are added to a building facade.

11. The system of claim 10, wherein the processor is further configured to employ one or more computer generated architecture (CGA) grammar rules to generate the remodeled images, wherein the CGA grammar rules define basic shapes for a building or structures associated with the building.

12. The system of claim 11, wherein the processor is further configured to detect repetitive images in a faç

ade texture image related to an architectural structure of the one or more architectural structures.

13. A method, comprising:

receiving one or more satellite images of building structures and one or more ground-level images associated with the building structures;

registering three-dimensional models and three-dimensional structure from at least one motion sequence from the satellite images and the ground-level images;

decomposing the three-dimensional models and the three-dimensional structure from the at least one motion sequence into building components; and

generating rules from the building components to facilitate remodeled imaging of the building structures.

14. The method of claim 13, further comprising synthesizing a building texture in accordance with the rules.

15. The method of claim 14, further comprising generating at least one remodeled building image based in part on the building texture.

16. The method of claim 13, wherein the generating includes generating one or more contain rules to facilitate the remodeled imaging of the building structures, wherein the contain rules describe shapes that are added to a building.

17. The method of claim 16, further comprising defining positions and regions of descending shapes of the building structures.

18. The method of claim 17, further comprising defining properties that are shared by the descending shapes.

19. A tangible computer-readable medium, comprising:

instructions for causing a computer to process models derived from aerial and ground-level images of building structures;

instructions for causing the computer to register the models in accordance with one or more motion sequences associated with the aerial and ground-level images;

instructions for causing the computer to generate one or more mesh rules and one or more texture rules describing the building structures, wherein the mesh rules include building roof regions and faç

ade planes, and the texture rules are employed to detect repetitive elements in a facade; and

instructions for causing the computer to generate one or more remodeled images of the building structures based in part on the one or more mesh rules and the one or more texture rules.

20. The computer-readable medium of claim 19, further comprising instructions for causing the computer to generate one or more contain rules to facilitate generation of the one or more remodeled images of the building structures, wherein the contain rules describe shapes that are added to a building.