SITE MODELING USING IMAGE DATA FUSION

• US 20090208095A1
• Filed: 02/15/2008
• Published: 08/20/2009
• Est. Priority Date: 02/15/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zebedin, Lukas
• Granted Patent: US 8,275,194 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/174 involving the use of two or more images

Abstract

Site modeling using image data fusion. Geometric shapes are generated to represent portions of one or more structures based on digital height data and a two-dimensional segmentation of portions of the one or more structures is generated based on three-dimensional line segments and digital height data. A labeled segmentation of the one or more structures is generated based on the geometric shapes and the two-dimensional segmentation. A three-dimensional model of the one or more structures is generated based on the labeled segmentation.

Claims

1. A method for site modeling using image data fusion, comprising:

generating geometric shapes to represent portions of one or more structures based on digital height data;

generating a two-dimensional segmentation of said portions of said one or more structures based on three-dimensional line segments and said digital height data;

generating a labeled segmentation of said one or more structures based on said geometric shapes and said two-dimensional segmentation; and

generating a three-dimensional model of said one or more structures based on said labeled segmentation.

2. The method of claim 1 wherein said generating a three-dimensional model comprises generating a model of said one or more structures at various levels of detail.

3. The method of claim 1 wherein said generating three dimensional line segments comprises matching line segments across multiple views.

4. The method of claim 1 wherein said generating geometric shapes comprises detecting basic geometric shapes in a point cloud.

5. The method of claim 1 wherein said generating a two dimensional segmentation comprises segmenting a building using three-dimensional line segments.

6. The method of claim 1 wherein said generating said labeled segmentation comprises the use of basic geometric shapes and a two-dimensional segmentation.

7. The method of claim 1 wherein said generating a three-dimensional model comprises extruding a labeled segmentation to produce a three dimensional polyhedral representation of said one or more structures.

8. A method for urban site modeling using image data fusion, comprising:

accessing digital height data corresponding to individual points of one or more buildings that are a part an aerial image of a site;

accessing three-dimensional line segments based on said one or more buildings;

generating geometric shapes to represent portions of said one or more buildings based on said digital height data;

generating a two-dimensional segmentation of said portions of said one or more buildings based on said three-dimensional line segments and said digital height data;

generating a labeled segmentation of said one or more buildings based on said geometric shapes and said two-dimensional segmentation; and

generating a three-dimensional model of said one or more buildings based on said labeled segmentation.

9. The method of claim 8 wherein said generating digital height data comprises taking aerial photographs of a site.

10. The method of claim 8 wherein said generating three dimensional line segments comprises matching line segments across multiple views.

11. The method of claim 8 wherein said generating geometric shapes comprises detecting basic geometric shapes in a point cloud.

12. The method of claim 8 wherein said generating a two dimensional segmentation comprises segmenting a building using three-dimensional line segments.

13. The method of claim 8 wherein said generating said labeled segmentation comprises using basic geometric shapes and a two-dimensional segmentation.

14. The method of claim 8 wherein said generating a three-dimensional model comprises extruding a labeled segmentation to produce a three dimensional polyhedral representation of said one or more buildings.

15. A computer-readable medium having computer-executable components, comprising:

a geometric shape generating component for generating geometric shapes to represent portions of one or more structures based on digital height data which provides a height value for a plurality of points in said one or more structures with respect to the ground;

a two-dimensional segmentation generating component for generating a two-dimensional segmentation of said portions of said one or more structures based on three-dimensional line segments and said digital height data wherein said three-dimensional line segments represents a depth discontinuity in said one or more structures;

a labeled segmentation generating component for generating a labeled segmentation of said one or more structures based on said geometric shapes and said two-dimensional segmentation; and

a three-dimensional model generating component for generating a three-dimensional model of said one or more structures based on said labeled segmentation.

16. The medium of claim 15 wherein said three-dimensional model generating component generates a three-dimensional model of said one or more structures at various levels of detail.

17. The medium of claim 15 wherein said geometric shape generating component detects basic geometric shapes in a point cloud.

18. The medium of claim 15 wherein said two dimensional segmentation generating component segments a building using three-dimensional line segments.

19. The medium of claim 15 wherein said labeled segmentation generating component generates said labeled segmentation by assigning polygons to said one or more portions of said one or more structures.

20. The medium of claim 15 wherein said three-dimensional model generating component extrudes a labeled segmentation to produce a three dimensional polyhedral representation of said one or more structures.