Method of generating three-dimensional (3D) models using ground based oblique imagery

• US 9,430,871 B2
• Filed: 01/27/2014
• Issued: 08/30/2016
• Est. Priority Date: 11/05/2008
• Status: Active Grant

• Current Assignee: Hover Inc. (Tucows Incorporated)
• Original Assignee: Hover Inc. (Tucows Incorporated)
• Inventors: Neophytou, Neophytos, Herbert, Marc L., Pittel, James L.
• Primary Examiner(s): TUCKER, WESLEY J
• Application Number:
  US14/164,508
• Publication Number:
  US 20140139523A1
• Time in Patent Office: 946 Days
• Field of Search: 382/154
• US Class Current: 1/1
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 2210/56 Particle system, point based geometry or rendering
• CPC Class Codes: G06T 2219/2008 Assembling, disassembling
• CPC Class Codes: G06V 20/176 Urban or other man-made structures
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces

Abstract

Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.

Claims

1. A method of generating digital three-dimensional (3D) building models, the method comprising:

implementing, in a visualization processing system, computer instructions to;

receive a plurality of digital ground based oblique images corresponding to at least one building structure;

receive an identified structural aspect of the at least one structure, the identified structural aspect including a visual boundary of at least one building facade;

for two or more of the received plurality of digital ground based oblique images, matching multiple common boundary points corresponding to boundary points of the identified structural aspect of the at least one structure to cross correlate the two or more of the received plurality of digital ground based oblique images to extract the 3D building model;

texture within the visual boundary of the structural aspect by copying an equivalent boundary of pixels within the at least one building facade from at least one of the digital ground based oblique images;

adjust the visual boundary of the structural aspect for relative orientation to the corresponding at least one of the digital ground based oblique images; and

storing in computer storage the extracted and textured 3D building model comprising a bounded space of the matched multiple boundary points for one or more the aspects of the at least one structure.

2. The method of claim 1, wherein the texturing includes textures located using one or more pattern matching algorithms.

3. The method of claim 2 further comprising recovering 3D location data of a pattern determined from the one or more pattern matching algorithms to correct for inaccurate structure identification.

4. The method of claim 1, wherein the digital ground based oblique images are geocoded.

5. The method of claim 1, wherein the aspect is correlated by applying a stereo algorithm to cross-correlate.

6. The method of claim 5, wherein the correlation of the aspect reveals 3D positions of one or more of the boundary points.

7. The method of claim 1 further comprising matching patterns to determine occlusions.

8. A method of generating three-dimensional (3D) building models, the method comprising:

implementing, in a visualization processing system, computer instructions to;

receiving a plurality of digital ground based oblique images corresponding to at least one building structure;

for two or more of the received plurality of digital ground based oblique images, matching multiple common boundary points of one or more structural aspects of the at least one structure to cross correlate the two or more of the received plurality of digital ground based oblique images to extract the 3D building model, the one or more structural aspects including one or more building facades;

texturing a visual bounded space within the multiple common boundary points;

adjusting the visual bounded space for relative orientation to a corresponding one or more of the plurality of digital ground based oblique images;

receiving an input to move one or more of the multiple common boundary points to modify the previously extracted 3D building model of the at least one building structure; and

storing in computer storage the modified extracted 3D model.

9. The method of claim 8, wherein the input to move one or more of the multiple common boundary points includes boundary points for one or more of the building facades.

10. The method of claim 8, wherein the texturing includes textures located using one or more pattern matching algorithms.

11. The method of claim 10 further comprising recovering 3D location data of a pattern determined from the one or more pattern matching algorithms to correct for inaccurate structure identification.

12. The method of claim 8, wherein the plurality of digital ground based oblique images are geocoded.

13. A method of generating three-dimensional (3D) building models of building structures, the method comprising:

implementing, in a visualization processing system, computer instructions to;

receiving a plurality of digital ground based oblique images corresponding to at least one building structure and including at least one structural aspect, the structural aspect including at least a first facade;

for two or more of the received plurality of digital ground based oblique images, matching multiple common boundary points within the at least one structural aspect of the plurality of digital ground based oblique images to extract at least the first facade for the 3D building model;

receive system inputs moving one or more of the matched common multiple boundary points of the at least the first facade to a dimensional boundary of the building structure visually correlating to the at least first facade;

repeating the receiving, matching and moving steps to extract remaining facades of the 3D model of the at least one structure;

texturing a surface of each of the extracted first and remaining facades using corresponding received plurality of digital ground based oblique images; and

storing the 3D building model with the extracted facades and textured surfaces in computer storage.

14. The method of claim 13 further comprising texturing the one or more extracted facades.

15. The method of claim 13 further comprising adjusting for orientation of the texturing.

16. The method of claim 15, wherein the texturing includes textures located using one or more pattern matching algorithms.

17. The method of claim 16 further comprising recovering 3D location data of a pattern determined from the one or more pattern matching algorithms to correct for inaccurate structure identification.

18. The method of claim 13, wherein the digital ground based oblique images are geocoded.