Modeling and texturing digital surface models in a mapping application

• US 7,831,089 B2
• Filed: 08/24/2006
• Issued: 11/09/2010
• Est. Priority Date: 08/24/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ofek, Eyal, Kimchi, Gur
• Primary Examiner(s): Bella; Matthew C
• Assistant Examiner(s): Cunningham; Gregory F
• Application Number:
  US11/466,952
• Publication Number:
  US 20080050011A1
• Time in Patent Office: 1,538 Days
• Field of Search: 382/154, 396/324, 396/325, 396/FOR.914
• US Class Current: 382/154
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/05 Geographic models

Abstract

Digital Surface Model (DSM) texturing and modeling of various objects on the earth'"'"'s surface are provided for implementation in a mapping application. One or more image capture devices having wide-angle lenses can be placed in various configurations to obtain nadir and oblique photography. Such configurations include a single lens, single sensor; single lens, multiple sensor; multiple lens, multiple sensor; and multiple lens, multiple sensor and a reflective surface. Positions, distances and areas can be measured from the imagery. Also provided is a continuous morph between aerial panorama and ground images.

Claims

1. A system embodied on one or more nonvolatile computer-readable media that, when implemented by one or more processing devices, facilitates modeling and texturing for mapping applications, the system comprising:

a first image capture component that is configured to capture wide-angle images, and that captures a first image from a first plurality of angles;

a second image capture component that is configured to capture wide-angle images, and that captures a second image from a second plurality of angles;

an object identification component that identifies an object that is included in both the first and second images;

a modeling component that generates a model of the object based on different views of the object from the first and second images, wherein generating the model includes,

a) identifying a point on the object in the first image that corresponds to a point on the object in the second image,

b) determining a three-dimensional location in space of the point, and

c) utilizing the three-dimensional location in space of the point to generate the model of the object; and

a presentation component that displays the model of the object in a mapping application.

2. The system of claim 1, wherein at least one of the first image capture component and the second image capture component is a camera comprising a wide-angle lens.

3. The system of claim 1, wherein at least one of the first image capture component and the second image capture component is a single lens, single sensor camera.

4. The system of claim 1, wherein at least one of the first image capture component and the second image capture component is a single lens, multiple sensor camera.

5. The system of claim 1, further comprising a curved reflective surface that is configured to reflect light rays from a hemispherical area beneath an aircraft, wherein the first and second image capture components face inward toward the curved reflective surface.

6. The system of claim 1, wherein the first and second image capture components are in an outward facing configuration.

7. The system of claim 1, further comprising a synchronization module that synchronizes an image capture time between the first and second image capture devices to facilitate a common capture of a similar scene.

8. The system of claim 1, further comprising a combiner module that combines the first and second images captured by the first and second image capture devices, respectively.

9. The system of claim 1, further comprising a storage media that retains the first and second images in a retrievable format.

10. The system of claim 1, wherein at least one of the first image capture component and the second image capture component captures the respective first or second image in at least one of a nadir position and an oblique position.

11. A method for digital surface model (DSM) texturing and modeling, comprising:

positioning a first image capture device to obtain aerial images, the first image capture device comprising a wide-angle lens;

capturing a first aerial image utilizing the first image capture device, the first aerial image including an object located on the surface of the earth;

positioning a second image capture device to obtain aerial images, the second image capture device comprising a wide-angle lens;

capturing a second aerial image utilizing the second image capture device, the second aerial image including the object;

identifying a first point on the object in the first aerial image;

identifying a second point on the object in the second aerial image, wherein the second point corresponds to the first point on the object in the first aerial image;

translating the point on the object in the first aerial image into a first view ray in space;

translating the corresponding point on the object in the second aerial image into a second view ray in space;

determining an intersection of the first view ray and the second view ray, wherein the first view ray and the second view ray intersect each other, and wherein the intersection defines a position in space of the point on the object;

combining the first and the second aerial images based on at least the position in space of the point on the object, thereby providing a combined aerial image;

receiving a request to view an aerial image at a particular location, wherein the particular location corresponds to a location of the combined aerial image; and

in response to the request, displaying the combined aerial image in a mapping application.

12. The method of claim 11, further comprising before positioning the first image capture device and the second image capture device, determining a configuration for the first image capture device and the second image capture device.

13. The method of claim 12, wherein the configuration is one of an inward facing configuration and an outward facing configuration.

14. The method of claim 12, further comprising:

placing the first image capture device and the second image capture device in a configuration that faces inward toward a reflective surface is configured to reflect light rays from a hemispherical area beneath an aircraft;

and

capturing the first and second aerial images from the reflective surface.

15. The method of claim 11, wherein capturing the first and second aerial images occurs at one or more of a nadir position and an oblique position with respect to the object.

16. The method of claim 11, further comprising determining at least one of a position measurement, a distance measurement and an area measurement of the first and second aerial images.

17. The method of claim 11, further comprising retaining the first and second aerial images in a retrievable format.

18. A system that provides texturing and modeling of Digital Surface Model (DSM) images, comprising:

means for capturing a first aerial image with a first wide-angle lens, wherein the first aerial image includes both nadir imagery and oblique imagery of the surface of the earth, and wherein the first aerial image includes an object;

means for capturing a second aerial image with a second wide-angle lens, wherein the second aerial image includes both nadir imagery and oblique imagery of the surface of the earth, and wherein the second aerial image includes the object;

means for identifying the object;

means for identifying a first point on the object in the first aerial image;

means for identifying a corresponding point on the object in the second aerial image, wherein the corresponding point corresponds to the point on the object in the first aerial image;

means for combining the first and the second aerial images based on matching the point on the object in the first aerial image with the corresponding point on the object in the second aerial image; and

means for presenting the combined aerial image in a map application.

19. The system of claim 18, further comprising:

means for capturing a third and a fourth aerial image with a wide-angle lens; and

means for synchronizing the capturing of the first and second aerial images and second aerial images and the capturing of the third and the forth aerial images.

20. The system of claim 19, further comprising means for combining the third and fourth aerial images with the first and second aerial images.