Mosaic oblique images and methods of making and using same

• US 9,805,489 B2
• Filed: 08/31/2016
• Issued: 10/31/2017
• Est. Priority Date: 08/30/2006
• Status: Active Grant

• Current Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Original Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Inventors: Schultz, Stephen, Giuffrida, Frank, Gray, Robert
• Primary Examiner(s): Rush, Eric
• Application Number:
  US15/253,135
• Publication Number:
  US 20160371869A1
• Time in Patent Office: 426 Days
• Field of Search: 382100, 382154, 382284, 382285, 382294, 345629, 345646, 348144, 348147
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 3/06 Topological mapping of higher dimensional structures onto lower dimensional surfaces
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

A computer system running image processing software receives identification of a geographical area for which an oblique-mosaic image is desired; assigns surface locations to pixels included in an oblique-mosaic pixel map of the geographical area encompassing multiple source images, the oblique-mosaic pixel map being part of a mathematical model of a virtual camera looking down at an oblique angle onto the geographical area; creates a ground elevation model of the ground and vertical structures within the oblique-mosaic pixel map using overlapping source images of the geographical area, wherein the source images were captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera; and reprojects, with the mathematical model, source oblique image pixels of the overlapping source images for pixels included in the oblique-mosaic pixel map using the ground elevation model to thereby create an oblique-mosaic image of the geographical area.

Claims

1. A system comprising:

a computer system running image processing software that when executed by the computer system causes the computer system to;

receive an identification of a geographical area for which an oblique-mosaic image is desired;

assign surface locations to pixels included in an oblique-mosaic pixel map of the geographical area encompassing multiple source images, the oblique-mosaic pixel map being part of a mathematical model of a virtual camera looking down at an oblique angle onto the geographical area;

create a ground elevation model of the ground and vertical structures within the oblique-mosaic pixel map using overlapping source images of the geographical area, wherein the source images were captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera; and

reproject, with the mathematical model, source oblique image pixels of the overlapping source images for pixels included in the oblique-mosaic pixel map using the ground elevation model to thereby create the oblique-mosaic image of the geographical area.

2. The system of claim 1, wherein the virtual camera has a perspective, and wherein the image processing software further causes the computer system to project each pixel through the perspective of the virtual camera to determine a corresponding surface location for each pixel in the oblique-mosaic pixel map.

3. The system of claim 1, wherein multiple source oblique images represent a same surface location.

4. The system of claim 3, wherein the image processing software further causes the computer system to compare the pixels of each source oblique image that represent the same surface location to determine which source pixel is most representative of the surface location, the more representative pixel to be included in the oblique-mosaic image.

5. The system of claim 1, wherein each pixel included in the oblique-mosaic pixel map is reprojected to match a size and shape of a represented surface location as taken from the elevation, compass direction, and oblique angle of the virtual camera.

6. The system of claim 1, wherein the image processing software further causes the computer system to remove effects of elevation from the source oblique images prior to reprojection and then to add the effects of elevation to the oblique-mosaic image after reprojection.

7. The system of claim 1, wherein metadata is stored with the oblique-mosaic image.

8. A system comprising:

a computer system running image processing software that when executed by the computer system causes the computer system to;

receive an identification of a geographical area for which an oblique-mosaic image is desired;

determine geographic coordinates for pixels included in an oblique-mosaic pixel map of the geographical area encompassing multiple source images, the oblique-mosaic pixel map being part of a mathematical model of a virtual camera looking down at an oblique angle onto the geographical area;

create a ground elevation model of the ground and vertical structures within the oblique-mosaic pixel map using overlapping source images of the geographical area, wherein the source images were captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera; and

reproject, with the mathematical model, using the ground elevation model to define a ground surface and surfaces of vertical structures within the geographical area, at least one source oblique image pixel of the overlapping source images from a vantage point of the virtual camera for pixels included in the oblique-mosaic pixel map to thereby create a geo-referenced oblique-mosaic image of the geographical area.

9. The system of claim 8, wherein the virtual camera has a perspective, and wherein the image processing software further causes the computer system to project each pixel through the perspective of the virtual camera to determine a corresponding surface location for each pixel in the oblique-mosaic pixel map.

10. The system of claim 8, wherein multiple source oblique images represent a same surface location.

11. The system of claim 8, wherein the image processing software further causes the computer system to compare the pixels of each source oblique image that represent a same surface location to determine which source pixel is most representative of the surface location, the more representative pixel to be included in the geo-referenced oblique-mosaic image.

12. The system of claim 8, wherein the at least one source oblique image pixel is reprojected to match a size and shape of a represented surface location as taken from the elevation, compass direction, and oblique angle of the virtual camera.

13. The system of claim 8, wherein the image processing software further causes the computer system to remove effects of elevation from the source oblique images prior to reprojection and then to add the effects of elevation to the geo-referenced oblique-mosaic image after reprojection.

14. The system of claim 8, wherein metadata is stored with the geo-referenced oblique-mosaic image.