Mosaic Oblique Images and Methods of Making and Using Same

• US 20080123994A1
• Filed: 08/29/2007
• Published: 05/29/2008
• Est. Priority Date: 08/30/2006
• Status: Active Grant

• Current Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Original Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Inventors: Giuffrida, Frank, Schultz, Stephen, Gray, Robert
• Granted Patent: US 7,873,238 B2
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 3/06 Topological mapping of higher dimensional structures onto lower dimensional surfaces
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

A method for creating an oblique-mosaic image from a plurality of source images is disclosed. Initially, a desired area to be imaged and collected into an oblique-mosaic image is identified and then a mathematical model of a sensor of a virtual camera is created, where the virtual camera has an elevation greater than an elevation of the area to be imaged. The mathematical model has an oblique-mosaic pixel map for the sensor of the desired area. A surface location is determined for each pixel included in the oblique mosaic pixel map, and at least one source oblique image pixel of the area to be imaged is reprojected for each pixel included in the oblique-mosaic pixel map to thereby create an oblique-mosaic image of the desired geographical area. The at least one single oblique-mosaic image is visually pleasing and geographically accurate. Further, techniques for compensating for building lean in oblique-mosaic images are disclosed.

Claims

1. A method for creating an oblique-mosaic image from a plurality of source oblique images, comprising the steps of:

identifying a desired area to be imaged and collected into an oblique-mosaic image;

creating a mathematical model of a sensor of a virtual camera, where the virtual camera has an elevation greater than an elevation of the area to be imaged, the mathematical model having an oblique-mosaic pixel map for the sensor of the desired area;

assigning a surface location to each pixel included in the oblique mosaic pixel map; and

reprojecting at least one source oblique image pixel of the area to be imaged for each pixel included in the oblique-mosaic pixel map to thereby create an oblique-mosaic image of the desired geographical area.

2. The method of claim 1, wherein the step of assigning is further defined by projecting each pixel through the perspective of the virtual camera to determine a corresponding surface location for each pixel in the oblique-mosaic pixel map.

3. The method of claim 1, wherein multiple source oblique images represent the same surface location.

4. The method of claim 1, wherein the method further comprises the step of selecting source oblique images of the surface location captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera.

5. The method of claim 3, wherein the pixels of each source oblique image that represent the same surface location are compared to determine which source pixel is most representative of the surface location, the more representative pixel to be included in the oblique-mosaic image.

6. The method of claim 1, wherein the step of reprojecting is further defined by reprojecting the pixel to match the size and shape of the represented surface location as taken from the elevation, compass direction, and oblique angle of the virtual camera.

7. The method of claim 1, wherein the step of reprojecting is further defined by removing the effects of elevation from the source oblique images prior to reprojection and then adding the effects of elevation to the oblique-mosaic image after reprojection.

8. The method of claim 1, further comprising the step of minimizing lean of vertical structures within the oblique mosaic image.

9. The method of claim 8, wherein the step of minimizing lean of vertical structures within the oblique mosaic image is defined further as the steps of creating an elevation model from the source oblique images taking into account the vertical structures, and reprojecting at least one source oblique image pixel of the area to be imaged.

10. The method of claim 8, wherein the step of minimizing lean of vertical structures is defined further as matching vertical structures in multiple source oblique images and shifting pixels apparent location in at least one of the source oblique images by a relative height above a ground model.

11. The method of claim 1, wherein metadata is stored with the oblique-mosaic image.

12. The method of claim 1, wherein the oblique-mosaic image is geo-referenced.

13. The method of claim 1, wherein the desired area to be imaged represents a geographical area.

14. A method for creating an oblique-mosaic image from a plurality of source oblique images, comprising the steps of:

identifying a desired area to be imaged and collected into an oblique-mosaic image;

creating a mathematical model of a sensor of a virtual camera, where the virtual camera has an elevation greater than an elevation of the area to be imaged, the mathematical model having an oblique-mosaic pixel map for the sensor of the desired area;

determining a surface location for each pixel included in the oblique mosaic pixel map; and

reprojecting at least one source oblique image pixel of the area to be imaged for each pixel included in the oblique-mosaic pixel map to thereby create an oblique-mosaic image of the desired geographical area.

15. The method of claim 14, wherein the step of determining is further defined by projecting each pixel through the perspective of the virtual camera to determine a corresponding surface location for each pixel in the oblique-mosaic pixel map.

16. The method of claim 14, wherein multiple source oblique images represent the same surface location.

17. The method of claim 14, wherein the method further comprises the step of selecting source oblique images of the surface location captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera.

18. The method of claim 16, wherein the pixels of each source oblique image that represent the same surface location are compared to determine which source pixel is most representative of the surface location, the more representative pixel to be included in the oblique-mosaic image.

19. The method of claim 14, wherein the step of reprojecting is further defined by reprojecting the pixel to match the size and shape of the represented surface location as taken from the elevation, compass direction, and oblique angle of the virtual camera.

20. The method of claim 14, wherein the step of reprojecting is further defined by removing the effects of elevation from the source oblique images prior to reprojection and then adding the effects of elevation to the oblique-mosaic image after reprojection.

21. The method of claim 14, further comprising the step of minimizing lean of vertical structures within the oblique mosaic image.

22. The method of claim 21, wherein the step of minimizing lean of vertical structures within the oblique mosaic image is defined further as the steps of creating an elevation model from the source oblique images taking into account the vertical structures, and reprojecting at least one source oblique image pixel of the area to be imaged.

23. The method of claim 21, wherein the step of minimizing lean of vertical structures is defined further as matching vertical structures in multiple source oblique images and shifting pixels apparent location in at least one of the source oblique images by a relative height above a ground model.

at least one of the source oblique images by a relative height above a ground model.

24. The method of claim 14, wherein metadata is stored with the oblique-mosaic image.

25. The method of claim 14, wherein the oblique-mosaic image is geo-referenced.

26. The method of claim 14, wherein the desired area to be imaged represents a geographical area.