Generating a composite field of view using a plurality of oblique panoramic images of a geographic area

• US 9,185,289 B2
• Filed: 06/10/2013
• Issued: 11/10/2015
• Est. Priority Date: 06/10/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fan, Quanfu, Miyazawa, Sachiko, Pankanti, Sharathchandra
• Primary Examiner(s): Thompson, James A
• Application Number:
  US13/913,964
• Publication Number:
  US 20140362107A1
• Time in Patent Office: 883 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

Generating a composite geo-referenced panoramic field of view image of a geographic area is provided. Geodetic coordinates are generated for each of a plurality of pixels in a digital image capturing the geographic area based on a corrected amount of image distortion in each line of pixels in the plurality of pixels in the digital image. Each of the plurality of pixels in the digital image with the calculated geodetic coordinates is mapped to a geo-referenced map corresponding to the geographic area based on the calculated geodetic coordinates of each pixel. The composite geo-referenced panoramic field of view image of the geographic area is generated based on the mapping of each of the plurality of pixels in the digital image with the calculated geodetic coordinates to the geo-referenced map corresponding to the geographic area captured in the digital image.

Claims

1. A computer-implemented method for generating a composite geo-referenced panoramic field of view image of a geographic area, the computer-implemented method comprising:

identifying, by a computer, solid angle vectors projecting from a center of Earth along a geographic coordinate system line corresponding to a line of pixels in a digital image capturing the geographic area with known geodetic coordinates associated with a selected set of reference coordinates to form a plurality of solid angles;

calculating, by the computer, a distance between a vertical axis and each of the solid angle vectors along the geographic coordinate system line corresponding to the line of pixels in the digital image using a non-linear geographical distance formula;

calculating, by the computer, geodetic coordinates of each of a plurality of pixels in the digital image capturing the geographic area based on a corrected amount of image distortion in each line of pixels in the plurality of pixels in the digital image;

mapping, by the computer, each of the plurality of pixels in the digital image with the calculated geodetic coordinates to a geo-referenced map corresponding to the geographic area based on the calculated geodetic coordinates of each pixel; and

generating, by the computer, the composite geo-referenced panoramic field of view image of the geographic area based on the mapping of each of the plurality of pixels in the digital image with the calculated geodetic coordinates to the geo-referenced map corresponding to the geographic area captured in the digital image.

2. The computer-implemented method of claim 1, further comprising:

receiving, by the computer, an image file that includes a header and the digital image of the geographic area captured at an oblique angle by an imaging device located on a mobile aerial platform.

3. The computer-implemented method of claim 2, further comprising:

selecting, by the computer, the set of reference coordinates from one or more sets of reference coordinates included in data of the header of the image file.

4. The computer-implemented method of claim 2, further comprising:

identifying, by the computer, depression angle vectors projecting from a known location associated with the imaging device along the geographic coordinate system line corresponding to the line of pixels in the digital image with known geodetic coordinates associated with the selected set of reference coordinates to form a plurality of depression angles.

5. The computer-implemented method of claim 4, further comprising:

measuring, by the computer, an amount of image distortion between the plurality of solid angles and the plurality of depression angles based on the calculated distance between the vertical axis and each of the solid angle vectors along the geographic coordinate system line corresponding to the line of pixels in the digital image.

6. The computer-implemented method of claim 5, further comprising:

calculating, by the computer, an image distortion scaling factor based on the measured amount of image distortion between the plurality of solid angles and the plurality of depression angles; and

using, by the computer, the calculated image distortion scaling factor to correct the measured amount of image distortion in the line of pixels in the digital image caused by an ellipsoidal geometry of the earth and the oblique angle of the digital image.

7. The computer-implemented method of claim 2, further comprising:

calculating, by the computer, an amount of optical distortion of pixels in the digital image caused by the imaging device based on imaging device data included in a sub header of the image file.

8. The computer-implemented method of claim 2, further comprising:

retrieving, by the computer, an elevation of the imaging device when the digital image was captured from the header of the image file; and

adjusting, by the computer, the elevation of the imaging device when the digital image was captured by subtracting an elevation of a center of the geographic area captured in the digital image.

9. The computer-implemented method of claim 1, further comprising:

selecting, by the computer, an object in the digital image of the geographic area.

10. The computer-implemented method of claim 9, further comprising:

performing, by the computer, geodetic mapping of the selected object in the digital image to a position on a geo-referenced map using a calculated image distortion scaling factor associated with the digital image; and

calculating, by the computer, the position on the geo-referenced map corresponding to the selected object in the digital image based on the performed geodetic mapping.