System and method for two-dimensional keystone correction for aerial imaging

• US 20060291744A1
• Filed: 03/09/2005
• Published: 12/28/2006
• Est. Priority Date: 03/09/2005
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Ikeda, Roger Mitsuo, Kempf, Jeffrey Matthew
• Granted Patent: US 7,379,619 B2
• Time in Patent Office: Days
• US Class Current: 382/275
• CPC Class Codes: G06T 2207/30181 Earth observation
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 5/006 Geometric correction correction of chromatic aberrations adapted to be used in an image pickup device containing an electronic image sensor H04N23/10; detecting, correcting, reducing or removing artefacts resulting only from the lens unit, e.g. flare, shading, vignetting or "cos4" H04N25/61
• CPC Class Codes: G06T 5/80 Geometric correction

Abstract

A digital keystone correction process locates image points in a corrected image from image points in a distorted image that was produced by misalignment of the axis of a sensor such as a camera. The correction process locates corrected image points by constructing intercept points that are the intersections of the extended sides of a quadrilateral in the distorted image plane that is constructed from a known rectangular feature in the subject plane. Reference points are located by drawing a line through each intercept point and the distorted image point. Distances are found from the intercept points to the image points and the reference points. The distances are scaled and corrected with an offset to locate the coordinates of the image points in the corrected image plane. This process can correct alignment errors of pitch, yaw, and roll between the subject plane and an image plane such as photographic film.

Claims

1. A device configured to correct keystone distortion of a distorted image captured with misalignment of the axes of a sensor and a subject plane, comprising:

a display configured to exhibit corners of a quadrilateral that represents a known rectangular feature in the subject plane; and

digital circuitry configured;

to locate intercept points that are the intersections of lines that are extensions of the top and bottom edges and the left and right sides of the quadrilateral;

to locate vertical and horizontal reference points on sides of the quadrilateral by drawing a line through each intercept point and an image point of the distorted image;

to compute distances from the respective intercept points to the image point of the distorted image and to the respective reference points; and

to scale and correct the distances with an offset to locate a corresponding image point of a corrected image.

2. A device to correct keystone distortion according to claim 1, wherein alignment errors of pitch, yaw, and roll between the subject plane and the distorted image plane are corrected.

3. A device to correct keystone distortion according to claim 1, wherein the corrected image is stored in an electronic medium.

4. A device to correct keystone distortion according to claim 1, wherein corrected distances between image points in the distorted image are computed.

5. A device to correct keystone distortion according to claim 1, wherein the distorted image is captured from an aircraft.

6. A device to correct keystone distortion according to claim 1, wherein the known rectangular feature is defined by intersecting streets.

7. A device to correct keystone distortion according to claim 1, wherein the distorted image is a photographic image.

8. A method to locate an image point of a corrected image in a corrected image plane from a corresponding image point of a distorted image in a distorted image plane that was produced from an image in a subject plane containing a known rectangular feature, comprising:

locating intercept points that are the intersections of lines that are extensions of the top and bottom edges and the left and right sides of a quadrilateral in the distorted image plane that represents a known rectangle in the subject plane;

locating vertical and horizontal reference points on sides of the quadrilateral in the distorted image plane by drawing a line through each intercept point and the image point of the distorted image;

determining distances from the respective intercept points to the image point of the distorted image and to the respective reference points; and

scaling and correcting the distances with an offset to locate the image point of the corrected image on the corrected image plane.

9. The method according to claim 8, including correcting alignment errors of pitch, yaw, and roll between the subject plane and the distorted image plane.

10. The method according to claim 8, including producing the distorted image on photographic paper.

11. The method according to claim 8, including computing the distance between two image points of a corrected image in a corrected image plane.

12. The method according to claim 8, including capturing the distorted image from an aircraft.

13. The method according to claim 8, including defining the known rectangular feature by intersecting streets.

14. A method for locating an image point in a corrected image of a geographic area from a corresponding image point of a distorted image of the geographic area, wherein the distorted image of the geographic area was captured from a position of altitude, wherein the plane of the distorted image is skewed relative the plane of the geographic area comprising:

(a) selecting a quadrilateral in the image that corresponds to a known rectangular feature in the geographic area;

(b) extending the top and bottom edges of the quadrilateral to define a first intercept point, and the left and right sides of the quadrilateral to define a second intercept point;

(c) locating a first reference point, being the point of intersection of (i) one of the top and bottom edge of the quadrilateral, and (ii) a line connecting the first intercept point and the image point of the distorted image;

(d) locating a second reference point, being the point of intersection of (i) one of the left and right side of the quadrilateral, and (ii) a line connecting the second intercept point and the image point of the distorted image;

(e) determining a first distance between the first intercept point and the first reference point and a second distance between the first intercept point and the image point of the distorted image;

(f) determining a third distance between the second intercept point and the second reference point and a fourth distance between the second intercept point and the image point of the distorted image;

(g) applying a predetermined offset value to the first, second, third, and fourth distances, respectively, to obtain first, second, third, and fourth offset distances, respectively; and

(h) using the first, second, third, and fourth offset distances, respectively, to locate the image point of the corrected image.

15. The method according to claim 14, wherein the distorted image is captured from an aircraft.

16. The method according to claim 14, wherein the known rectangular feature is defined by intersecting streets.

17. The method according to claim 14, wherein the distorted image is a photographic image.

18. The method according to claim 14, further comprising:

(i) repeating the steps (a) through (h) for a second image point; and

(101) determining a distance between the first image point and the second image point.