Device for forming an image and method of correcting geometrical optical distortions in an image

• US 5,675,380 A
• Filed: 12/20/1995
• Issued: 10/07/1997
• Est. Priority Date: 12/29/1994
• Status: Expired due to Fees

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Lelong, Pierre, Florent, Raoul
• Primary Examiner(s): Peng, John K.
• Assistant Examiner(s): Murrell, Jeffrey S.
• Application Number:
  US08/575,537
• Time in Patent Office: 657 Days
• Field of Search: 348/175, 348/187, 348/188, 348/189, 348/190, 348/241, 348/246, 348/247, 348/251, 348/615, 348/616, 348/745, 348/746, 348/806
• US Class Current: 348/251
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation

Abstract

The device includes systems for picking up (1), acquiring (2) and digitizing (3) a distorted source image (SI), a system for processing digital images (4, 47) for constructing a distortion-corrected target image (TI) corresponding to the source image (SI), this system including a first sub-assembly (4) for predetermining, on the basis of the data of a distorted TEST source image (SG°), an optical center (OCⁿ) and a polynomial function (F_n) for correcting radial distortions around this optical center, and a second sub-assembly (47) which applies the polynomial correction function to each address of the pixel of the target image (TI) for furnishing the address of a point in the distorted source image (SI) in which an intensity data is present which is applied to the initial address in the target image. The method includes the computation, in a TEST source image (SG°), of an optical center (OCⁿ) at the center of optical distortions, and of a polynomial function (Fⁿ) for correcting distortions for constructing a TEST target image (TI).

Claims

1. A device for forming an image, comprising:

a camera system;

a system for acquisition of data of a source image distorted by the camera system;

a system for digitizing said source image including a first image memory for storing intensity data of each pixel marked by an address in a bidimensional matrix; and

a system for processing the digital image for constructing a distortion-corrected target image corresponding to the source image,

in which the image processing system includes;

a first sub-assembly for predetermining, on the basis of image data of a distorted TEST source image, an optical center and a polynomial function for correcting radial distortions around said optical center; and

a second sub-assembly including a memory for storing the optical center and the polynomial function determined by the first sub-assembly, a computing block for applying the polynomial function to each pixel address of the target image, and for supplying an address of a pixel in the distorted source image in which an intensity data is present which is to be applied to the initial address in the target image, and a second image memory for storing data of the target image.

2. A device for forming images as claimed in claim 1, in which:

the first sub-assembly includes blocks for treating the source image TEST, said source image TEST being formed as a grating, referred to as source grating, for constructing a target image TEST, referred to as theoretical grating, said blocks comprising;

a block for extracting reference points at the points of intersection of the bars of the source grating;

a block for estimating the first approximate theoretical grating, computing the address of a center and the step size of said first theoretical grating;

a block for estimating a distortion-corrected theoretical grating, computing by way of iteration the address of a center and the step size of said corrected theoretical grating;

a block for computing a correction polynomial of the radial distortions, providing a transformation rule for passing a point of the corrected theoretical grating at the iteration n to a reference point of the distorted source grating, which transformation rule operates at the iteration n;

a block for computing a patterning error due to the iteration n transformation rule; and

a block for computing a modified address of the optical center which minimizes the patterning error.

3. A method of correcting geometrical optical distortions produced in an image by a camera system, said method comprising the preliminary steps of:

a) acquiring data and digitizing a TEST source image, including storing intensity data of each pixel marked by an address in a bidimensional matrix;

b) estimating an optical center located, at best, at the optical distortion center of the TEST source image and the ratio of said optical center computed in a digital image to be constructed, referenced TEST target image representing the corrected TEST source image of the optical distortions; and

c) estimating a polynomial function for causing the address of a corresponding point, denoted reference point, in the distorted TEST source image to correspond to the address of a pixel in the corrected TEST target image, based on the hypothesis that the geometrical optical distortions in the TEST source image are radial around the distortion center, so that said corresponding points are aligned, at best, with the estimated optical center.

4. A method as claimed in claim 3, comprising, in the preliminary steps, the iterative steps of:

d) estimating the best polynomial function capable of minimizing, at an iteration of the order of Nopt, the patterning error realized at the localization of the pixels of the TEST target image constructed at a preceding iteration in accordance with the hypothesis of radial distortions around an optical center estimated at said preceding iteration; and

e) estimating, at an iteration of the order of Nlast, an optimized modified optical center and re-estimating under these conditions a new polynomial function capable of further minimizing the patterning error realized at the localization of the pixels of the reconstructed target image in accordance with the hypothesis of radial distortions around said estimated optimized modified optical center.

5. A method as claimed in claim 4, in which the preliminary steps are performed once, said method comprising, at the start of the preliminary steps, the steps of:

a_o) acquiring the data of a source image distorted by the camera system, digitizing and storing the intensity data of each pixel; and

f'"'"') correcting the optical distortions by applying the best estimated polynomial function to a digital target image to be constructed, so as to supply, on the basis of each address in said target image, a corresponding address in the distorted digital source image in which an intensity function is found which is applied to said address in the target image to be constructed.

6. A method as claimed in claim 3, in which the preliminary steps are performed once, said method comprising, at the start of the preliminary steps, the steps of:

a₀) acquiring the data of a source image distorted by the camera system, and digitizing and storing intensity data of each pixel; and

f) correcting the optical distortions by applying the estimated polynomial function to a digital target image to be constructed, so as to supply, on the basis of each address of this target image, a corresponding address in the distorted digital source image in which an intensity data is found which is applied to said address in the target image to be constructed.

7. A method as claimed in claim 3, in which:

in the preliminary step a) of acquiring the data and digitizing, the TEST source image is the digitized image of a rectangular mesh whose bars are parallel to the rows and columns of pixels, to the most approximate optical distortions referred to as source grating;

in the step b), said optical center is estimated in an iterative manner on the basis of a zero iteration comprising the construction of a first distortion-corrected TEST target image, referred to as first target grating, by means of the sub-steps of;

extracting one point per zone of intersection of the bars of the source grating, these extracted points being denoted as reference points of the source grating;

estimating a reference point which is nearest to the center of distortions of the source grating;

transferring this reference point into the first target grating for constituting a first center of the grating;

estimating a first grating pitch for said target grating; and

estimating a first approximate optical center for said first target grating coinciding with said transferred reference point and coinciding with the center of the grating.

8. A method as claimed in claim 7, in which in step d), the iterative estimation of the best polynomial function comprises the estimation, in a zero-order iteration, of a first polynomial function comprising the sub-steps of:

constructing points of the first target grating on the basis of the center of the grating and the grating step to correspond to the reference points of intersection of the bars of the source grating;

causing the grating points of the first target grating and the reference points of the source grating to correspond by localizing the center of the grating coinciding with the reference point which is nearest to the center of distortion;

forming the pairs constituted by the grating points and the corresponding reference points step by step from the center to the edges of the target grating;

estimating the pairs of radii formed by segments joining the optical center of the first target grating and each point of the pairs of target grating points and the reference point; and

computing the first polynomial function as the one which best connects the pairs of radii in conformity with the hypothesis in accordance with which the distortions are radial around the optical center.

9. A method as claimed in claim 8, in which in step d), the iterative estimation of the best polynomial function comprises the estimation, in an n>

0 order iteration, of a polynomial function comprising the sub-steps of;

constructing a target grating at the order of n, having an optical center and grating points defined by a center of the grating and a grating pitch;

causing the grating points of the target grating to correspond to the reference points of the source grating by localizing the center of the target grating by means of its coordinates determined in the preceding iteration;

forming pairs of grating points and reference points step by step from the center towards the edges of the target image;

estimating the pairs of radii formed by segments joining the known optical center and each point of the pairs; and

computing the polynomial function as the one which best connects the pairs of radii in conformity with the hypothesis in accordance with which the geometrical distortions are radial around the optical center.

10. A method as claimed in claim 9, in which the construction of a target grating at the current iteration (n) comprises the sub-steps of:

localizing an optical center which is re-updated;

localizing the grating points and corresponding reference points constituting pairs formed at the preceding iteration;

estimating the geometrical distances on the abscissa of the grating points of the radii passing through the re-updated optical center and through the corresponding reference points of the pairs formed at this preceding iteration;

estimating a criterion, referred to as radial criterion, which expresses the radial hypothesis that the best corrected target grating corresponds to the minimization of the geometrical distances; and

minimizing the radial criterion expressed as a function of the coordinates of the center and of the components of the grating pitch at the iteration, supplying the center coordinates and the components of the target grating pitch at the iteration.

11. A method as claimed in claim 10, in which the step b) of estimating the optical center is realized in an iteration loop in which, at each current iteration, the localization of the optical center is modified and then reintroduced in the construction of the current target grating for determining a new polynomial function, and estimating the corresponding patterning error the best localization of the center being that which results in the smallest patterning error corresponding to the best polynomial function.