Program for correcting image distortion, apparatus for correcting image distortion, method for correcting image distortion, and recording medium storing program for correcting image distortion

• US 20060140504A1
• Filed: 02/22/2006
• Published: 06/29/2006
• Est. Priority Date: 10/24/2003
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Suwa, Misako, Takebe, Hiroaki, Naoi, Satoshi, Fujimoto, Katsuhito
• Granted Patent: US 7,471,848 B2
• Time in Patent Office: Days
• US Class Current: 382/275
• CPC Class Codes: G06T 3/06 Topological mapping of higher dimensional structures onto lower dimensional surfaces
• CPC Class Codes: G06T 3/608 by skew deformation, e.g. two-pass or three-pass rotation
• CPC Class Codes: G06T 5/006 Geometric correction correction of chromatic aberrations adapted to be used in an image pickup device containing an electronic image sensor H04N23/10; detecting, correcting, reducing or removing artefacts resulting only from the lens unit, e.g. flare, shading, vignetting or "cos4" H04N25/61
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals

Abstract

A projection set of geodesic lines which are parallel with each other on a curved surface of a paper face is extracted from an image in which a paper face has been imaged by an image-pickup device, using the paper face contents as a clue; and also a projection set of ruling lines which form a ruled surface corresponding to the curved surface of the paper face is extracted from the projection set of geodesic lines. Then, the curved surface of the paper face is estimated from the projection set of the geodesic lines and ruling lines, and distortion of the image is corrected based on this curved surface of the paper face. If this is done, correspondence with various types of diverse distortions becomes possible, and distortion correction can be performed even when only one part of the paper face appears in the image.

Claims

1. A program for correcting image distortion for executing on a computer:

an image input function for inputting an picked-up image in which a paper face has been imaged;

a geodesic line projection extraction function for extracting from the image that has been input by said image input function, a projection set of geodesic lines which are parallel with each other on a curved surface of the paper face, using the contents of said paper face as a clue;

a ruling line projection extraction function for extracting from the projection set of geodesic lines that has been extracted by said geodesic line projection extraction function, a projection set of ruling lines that form a ruled surface corresponding to said curved surface of the paper face;

a paper face curved surface estimating function for estimating said curved surface of the paper face from the projection sets of the geodesic lines and the ruling lines extracted by said geodesic line projection extraction function and said ruling line projection extraction function, respectively; and

a distortion correction function for correcting distortion of the image input by said image input function, based on the curved surface of the paper face estimated by said paper face curved surface estimating function.

2. The program for correcting image distortion according to claim 1, wherein said ruling line projection extraction function searches for and extracts from the projection set of the geodesic lines extracted by said geodesic line projection extraction function, a projection set of ruling lines for which the ratio of line segment lengths for where the ruling line projection is cut by the geodesic line projection is constant.

3. The program for correcting image distortion according to claim 1, wherein said ruling line projection extraction function extracts from amongst the projection sets of the geodesic lines extracted by said geodesic line projection extraction function, projection sets of ruling lines, excluding geodesic line projections for which the slope of lines tangent to the ruling line projection at the intersection point of the ruling line projection and the geodesic line projection is not constant.

4. The program for correcting image distortion according to claim 1, wherein said ruling line projection extraction function uses the projection set of geodesic lines extracted by said geodesic line projection extraction function, and searches from amongst the set of the ruling lines, for which the internal ratio due to the internal geodesic line projections positioned between the upper end and the lower end becomes constant, sets of ruling lines where the sum total of deviations from the internal ratio becomes a minimum, and extracts those as projection set of ruling lines.

5. The program for correcting image distortion according to claim 1, wherein said paper face curved surface estimating function estimates the curved surface of the paper face using the image-pickup height with respect to the curved surface of paper face, and a geometrical property in which tangent vectors to the geodesic lines at the upper end and lower end intersecting with one ruling line are parallel.

6. An apparatus for correcting image distortion comprising:

an image input means for inputting a picked-up image in which a paper face has been imaged;

a geodesic line projection extraction means for extracting from the image that has been input by said image input means, a projection set of geodesic lines which are parallel with each other on a curved surface of the paper face, using the contents of said paper face as a clue;

a ruling line projection extraction means for extracting from the projection set of geodesic lines that has been extracted by said geodesic line projection extraction means, a projection set of ruling lines which form a ruled surface corresponding to said curved surface of the paper face;

a paper face curved surface estimating means for estimating said curved surface of the paper face from the projection set of the geodesic lines and ruling lines individually extracted by said geodesic line projection extraction means and said ruling line projection extraction means; and

a distortion correction means for correcting distortion of the image input by said image input means, based on the curved surface of the paper face estimated by said paper face curved surface estimating means.

7. A method for correcting image distortion comprising executing on a computer:

a geodesic line projection extraction step for extracting from an image in which a paper face has been imaged by an image-pickup device, a projection set of geodesic lines which are parallel with each other on a curved surface of the paper face, using the contents of said paper face as a clue;

a ruling line projection extraction step for extracting from the projection set of geodesic lines that has been extracted by said geodesic line projection extraction step, a projection set of ruling lines which form a ruled surface corresponding to said curved surface of the paper face;

a paper face curved surface estimating step for estimating said curved surface of the paper face from the projection set of the geodesic lines and ruling lines individually extracted by said geodesic line projection extraction step and said ruling line projection extraction step; and

a distortion correction step for correcting distortion of the image input by said image-pickup device, based on the curved surface of the paper face estimated by said paper face curved surface estimating step.

8. A recording medium storing a program for correcting image distortion for executing on a computer:

an image input function for inputting a picked-up image in which a paper face has been imaged;

a geodesic line projection extraction function for extracting from the image that has been input by said image input function, a projection set of geodesic lines which are parallel with each other on a curved surface of the paper face, using the contents of said paper face as a clue;

a ruling line projection extraction function for extracting from the projection set of geodesic lines that has been extracted by said geodesic line projection extraction function, a projection set of ruling lines which form a ruled surface corresponding to said curved surface of the paper face;

a paper face curved surface estimating function for estimating said curved surface of the paper face from the projection set of the geodesic lines and ruling lines individually extracted by said geodesic line projection extraction function and said ruling line projection extraction function; and

a distortion correction function for correcting distortion of the image input by said image input function, based on the curved surface of the paper face estimated by said paper face curved surface estimating function.