Image processing method and apparatus and computer-readable storage medium using improved distortion correction
First Claim
1. An image processing method for correcting image distortions, comprising the steps of:
- inputting a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane;
determining a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and determining a matched point of one of the other partially overlapping images corresponding to the feature point so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object;
selecting one of the plurality of partially overlapping images as a standard image whose image distortions are to be corrected, the selection being based on one of (1) a direction of a straight-line pattern contained in each image, (2) the feature point and the matched point determined in the determining step, and (3) a calculated direction of the object plane for each of the partially overlapping images; and
generating a distortion-corrected image on a projection plane by projecting the standard image onto the projection plane based on the direction of the tangible object plane such that image distortions in the standard image are eliminated.
1 Assignment
0 Petitions
Accused Products
Abstract
In image processing method and apparatus of the present invention, image distortions caused by oblique imaging are corrected. A feature point of one of a plurality of partially overlapping images corresponding to a common location of an original image, shared by the plurality of partially overlapping images, is determined. A matched point of one of the other partially overlapping images corresponding to the feature point is determined so that a direction of the object plane is calculated based on the feature point and the matched point. One of the plurality of partially overlapping images is selected as a standard image whose image distortions are to be corrected. A distortion-corrected image is generated on a projection plane by projecting the standard image onto the projection plane based on the direction of the object plane such that image distortions in the standard image are eliminated.
-
Citations
42 Claims
-
1. An image processing method for correcting image distortions, comprising the steps of:
-
inputting a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane; determining a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and determining a matched point of one of the other partially overlapping images corresponding to the feature point so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object; selecting one of the plurality of partially overlapping images as a standard image whose image distortions are to be corrected, the selection being based on one of (1) a direction of a straight-line pattern contained in each image, (2) the feature point and the matched point determined in the determining step, and (3) a calculated direction of the object plane for each of the partially overlapping images; and generating a distortion-corrected image on a projection plane by projecting the standard image onto the projection plane based on the direction of the tangible object plane such that image distortions in the standard image are eliminated. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An image processing method for correcting image distortions, comprising the steps of:
-
inputting a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane; determining a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and determining a matched point of one of the other partially overlapping images corresponding to the feature point of said one of the plurality of partially overlapping images so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object; selecting one of the plurality of partially overlapping images as a standard image that contains a smallest amount of image distortions among the plurality of partially overlapping images; and combining the other partially overlapping images, which are projected onto an image surface of the standard image with respect to each of the other partially overlapping images, so that a composite image is generated on the image surface so as to correct image distortions in the standard image. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. An image processing apparatus for correcting image distortions, comprising:
-
an input unit inputting a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane; a correspondence detecting unit determining a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and determining a matched point of one of the other partially overlapping images corresponding to the feature point of said one of the plurality of partially overlapping images so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object; a standard image setting unit selecting one of the plurality of partially overlapping images as a standard image that contains a smallest amount of image distortions among the plurality of partially overlapping images; and an image composition unit combining the other partially overlapping images, which are projected onto an image surface of the standard image with respect to each of the other partially overlapping images, so that a composite image is generated on the image surface so as to correct image distortions in the standard image. - View Dependent Claims (19, 20, 21, 22, 23)
-
-
24. An image processing apparatus for correcting image distortions, comprising:
-
an input unit inputting a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane; a correspondence detecting unit determining a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and determining a matched point of one of the other partially overlapping images corresponding to the feature point so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object; a standard image setting unit selecting one of the plurality of partially overlapping images as a standard image whose image distortions are to be corrected, the selection being based on one of (1) a direction of a straight-line pattern contained in each image, (2) the feature point and the matched point determined by the correspondence detecting unit, and (3) a calculated direction of the object plane for each of the partially overlapping images; and a distortion correcting unit generating a distortion-corrected image on a projection plane by projecting the standard image onto the projection plane based on the direction of the tangible object plane such that image distortions in the standard image are eliminated. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32)
-
-
33. A computer-readable storage medium storing program code instructions for causing a computer to execute an image distortion correction processing to correct image distortions, comprising:
-
first program code means for causing the computer to input a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane; second program code means for causing the computer to determine a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and to determine a matched point of one of the other partially overlapping images corresponding to the feature point so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object; third program code means for causing the computer to select one of the plurality of partially overlapping images as a standard image whose image distortions are to be corrected, the selection being based on one of (1) a direction of a straight-line pattern contained in each image, (2) the feature point and the matched point determined by the second program code means, and (3) a calculated direction of the object plane for each of the partially overlapping images; and fourth program code means for causing the computer to generate a distortion-corrected image on a projection plane by projecting the standard image onto the projection plane based on the direction of the tangible object plane such that image distortions in the standard image are eliminated. - View Dependent Claims (34, 35, 36, 37)
-
-
38. A computer-readable storage medium storing program code instructions for causing a computer to execute an image distortion correction processing to correct image distortions, comprising:
-
first program code means for causing the computer to input a plurality of partially overlapping images of a tangible object on an object plane, the plurality of partially overlapping images sharing a common location of the tangible object and being created by capturing the tangible object on the tangible object plane from different directions to the tangible object plane; second program code means for causing the computer to determine a feature point of one of the plurality of partially overlapping images corresponding to the common location of the tangible object, and to determine a matched point of one of the other partially overlapping images corresponding to the feature point of said one of the plurality of partially overlapping images so that a direction of the tangible object plane is calculated based on the feature point and the matched point, the tangible object plane being defined by a spatial orientation of the tangible object; third program code means for causing the computer to select one of the plurality of partially overlapping images as a standard image that contains a smallest amount of image distortions among the plurality of partially overlapping images; and fourth program code means for causing the computer to combine the other partially overlapping images, which are projected onto an image surface of the standard image with respect to each of the other partially overlapping images, so that a composite image is generated on the image surface so as to correct image distortions in the standard image. - View Dependent Claims (39, 40, 41, 42)
-
Specification