Stereo calibration apparatus and stereo image monitoring apparatus using the same
First Claim
1. A stereo calibration apparatus for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the stereo calibration apparatus comprising:
- an image input device to which a pair of images is input from the one pair of image pickup devices;
a straight-line detector detecting at least four straight lines from each image of the pair of images output from the image input device;
a straight-line correspondence detector detecting at least four sets of corresponding lines between the pair of images by using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; and
a transformation matrix calculator calculating the transformation matrix by using the sets of corresponding lines,wherein the straight-line correspondence detector is configured to;
obtain data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images;
obtain data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images;
obtain normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and
determine one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
1 Assignment
0 Petitions
Accused Products
Abstract
The stereo calibration apparatus includes an image input device inputting an image from each of two image pickup devices, a straight-line detector detecting at least four straight lines from each of two input images, a straight-line correspondence detector detecting at least four sets of corresponding lines by using an image feature in a neighboring area of the straight line, and a transformation matrix calculator calculating a transformation matrix between two image pickup devices from the sets of corresponding lines.
-
Citations
15 Claims
-
1. A stereo calibration apparatus for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the stereo calibration apparatus comprising:
-
an image input device to which a pair of images is input from the one pair of image pickup devices; a straight-line detector detecting at least four straight lines from each image of the pair of images output from the image input device; a straight-line correspondence detector detecting at least four sets of corresponding lines between the pair of images by using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; and a transformation matrix calculator calculating the transformation matrix by using the sets of corresponding lines, wherein the straight-line correspondence detector is configured to; obtain data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtain data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtain normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determine one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines. - View Dependent Claims (2)
-
-
3. A stereo calibration method for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the method comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; detecting at least four sets of corresponding lines between the pair of images by using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; calculating the transformation matrix between the image pickup devices by using the sets of corresponding lines; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
4. A computer-readable medium storing a computer program product tangibly embodying a program of instructions which is executed by a computer to perform a process for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the process comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; detecting at least four sets of corresponding lines between the pair of images by using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; calculating the transformation matrix between the image pickup devices by using the sets of corresponding lines; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
5. A stereo image monitor for detecting an object, the stereo image monitor comprising:
-
a pair of image pickup devices configured to photograph a pair of images containing a common area; a straight-line detector detecting at least four straight lines from each image of the pair of images; a straight-line correspondence detector detecting at least four sets of corresponding lines between the pair of images by using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; a transformation matrix calculator calculating the transformation matrix by using the four sets of corresponding lines; and a monitor transforming one image of the pair of images by using the transformation matrix to detect an object in the common area, wherein the straight-line correspondence detector is configured to; obtain data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtain data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtain normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determine one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
6. A stereo image monitoring method for monitoring a common area, which photographed by a pair of image pickup devices, the method comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; detecting at least four sets of corresponding lines between the pair of images using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; calculating a transformation matrix between the image pickup devices by using the four sets of corresponding lines; transforming one image of the pair of images by using the transformation matrix to detect an object in the common area; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
7. A computer-readable medium storing a computer program product tangibly embodying a program of instructions which is executed by a computer to perform a process for monitoring a common area, which photographed by a pair of image pickup devices, the process comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; detecting at least four sets of corresponding lines between the pair of images using an image feature in a neighboring area of each of the four straight lines detected for each image of the pair of images; calculating a transformation matrix between the image pickup devices by using the four sets of corresponding lines; transforming one image of the pair of images by using the transformation matrix to detect an object in the common area; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
8. A stereo calibration apparatus for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the stereo calibration apparatus comprising:
-
an image input device to which a pair of images is input from the one pair of image pickup devices; a straight-line detector detecting at least four straight lines from each image of the pair of images output from the image input device; a straight-line correspondence detector detecting at least four sets of corresponding lines between the pair of images by using a geometrical relation among each of the four straight lines detected for each image of the pair of images; and a transformation matrix calculator calculating the transformation matrix by using the sets of corresponding lines, wherein the straight-line correspondence detector is configured to; obtain data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtain data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtain normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determine one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines. - View Dependent Claims (9, 10)
-
-
11. A stereo calibration method for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the method comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; detecting at least four sets of corresponding lines between the pair of images by using a geometrical relation among each of the four straight lines detected for each image of the pair of images; calculating the transformation matrix between the image pickup devices by using the sets of corresponding lines; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
12. A computer-readable medium storing a computer program product tangibly embodying a program of instructions causing a computer to perform a process for obtaining a transformation matrix, which is an image transformation parameter between a pair of image pickup devices for photographing a preset common area, the process comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; detecting at least four sets of corresponding lines between the pair of images by using a geometrical relation among each of the four straight lines detected for each image of the pair of images; calculating the transformation matrix between the image pickup devices by using the sets of corresponding lines; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
13. A stereo image monitor for detecting an object, the stereo image monitor comprising:
-
a pair of image pickup devices configured to photograph images containing a common area; an image input device to which a pair of images is input from the image pickup devices; a straight-line detector detecting at least four straight lines from each image of the pair of images output from the image input device; a straight-line correspondence detector detecting at least four sets of corresponding lines between the pair of images by using a geometrical relation among each of the four straight lines detected for each image of the pair of images; a transformation matrix calculator calculating the transformation matrix by using the sets of corresponding lines; and a monitor transforming one image of the pair of images by using the transformation matrix to detect an object in the common area, wherein the straight-line correspondence detector is configured to; obtain data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtain data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtain normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determine one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
14. A stereo image monitoring method for monitoring a common area, which photographed by a pair of image pickup devices, the method comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; obtaining at least four sets of corresponding lines between the pair of images by using a geometrical relation among each of the four straight lines detected for each image of the pair of images; calculating a transformation matrix between the image pickup devices by using the four sets of corresponding lines; transforming one of the images of the pair of images by using the transformation matrix to detect an object in the common area; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
-
15. A computer-readable medium storing a computer program product tangibly embodying a program of instructions which is executed by a computer to perform a process for monitoring a common area, which photographed by a pair of image pickup devices, the process comprising:
-
inputting a pair of images from the image pickup devices; detecting at least four straight lines from each image of the pair of images; obtaining at least four sets of corresponding lines between the pair of images by using a geometrical relation among each of the four straight lines detected for each image of the pair of images; calculating a transformation matrix between the image pickup devices by using the four sets of corresponding lines; transforming one of the images of the pair of images by using the transformation matrix to detect an object in the common area; obtaining a data series regarding the image feature in the neighboring area for each of the four straight lines detected for each image of the pair of images; obtaining data differences between each of data in the data series of each of the four straight lines detected for a first image of the pair of images and each of data in the data series of each of the four straight lines detected for a second image of the pair of images; obtaining normalized distances by normalizing a weighted sum of the data differences using a sum of weighting factors; and determining one of the four straight lines in the first image of the pair of images and the corresponding one of the four straight lines in the second image of the pair of images having a smallest normalized distance as a pair of corresponding lines.
-
Specification