COMPOUND EYE IMAGING APPARATUS, DISTANCE MEASURING APPARATUS, DISPARITY CALCULATION METHOD, AND DISTANCE MEASURING METHOD
First Claim
1. A compound eye imaging apparatus which calculates a disparity occurring in a plurality of imaging optical systems that take an image of a same object,said apparatus comprising:
- a standard imaging optical system which generates a picture including a standard image by taking an image of the object;
reference imaging optical systems of an even number equal to or larger than two, each of which has an optical center and generates a picture including a reference image by taking an image of the object, the optical centers being arranged substantially point-symmetrically with respect to an optical center of said standard imaging optical system;
a correlation value calculation unit configured to calculate a correlation value indicating a degree of similarity between the standard image and the reference image, for each shifting amount by which a search position of the reference image in the picture generated by said reference imaging optical systems is shifted in a direction parallel to a baseline so that an image position of the reference image which is similar to the standard image is searched for, for each of said reference imaging optical systems of an even number equal to or larger than two, the baseline being a straight line connecting the optical center of said standard imaging optical system and the optical center of said reference imaging optical systems;
a correlation value addition unit configured to calculate an integrated correlation value by adding the correlation value to each corresponding shifting amount, the correlation value being calculated for each of said reference imaging optical systems of an even number equal to or larger than two; and
a disparity calculation unit configured to calculate, at a sub-pixel level, a disparity that is a shifting amount which results in a largest degree of similarity between the standard image and the reference image.
2 Assignments
0 Petitions
Accused Products
Abstract
A compound eye imaging apparatus can estimate a sub-pixel disparity with a high degree of accuracy without depending on a brightness of a surface of an object. The compound eye imaging apparatus includes: a standard imaging optical system generating a picture including a standard image; reference imaging optical systems of an even number equal to or larger than two arranged substantially point-symmetrically with respect to the standard imaging optical system, which generate an picture including a reference image; a correlation value calculation unit (6) calculating a correlation value for each shifting amount by which one of the reference images is shifted parallel to a baseline, with respect to the standard image, for each of the reference imaging optical systems of an even number equal to or larger than two; a correlation value addition unit (7) calculating an integrated correlation value by adding, to each corresponding shifting amount, the correlation value calculated for each of said reference imaging optical systems of an even number equal to or larger than two; and a disparity calculation unit (8) calculating a disparity that is a shifting amount resulting in the largest degree of similarity between the standard image and the reference image.
53 Citations
11 Claims
-
1. A compound eye imaging apparatus which calculates a disparity occurring in a plurality of imaging optical systems that take an image of a same object,
said apparatus comprising: -
a standard imaging optical system which generates a picture including a standard image by taking an image of the object; reference imaging optical systems of an even number equal to or larger than two, each of which has an optical center and generates a picture including a reference image by taking an image of the object, the optical centers being arranged substantially point-symmetrically with respect to an optical center of said standard imaging optical system; a correlation value calculation unit configured to calculate a correlation value indicating a degree of similarity between the standard image and the reference image, for each shifting amount by which a search position of the reference image in the picture generated by said reference imaging optical systems is shifted in a direction parallel to a baseline so that an image position of the reference image which is similar to the standard image is searched for, for each of said reference imaging optical systems of an even number equal to or larger than two, the baseline being a straight line connecting the optical center of said standard imaging optical system and the optical center of said reference imaging optical systems; a correlation value addition unit configured to calculate an integrated correlation value by adding the correlation value to each corresponding shifting amount, the correlation value being calculated for each of said reference imaging optical systems of an even number equal to or larger than two; and a disparity calculation unit configured to calculate, at a sub-pixel level, a disparity that is a shifting amount which results in a largest degree of similarity between the standard image and the reference image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A distance measuring apparatus which calculates a distance to an object or a three-dimensional location of the object by calculating a disparity occurring in a plurality of imaging optical systems that take an image of the same object, said apparatus comprising:
-
a standard imaging optical system which generates a picture including a standard image by taking an image of the object; reference imaging optical systems of an even number equal to or larger than two, each of which has an optical center and generates a picture including a reference image by taking an image of the object, the optical centers being arranged substantially point-symmetrically with respect to an optical center of said standard imaging optical system; a correlation value calculation unit configured to calculate a correlation value indicating a degree of similarity between the standard image and the reference image, for each shifting amount by which a search position of the reference image in the picture generated by said reference imaging optical systems is shifted in a direction parallel to a baseline so that an image position of the reference image which is similar to the standard image is searched for, for each of said reference imaging optical systems of an even number equal to or larger than two, the baseline being a straight line connecting the optical center of said standard imaging optical system and the optical center of said reference imaging optical systems; a correlation value addition unit configured to calculate an integrated correlation value by adding the correlation value to each corresponding shifting amount, the correlation value being calculated for each of said reference imaging optical systems of an even number equal to or larger than two; a disparity calculation unit configured to calculate, at a sub-pixel level, a disparity that is a shifting amount which results in a largest degree of similarity between the standard image and the reference image; and a distance calculation unit configured to calculate a distance from said distance measuring apparatus to the object or a three-dimensional location of the object based on the calculated disparity, a focal length of said standard imaging optical system, and a length of the baseline.
-
-
10. A disparity calculation method for calculating a disparity occurring in a plurality of imaging optical systems that take an image of a same object, the plurality of imaging optical systems including:
- a standard imaging optical system which generates a picture including a standard image by taking an image of the object; and
reference imaging optical systems of an even number equal to or larger than two, each of which has an optical center and generates a picture including a reference image by taking an image of the object, the optical centers being arranged substantially point-symmetrically with respect to an optical center of the standard imaging optical system,said disparity calculation method comprising; calculating a correlation value indicating a degree of similarity between the standard image and the reference image, for each shifting amount by which a search position of the reference image in the picture generated by the reference imaging optical systems is shifted in a direction parallel to a baseline so that an image position of the reference image which is similar to the standard image is searched for, for each of the reference imaging optical systems of an even number equal to or larger than two, the baseline being a straight line connecting the optical center of the standard imaging optical system and the optical center of the reference imaging optical systems; calculating an integrated correlation value by adding the correlation value to each corresponding shifting amount, the correlation value being calculated for each of the reference imaging optical systems of an even number equal to or larger than two; and calculating, at a sub-pixel level, a disparity that is a shifting amount which results in a largest degree of similarity between the standard image and the reference image.
- a standard imaging optical system which generates a picture including a standard image by taking an image of the object; and
-
11. A distance measuring method for calculating a distance to an object or a three-dimensional location of the object by calculating a disparity occurring in a plurality of imaging optical systems that take an image of the same object, the plurality of imaging optical systems including:
- a standard imaging optical system which generates a picture including a standard image by taking an image of the object; and
reference imaging optical systems of an even number equal to or larger than two, each of which has an optical center and generates a picture including a reference image by taking an image of the object, the optical centers being arranged substantially point-symmetrically with respect to an optical center of the standard imaging optical system,said distance measuring method comprising; calculating a correlation value indicating a degree of similarity between the standard image and the reference image, for each shifting amount by which a search position of the reference image in the picture generated by the reference imaging optical systems is shifted in a direction parallel to a baseline so that an image position of the reference image which is similar to the standard image is searched for, for each of the reference imaging optical systems of an even number equal to or larger than two, the baseline being a straight line connecting the optical center of the standard imaging optical system and the optical center of the reference imaging optical systems; calculating an integrated correlation value by adding the correlation value to each corresponding shifting amount, the correlation value being calculated for each of the reference imaging optical systems of an even number equal to or larger than two; calculating, at a sub-pixel level, a disparity that is a shifting amount which results in a largest degree of similarity between the standard image and the reference image; and calculating a distance from the distance measuring apparatus to the object or a three-dimensional location of the object based on the calculated disparity, a focal length of the standard imaging optical system, and a length of the baseline.
- a standard imaging optical system which generates a picture including a standard image by taking an image of the object; and
Specification