Image pickup system employing a three-dimensional reference object
First Claim
1. An image pickup system comprising:
- (a) a movable image-pickup apparatus;
(b) a reference object having a known shape in a three-dimensional space;
(c) a calibration-use information processing device; and
(d) a subject-use image-pickup apparatus for acquiring an image of a subject as second image data,wherein said movable image-pickup apparatus includes;
(a-1) an image-pickup device for acquiring an image of said reference object as first image data;
(a-2) a driver which rotates and drives said image-pickup device with respect to a fixed portion;
(a-3) a controller which controls said driver in such a manner that, when said movable image-pickup apparatus is moved, said image-pickup device can acquire the image of said reference object;
(a-4) a first communication device for carrying out data communications with said calibration-use information processing device;
(a-5) a securing member which secures said fixed portion to another object;
(a-6) an element for finding a rotation angle from a reference orientation of said image-pickup device that has been rotated by said driver; and
(a-7) an image-pickup controller which is attached to said subject-use image-pickup apparatus by said securing member, and allows said image-pickup device to acquire said first image data in cooperation with the acquiring of said second image data by said subject-use image-pickup apparatus,wherein said calibration-use information processing device includes;
(c-1) a second communication device for carrying out data communications with said movable image-pickup apparatus;
(c-2) a first calculator which, based upon said first image data, calculates a first parameter used for calibration for said movable image-pickup apparatus that depends on a relative position and a relative orientation of an image-pickup position of said movable image-pickup apparatus and said reference object;
(c-3) a second calculator which, based upon image data obtained by acquiring the image of said reference object, calculates a second parameter used for calibration for said subject-use image-pickup apparatus that depends on a relative position and a relative orientation of an image-pickup position of said subject-use image-pickup apparatus and said reference object;
(c-4) a third calculator which, based upon said first parameter, said second parameter and said rotation angle, calculates a third parameter used for calibration for said subject-use image-pickup apparatus that depends on a relative position and a relative orientation between an image-pickup position in a reference orientation of said movable image pickup apparatus and an image-pickup position of said subject-use image-pickup apparatus; and
(c-5) a fourth calculator which, based upon said first parameter and said third parameter, calculates a fourth parameter used for calibration for said subject-use image-pickup apparatus that depends on a relative position and a relative orientation between an image-pickup position of said subject-use image-pickup apparatus and said reference object, andwherein said subject-use image-pickup apparatus includes;
(d-1) a third communication device for transmitting said second image data to said calibration-use information processing device.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention provides a three-dimensional chart, a parameter acquiring method and an information processing device that are used for carrying out camera calibration in a wide range with high precision. For this reason, a plurality of unit graphic forms the sizes of which are coded by using different cross-ratios are placed on side faces of a three-dimensional chart. The cross-ratios of unit graphic forms are calculated from a picked-up image of the three-dimensional chart, and by collating these with actual values, the position and orientation of the image-pickup point are determined. The shifting average of the heights of the unit graphic forms is made approximately proportional to the distance from the apex so that it is possible to reduce the limitation of image-pickup distances. A movable camera is attached to a subject-use camera, and upon picking up an image of the subject, an image of the three-dimensional chart is also picked up simultaneously. Based upon the position and orientation of the movable camera found out by the above-mentioned sequence of image-pickup processes and the relative position and orientation between the two cameras that have been preliminarily found, it is possible to determine the position and orientation of the subject-use camera.
70 Citations
7 Claims
-
1. An image pickup system comprising:
-
(a) a movable image-pickup apparatus; (b) a reference object having a known shape in a three-dimensional space; (c) a calibration-use information processing device; and (d) a subject-use image-pickup apparatus for acquiring an image of a subject as second image data, wherein said movable image-pickup apparatus includes; (a-1) an image-pickup device for acquiring an image of said reference object as first image data; (a-2) a driver which rotates and drives said image-pickup device with respect to a fixed portion; (a-3) a controller which controls said driver in such a manner that, when said movable image-pickup apparatus is moved, said image-pickup device can acquire the image of said reference object; (a-4) a first communication device for carrying out data communications with said calibration-use information processing device; (a-5) a securing member which secures said fixed portion to another object; (a-6) an element for finding a rotation angle from a reference orientation of said image-pickup device that has been rotated by said driver; and (a-7) an image-pickup controller which is attached to said subject-use image-pickup apparatus by said securing member, and allows said image-pickup device to acquire said first image data in cooperation with the acquiring of said second image data by said subject-use image-pickup apparatus, wherein said calibration-use information processing device includes; (c-1) a second communication device for carrying out data communications with said movable image-pickup apparatus; (c-2) a first calculator which, based upon said first image data, calculates a first parameter used for calibration for said movable image-pickup apparatus that depends on a relative position and a relative orientation of an image-pickup position of said movable image-pickup apparatus and said reference object; (c-3) a second calculator which, based upon image data obtained by acquiring the image of said reference object, calculates a second parameter used for calibration for said subject-use image-pickup apparatus that depends on a relative position and a relative orientation of an image-pickup position of said subject-use image-pickup apparatus and said reference object; (c-4) a third calculator which, based upon said first parameter, said second parameter and said rotation angle, calculates a third parameter used for calibration for said subject-use image-pickup apparatus that depends on a relative position and a relative orientation between an image-pickup position in a reference orientation of said movable image pickup apparatus and an image-pickup position of said subject-use image-pickup apparatus; and (c-5) a fourth calculator which, based upon said first parameter and said third parameter, calculates a fourth parameter used for calibration for said subject-use image-pickup apparatus that depends on a relative position and a relative orientation between an image-pickup position of said subject-use image-pickup apparatus and said reference object, and wherein said subject-use image-pickup apparatus includes; (d-1) a third communication device for transmitting said second image data to said calibration-use information processing device.
-
-
2. An image pickup system comprising:
-
(a) a movable image-pickup apparatus; (b) a reference object having a known shape in a three-dimensional space; and (c) a calibration-use information processing device, wherein said movable image-pickup apparatus includes; (a-1) an image-pickup device for acquiring an image of said reference object as first image data; (a-2) a driver which rotates and drives said image-pickup device with respect to a fixed portion; (a-3) a controller which controls said driver in such a manner that, when said movable image-pickup apparatus is moved, said image-pickup device can acquire the image of said reference object; (a-4) a first communication device for carrying out data communications with said calibration-use information processing device; (a-8) a securing member which secures said fixed portion to another object; (a-9) an element for finding a rotation angle from a reference orientation of said image-pickup device that has been rotated by said driver; (a-10) an element for acquiring reference relative data that depends on a relative position and a relative orientation between an image-pickup position in a reference orientation of said image pickup device and said fixed portion; and (a-11) an element which, based upon said rotation angle and said reference relative data, calculates a fifth parameter that depends on a relative position and a relative orientation between an image-pickup position of said image pickup device and said fixed portion, wherein said calibration-use information processing device includes; (c-1) a second communication device for carrying out data communications with said movable image-pickup apparatus; and (c-2) a first calculator which, based upon said first image data, calculates a first parameter used for calibration for said movable image-pickup apparatus that depends on a relative position and a relative orientation of an image-pickup position of said movable image-pickup apparatus and said reference object, and wherein said calibration-use information processing device calculates a sixth parameter that depends on a relative position and a relative orientation between a position of said fixed portion and said reference object based upon said fifth parameter and said first parameter.
-
-
3. A movable image-pickup device comprising:
-
an image pickup device which acquires first image data of a reference object having a known three-dimensional shape; a driver which drives said image pickup device with respect to a fixed portion; a controller which, in the case when said movable image-pickup device is shifted, controls said driver so as to allow said image pickup device to acquire an image of said reference object; a memory which stores said first image data acquired by said image pickup device, said first image data for use to find a position of said image pickup device that has been driven by said driver; a securing member which attaches said fixed portion to a subject-use image-pickup device that acquires an image of a subject as second image data; and an image-pickup controller which allows said image pickup device to acquire said first image data simultaneously with an acquiring process of said second image data of said subject-use image-pickup device. - View Dependent Claims (4, 5, 6, 7)
-
Specification