MULTI-LENS CAMERA AND CONTROL METHOD

• US 20110069151A1
• Filed: 09/21/2010
• Published: 03/24/2011
• Est. Priority Date: 09/24/2009
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: ORIMOTO, Masaaki
• Granted Patent: US 8,854,432 B2
• Time in Patent Office: Days
• US Class Current: 348/42
• CPC Class Codes: G03B 35/00 Stereoscopic photography
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/246 Calibration of cameras

Abstract

A dual lens camera for producing a three-dimensional image includes plural lens systems and a zoom mechanism. Initial correction data is constituted by a displacement vector of an amount and a direction of misalignment between plural images according to a superimposed state thereof for each of zoom positions of the lens systems. A vector detector, if a calibration mode is set, obtains a current displacement vector related to one first zoom position. A data processor outputs current correction data by adjusting the initial correction data according to the initial correction data and current displacement vector. If the current correction data is stored, a displacement vector is obtained from the current correction data according to a zoom position of the lens systems upon forming the plural images, to carry out image registration between the images according to the obtained displacement vector for producing the three-dimensional image.

Claims

1. A multi-lens camera for producing a three-dimensional image from plural images with parallax, comprising:

plural lens systems for receiving entry of object light to form said plural images;

a zoom mechanism for changing a magnification of each of said lens systems within a zooming range;

a first correction data memory for storing initial correction data constituted by a displacement vector of an amount and a direction of misalignment between said plural images according to a superimposed state thereof for each of zoom positions of said lens systems;

a mode designation device for setting a calibration mode for adjusting said initial correction data;

a vector detector for, if said calibration mode is set, obtaining a current displacement vector between said plural images in relation to one first zoom position;

a data processor for outputting current correction data by adjusting said initial correction data according to said initial correction data and said current displacement vector;

a second correction data memory for storing said current correction data;

an image registration processor for, if said current correction data is absent in said second correction data memory, obtaining a displacement vector from said initial correction data according to a zoom position of said lens systems upon forming said plural images, and if said current correction data is stored in said second correction data memory, obtaining a displacement vector from said current correction data according to a zoom position of said lens systems upon forming said plural images, to carry out image registration between said plural images according to said obtained displacement vector for producing said three-dimensional image.

2. A multi-lens camera as defined in claim. 1, wherein said data processor obtains said displacement vector in association with said first zoom position from said initial correction data, to constitute said initial displacement vector, determines a first difference amount between said initial displacement vector and said current displacement vector, determines a second difference amount in association with one second zoom position according to said first difference amount and a ratio between focal lengths in relation to respectively said first and second zoom positions, obtains a second initial displacement vector in association with said second zoom position from said initial correction data, and determines a sum of said second difference amount and said second initial displacement vector, to constitute said current correction data in relation to said second zoom position.

3. A multi-lens camera as defined in claim 1, further comprising a zoom control device for driving said zoom mechanism in response to setting of said calibration mode, to set said lens systems in a telephoto end position for a zoom position.

4. A multi-lens camera as defined in claim. 1, wherein said image registration processor determines an overlap region where said plural images overlap on one another according to said obtained displacement vector, for said image registration by retrieving said overlap region from said plural images.

5. A multi-lens camera as defined in claim 4, further comprising a display panel for displaying said plural images in said superimposed state;

wherein said vector detector is externally operable to input a signal for shifting one of said plural images in one direction;

an amount and direction of shift of said shifted image are determined for said current displacement vector upon registering a common object in said plural images on said display panel.

6. A multi-lens camera as defined in claim 4, wherein said second correction data memory is accessed to rewrite said current correction data determined newly at each time of setting said calibration mode.

7. A control method of controlling a multi-lens camera including plural lens systems for receiving entry of object light to form plural images with parallax, and a zoom mechanism for changing a magnification of each of said lens systems within a zooming range, so as to produce a three-dimensional image from said plural images, comprising steps of:

obtaining a displacement vector of an amount and a direction of misalignment between said plural images according to a superimposed state thereof for each of zoom positions of said lens systems, to store initial correction data;

if a calibration mode is set for adjusting said initial correction data, obtaining a current displacement vector between said plural images in relation to one first zoom position;

outputting current correction data by adjusting said initial correction data according to said initial correction data and said current displacement vector;

writing said current correction data to a correction data memory;

if said current correction data is absent in said correction data memory, obtaining a displacement vector from said initial correction data according to a zoom position of said lens systems upon forming said plural images, and if said current correction data is stored in said correction data memory, obtaining a displacement vector from said current correction data according to a zoom position of said lens systems upon forming said plural images, to carry out image registration between said plural images according to said obtained displacement vector for producing said three-dimensional image.

8. A control method as defined in claim 7, wherein said step of outputting said current correction data includes:

obtaining said displacement vector in association with said first zoom position from said initial correction data, to constitute said initial displacement vector;

determining a first difference amount between said initial displacement vector and said current displacement vector;

determining a second difference amount in association with one second zoom position according to said first difference amount and a ratio between focal lengths in relation to respectively said first and second zoom positions;

obtaining a second initial displacement vector in association with said second zoom position from said initial correction data; and

determining a sum of said second difference amount and said second initial displacement vector, to constitute said current correction data in relation to said second zoom position.

9. A control method as defined in claim 7, further comprising a step of driving said zoom mechanism in response to setting of said calibration mode, to set said lens systems in a telephoto end position for a zoom position.

10. A control method as defined in claim 7, wherein said step of said image registration includes:

determining an overlap region where said plural images overlap on one another according to said obtained displacement vector; and

carrying out said image registration by retrieving said overlap region from said plural images.

11. A control method as defined in claim 10, wherein said step of initially obtaining said displacement vector includes:

obtaining displacement vectors of said lens systems when said lens systems are set in a telephoto end position and a wide-angle end position; and

obtaining a displacement vector in relation to one intermediate zoom position according to said displacement vectors in relation to said telephoto and wide-angle end positions and ratios between focal lengths of said optical systems in said telephoto and wide-angle end positions and said intermediate zoom position thereof.