Stereoscopic imaging device and shading correction method

• US 9,369,693 B2
• Filed: 02/21/2013
• Issued: 06/14/2016
• Est. Priority Date: 09/22/2010
• Status: Expired due to Fees

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Kurahashi, Hidekazu
• Primary Examiner(s): Elahi, Shan
• Application Number:
  US13/772,728
• Publication Number:
  US 20130162780A1
• Time in Patent Office: 1,209 Days
• Field of Search: 348/46
• US Class Current: 1/1
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/20 Image signal generators
• CPC Class Codes: H04N 13/218 using spatial multiplexing
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/672 based on the phase difference signals
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Abstract

Provided is a technique for improving the quality of an image obtained by a pupil-division-type stereoscopic imaging device. First and second images obtained by the stereoscopic imaging device according to the present invention have the shading of an object in a pupil division direction. Therefore, when the first and second images are composed, reference data in which shading is cancelled is generated. The amount of shading correction for the first and second images is determined on the basis of the reference data and shading correction is performed on the first and second images on the basis of the determined amount of shading correction.

Claims

1. A stereoscopic imaging device that outputs a plurality of images with a phase difference caused by pupil division for a beam emitted from a single imaging optical system and is capable of restoring a stereoscopic image with a parallax corresponding to the phase difference from the plurality of images, comprising:

a composition device that composes the plurality of images and outputs reference data for shading correction on the basis of the composite image of the plurality of images; and

a correction device that compares the reference data output from the composition device with each of the plurality of images and calculates a difference between an average density value of the reference data and an average density value of each of the plurality of images to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction;

an acquisition device that acquires set information when each of the plurality of images is captured; and

a determination device that determines whether the shading correction by the correction device is needed on the basis of the set information acquired by the acquisition device,

wherein the correction device corrects the shading of each of the plurality of images when the determination device determines that the shading correction by the correction device is needed,

wherein the set information includes imaging mode setting information indicating a stereoscopic image capture mode or a planar image capture mode, and

when the imaging mode setting information indicates the planar image capture mode, the determination device determines that the shading correction by the correction device is needed,

wherein, when the imaging mode setting information indicates the stereoscopic image capture mode, the determination device determines that the shading correction by the correction device is not needed.

2. The stereoscopic imaging device according to claim 1, further comprising:

a thinning device that thins out pixels of each of the plurality of images,

wherein the composition device composes the plurality of images from which the pixels are thinned out by the thinning device and outputs the reference data for shading correction on the basis of the composite image of the plurality of images, and

the correction device interpolates the reference data such that the size thereof is equal to the original size of each of the plurality of images, compares the interpolated reference data with each of the plurality of images to determine the amount of shading correction for each of the plurality of images, and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

3. The stereoscopic imaging device according to claim 2, further comprising:

a filtering device that filters the reference data and each of the plurality of images using a low-pass filter and outputs the filtered reference data and the filtered plurality of images,

wherein the correction device compares the reference data and each of the plurality of images output from the filtering device to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

4. The stereoscopic imaging device according to claim 1, further comprising:

a filtering device that filters the reference data and each of the plurality of images using a low-pass filter and outputs the filtered reference data and the filtered plurality of images,

wherein the correction device compares the reference data and each of the plurality of images output from the filtering device to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

5. The stereoscopic imaging device according to claim 1,

wherein the set information includes aperture setting information, and

when the aperture setting information is closer to an aperture side than to a predetermined aperture value, the determination device determines that the shading correction by the correction device is needed.

6. The stereoscopic imaging device according to claim 5,

wherein the set information includes zoom position setting information, and

when the aperture setting information is closer to an opening side than to the predetermined aperture value and the zoom position setting information is closer to a wide side than to a predetermined zoom position, the determination device determines that the shading correction by the correction device is needed.

7. The stereoscopic imaging device according to claim 6, further comprising:

a filtering device that filters the reference data and each of the plurality of images using a low-pass filter and outputs the filtered reference data and the filtered plurality of images,

wherein, when the aperture setting information is closer to the opening side than to the predetermined aperture value and the zoom position setting information is closer to a telephoto side than to the predetermined zoom position, the determination device determines that the shading correction by the correction device is needed, and

when the determination device determines that the shading correction by the correction device is needed, the correction device compares the reference data and each of the plurality of images output from the filtering device to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

8. A shading correction method which outputs a plurality of images with a phase difference caused by pupil division for a beam emitted from a single imaging optical system and is capable of restoring a stereoscopic image with a parallax corresponding to the phase difference from the plurality of images, comprising:

composing the plurality of images and outputting, by utilizing a composition device, reference data for shading correction on the basis of the composite image of the plurality of images; and

comparing the reference data output from the composition device with each of the plurality of images and calculating a difference between an average density value of the reference data and an average density value of each of the plurality of images to determine the amount of shading correction for each of the plurality of images and performing the shading correction on each of the plurality of images on the basis of the determined amount of shading correction;

acquiring set information when each of the plurality of images is captured; and

determining, by utilizing a determination device, whether the shading correction is needed on the basis of the set information,

wherein the shading correction step corrects the shading of each of the plurality of images when the determination device determines that the shading correction is needed,

wherein the set information includes imaging mode setting information indicating a stereoscopic image capture mode or a planar image capture mode, and

when the imaging mode setting information indicates the planar image capture mode, the determination device determines that the shading correction by the correction device is needed, and

wherein, when the imaging mode setting information indicates the stereoscopic image capture mode, the determination device determines that the shading correction by the correction device is not needed.