STEREOSCOPIC IMAGING DEVICE AND SHADING CORRECTION METHOD

• US 20130162780A1
• Filed: 02/21/2013
• Published: 06/27/2013
• Est. Priority Date: 09/22/2010
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: KURAHASHI, Hidekazu
• Granted Patent: US 9,369,693 B2
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/20 Image signal generators
• CPC Class Codes: H04N 13/218 using spatial multiplexing
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/672 based on the phase difference signals
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Abstract

Provided is a technique for improving the quality of an image obtained by a pupil-division-type stereoscopic imaging device. First and second images obtained by the stereoscopic imaging device according to the present invention have the shading of an object in a pupil division direction. Therefore, when the first and second images are composed, reference data in which shading is cancelled is generated. The amount of shading correction for the first and second images is determined on the basis of the reference data and shading correction is performed on the first and second images on the basis of the determined amount of shading correction.

Claims

1. A stereoscopic imaging device that outputs a plurality of images with a phase difference caused by pupil division for a beam emitted from a single imaging optical system and is capable of restoring a stereoscopic image with a parallax corresponding to the phase difference from the plurality of images, comprising:

a composition unit that composes the plurality of images and outputs reference data for shading correction on the basis of the composite image of the plurality of images; and

a correction unit that compares the reference data output from the composition unit with each of the plurality of images to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

2. The stereoscopic imaging device according to claim 1, further comprising:

a thinning unit that thins out pixels of each of the plurality of images,

wherein the composition unit composes the plurality of images from which the pixels are thinned out by the thinning unit and outputs the reference data for shading correction on the basis of the composite image of the plurality of images, and

the correction unit interpolates the reference data such that the size thereof is equal to the original size of each of the plurality of images, compares the interpolated reference data with each of the plurality of images to determine the amount of shading correction for each of the plurality of images, and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

3. The stereoscopic imaging device according to claim 1, further comprising:

a filtering unit that filters the reference data and each of the plurality of images using a low-pass filter and outputs the filtered reference data and the filtered plurality of images,

wherein the correction unit compares the reference data and each of the plurality of images output from the filtering unit to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

4. The stereoscopic imaging device according to claim 2, further comprising:

a filtering unit that filters the reference data and each of the plurality of images using a low-pass filter and outputs the filtered reference data and the filtered plurality of images,

wherein the correction unit compares the reference data and each of the plurality of images output from the filtering unit to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

5. The stereoscopic imaging device according to claim 1, further comprising:

an acquisition unit that acquires set information when each of the plurality of images is captured; and

a determination unit that determines whether the shading correction by the correction unit is needed on the basis of the set information acquired by the acquisition unit,

wherein the correction unit corrects the shading of each of the plurality of images when the determination unit determines that the shading correction by the correction unit is needed.

6. The stereoscopic imaging device according to claim 2, further comprising:

an acquisition unit that acquires set information when each of the plurality of images is captured; and

a determination unit that determines whether the shading correction by the correction unit is needed on the basis of the set information acquired by the acquisition unit,

wherein the correction unit corrects the shading of each of the plurality of images when the determination unit determines that the shading correction by the correction unit is needed.

7. The stereoscopic imaging device according to claim 3, further comprising:

an acquisition unit that acquires set information when each of the plurality of images is captured; and

a determination unit that determines whether the shading correction by the correction unit is needed on the basis of the set information acquired by the acquisition unit,

wherein the correction unit corrects the shading of each of the plurality of images when the determination unit determines that the shading correction by the correction unit is needed.

8. The stereoscopic imaging device according to claim 4, further comprising:

an acquisition unit that acquires set information when each of the plurality of images is captured; and

a determination unit that determines whether the shading correction by the correction unit is needed on the basis of the set information acquired by the acquisition unit,

wherein the correction unit corrects the shading of each of the plurality of images when the determination unit determines that the shading correction by the correction unit is needed.

9. The stereoscopic imaging device according to claim 5,

wherein the set information includes imaging mode setting information indicating a stereoscopic image capture mode or a planar image capture mode, and

when the imaging mode setting information indicates the planar image capture mode, the determination unit determines that the shading correction by the correction unit is needed.

10. The stereoscopic imaging device according to claim 9,

wherein, when the imaging mode setting information indicates the stereoscopic image capture mode, the determination unit determines that the shading correction by the correction unit is not needed.

11. The stereoscopic imaging device according to claim 9,

wherein the set information includes aperture setting information, and

when the aperture setting information is closer to an aperture side than to a predetermined aperture value, the determination unit determines that the shading correction by the correction unit is needed.

12. The stereoscopic imaging device according to claim 11,

wherein the set information includes zoom position setting information, and

when the aperture setting information is closer to an opening side than to the predetermined aperture value and the zoom position setting information is closer to a wide side than to a predetermined zoom position, the determination unit determines that the shading correction by the correction unit is needed.

13. The stereoscopic imaging device according to claim 12, further comprising:

a filtering unit that filters the reference data and each of the plurality of images using a low-pass filter and outputs the filtered reference data and the filtered plurality of images,

wherein, when the aperture setting information is closer to the opening side than to the predetermined aperture value and the zoom position setting information is closer to a telephoto side than to the predetermined zoom position, the determination unit determines that the shading correction by the correction unit is needed, and

when the determination unit determines that the shading correction by the correction unit is needed, the correction unit compares the reference data and each of the plurality of images output from the filtering unit to determine the amount of shading correction for each of the plurality of images and corrects the shading of each of the plurality of images on the basis of the determined amount of shading correction.

14. A shading correction method that is performed by the stereoscopic imaging device according to claim 1 which outputs a plurality of images with a phase difference caused by pupil division for a beam emitted from a single imaging optical system and is capable of restoring a stereoscopic image with a parallax corresponding to the phase difference from the plurality of images, comprising:

composing the plurality of images and outputting reference data for shading correction on the basis of the composite image of the plurality of images; and

comparing the reference data output from the composition unit with each of the plurality of images to determine the amount of shading correction for each of the plurality of images and performing the shading correction on each of the plurality of images on the basis of the determined amount of shading correction.