STEREOSCOPIC SHOOTING DEVICE

• US 20140002612A1
• Filed: 09/03/2013
• Published: 01/02/2014
• Est. Priority Date: 01/20/2012
• Status: Abandoned Application

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: MORIOKA, Yoshihiro, YANO, Shuji, MATSUURA, Kenji, ASAI, Yoshimitsu, OKAWA, Keisuke, SOH, Shoji, KUBOTA, Kenichi, ONO, Yusuke
• Application Number:
  US14/016,465
• Publication Number:
  US 20140002612A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/133 Equalising the characteristics of different image components, e.g. their average brightness or colour balance
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2213/001 Constructional or mechanical details
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Abstract

A stereoscopic shooting device includes: a first and second shooting sections that obtain a first and second images, respectively; and an angle of view matching section. The angle of view matching section performs: calculating a vertical image area of the second image that has the same vertical direction range as the first image by comparing ratios of the vertical coordinates of respective representative points in image blocks selected from the first and second images, respectively; adjusting the number of horizontal lines included in the vertical image area of the second image and the number of horizontal lines included in the first image; outputting a first and second horizontal line signals representing the horizontal lines included in the first image and the vertical image area of the second image, respectively; and carrying out stereo matching by comparing the first and second horizontal line signals to each other.

Claims

1. A stereoscopic shooting device comprising:

a first shooting section having a zoom optical system and being configured to obtain a first image by shooting a subject;

a second shooting section configured to obtain a second image by shooting the subject; and

an angle of view matching section configured to cut respective image portions that would have the same angle of view out of the first and second images, the angle of view matching section including;

a vertical area calculating section configured to select a plurality of mutually corresponding image blocks that would have the same image feature from the first and second images and calculate a vertical image area of the second image that would have the same vertical direction range as the first image based on relative vertical positions of the image blocks in the respective images;

a number of horizontal lines matching section configured to adjust the number of horizontal lines included in the vertical image area of the second image that has been calculated by the vertical area calculating section and the number of horizontal lines included in the first image to a predetermined value and then output a signal representing the horizontal lines included in the first image as a first horizontal line signal and a signal representing the horizontal lines included in the vertical image area of the second image as a second horizontal line signal, respectively; and

a horizontal matching section configured to carry out stereo matching by comparing to each other the first and second horizontal line signals supplied from the number of horizontal lines matching section,

wherein the vertical area calculating section is configured to determine the vertical image area by comparing the ratio of the vertical coordinates of respective representative points in a plurality of image blocks selected from the first image to the ratio of the vertical coordinates of respective representative points in a plurality of image blocks selected from the second image.

2. The stereoscopic shooting device of claim 1, wherein the second shooting section obtains the second image by shooting the subject at a wider angle of view than an angle of view at which the first image is shot.

3. The stereoscopic shooting device of claim 1, wherein the horizontal matching section makes a gain adjustment in order to reduce a difference in average luminance value between at least one pair of mutually corresponding image areas in the first and second images to a preset value or less and then carries out the stereo matching.

4. The stereoscopic shooting device of claim 1, wherein the horizontal matching section carries out the stereo matching based on a cross-correlation between the signal representing the horizontal lines included in the vertical image area that has been calculated by the vertical area calculating section and the signal representing their corresponding horizontal lines in the first image.

5. The stereoscopic shooting device of claim 1, further comprising a parallax information generating section configured to generate parallax information based on the first and second horizontal line signals.

6. The stereoscopic shooting device of claim 5, further comprising an image generating section configured to generate, based on the parallax information and the first image, a third image that forms, along with the first image, a pair of stereoscopic images.

7. The stereoscopic shooting device of claim 1, wherein the vertical area calculating section further includes a rough cropping section configured to cut an area that corresponds to a range of the first image out of the second image by reference to information indicating the zoom power of the zoom optical system and/or information indicating the magnitude of shift between the optical axis of the zoom optical system and the center of an image sensor of the first shooting section, and

wherein the vertical area calculating section selects a plurality of image blocks from the area that has been cut out by the rough cropping section.

8. The stereoscopic shooting device of claim 1, wherein the vertical area calculating section further includes:

a first distortion correcting section configured to make correction on a distortion that has been caused by a lens distortion of the zoom optical system with respect to the first image; and

a second distortion correcting section configured to make correction on a different kind of distortion from the distortion according to the zoom power of the zoom optical system with respect to the second image, and

wherein the vertical area calculating section is configured to calculate the vertical image area of the second image that would have the same vertical direction range as the first image that has had its distortion corrected by the first distortion correcting section with respect to the second image that has had its distortion corrected by the second distortion correcting section.

9. The stereoscopic shooting device of claim 1, wherein the vertical area calculating section is configured to compare respective image features of the first and second images that are represented in multiple different resolutions and determine the plurality of image blocks based on a result of the comparison.

10. The stereoscopic shooting device of claim 1, wherein the horizontal matching section is configured to carry out the stereo matching by performing, on the same horizontal range, the processing of matching the respective numbers of pixels of the first and second horizontal line signals to each other.

11. A stereoscopic shooting device comprising:

a first shooting section having a zoom optical system and being configured to obtain a first image by shooting a subject;

a second shooting section configured to obtain a second image by shooting the subject; and

an angle of view matching section configured to cut respective image portions that would have the same angle of view out of the first and second images, the angle of view matching section configured to perform;

selecting a plurality of mutually corresponding image blocks that would have the same image feature from the first and second images;

calculating a vertical image area of the second image that would have the same vertical direction range as the first image based on relative vertical positions of the image blocks in the respective images by comparing the ratio of the vertical coordinates of respective representative points in a plurality of image blocks selected from the first image to the ratio of the vertical coordinates of respective representative points in a plurality of image blocks selected from the second image;

adjusting the number of horizontal lines included in the vertical image area of the second image and the number of horizontal lines included in the first image to a predetermined value;

outputting a signal representing the horizontal lines included in the first image as a first horizontal line signal and a signal representing the horizontal lines included in the vertical image area of the second image as a second horizontal line signal; and

carrying out stereo matching by comparing the first and second horizontal line signals to each other.