DEVICE, METHOD AND PROGRAM FOR DETERMINING OBSTACLE WITHIN IMAGING RANGE DURING IMAGING FOR STEREOSCOPIC DISPLAY

• US 20130113888A1
• Filed: 12/28/2012
• Published: 05/09/2013
• Est. Priority Date: 06/30/2010
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: KOGUCHI, Takehiro
• Application Number:
  US13/729,917
• Publication Number:
  US 20130113888A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/811 by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor

Abstract

An obstacle determining unit obtains predetermined index values for each of subranges of each imaging range of each imaging unit, compares the index values of the subranges at mutually corresponding positions in the imaging ranges of the different imaging units, and if a difference between the index values in the imaging ranges of the different imaging units is large enough to satisfy a predetermined criterion, determines that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.

Claims

1. A stereoscopic imaging device comprising:

a plurality of imaging units for capturing a subject and outputting captured images, the imaging units including imaging optical systems positioned to allow stereoscopic display of the subject using the captured images outputted from the imaging units, wherein each imaging unit performs photometry at a plurality of points or areas in an imaging range thereof to determine an exposure for capturing the image using photometric values obtained by the photometry;

an index value obtaining unit for obtaining the photometric value as an index value for each of a plurality of subranges of the imaging range of each imaging unit;

an obstacle determining unit for comparing the index values of each set of the subranges at mutually corresponding positions in the imaging ranges of the different imaging units with each other, and if a difference between the index values in the imaging ranges of the different imaging units is large enough to satisfy a predetermined criterion, determining that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units;

a macro imaging mode setting unit for setting a macro imaging mode that provides imaging conditions suitable for capturing the subject at a position close to the stereoscopic imaging device; and

a unit for exerting a control such that the determination is not performed when the macro imaging mode is set.

2. The stereoscopic imaging device as claimed in claim 1, wherein the imaging units outputs images captured by actual imaging and outputs images captured by preliminary imaging that is performed prior to the actual imaging for determining imaging conditions for the actual imaging, and the index value obtaining unit obtains the index values in response to the preliminary imaging.

3. The stereoscopic imaging device as claimed in claim 1, wherein each imaging unit performs focus control of the imaging optical system of the imaging unit based on AF evaluation values at the plurality of points or areas in the imaging range thereof, and

the index value obtaining unit obtains the AF evaluation value as an additional index value for each of the subranges of the imaging range of each imaging unit.

4. The stereoscopic imaging device as claimed in claim 1, wherein the index value obtaining unit extracts an amount of a high spatial frequency component that is high enough to satisfy predetermined criterion from each of the captured images, and obtains the amount of each of the subranges of the high frequency component as an additional index value.

5. The stereoscopic imaging device as claimed in claim 1, wherein each imaging unit performs automatic white balance control of the imaging unit based on color information values at the plurality of points or areas in the imaging range thereof, and

the index value obtaining unit obtains the color information value as an additional index value for each of the subranges of the imaging range of each imaging unit.

6. The stereoscopic imaging device as claimed in claim 1, wherein the index value obtaining unit calculates a color information value for each of the subranges from each of the captured images, and obtains the color information value as an additional index value.

7. The stereoscopic imaging device as claimed in claim 1, wherein each of the subranges includes two or more of the plurality of points or areas therein, and

the index value obtaining unit calculates the index value for each subrange based on the index values at the points or areas in the subrange.

8. The stereoscopic imaging device as claimed in claim 1, wherein a central area of each imaging range is not processed by the index value obtaining unit and/or the obstacle determining unit.

9. The stereoscopic imaging device as claimed in claim 3, wherein the obstacle determining unit performs the comparison based on two or more types of the index values, and if a difference based on at least one of the index values is large enough to satisfy a predetermined criterion, determines that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.

10. The stereoscopic imaging device as claimed in claim 4, wherein the obstacle determining unit performs the comparison based on two or more types of the index values, and if a difference based on at least one of the index values is large enough to satisfy a predetermined criterion, determines that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.

11. The stereoscopic imaging device as claimed in claim 5, wherein the obstacle determining unit performs the comparison based on two or more types of the index values, and if a difference based on at least one of the index values is large enough to satisfy a predetermined criterion, determines that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.

12. The stereoscopic imaging device as claimed in claim 6, wherein the obstacle determining unit performs the comparison based on two or more types of the index values, and if a difference based on at least one of the index values is large enough to satisfy a predetermined criterion, determines that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.

13. The stereoscopic imaging device as claimed in claim 1 further comprising a notifying unit, wherein, if it is determined that an obstacle is contained in the imaging range, the notifying unit notifies to that effect.

14. The stereoscopic imaging device as claimed in claim 1, wherein the obstacle determining unit controls a correspondence between positions in the imaging ranges to provide a parallax of substantially 0 of a main subject in the captured images outputted from the imaging units, and then, compares the index values of each set of the subranges at mutually corresponding positions in the imaging ranges of the different imaging units with each other.

15. The stereoscopic imaging device as claimed in claim 1 further comprising:

a unit for calculating a subject distance, the subject distance being a distance from the imaging unit to the subject; and

a unit for exerting a control such that the determination is not performed if the subject distance is smaller than a predetermined threshold.

16. The stereoscopic imaging device as claimed in claim 1 further comprising:

a unit for identifying any of the captured images containing the obstacle and identifying an area containing the obstacle in the identified captured image based on the index values if it is determined by the obstacle determining unit that the obstacle is contained; and

a unit for changing an area of the captured image not identified to contain the obstacle corresponding to the identified area of the identified captured image such that the area corresponding to the identified area has a same pixel value as that of the identified area.

17. An obstacle determination device comprising:

an index value obtaining unit for obtaining, from a plurality of captured images for stereoscopically displaying a main subject obtained by capturing the main subject from different positions using imaging units, or from accompanying information of the captured images, photometric values at a plurality of points or areas in each imaging range for capturing each captured image as index values for each of subranges of the imaging range, the photometric values being obtained by photometry for determining an exposure for capturing the image;

a determining unit for comparing the index values of each set of the subranges at mutually corresponding positions in the imaging ranges of the different plurality of captured images with each other, and if a difference between the index values in the imaging ranges of the different plurality of captured images is large enough to satisfy a predetermined criterion, determining that the imaging range of at least one of the captured images contains an obstacle that is close to an imaging optical system of the imaging unit;

a macro imaging mode determining unit for determining, based on the accompanying information of the captured images, whether or not the captured images are captured using a macro imaging mode that provides imaging conditions suitable for capturing a subject at a position close to the stereoscopic imaging device; and

a unit for exerting a control such that, if it is determined that the captured images are captured using the macro imaging mode, the determination by the determining means is not performed.

18. An obstacle determining method for use with a stereoscopic imaging device including a plurality of imaging units for capturing a subject and outputting captured images, the imaging units including imaging optical systems positioned to allow stereoscopic display of the subject using the captured images outputted from the imaging units, the method being used to determine whether or not an obstacle is contained in an imaging range of at least one of the imaging units,

wherein each imaging unit performs photometry at a plurality of points or areas in the imaging range thereof to determine an exposure for capturing the image using photometric values obtained by the photometry, and

the method comprises the steps of:

obtaining the photometric value as an index value for each of a plurality of subranges of the imaging range of each imaging unit;

determining whether or not a macro imaging mode that provides imaging conditions suitable for capturing the subject at a position close to the stereoscopic imaging device is set for the stereoscopic imaging device; and

if it is determined that the macro imaging mode is not set, comparing the index values of each set of the subranges at mutually corresponding positions in the imaging ranges of the different imaging units with each other, and if a difference between the index values in the imaging ranges of the different imaging units is large enough to satisfy a predetermined criterion, determining that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.