3D imaging device and 3D imaging method

• US 9,128,367 B2
• Filed: 03/03/2011
• Issued: 09/08/2015
• Est. Priority Date: 03/05/2010
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Yamashita, Haruo, Ito, Takeshi, Ono, Hiromichi
• Primary Examiner(s): YENKE, BRIAN P
• Application Number:
  US13/582,050
• Publication Number:
  US 20120327191A1
• Time in Patent Office: 1,650 Days
• Field of Search: 348/46, 348/47, 348/49, 382/154, 359/462
• US Class Current: 1/1
• CPC Class Codes: G03B 21/56 Projection screens
• CPC Class Codes: G03B 21/58 collapsible, e.g. foldable; of variable area
• CPC Class Codes: G03B 21/62 Translucent screens
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof

Abstract

A 3D imaging device obtains a 3D image (3D video) that achieves an appropriate 3D effect and/or intended placement. The 3D imaging device estimates (calculates) an ideal disparity of a main subject based on a preset viewing environment (display condition) and a distance to the main subject, and obtains a disparity (an actual disparity) of the subject (main subject) actually occurring on a virtual screen. The 3D imaging device obtains a correction disparity using the ideal disparity and the actual disparity, and adds the calculated correction disparity to the 3D image (horizontally shifts the image) to perform appropriate disparity correction. The 3D imaging device obtains a 3D image (3D video) that achieves an appropriate 3D effect and/or intended placement without being affected by a disparity occurring in the horizontal direction caused by insufficient precision (in particular, insufficient optical precision).

Claims

1. A 3D imaging device for three-dimensionally imaging a subject and capturing a 3D image formed by a left eye image and a right eye image, the 3D imaging device comprising:

an imaging unit configured to capture the 3D image;

a distance information obtaining unit configured to obtain distance information indicating a distance from the 3D imaging device to the subject;

a condition obtaining unit configured to obtain an imaging condition under which the 3D image has been captured and a display condition under which the 3D image will be displayed;

an ideal disparity setting unit configured to set a disparity of the subject that will occur under the display condition as an ideal disparity, based on the obtained imaging condition and the obtained display condition;

an actual disparity obtaining unit configured to detect a disparity of the subject occurring in the captured 3D image as an actual disparity;

a disparity correction unit configured to perform disparity correction of the 3D image in a manner that the detected actual disparity is adjusted toward the set ideal disparity;

a display information setting unit configured to set at least a viewing distance L and a base-line length S as display parameters associated with a viewing environment in which the 3D image is displayed, the viewing distance L being a distance between a display screen to display the 3D image thereon and a base-line that is a straight line connecting a left eye point and a right eye point in the viewing environment, the base-line length S being a distance between the left eye point and the right eye point in the viewing environment;

wherein the condition obtaining unit sets a virtual screen at a position at which a distance to the subject matches the viewing distance L, and sets the imaging condition in a manner that a point of convergence is positioned on the virtual screen;

when free positioning imaging is designated by the condition obtaining unit, and a placement position of the subject set by the condition obtaining unit is at a distance R3 from the base-line,

the disparity correction unit calculates a correction disparity Δ

x using the formula;

Δ

x=x3−

x2, where x3 is the ideal disparity and x2 is the actual disparity, and

x3=S*(1−

L/R3), where S is the base-line length, and R3 is the distance from the base line to the placement position, the base-line being a straight line including the left eye point and the right eye point, and L is the distance from the base-line to the display screen, and;

the disparity correction unit performs disparity correction of the left eye image and the right eye image captured by the imaging unit by horizontally shifting the left eye image and the right eye image by an amount corresponding to the correction disparity Δ

x.

2. A 3D imaging method for three-dimensionally imaging a subject and capturing a 3D image formed by a left eye image and a right eye image, the method comprising:

capturing the 3D image;

obtaining distance information indicating a distance from an imaging point to the subject;

obtaining an imaging condition under which the 3D image has been captured and a display condition under which the 3D image will be displayed;

setting a disparity of the subject that will occur under the display condition as an ideal disparity based on the obtained imaging condition and the obtained display condition;

detecting a disparity of the subject occurring in the captured 3D image as an actual disparity;

performing disparity correction of the 3D image in a manner that the obtained actual disparity is adjusted toward the set ideal disparity;

setting at least a viewing distance L and a base-line length S as display parameters associated with a viewing environment in which the 3D image is displayed, the viewing distance L being a distance between a display screen to display the 3D image thereon and a base-line that is a straight line connecting a left eye point and a right eye point in the viewing environment, the base-line length S being a distance between the left eye point and the right eye point in the viewing environment;

setting a virtual screen at a position at which a distance to the subject matches the viewing distance L;

setting the imaging condition in a manner that a point of convergence is positioned on the virtual screen;

when free positioning is designated and when a placement position of the subject is set at a distance R3 from the base-line, calculating a correction disparity Δ

x using the formula;

Δ

x=x3−

x2, where x3 is the ideal disparity and x2 is the actual disparity, and

x3=S*(1−

L/R3), where S is the base-line length, and R3 is the distance from the base-line to the placement position, the base-line being a straight line including the left eye point and the right eye point, and L is the distance from the base-line to the display screen; and

;

performing disparity correction of the left eye image and the right eye image by horizontally shifting the left eye image and the right eye image by an amount corresponding to the correction disparity Δ

x.