Image processing apparatus and method, image processing system and program

• US 8,878,944 B2
• Filed: 10/02/2013
• Issued: 11/04/2014
• Est. Priority Date: 11/02/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tokunaga, Nodoka, Oyaizu, Hideki, Myokan, Yoshihiro, Ogasawara, Hidehiko
• Primary Examiner(s): HSIA, SHERRIE Y
• Application Number:
  US14/044,215
• Publication Number:
  US 20140125819A1
• Time in Patent Office: 398 Days
• Field of Search: 348/187, 348/188, 348/135, 348/139, 348/182, 348/180
• US Class Current: 348/188
• CPC Class Codes: G01B 11/2513 with several lines being projected in more than one direction, e.g. grids, patterns
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06T 7/85 Stereo camera calibration
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/246 Calibration of cameras
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

There is provided an image processing apparatus including multiple imaging units included in a stereo camera, the multiple imaging units configured to photograph a chart pattern including a pole, and a correction parameter calculation unit configured to calculate a correction parameter that corrects a gap between the multiple imaging units, based on the pole and a pattern included in the chart pattern photographed by the multiple imaging units.

Claims

1. An image processing apparatus comprising:

multiple imaging units included in a stereo camera, the multiple imaging units configured to photograph a chart pattern including a pole; and

a correction parameter calculation unit configured to calculate a correction parameter that corrects a gap between the multiple imaging units, based on the pole and a pattern included in the chart pattern photographed by the multiple imaging units.

2. The image processing apparatus according to claim 1, wherein the pole includes a disk portion in a tip and a side shape of the tip is T-shaped.

3. The image processing apparatus according to claim 1, further comprising:

a pole detection unit configured to detect the pole included in the chart pattern photographed by the multiple imaging units;

a tilt detection unit configured to detect a tilt of the chart pattern based on the pole detected by the pole detection unit;

a detection unit configured to detect a feature point based on the pattern included in the chart pattern photographed by the multiple imaging units; and

a feature point correction unit configured to correct arrangement of the feature point detected by the detection unit, based on the tilt detected by the tilt detection unit,

wherein the correction parameter calculation unit calculates the correction parameter that corrects the gap between the multiple imaging units, based on information on the feature point whose arrangement is corrected by the feature point correction unit.

4. The image processing apparatus according to claim 1, wherein the chart pattern includes a box chart and a lattice point chart.

5. The image processing apparatus according to claim 1, wherein the pole is installed at a position protruding from the chart pattern.

6. The image processing apparatus according to claim 1, wherein the pole is formed of a disk portion and a prop portion.

7. The image processing apparatus according to claim 6, wherein the prop portion is installed at a position of chart pattern, and the disk portion is formed upon an end of the prop portion that is protruded from the chart pattern.

8. The image processing apparatus according to claim 1, wherein the chart pattern is a planar chart pattern.

9. The image processing apparatus according to claim 1, wherein the correction parameter calculation unit calculates the correction parameter that corrects the gap between the multiple imaging units, based on a shift amount of the pole and the pattern included in the chart pattern.

10. The image processing apparatus according to claim 1, wherein the chart pattern includes a plurality of poles.

11. An image processing method comprising:

photographing a chart pattern including a pole by multiple imaging units included in a stereo camera; and

calculating a correction parameter that corrects a gap between the multiple imaging units, based on the pole and a pattern included in the chart pattern photographed by the multiple imaging units.

12. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to perform a method, the method comprising:

photographing a chart pattern including a pole by multiple imaging units included in a stereo camera; and

calculating a correction parameter that corrects a gap between the multiple imaging units, based on the pole and a pattern included in the chart pattern photographed by the multiple imaging units.

13. An image processing system comprising:

an image processing apparatus configured to include multiple imaging units; and

a chart pattern configured to perform calibration in an imaging direction of each of the imaging units,

wherein the chart pattern is installed in a position facing the multiple imaging units and includes a pattern as a feature point and a pole, and

wherein the image processing apparatus includes the multiple imaging units that are included in a stereo camera and photograph the chart pattern, and a correction parameter calculation unit that calculates a correction parameter which corrects a gap between the multiple imaging units, based on the pole and a pattern included in the chart pattern photographed by the multiple imaging units.