Plane detector and detecting method

• US 8,180,100 B2
• Filed: 08/11/2005
• Issued: 05/15/2012
• Est. Priority Date: 08/11/2004
• Status: Expired due to Fees

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company), Tokyo Institute of Technology (National University Corporation Tokyo Institute of Technology)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company), Tokyo Institute of Technology (National University Corporation Tokyo Institute of Technology)
• Inventors: Okutomi, Masatoshi, Fujimaki, Tomo
• Primary Examiner(s): ENTEZARI, MICHELLE M
• Application Number:
  US11/659,913
• Publication Number:
  US 20080253606A1
• Time in Patent Office: 2,469 Days
• Field of Search: None
• US Class Current: 382/100
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/85 Stereo camera calibration
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication

Abstract

A rotation matrix and a translation vector between a basic camera and a reference camera are read out from a parameter storage section. At a projection conversion matrix calculating section, a projection conversion matrix capable of overlapping the road plane area included in images picked up by the basic camera and the reference camera is calculated by using the rotation matrix and the translation vector.

Claims

1. A plane detecting apparatus for detecting a plane from a captured image with capturing units, comprising:

a pair of image capturing units located in a predetermined positional relationship, for capturing images of a mutually overlapping area containing a plane;

a parameter storing unit for storing, as parameters, a rotation matrix and a translation vector for transforming one of coordinate systems of said pair of said image capturing units into another coordinate system, internal parameters of said pair of said image capturing units, an initial value of a normal vector of said plane and an initial value of a distance from one image capturing unit of said image capturing units, as a base, to said plane; and

a projection transformation matrix estimating unit for changing said initial value of said normal vector and said initial value of said distance based on a density gradient method by use of said rotation matrix, said translation vector and said internal parameters to estimate a projection transformation matrix for overlapping planes contained in a stereo image captured by said pair of said image capturing units, onto each other; and

a projection transformation matrix calculating unit for calculating the projection transformation matrix, said projection transformation matrix transforming one of said images captured by one image capturing unit to overlap said plane contained in said one image onto a plane contained in another of said images captured by another image capturing unit, by use of said rotation matrix and said translation vector;

wherein said plane is detected using said projection transformation matrix.

2. A plane detecting apparatus according to claim 1, further comprising a plane parameter calculating unit for calculating plane parameters comprising a normal vector of said plane and a distance from one of said image capturing units as a base to said plane, and wherein said projection transformation matrix calculating unit calculates said projection transformation matrix by use of said rotation matrix, said translation vector, said normal vector and said distance.

3. A plane detecting apparatus according to claim 1, wherein said image capturing units are fixed to a mobile object.

4. A plane detecting apparatus according to claim 1, further comprising a plane area extracting unit for extracting a plane area based on a differential image between a projectively transformed image obtained by transforming the one image captured by the one image capturing unit with said projection transformation matrix and the other image captured by the other image capturing unit.

5. A plane detecting apparatus for detecting a plane from a captured image with image capturing units, comprising:

a pair of image capturing units located in a predetermined positional relationship, for capturing images of a mutually overlapping area containing a plane;

a parameter storing unit for storing, as parameters, a rotation matrix and a translation vector for transforming one of coordinate systems of said pair of said image capturing units into another coordinate system, internal parameters of said pair of said image capturing units, an initial value of a normal vector of said plane and an initial value of a distance from one image capturing unit of said image capturing units, as a base, to said plane; and

a projection transformation matrix estimating unit for changing said initial value of said normal vector and said initial value of said distance based on a density gradient method by use of said rotation matrix, said translation vector and said internal parameters to estimate a projection transformation matrix for overlapping planes contained in a stereo image captured by said pair of said image capturing units, onto each other,

wherein said plane is detected using said projection transformation matrix.

6. A plane detecting apparatus according to claim 5, further comprising

a plane parameter estimating unit for estimating plane parameters comprising said normal vector of said plane and said distance from one of said image capturing units as a base to said plane, and

wherein said plane parameter estimating unit estimates said plane parameters by use of amounts of changes of said normal vector and said distance changed when said projection transformation matrix has been estimated by said projection transformation matrix estimating unit, with respect to said initial values of said normal vector and said distance stored in said parameter storing unit.

7. A plane detecting apparatus according to claim 5, wherein said initial values of said normal vector and said distance are initial values in a state where a mobile object with said pair of said image capturing units fixed thereto is held at rest.

8. A plane detecting apparatus according to claim 5, further comprising a spatial position calculating unit for calculating a spatial position of said plane, using said plane parameters estimated by said plane parameter estimating unit.

9. A plane detecting method for detecting a plane from a captured image with image capturing units, comprising:

capturing images of a mutually overlapping area containing a plane by use of a pair of image capturing units located in a predetermined positional relationship;

storing, as parameters, a rotation matrix and a translation vector for transforming one of coordinate systems of said pair of said image capturing units into another coordinate system, internal parameters of said pair of said image capturing units, an initial value of a normal vector of said plane and an initial value of a distance from one image capturing unit of said image capturing units, as a base, to said plane;

changing said initial value of said normal vector and said initial value of said distance based on a density gradient method by use of said rotation matrix, said translation vector and said internal parameters to estimate a projection transformation matrix for overlapping planes contained in a stereo image captured by said pair of said image capturing units, onto each other; and

calculating the projection transformation matrix for transforming one of said images captured by one image capturing unit of said pair of said image capturing units to overlap said plane contained in the one image onto a plane contained in another image captured by another image capturing unit, by use of the rotation matrix and translation vector for transforming one coordinate system of one image capturing unit into another coordinate system of another image capturing unit, wherein said plane is detected using said projection transformation matrix.

10. A plane detecting method according to claim 9, wherein, using said rotation matrix, said translation vector, said internal parameters of said pair of said image capturing units, a normal vector of said plane and a distance from the one image capturing unit as a base to said plane, said projection transformation matrix is defined as