Object detecting apparatus in which the position of a planar object is estimated by using hough transform

• US 5,825,915 A
• Filed: 08/30/1996
• Issued: 10/20/1998
• Est. Priority Date: 09/12/1995
• Status: Expired due to Fees

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Michimoto, Yasuyuki, Nishizawa, Masato, Onda, Katsumasa
• Primary Examiner(s): Moore, David K.
• Assistant Examiner(s): Werner, Brian P.
• Application Number:
  US08/704,895
• Time in Patent Office: 781 Days
• Field of Search: 382/103, 382/104, 382/105, 382/106, 382/154, 382/173, 382/266, 382/281, 382/291, 356/3.14, 356/376, 348/116, 348/118, 348/119, 348/120
• US Class Current: 382/154
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

Based on left and right images that have been taken by image pickup devices, a correlation processing section obtains parallax data as three-dimensional data of objects. At processing start time, a plane estimating section estimates the position of a planar object such as a road or a floor by utilizing the Hough transform based on the parallax data that have been obtained successfully for part of rectangular segments of the images, and interpolates the parallax data by using the position of the planar object. At a time point after the processing start time, a parallax variation detecting section detects an object by comparing current parallax data with the parallax data at the processing start time.

Claims

1. A plane estimating method comprising the steps of:

receiving a plurality of images that are produced by a plurality of image pickup means disposed at a predetermined interval;

calculating three-dimensional data S(X, Y);

1≦

X≦

M, 1≦

Y≦

N for each of rectangular segments obtained by dividing the received images into a plurality of M parts in a horizontal direction and into a plurality of N parts in a vertical direction through correlation between the received images;

determining a plane passage straight line L(Y) by performing Hough transform on M three-dimensional data corresponding to rectangular segments belonging to a horizontal area GL(Y) of the received images;

performing the determining step on all horizontal areas GL(Y), 1≦

Y≦

N, to thereby determine N plane passage straight lines L(Y), 1≦

Y≦

N; and

estimating a position of a planar object in a three-dimensional space based on the N plane passage straight lines L(Y), 1≦

Y≦

N.

2. The plane estimating method according to claim 1, further comprising the steps of:

calculating an angle θ

(Y) of a perpendicular to both of a Y axis and each of the N plane passage straight lines L(Y), 1≦

Y≦

N, to obtain N angles θ

(Y), 1≦

Y≦

N;

calculating a central angle value θ

_R of the N angles θ

(Y), 1≦

Y≦

N; and

replacing all of the angles θ

(Y), 1≦

Y≦

N with the central angle value θ

_R, to obtain N angle-corrected plane passage straight lines L'"'"'(Y), 1≦

Y≦

N,

wherein the estimating step estimates the position of the planar object based on the N angle-corrected plane passage straight lines L'"'"'(Y), 1≦

Y≦

N.

3. The plane estimating method according to claim 2, further comprising the steps of:

calculating a distance ρ

(Y) between the origin of a coordinate system of the three-dimensional data S(X, Y) and each of the N angle-corrected plane passage straight lines L'"'"'(Y), 1≦

Y≦

N, to obtain N distances ρ

(Y), 1≦

Y≦

N;

determining a distance correction line by performing Hough transform on the N distances ρ

(Y), 1≦

Y≦

N; and

translating the N angle-corrected plane passage straight lines L'"'"'(Y), 1≦

Y≦

N so that they intersect the distance correction line, to obtain N distance-corrected plane passage straight lines L"(Y), 1≦

Y≦

N,

wherein the estimating step estimates the position of the planar object based on the N distance-corrected plane passage straight lines L"(Y), 1≦

Y≦

N.

4. An object detecting apparatus comprising:

a plurality of image pickup means disposed at a predetermined interval, for producing a plurality of received images;

a correlation processing section for producing three-dimensional data of objects according to triangulation through correlation between the plurality of received images;

a plane estimating section for estimating a position of a planar object in a three-dimensional space by performing Hough transformation on the three-dimensional data

wherein said three-dimensional data S(X, Y) are calculated;

1≦

X≦

M, 1≦

Y≦

N, for each rectangular segment obtained by dividing the received images into a plurality of M parts in a horizontal direction and into a plurality of N parts in a vertical direction through correlation between the received images;

a plane passage straight line L(Y) is determined by performing Hough transform on M three-dimensional data corresponding to rectangular segments belonging to a horizontal area GL(Y) of the received images;

a plurality of N plane passage straight lines L(Y), 1≦

Y≦

N, are determined on all horizontal areas GL(Y), 1≦

Y≦

N; and

,

a position of a planar object in three-dimensional space is estimated on the N plane passage straight lines L(Y).

5. An object detecting apparatus comprising:

a plurality of image pickup means disposed at a predetermined interval, for producing a plurality of received images;

means for producing three-dimensional data of objects for respective rectangular segments of the plurality of received images;

a plane estimating section for estimating a position of a planar object in a three-dimensional space based on the three-dimensional data;

means for producing, by using the position of the planar object, three-dimensional data for part of the rectangular segments for which three-dimensional data could not be produced, to obtain interpolated three-dimensional data; and

means for detecting an object that is located at a position different than the planar object when viewed from the plurality of image pickup means based on the interpolated three-dimensional data

wherein said three-dimensional data S(X, Y) are calculated;

1≦

X≦

M, 1≦

Y≦

N, for each rectangular segment obtained by dividing the received images into a plurality of M parts in a horizontal direction and into a plurality of N parts in a vertical direction through correlation between the received images;

a plane passage straight line L(Y) is determined by performing Hough transform on M three-dimensional data corresponding to rectangular segments belonging to a horizontal area GL(Y) of the received images;

a plurality of N plane passage straight lines L(Y), 1≦

Y≦

N, are determined on all horizontal areas GL(Y), 1≦

Y≦

N; and

,

a position of a planar object in three-dimensional space is estimated on the N plane passage straight lines L(Y).

6. An object detecting apparatus comprising:

a plurality of image pickup means disposed at a predetermined interval, for producing a plurality of received images;

means for estimating a position of a planar object in a three-dimensional space based on the plurality of received images; and

means for producing three-dimensional data of an object except for an object that is more distant from the plurality of image pickup means than the planar object is

wherein said three-dimensional data S(X, Y) are calculated;

1≦

X≦

M, 1≦

Y≦

N, for each rectangular segment obtained by dividing the received images into a plurality of M parts in a horizontal direction and into a plurality of N parts in a vertical direction through correlation between the received images;

a plane passage straight line L(Y) is determined by performing Hough transform on M three-dimensional data corresponding to rectangular segments belonging to a horizontal area GL(Y) of the received images;

a plurality of N plane passage straight lines L(Y), 1≦

Y≦

N, are determined on all horizontal areas GL(Y), 1≦

Y≦

N; and

,

a position of a planar object in three-dimensional space is estimated on the N plane passage straight lines L(Y).