Device for detecting a road traveling lane using an edge histogram

• US 7,583,816 B2
• Filed: 09/22/2004
• Issued: 09/01/2009
• Est. Priority Date: 09/24/2003
• Status: Expired due to Fees

• Current Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Original Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Inventors: Akita, Tokihiko, Kakinami, Toshiaki, Hiramaki, Takashi
• Primary Examiner(s): Werner; Brian P
• Assistant Examiner(s): DRENNAN, BARRY T
• Application Number:
  US10/572,957
• Publication Number:
  US 20070107965A1
• Time in Patent Office: 1,805 Days
• Field of Search: 382/103, 382/104, 382/106, 382/108, 382/181, 382/190, 382192-194, 382/202, 382168-172, 701/28
• US Class Current: 382/104
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30256 Lane; Road marking
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

A device for detecting a road traveling lane, which is capable of stably defining a position of a boundary of a traveling lane. The device has edge point detection means (ED) for detecting a plurality of edge points in a contour on an image, edge histogram producing means (HD) for producing a vertical edge histogram for horizontal elements of the plurality of edge points, block marking line determination means (BD) for determining presence and absence of a block-like marking line on the basis of periodicity of distribution and a combination of distributions of plus edges and minus edges in the vertical edge histogram, and lane boundary edge detection means (MD) for detecting vertical edge points present outside (relative to the center of the traveling lane) of a region where the block-like marking line is present. And, according to lane boundary position defining means (LD), it is so constituted to define a position of a curve fitted to the vertical edge points, as the position of the boundary of the traveling lane.

Claims

1. A device for detecting a road traveling lane, comprising:

image pickup means for picking up images on a road surface continuously,

edge point detection section for detecting a plurality of edge points in a contour on the image;

edge histogram producing section for producing a vertical edge histogram for horizontal elements of the plurality of edge points detected by said edge point detection section;

block marking line determination section for determining presence and absence of a block-like marking line on the basis of periodicity of distribution and a combination of distributions of plus edges and minus edges in the vertical edge histogram produced by said edge histogram producing section, and defining a region where said block-like marking line is present;

lane boundary edge detection section for detecting vertical edge points present outside of a center of said traveling lane, in the region where said block-like marking line defined by said block marking line determination section is present; and

lane boundary position defining section means-for defining a position of a curve fitted to the vertical edge points detected by said lane boundary edge detection section, as a position of a boundary of said traveling lane;

wherein said lane boundary edge detection section detects the edges of the lane boundary in an interval between neighboring block lines, on the basis of such a relationship that a vertical region between a peak of a plus edge histogram and a peak of a minus edge histogram corresponds to the interval between neighboring block lines, in said vertical edge histogram produced by said edge histogram producing section.

2. A device for detecting a road traveling lane as described in claim 1, wherein said edge point detection section detects the plurality of edge points on the image picked up by said image pickup means, and makes a reverse projection of coordinate data of the plurality of edge points on a 3-dimensional road surface coordinate, to produce said plurality of edge points.

3. A device for detecting a road traveling lane as described in claim 1, wherein said lane boundary position defining section applies a curve including a plurality of straight lines to the vertical edge points detected by said lane boundary edge detection section, to achieve a curve-fitting.

4. A device for detecting a road traveling lane as described in claim 3, wherein said lane boundary position defining section achieves said curve-fitting by means of one of RANSAC, Hough conversion and least square method.

5. A device for detecting a road traveling lane, comprising:

image pickup means for picking up images on a road surface continuously;

edge point detection section for detecting a plurality of edge points in a contour on the image;

vertical edge histogram producing section for producing a vertical edge histogram for horizontal elements of the plurality of edge points detected by said edge point detection section;

horizontal edge histogram producing section for producing a horizontal edge histogram for vertical elements of the plurality of edge points detected by said edge point detection section;

block marking line determination section for determining presence and absence of a block-like marking line on the basis of periodicity of distribution and a combination of distributions of plus edges and minus edges in both the vertical edge histogram produced by said vertical edge histogram producing section and the horizontal edge histogram producing by said horizontal edge histogram producing section; and

lane boundary position defining section for determining a plurality of vertical edge points, whose vertical edge histogram varies periodically in response to traveling of said vehicle, and which were determined to be closest to a center of said traveling lane on the basis of the horizontal edge histogram produced by said horizontal edge histogram producing section, and defining a position of a curve fitted to the plurality of edge points present outside of the center of said traveling lane, as a position of a boundary of said traveling lane.

6. A device for detecting a road traveling lane as described in claim 5, wherein said edge point detection section detects the plurality of edge points on the image picked up by said image pickup means, and makes a reverse projection of coordinate data of the plurality of edge points on a 3-dimensional road surface coordinate, to produce said plurality of edge points.

7. A device for detecting a road traveling lane as described in claim 5, wherein said lane boundary position defining section applies a curve including a plurality of straight lines to the vertical edge points detected by said lane boundary edge detection section, to achieve a curve-fitting.

8. A device for detecting a road traveling lane as described in claim 7, wherein said lane boundary position defining section achieves said curve-fitting by means of one of RANSAC, Hough conversion and least square method.