Apparatus and method for generating virtual lane, and system for controlling lane keeping of vehicle with the apparatus

• US 9,552,523 B2
• Filed: 12/26/2013
• Issued: 01/24/2017
• Est. Priority Date: 11/28/2013
• Status: Active Grant

• Current Assignee: Hyundai Mobis Co., Ltd.
• Original Assignee: Hyundai Mobis Co., Ltd.
• Inventors: Ryu, Kyung Jin, Hwang, Tae Hun, Lee, Kyu Hoon, You, Eun Young
• Primary Examiner(s): GIRMA, FEKADESELASS
• Application Number:
  US14/140,767
• Publication Number:
  US 20150145664A1
• Time in Patent Office: 1,125 Days
• Field of Search: 340/435, 340/439, 340/438, 340/431, 340/436, 340/471, 340/576, 340/905, 340/935, 340/988, 701/301, 701/1, 701/532, 701/533, 701/70, 701/93
• US Class Current: 1/1
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B62D 15/025 Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation B62D1/28 takes precedence
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

Disclosed are an apparatus and a method for generating a virtual lane, which correct or estimate an undetected lane depending on detection of a lane at each side and a system for controlling lane keeping of a vehicle with the apparatus. The apparatus for generating a virtual lane according to the present invention includes: a lane detection judging unit configured to judge whether both lanes of a front road are normally detected based on a front image; a lane correction unit configured to generate a virtual lane by correcting one lane based on the other lane when it is judged that the one lane of both lanes is not normally detected; and a lane estimation unit configured to generate the virtual lane by estimating both lanes based on previously detected lane information when it is judged that either lane is not normally detected.

Claims

1. An apparatus for generating a virtual lane, the apparatus comprising:

a lane detection judging unit configured to judge whether a first lane and a second lane of a front road are normally detected based on a front image;

a lane correction unit configured to generate, based on the judging, a virtual lane by correcting the first lane based on the second lane in response to the first lane being judged to not be normally detected; and

a lane estimation unit configured to generate, based on the judging, the virtual lane by estimating the first lane and the second lane based on detected lane information obtained prior to generation of the virtual lane in response to the first lane and the second lane being judged to not be normally detected,

wherein the lane estimation unit is configured to estimate the first lane and the second lane based on the detected lane information, which comprises first driving state information of a vehicle acquired from the front image and second driving state information of the vehicle acquired from sensors mounted on the vehicle,

wherein the first driving state information comprises an offset between the vehicle and the first lane and an offset between the vehicle and the second lane, a heading angle of the vehicle, and a curvature of the front road, and the second driving state information comprises a velocity and a yaw rate of the vehicle, and

wherein the lane detection judging unit is configured to judge whether the first lane and the second lane are normally detected based on a difference value between a change rate of the offset between the vehicle and the first lane and a change rate of the offset between the vehicle and the second lane.

2. The apparatus of claim 1, wherein the lane detection judging unit judges whether both lanes are normally detected based on the offset between the vehicle and the first lane and the offset between the vehicle and the second lane.

3. The apparatus of claim 1, wherein the lane detection judging unit is configured to judge whether the first lane and the second lane are normally detected based on the offset between the vehicle and the first lane and the offset between the vehicle and the second lane, the heading angle of the vehicle, and lane accuracy.

4. The apparatus of claim 1, wherein:

the difference value between the change rate of the offset between the vehicle and the first lane and the change rate of the offset between the vehicle and the second lane is a first difference value; and

the lane detection judging unit is configured to judge whether the first lane and the second lane are normally detected based on a second difference value between a left heading angle and a right heading angle of the vehicle, and a third difference value between a lane accuracy and a reference value.

5. The apparatus of claim 4, wherein the lane detection judging unit is configured to judge that the first lane and the second lane are normally detected when an index value acquired by substituting the first difference value, the second difference value, and the third difference value is equal to a first threshold value, judges that the first lane is not normally detected when the index value is more than the first threshold value or less than a second threshold value, and judges that the first lane and the second lane are not normally detected when the index value is more than the second threshold value.

6. The apparatus of claim 5, wherein the lane detection judging unit is configured to judge whether at least one of the first lane and the second lane is not normally detected based on a result of generating a previous virtual lane when the index value is equal to the second threshold value.

7. The apparatus of claim 1, wherein the lane correction unit is configured to correct the first lane based on the offset between the vehicle and the first lane and the offset between the vehicle and the second lane, the heading angle of the vehicle, and the curvature of the front road.

8. The apparatus of claim 7, wherein the lane correction unit is configured to correct the first lane by using a value, which is acquired by adding a lane width to an offset between the vehicle and the second lane, as an offset between the vehicle and the first lane when one side is the first lane and corrects the second lane by using a value, which is acquired by subtracting the lane width from the offset between the vehicle and the first lane, as an offset between the vehicle and the second lane when the one side is the second lane.

9. The apparatus of claim 7, wherein the lane correction unit is configured to correct the first lane so that the heading angles at both sides of the vehicle are the same as each other or corrects the first lane so that the curvatures of the first lane and the second lane are the same as each other on the front road.

10. A method for generating a virtual lane, the method comprising:

judging whether a first lane and a second lane of a front road are normally detected based on a front image;

generating, based on the judging, a virtual lane by correcting the first lane based on the second lane in response to the first lane being judged to not be normally detected; and

generating, based on the judging, the virtual lane by estimating the first lane and the second lane based on detected lane information obtained prior to generating the virtual lane in response to the first lane and the second lane being judged to not be normally detected,

wherein the estimating is based on the detected lane information, which comprises first driving state information of a vehicle acquired from the front image and second driving state information of the vehicle acquired from sensors mounted on the vehicle, and

wherein the first driving state information comprises an offset between the vehicle and the first lane and an offset between the vehicle and the second lane, a heading angle of the vehicle, and a curvature of the front road, and the second driving state information comprises a velocity and a yaw rate of the vehicle, and

wherein the lane detection judging unit is configured to judge whether the first lane and the second lane are normally detected based on a difference value between a change rate of the offset between the vehicle and the first lane and a change rate of the offset between the vehicle and the second lane.

11. The method of claim 10, wherein in the judging of whether the first lane and the second lane of the front road are normally detected based on the front image,

it is judged whether the first lane and the second lane are normally detected based on the offset between the vehicle and the first lane and the offset between the vehicle and the second lane, the heading angle of the vehicle, and lane accuracy.

12. The method of claim 10, wherein in the generating of the virtual lane by correcting first lane based on the second lane when it is judged that the first lane is not normally detected,

the first lane is corrected based on the offset between the vehicle and the first lane and the offset between the vehicle and the second lane, the heading angle of the vehicle, and the curvature of the front road.

13. A system for controlling lane keeping of a vehicle, the system comprising:

a lane detection judging unit configured to judge whether a first lane and a second lane of a front road are normally detected based on a front image;

a lane detection unit configured to acquire a lane normally detected from the front image;

a lane correction unit configured to generate, based on the judging, a virtual lane by correcting the first lane based on the second lane in response to the first lane being judged to not be normally detected;

a lane estimation unit configured to generate, based on the judging, the virtual lane by estimating the first lane and the second lane based on detected lane information obtained prior to generation of the virtual lane in response to the first lane and the second lane being judged to not be normally detected;

a steering torque calculating unit configured to calculate steering torque for controlling the vehicle based on driving state information of the first lane and the second lane and the vehicle acquired by at least one method of detection, correction, and estimation; and

a lane keeping control unit configured to control the lane keeping of the vehicle based on the steering torque,

wherein the lane estimation unit is configured to estimate the first lane and the second lane based on the detected lane information, which comprises first driving state information of the vehicle acquired from the front image and second driving state information of the vehicle acquired from sensors mounted on the vehicle, and

wherein the first driving state information comprises an offset between the vehicle and the first lane and the offset between the vehicle and the second lane, a heading angle of the vehicle, and a curvature of the front road, and the second driving state information comprises a velocity and a yaw rate of the vehicle, and

wherein the lane detection judging unit is configured to judge whether the first lane and the second lane are normally detected based on a difference value between a change rate of the offset between the vehicle and the first lane and a change rate of the offset between the vehicle and the second lane.