Vehicle lane keep assist system

• US 9,340,227 B2
• Filed: 08/12/2013
• Issued: 05/17/2016
• Est. Priority Date: 08/14/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Bajpai, Devendra
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): Nolan, Peter D
• Application Number:
  US13/964,134
• Publication Number:
  US 20140052340A1
• Time in Patent Office: 1,009 Days
• US Class Current: 1/1
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B62D 15/025 Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation B62D1/28 takes precedence
• CPC Class Codes: B62D 6/00 Arrangements for automatically controlling steering depending on driving conditions sensed and responded to, e.g. control circuits means for initiating a change in direction B62D1/00; steering valves B62D5/06; combined with means for inclining the vehicle body or wheels on bends B62D9/00

Abstract

A lane keep assist system for a vehicle includes a forward facing camera and an image processor. The forward facing camera is disposed at a vehicle and has a forward field of view exterior of the vehicle. The image processor is operable to process image data captured by the forward facing camera. The lane keep assist system is operable to process image data to determine lane markers in the field of view and to determine a time to lane crossing value. The lane keep assist system determines a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm. The lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values.

Claims

1. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values; and

wherein said lane keep assist system is operable to at least one of (i) combine said first and second time to lane crossing values to provide a more accurate estimation of the time to lane crossing and (ii) average said first and second time to lane crossing values to provide a more accurate estimation of the time to lane crossing.

2. The lane keep assist system of claim 1, wherein said lane keep assist system is operable to determine a time period during which said lane keep assist system can determine lane markers ahead of the vehicle, and wherein said lane keep assist system is operable to adjust said steering signal responsive to a change in the determined time period.

3. The lane keep assist system of claim 1, wherein said lane keep assist system is operable to adjust application of the steering signal responsive to how far ahead said lane keep assist system can track lane markers.

4. The lane keep assist system of claim 1, further comprising a rearward facing camera disposed at the vehicle and having a rearward field of view exterior of the vehicle, wherein said image processor is operable to process image data captured by said rearward facing camera.

5. The lane keep assist system of claim 1, further comprising a plurality of exterior facing cameras disposed at the vehicle and having respective exterior fields of view exterior of the vehicle, wherein said image processor is operable to process image data captured by said plurality of exterior facing cameras, and wherein said plurality of exterior facing cameras comprise at least (i) a rearward facing camera having a rearward field of view, (ii) a left sideward facing camera disposed at the left side of the vehicle and having a left sideward field of view and (iii) a right sideward facing camera disposed at the right side of the vehicle and having a right sideward field of view.

6. The lane keep assist system of claim 1, wherein said at least one other vehicle sensor comprises at least one of a vehicle speed sensor and a vehicle steering angle sensor.

7. The lane keep assist system of claim 1, wherein said lane keep assist system is operable to (i) determine an anticipated position of the vehicle a determined time in the future, (ii) determine an anticipated position of the left lane marking a determined time in the future and (iii) determine an anticipated position of the right lane marking a determined time in the future.

8. The lane keep assist system of claim 7, wherein, responsive to determining the anticipated positions, said lane keep assist system is operable to adjust the applied steering signal.

9. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values;

wherein said lane keep assist system is operable to (i) determine an anticipated position of the vehicle a determined time in the future, (ii) determine an anticipated position of the left lane marking a determined time in the future and (iii) determine an anticipated position of the right lane marking a determined time in the future; and

wherein said lane keep assist system is operable, responsive to processing of captured image data by said image processor, to adjust the determined time period.

10. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values; and

wherein application of the steering signal by said lane keep assist system is limited when said lane keep assist system determines that the vehicle is within a threshold distance of the determined lane markers.

11. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values; and

wherein, responsive to determination of the time to lane crossing values, said lane keep assist system is operable to determine a time to lane crossing gain factor, and wherein said lane keep assist system is operable to adjust the applied steering signal responsive to the determined time to lane crossing gain factor.

12. The lane keep assist system of claim 11, wherein, responsive to an increase in the determined time to lane crossing, said lane keep assist system increases the time to lane crossing gain factor.

13. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said at least one other vehicle sensor comprises at least one of a vehicle speed sensor and a vehicle steering angle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values;

wherein said lane keep assist system is operable to (i) determine an anticipated position of the vehicle a determined time in the future, (ii) determine an anticipated position of the left lane marking a determined time in the future and (iii) determine an anticipated position of the right lane marking a determined time in the future;

wherein, responsive to determining the anticipated positions, said lane keep assist system is operable to adjust the applied steering signal; and

wherein, responsive to determination of the time to lane crossing values, said lane keep assist system is operable to determine a time to lane crossing gain factor, and wherein said lane keep assist system is operable to adjust the applied steering signal responsive to the determined time to lane crossing gain factor.

14. The lane keep assist system of claim 13, wherein said lane keep assist system is operable to determine a time period during which said lane keep assist system can determine lane markers ahead of the vehicle, and wherein said lane keep assist system is operable to adjust said steering signal responsive to a change in the determined time period.

15. The lane keep assist system of claim 13, wherein said lane keep assist system is operable to adjust application of the steering signal responsive to how far ahead said lane keep assist system can track lane markers.

16. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values;

wherein said lane keep assist system is operable to determine a time period during which said lane keep assist system can determine lane markers ahead of the vehicle, and wherein said lane keep assist system is operable to adjust said steering signal responsive to a change in the determined time period;

wherein said lane keep assist system is operable to adjust application of the steering signal responsive to how far ahead said lane keep assist system can track lane markers; and

wherein application of the steering signal by said lane keep assist system is limited when said lane keep assist system determines that the vehicle is within a threshold distance of the determined lane markers.

17. A lane keep assist system for a vehicle, said lane keep assist system comprising:

a forward facing camera disposed at a vehicle and having a forward field of view exterior of the vehicle;

an image processor operable to process image data captured by said forward facing camera;

wherein said lane keep assist system is operable to process image data to determine lane markers in said field of view and to determine at least one time to lane crossing value;

wherein said lane keep assist system is operable to determine a first time to lane crossing value via a first algorithm and a second time to lane crossing value via a second algorithm;

wherein said first algorithm determines the first time to lane crossing value responsive to image processing of captured image data by said image processor;

wherein said second algorithm determines the second time to lane crossing value responsive to signals from at least one other vehicle sensor;

wherein said lane keep assist system is operable to apply a steering signal to adjust the steering of the vehicle at least in part responsive to the determined first and second time to lane crossing values;

wherein said lane keep assist system is operable to determine a time period during which said lane keep assist system can determine lane markers ahead of the vehicle, and wherein said lane keep assist system is operable to adjust said steering signal responsive to a change in the determined time period;

wherein said lane keep assist system is operable to adjust application of the steering signal responsive to how far ahead said lane keep assist system can track lane markers; and

wherein, responsive to determination of the time to lane crossing values, said lane keep assist system is operable to determine a time to lane crossing gain factor, and wherein said lane keep assist system is operable to adjust the applied steering signal responsive to the determined time to lane crossing gain factor.