Lane keeping system using rear camera

• US 8,494,716 B1
• Filed: 06/04/2012
• Issued: 07/23/2013
• Est. Priority Date: 06/04/2012
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Litkouhi, Bakhtiar Brian, Lee, Jin-Woo
• Primary Examiner(s): Algahaim, Helal A
• Application Number:
  US13/487,303
• Time in Patent Office: 414 Days
• Field of Search: 701/23, 701/41, 701/44, 701/93, 701/96, 701/301, 382/103, 382/276
• US Class Current: 701/41
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means

Abstract

Method for controlling a vehicle to maintain a desired position on a roadway includes monitoring roadway information behind the vehicle using a rearward detection device and monitoring vehicle sensor information. Frontward positional information is projected based on rearward positional information obtained from the monitored roadway information behind the vehicle. Forward roadway curvature is estimated based on the vehicle sensor information. Roadway information ahead of the vehicle is modeled based on the projected frontward positional information and the estimated forward roadway curvature to determine desired vehicle positional information. Future vehicle positional information is predicted with respect to the modeled roadway information based on the monitored vehicle sensor information and the estimated forward roadway curvature. The desired vehicle position information is compared to the predicted future vehicle positional information and a steering command is generated based on a deviation in the predicted future position information from the desired vehicle positional information.

Claims

1. Method for controlling a vehicle to maintain a desired position on a roadway, comprising:

monitoring roadway information behind the vehicle using a rearward detection device;

monitoring vehicle sensor information;

projecting frontward positional information employing a frontward positional information module and based on rearward positional information obtained from the monitored roadway information behind the vehicle, wherein projecting the frontward positional information based on rearward positional information obtained from the monitored roadway information behind the vehicle comprises;

obtaining a vehicle rearward lateral offset from the monitored roadway information and a vehicle rearward heading angle with respect to the monitored roadway information,

applying geometric relationships to the obtained vehicle rearward lateral offset and the vehicle rearward heading angle to compensate for geometric delay, and

projecting a vehicle frontward lateral offset from frontward roadway information and a vehicle frontward heading angle with respect to frontward roadway information based on the geometric relationships applied to the obtained vehicle rearward lateral offset and the vehicle rearward heading angle;

estimating forward roadway curvature based on the monitored vehicle sensor information;

modeling roadway information ahead of the vehicle based on the projected frontward positional information and the estimated forward roadway curvature to determine desired vehicle positional information with respect to the modeled roadway information;

predicting future vehicle positional information with respect to the modeled roadway information based on the monitored vehicle sensor information and the estimated forward roadway curvature;

comparing the desired vehicle positional information to the predicted future vehicle positional information; and

generating a steering command based on a deviation in the predicted future vehicle positional information from the desired vehicle positional information to converge the predicted future vehicle positional information toward the desired vehicle positional information.

2. The method of claim 1 wherein the rearward detection device comprises a rearward camera.

3. The method of claim 1 wherein the rearward detection device comprises at least one of a rearward camera, a rearward lidar device, a rearward laser device, a rearward radar device, vehicle-to-vehicle information, a GPS device in conjunction with a 3D map database and vehicle-to-infrastructure information.

4. The method of claim 1 wherein monitored roadway information behind the vehicle comprises:

a left edge lane marking of a roadway lane behind the vehicle; and

a right edge lane marking of the roadway lane behind the vehicle.

5. The method of claim 1 wherein when the monitored roadway information indicates no roadway curvature, the projected vehicle frontward lateral offset is based on a tangent of the vehicle rearward heading angle, a longitudinal offset of the rearward detection device from a vehicle center and the vehicle rearward lateral offset, and the projected vehicle frontward heading angle is equal to the vehicle rearward heading angle.

6. The method of claim 1 wherein when the monitored roadway information indicates no roadway curvature, the projected vehicle frontward lateral offset is based on a tangent of the vehicle rearward heading angle, a longitudinal offset of the rearward detection device from a vehicle center, the vehicle rearward lateral offset and the estimated forward roadway curvature, and the projected vehicle frontward heading angle is based on the vehicle rearward heading angle, a cotangent of the longitudinal offset of the rearward detection device from the vehicle center and a cotangent of the estimated forward roadway curvature.

7. The method of claim 1 wherein estimating the forward roadway curvature based on the monitored vehicle sensor information comprises estimating the forward roadway curvature based on vehicle speed, vehicle yaw rate, lateral acceleration, a frontward steering angle and a rearward steering angle.

8. The method of claim 1 wherein estimating the forward roadway curvature based on the monitored vehicle sensor information comprises:

tracking previously traversed GPS information;

determining previously traversed roadway curvature based on the previously traversed GPS information; and

estimating the forward roadway curvature based on the previously traversed roadway curvature and the monitored vehicle sensor information.

9. The method of claim 8 wherein the monitored vehicle sensor information comprises vehicle speed, a frontward steering angle, and a rearward steering angle.

10. The method of claim 1 wherein modeling the roadway information ahead of the vehicle based on the projected frontward positional information and the estimated forward roadway curvature to determine the desired vehicle positional information with respect to the modeled roadway information comprises:

utilizing a polynomial to model the roadway information ahead of the vehicle based on the projected positional information and the estimated forward roadway curvature, said modeled roadway information comprising

a modeled left edge lane marking of a roadway lane ahead of the vehicle, and

a modeled right edge lane marking of the roadway lane ahead of the vehicle;

determining a lane center based on an average between the modeled right and left edge lane markings; and

determining the desired vehicle positional information with respect to the modeled roadway information based on the determined lane center.

11. The method of claim 10 wherein the desired vehicle positional information with respect to the modeled roadway information based on the determined lane center comprises a desired vehicle lateral offset from the modeled roadway information to the lane center and a desired vehicle heading with respect to the lane center.

12. The method of claim 1 wherein predicting the future vehicle positional information with respect to the modeled roadway information based on the monitored vehicle sensor information and the estimated forward roadway curvature comprises:

monitoring the vehicle sensor information including vehicle speed, a vehicle yaw rate, a steering angle, rearward corner stiffness and forward corner stiffness;

determining vehicle longitudinal speed and vehicle lateral speed based on the vehicle speed; and

utilizing a differential equation to predict the future vehicle positional information with respect to the modeled roadway information based on the vehicle yaw rate, the steering angle, the rearward corner stiffness, the forward corner stiffness, the vehicle longitudinal speed and the vehicle lateral speed.

13. The method of claim 12 wherein the modeled roadway information comprises a modeled left edge lane marking of a roadway lane ahead of the vehicle and a modeled right edge lane marking of the roadway lane ahead of the vehicle, the method further comprising:

determining a lane center based on an average between the modeled left and right edge lane markings; and

predicting the future vehicle positional information with respect to the modeled roadway information, the predicted future vehicle positional information comprising a future vehicle lateral offset from the modeled roadway information and a future vehicle heading angle with respect to the lane center.

14. The method of claim 1 wherein generating the steering command comprises:

calculating a steering angle command based on the steering command.

15. The method of claim 1 wherein generating the steering command comprises at least one of:

calculating a differential torque command to a driveline of the vehicle based on the steering command; and

calculating a differential braking command to a driveline of the vehicle based on the steering command.

16. The method of claim 1 further comprising:

controlling the vehicle based on the generated steering command over a predetermined period of time to converge the predicted future vehicle positional information toward the desired vehicle positional information.

17. Method for controlling a vehicle to maintain a desired position on a roadway, comprising:

monitoring roadway information behind the vehicle using a rearward camera;

monitoring vehicle sensor information;

projecting frontward positional information employing frontward positional information module based on rearward positional information obtained from the monitored roadway information behind the vehicle, comprising

obtaining a vehicle rearward lateral offset from the monitored roadway information and a vehicle rearward heading angle with respect to the monitored roadway information,

applying geometric relationships to the obtained vehicle rearward lateral offset and the vehicle rearward heading angle to compensate for geometric delay, and

projecting a vehicle frontward lateral offset from frontward roadway information and a vehicle frontward heading angle with respect to frontward roadway information based on the geometric and kinematics relationships applied to the obtained vehicle rearward lateral offset and the vehicle rearward heading angle;

estimating forward roadway curvature based on the monitored vehicle sensor information, comprising

tracking previously traversed GPS information,

determining previously traversed roadway curvature based on the previously traversed GPS information, and

estimating the forward roadway curvature based on the previously traversed roadway curvature and the monitored vehicle sensor information;

modeling roadway information ahead of the vehicle based on the projected frontward positional information and the estimated forward roadway curvature to determine desired vehicle positional information with respect to the modeled roadway information;

predicting future vehicle positional information with respect to the modeled roadway information based on the monitored vehicle sensor information and the estimated forward roadway curvature;

comparing the desired vehicle positional information to the predicted future vehicle positional information; and

generating a steering command based on a deviation in the predicted future vehicle positional information from the desired vehicle positional information to converge the predicted future vehicle positional information toward the desired vehicle positional information.

18. The method of claim 17 wherein monitored roadway information behind the vehicle comprises:

a left edge lane marking of a roadway lane behind the vehicle; and

a right edge lane marking of the roadway lane behind the vehicle.

19. Apparatus for autonomously controlling a vehicle to maintain a desired position on a roadway, comprising:

a plurality of vehicle sensors;

a rearward detection device;

a steering module; and

a

lane keeping control module configured to;

monitor roadway information behind the vehicle using the rearward detection device,

monitor vehicle sensor information from the plurality of vehicle sensors,

project frontward positional information based on rearward positional information obtained from the monitored roadway information behind the vehicle,

estimate forward roadway curvature based on the monitored vehicle sensor information,

model roadway information ahead of the vehicle based on the projected frontward positional information and the estimated forward roadway curvature to determine desired vehicle positional information with respect to the modeled roadway information,

predict future vehicle positional information with respect to the modeled roadway information based on the monitored vehicle sensor information and the estimated forward roadway curvature,

compare the desired vehicle positional information to the predicted future vehicle positional information, and

generate a steering command based on a deviation in the predicted future vehicle positional information from the desired vehicle positional information to converge the predicted future vehicle positional information toward the desired vehicle positional information.