Redundant lane sensing systems for fault-tolerant vehicular lateral controller

• US 9,542,846 B2
• Filed: 02/28/2011
• Issued: 01/10/2017
• Est. Priority Date: 02/28/2011
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Zeng, Shuqing, Salinger, Jeremy A., Chundrlik, William J. Jr.
• Primary Examiner(s): HILGENDORF, DALE W
• Application Number:
  US13/036,538
• Publication Number:
  US 20120221168A1
• Time in Patent Office: 2,143 Days
• Field of Search: 701/23, 701/36, 701/41, 701/43, 701/29.7, 701/466, 701/518, 701/534, 382/104, 382/107
• US Class Current: 1/1
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2552/30 Road curve radius
• CPC Class Codes: B60W 2554/80 Spatial relation or speed relative to objects
• CPC Class Codes: B60W 2556/35 Data fusion
• CPC Class Codes: B60W 2556/50 of positioning data, e.g. GPS [Global Positioning System] data
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B60W 30/16 Control of distance between vehicles, e.g. keeping a distance to preceding vehicle
• CPC Class Codes: B60W 60/0018 by employing degraded modes, e.g. reducing speed, in response to suboptimal conditions
• CPC Class Codes: B60W 60/0053 from vehicle to occupant
• CPC Class Codes: G08G 1/09626 where the origin of the information is within the own vehicle, e.g. a local storage device, digital map
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

A vehicle lateral control system includes a lane marker module configured to determine a heading and displacement of a vehicle in response to images received from a secondary sensing device, a lane information fusion module configured to generate vehicle and lane information in response to data received from heterogeneous vehicle sensors and a lane controller configured to generate a collision free vehicle path in response to the vehicle and lane information from the lane information fusion module and an object map.

Claims

1. A vehicle lateral control system, comprising:

a primary sensing device controlling a vehicle lateral movement;

a lane marker module configured to determine a heading and displacement of a vehicle in response to images received from a secondary sensing device;

a lane information fusion module configured to generate vehicle and lane information in response to data received from heterogeneous vehicle sensors, wherein the data received from the heterogeneous vehicle sensors includes a digital map database from a global positioning system module; and

a lane controller configured to detect a failure in the primary sensing device and to generate a collision free vehicle path in response to the vehicle and lane information from the lane information fusion module and an object map, said controller controlling the vehicle lateral movement by following the collision free vehicle path, and alerting a vehicle driver to take control of steering the vehicle.

2. The system according to claim 1 wherein the secondary sensing device is a rear-view camera.

3. The system according to claim 1 wherein the digital map database includes a list of waypoints that represent a forward lane geometry.

4. The system according to claim 1 wherein data received from heterogeneous vehicle sensors includes the images received from the secondary sensing device.

5. The system according to claim 4 wherein the images received from the secondary sensing device are rectified and projected to a vehicle frame coordinate system to estimate the vehicle'"'"'s heading and displacement with respect to a center line of the lane.

6. The system according to claim 1 wherein the lane marker module includes an algorithm configured to detect lane markers in the images received by the secondary sensing device.

7. The system according to claim 6 wherein the algorithm is configured to perform a pixel clustering and shape classification operation to isolate the pixel clusters that are potential lane stripes.

8. The system according to claim 6 wherein the lane markers include curbs and lane stripes.

9. The system according to claim 1 wherein data received from heterogeneous vehicle sensors includes data received from a plurality of vehicle dynamics sensors.

10. The system according to claim 1 wherein data received from heterogeneous vehicle sensors includes data received from a leading vehicle trajectory estimator that is configured to build a historical position trajectory of target vehicles and estimate the lane curvature and heading in response to the dynamic and static object map.

11. The system according to claim 1 wherein the object map includes dynamic and static objects detected by a plurality of object sensors mounted to the vehicle.

12. The system according to claim 1 further comprising an actuator responsive to signals from the lane controller, wherein the actuator is selected from a group consisting of an electrical power steering actuator, an active front steering actuator, a rear-wheel steering assist actuator and/or a differential braking actuator.

13. The system according to claim 1 where the lane controller generates the collision free vehicle path using calculations for an artificial potential repulsion field acting on the vehicle from objects that the vehicle could collide with.