DRIVER ASSISTANCE SYSTEM FOR A VEHICLE

• US 20130321615A1
• Filed: 06/17/2013
• Published: 12/05/2013
• Est. Priority Date: 07/31/2001
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Schofield, Kenneth
• Granted Patent: US 9,245,448 B2
• Time in Patent Office: Days
• US Class Current: 348/118
• CPC Class Codes: B60Q 1/346 with automatic actuation
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60T 2201/08 Lane monitoring; Lane Keeping Systems
• CPC Class Codes: B60T 2201/089 using optical detection
• CPC Class Codes: B62D 15/029 Steering assistants using warnings or proposing actions to the driver without influencing the steering system
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 2013/9315 Monitoring blind spots
• CPC Class Codes: G01S 2013/9316 combined with communication equipment with other vehicles or with base stations
• CPC Class Codes: G01S 2013/932 using own vehicle data, e.g. ground speed, steering wheel direction
• CPC Class Codes: G01S 2013/9323 Alternative operation using light waves
• CPC Class Codes: G01S 2013/9324 Alternative operation using ultrasonic waves
• CPC Class Codes: G01S 2013/9325 for inter-vehicle distance regulation, e.g. navigating in platoons
• CPC Class Codes: G01S 2013/93274 on the side of the vehicles
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A driver assistance system for a vehicle includes a forward facing and a control having an image processor that processes image data captured by the camera. At least in part responsive to processing by the image processor, an alert to a driver of the equipped vehicle is generated based upon at least one of (i) detection of an inappropriate lane change maneuver of the equipped vehicle and (ii) a detection of a potential impact with another vehicle. The image processor processes image data captured by the forward facing camera to detect a traffic control device present within the field of view of the forward facing camera, and the system may generate an alert to the driver when it is determined that the vehicle is not appropriately responding to the detected traffic control device.

Claims

1. A driver assistance system for a vehicle, said driver assistance system comprising:

a forward facing camera having a field of view that encompasses the road ahead of the equipped vehicle;

said forward facing camera comprising a CMOS imaging sensor;

wherein said forward facing camera views lane markers on the road being traveled by the equipped vehicle;

a control comprising an image processor;

wherein image data captured by said forward facing camera is processed by said image processor;

wherein said image processor processes data at a processing speed of at least about 5 MIPS;

wherein, at least in part responsive to processing by said image processor of image data captured by said forward facing camera, an alert to a driver of the equipped vehicle is generated based upon at least one of (i) detection of an inappropriate lane change maneuver of the equipped vehicle and (ii) a detection of a potential impact with another vehicle;

wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle;

wherein said image processor processes image data captured by said forward facing camera to detect a traffic control device present within the field of view of said forward facing camera; and

wherein, when the detected traffic control device requires at least one of (i) a reduction of speed of the equipped vehicle and (ii) that the equipped vehicle come to a stop, and when said control determines that the equipped vehicle is not appropriately responding based on at least one of (i) a current speed of the equipped vehicle and (ii) a deceleration of the equipped vehicle, an alert is generated to alert the driver that the equipped vehicle is not appropriately responding to the detected traffic control device.

2. The driver assistance system of claim 1, wherein said control, responsive to processing by said image processor of image data captured by said forward facing camera, detects at least one of solid lines, dashed lines and double lines on the road being traveled by the equipped vehicle.

3. The driver assistance system of claim 1, wherein said traffic control device is one of a stop sign and a stop light requiring that the equipped vehicle come to a stop and wherein said alert indicative that the equipped vehicle is not stopping at the detected stoplight or stop sign comprises at least one of (a) a visual alert, (b) a vibration alert, (c) an audible alert, (d) a voice command and (e) a heads-up-display alert.

4. The driver assistance system of claim 1, wherein said image processor processes image data from at least one other camera of the equipped vehicle and wherein said other camera is located at an exterior side view mirror assembly of the equipped vehicle.

5. The driver assistance system of claim 1, wherein said control receives input from a global positioning system and wherein said image processor processes data at a processing speed of at least about 30 MIPS.

6. The driver assistance system of claim 5, wherein said alert indicative that the equipped vehicle is appropriately responding to the detected traffic control device is generated at least in part responsive to an input from said global positioning system.

7. The driver assistance system of claim 1, wherein said image processor processes data at a processing speed of at least about 12 MIPS.

8. The driver assistance system of claim 1, including a radar sensor mounted at the equipped vehicle, wherein radar data from said radar sensor is received by said control and wherein image data and radar data are fused at said control.

9. The driver assistance system of claim 1, wherein said vehicle bus comprises at least one of (a) a CAN bus of the vehicle and (b) a LIN bus of the vehicle.

10. The driver assistance system of claim 1, wherein said vehicle data comprises at least one of speed data relating to the equipped vehicle and steering data relating to the equipped vehicle.

11. The driver assistance system of claim 1, including a wireless communication system and wherein at least one of (i) information on road conditions is receivable at the equipped vehicle via said wireless communication system and (ii) said control is operable to transmit safety warnings via said wireless communication system.

12. The driver assistance system of claim 11, wherein, when said control determines if said vehicle is not appropriately responding to said detected traffic control device and when said control determines that the equipped vehicle may be in hazard of a collision, at least one of (i) a safety warning to other vehicles is transmitted via a wireless communication system, (ii) a horn of the equipped vehicle is activated and (iii) headlights of the equipped vehicle are activated.

13. A driver assistance system for a vehicle, said driver assistance system comprising:

a forward facing camera having a field of view that encompasses the road ahead of the equipped vehicle;

said forward facing camera comprising a CMOS imaging sensor;

wherein said forward facing camera views lane markers on the road being traveled by the equipped vehicle;

a control comprising an image processor;

wherein image data captured by said forward facing camera is processed by said image processor;

wherein said image processor processes data at a processing speed of at least about 30 MIPS;

wherein, at least in part responsive to processing by said image processor of image data captured by said forward facing camera, an alert to a driver of the equipped vehicle is generated based upon at least one of (i) detection of an inappropriate lane change maneuver of the equipped vehicle and (ii) a detection of a potential impact with another vehicle;

wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle;

wherein said image processor processes image data captured by said forward facing camera to detect a traffic control device present within the field of view of said forward facing camera;

wherein said control, responsive to processing by said image processor of image data captured by said forward facing camera, detects at least one of solid lines, dashed lines and double lines on the road being traveled by the equipped vehicle; and

wherein, when said control at least one of (a) determines if said vehicle is not appropriately responding to a detected traffic control device and (b) determines that the equipped vehicle is in hazard a collision, an alert is generated to alert the driver, said alert comprising at least one of (a) a visual alert, (b) a vibration alert, (c) an audible alert, (d) a voice command and (e) a heads-up-display alert.

14. The driver assistance system of claim 13, wherein said vehicle data comprises at least one of speed data relating to the equipped vehicle and steering data relating to the equipped vehicle.

15. The driver assistance system of claim 13, wherein, when said control determines if said vehicle is not appropriately responding to said detected traffic control device and when said control determines that the equipped vehicle may not stop in time to avoid a collision, at least one of (i) a safety warning to other vehicles is transmitted via a wireless communication system, (ii) a horn of the equipped vehicle is activated and (iii) headlights of the equipped vehicle are activated.

16. The driver assistance system of claim 13, wherein at least one of (i) said alert indicative that the equipped vehicle is not appropriately responding to the detected traffic control device is generated at least in part responsive to an input from said global positioning system and (ii) said vehicle bus comprises at least one of (a) a CAN bus of the vehicle and (b) a LIN bus of the vehicle.

17. The driver assistance system of claim 13, wherein said traffic control device is one of a stop sign and a stop light requiring that the equipped vehicle come to a stop and wherein said alert alerts that the equipped vehicle is not stopping at the detected stoplight or stop sign.

18. A driver assistance system for a vehicle, said driver assistance system comprising:

a forward facing camera having a field of view that encompasses the road ahead of the equipped vehicle;

said forward facing camera comprising a CMOS imaging sensor;

wherein said forward facing camera views lane markers on the road being traveled by the equipped vehicle;

a control comprising an image processor;

wherein image data captured by said forward facing camera is processed by said image processor;

wherein said image processor processes data at a processing speed of at least about 30 MIPS;

wherein, at least in part responsive to processing by said image processor of image data captured by said forward facing camera, an alert to a driver of the equipped vehicle is generated based upon at least one of (i) detection of an inappropriate lane change maneuver of the equipped vehicle and (ii) a detection of a potential impact with another vehicle;

wherein said control receives vehicle data relating to the equipped vehicle via a vehicle bus of the equipped vehicle;

wherein said vehicle data comprises at least one of speed data relating to the equipped vehicle and steering data relating to the equipped vehicle;

wherein said image processor processes image data captured by said forward facing camera to detect a traffic control device present within the field of view of said forward facing camera;

wherein, when said control at least one of (a) determines if said vehicle is not appropriately responding to a detected traffic control device and (b) determines that the equipped vehicle is in hazard of a collision, an alert is generated to alert the driver, said alert comprising at least one of (a) a visual alert, (b) a vibration alert, (c) an audible alert, (d) a voice command and (e) a heads-up-display alert;

wherein, at least one of (i) said control, responsive to processing by said image processor of image data captured by said forward facing camera, detects at least one of solid lines, dashed lines and double lines on the road being traveled by the equipped vehicle, (ii) said alert indicative that the equipped vehicle is not appropriately responding to the detected traffic control device is generated at least in part responsive to an input from said global positioning system, (iii) said vehicle bus comprises a CAN bus of the vehicle and (iv) said vehicle bus comprises a LIN bus of the vehicle; and

wherein said traffic control device is one of a stop sign and a stop light requiring that the equipped vehicle come to a stop and wherein said alert alerts that the equipped vehicle is not stopping at the detected stoplight or stop sign.

19. The driver assistance system of claim 18, wherein said image processor processes image data from at least one other camera of the equipped vehicle and wherein said other camera is located at an exterior side view mirror assembly of the equipped vehicle.

20. The driver assistance system of claim 18, including a radar sensor mounted at the equipped vehicle, wherein radar data from said radar sensor is received by said control and wherein image data and radar data are fused at said control.