DRIVER ASSISTANCE SYSTEM FOR A VEHICLE

• US 20160297365A1
• Filed: 06/13/2016
• Published: 10/13/2016
• Est. Priority Date: 08/20/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Nix, Axel
• Granted Patent: US 9,802,541 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60W 10/18 including control of braking systems
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2554/80 Spatial relation or speed relative to objects
• CPC Class Codes: B60W 2710/18 Braking system
• CPC Class Codes: B60W 2710/20 Steering systems
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B60W 30/095 Predicting travel path or likelihood of collision
• CPC Class Codes: B60W 50/0098 Details of control systems ensuring comfort, safety or stability not otherwise provided for
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A driver assistance system suitable for use in a vehicle includes a forward-viewing camera mounted at a front windshield of the vehicle, and an event recorder having an image processor and memory. Based at least in part on processing by the image processor of image data captured by the camera, a lane departure warning is generated if, when a turn signal of the vehicle is not activated, at least one of (i) the vehicle is heading towards a lane marking and (ii) the vehicle is within a certain distance of an edge of a lane marking for a certain time. Based at least in part on processing by the image processor of image data captured by the camera, a forward collision alert is generated if the vehicle is heading towards a given object with the separation between the vehicle and the given object being less than a threshold.

Claims

1. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a forward-viewing camera mounted at a front windshield of a vehicle equipped with said driver assistance system;

said camera viewing forward of the equipped vehicle through the windshield;

said camera comprising a lens and an image sensor;

said image sensor comprising a plurality of photosensor elements arranged in a photosensor array having rows and columns;

an event recorder comprising an image processor and memory;

wherein said image processor is operable to process image data captured by said camera for detecting objects in the field of view of said camera;

said image processor utilizing object detection software for detecting objects in the field of view of said camera;

wherein memory of said event recorder comprises random access memory associated with said image processor;

wherein memory of said event recorder comprises non-volatile memory associated with said image processor;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a lane departure warning is generated if, when a turn signal of the equipped vehicle is not activated, at least one of (i) the equipped vehicle is heading towards a lane marking and (ii) the equipped vehicle is within a certain distance of an edge of a lane marking for a certain time;

wherein generation of said lane departure warning defines a lane departure warning event;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a forward collision alert is generated if the equipped vehicle is heading towards a given object with the separation between the equipped vehicle and the given object being less than a threshold;

wherein generation of said forward collision alert defines a forward collision alert event;

wherein said event recorder receives vehicle data via a vehicle data bus of the equipped vehicle;

wherein vehicle data received at said event recorder comprises vehicle speed;

wherein image data captured by said camera and vehicle data received at said event recorder during a first pre-event time period immediately preceding said lane departure warning event begins is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a first post-event time period immediately following said lane departure warning event begins is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a second pre-event time period immediately preceding said forward collision alert event begins is stored in memory of said event recorder; and

wherein image data captured by said camera and vehicle data received at said event recorder during a second post-event time period immediately following said forward collision alert begins is stored in memory of said event recorder.

2. The driver assistance system of claim 1, wherein captured image data is stored in random access memory of said event recorder responsive to at least one of (i) image processing by said image processing and (ii) received vehicle data.

3. The driver assistance system of claim 2, wherein captured image data is moved from random access memory to non-volatile memory based on a priority determination.

4. The driver assistance system of claim 1, wherein captured image data is processed to detect at least one type of probability event.

5. The driver assistance system of claim 4, wherein said driver assistance system comprises a safety-critical application, and wherein the safety critical application is enabled after it has been determined that the detected at least one type of probability event is sufficiently free of false events.

6. The driver assistance system of claim 5, wherein the safety-critical application comprises an automatic braking application.

7. The driver assistance system of claim 5, wherein the safety-critical application comprises an automatic evasive steering application.

8. The driver assistance system of claim 4, wherein said driver assistance system is operable to determine if a detected probability event is true or false and wherein the determination comprises detection of driver response to the probability event.

9. The driver assistance system of claim 8, wherein driver response to the probability event is represented by received vehicle data indicating at least one of a brake activation, a steering wheel movement, a yaw rate change, a vehicle deceleration and a vehicle acceleration.

10. The driver assistance system of claim 1, wherein at least one of said first and second pre-event time periods is greater than zero seconds and less than six seconds.

11. The driver assistance system of claim 1, wherein at least one of said first and second post-event time periods is greater than zero seconds and less than four seconds.

12. The driver assistance system of claim 1, wherein vehicle data received at said event recorder comprises at least one of (i) brake deployment data, (ii) airbag deployment data and (iii) anti-lock braking system (ABS) deployment data.

13. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a forward-viewing camera mounted at a front windshield of a vehicle equipped with said driver assistance system;

said camera viewing forward of the equipped vehicle through the windshield;

said camera comprising a lens and an image sensor;

said image sensor comprising a plurality of photosensor elements arranged in a photosensor array having at least 480 rows and at least 640 columns;

an event recorder comprising an image processor and memory;

wherein said image processor is operable to process image data captured by said camera for detecting objects in the field of view of said camera;

said image processor utilizing object detection software for detecting objects in the field of view of said camera;

wherein memory of said event recorder comprises random access memory associated with said image processor;

wherein memory of said event recorder comprises non-volatile memory associated with said image processor;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a lane departure warning is generated if, when a turn signal of the equipped vehicle is not activated, at least one of (i) the equipped vehicle is heading towards a lane marking and (ii) the equipped vehicle is within a certain distance of an edge of a lane marking for a certain time;

wherein generation of said lane departure warning defines a lane departure warning event;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a forward collision alert is generated if the equipped vehicle is heading towards a given object with the separation between the equipped vehicle and the given object being less than a threshold;

wherein generation of said forward collision alert defines a forward collision alert event;

wherein said event recorder receives vehicle data via a vehicle data bus of the equipped vehicle;

wherein vehicle data received at said event recorder comprises vehicle speed;

wherein image data captured by said camera and vehicle data received at said event recorder during a first pre-event time period immediately preceding said lane departure warning event begins is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a first post-event time period immediately following said lane departure warning event begins is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a second pre-event time period immediately preceding said forward collision alert event begins is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a second post-event time period immediately following said forward collision alert begins is stored in memory of said event recorder; and

wherein said driver assistance system comprises a safety-critical application.

14. The driver assistance system of claim 13, wherein the safety-critical application comprises an automatic braking application.

15. The driver assistance system of claim 14, wherein captured image data is processed to detect at least one type of probability event.

16. The driver assistance system of claim 15, wherein the safety critical application is enabled after it has been determined that the detected at least one type of probability event is sufficiently free of false events.

17. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a forward-viewing camera mounted at a front windshield of a vehicle equipped with said driver assistance system;

said camera viewing forward of the equipped vehicle through the windshield;

said camera comprising a lens and an image sensor;

said image sensor comprising a plurality of photosensor elements arranged in a photosensor array having at least 480 rows and at least 640 columns;

an event recorder comprising an image processor and memory;

wherein said image processor is operable to process image data captured by said camera for detecting objects in the field of view of said camera;

said image processor utilizing object detection software for detecting objects in the field of view of said camera;

wherein memory of said event recorder comprises random access memory associated with said image processor;

wherein memory of said event recorder comprises non-volatile memory associated with said image processor;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a forward collision alert is generated if the equipped vehicle is heading towards a given object with the separation between the equipped vehicle and the given object being less than a threshold;

wherein generation of said forward collision alert defines a forward collision alert event;

wherein said event recorder receives vehicle data via a vehicle data bus of the equipped vehicle;

wherein vehicle data received at said event recorder comprises vehicle speed;

wherein image data captured by said camera and vehicle data received at said event recorder during a first pre-event time period immediately preceding said forward collision alert event begins is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a first post-event time period immediately following said forward collision alert event begins is stored in memory of said event recorder; and

wherein captured image data is stored in random access memory of said event recorder.

18. The driver assistance system of claim 17, wherein captured image data is moved from random access memory to non-volatile memory based on a priority determination.

19. The driver assistance system of claim 18, wherein captured image data is stored in random access memory of said event recorder responsive to at least one of (i) image processing by said image processing and (ii) received vehicle data.

20. The driver assistance system of claim 17, wherein said driver assistance system comprises a safety-critical application and wherein the safety-critical application comprises an automatic braking application.