Driver assistance system for vehicle

• US 10,086,747 B2
• Filed: 08/25/2014
• Issued: 10/02/2018
• Est. Priority Date: 07/12/2007
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Higgins-Luthman, Michael J., Lu, Yuesheng, Ince, William C.
• Primary Examiner(s): Mai, Anh
• Assistant Examiner(s): Snyder, Zachary J
• Application Number:
  US14/467,297
• Publication Number:
  US 20140362594A1
• Time in Patent Office: 1,499 Days
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/245 Searchlights, e.g. adjustable from within the vehicle adjustable headlights B60Q1/06
• CPC Class Codes: B60Q 2300/23 Driver's line of sight
• CPC Class Codes: B60Q 2300/45 Special conditions, e.g. pedestrians, road signs or potential dangers

Abstract

A driver assistance system for a vehicle includes a camera disposed at and viewing forwardly through a windshield of the equipped vehicle and operable to capture image data. A control operable to process captured image data utilizing algorithmic decision-making, which uses an edge detection algorithm. The control is operable to process captured image data to detect a pedestrian present in the field of view of the camera. The control is operable to process captured image data to detect an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle. Responsive to pedestrian detection, the control is operable to generate an alert to a driver of the equipped vehicle. Responsive to detection of an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle, a light beam of a headlight of the equipped vehicle is adjusted.

Claims

1. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a camera disposed at and viewing forwardly through a windshield of a vehicle equipped with said driver assistance system;

wherein said camera comprises a plurality of CMOS photosensors arranged in a two dimensional array;

wherein said camera is operable to capture image data;

a control operable to process captured image data utilizing algorithmic decision-making;

wherein said control is operable to process captured image data to detect a pedestrian present in the field of view of said camera;

wherein said control is operable to process captured image data to detect an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle;

a headlight of the equipped vehicle operable to illuminate at least one of generally forwardly of the equipped vehicle and generally sidewardly of the equipped vehicle;

wherein, responsive to said pedestrian detection, said control is operable to generate an alert to a driver of the equipped vehicle;

wherein, responsive to said detection of an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle, a light beam of said headlight is adjusted;

wherein, responsive to said algorithmic decision-making determining presence of a pedestrian present in the field of view of said camera, a near-infrared light beam of an auxiliary near-infrared light source of the equipped vehicle is adjusted to at least briefly illuminate the pedestrian determined to be present in the field of view of said camera, and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjusted at least in part responsive to (a) distance from the equipped vehicle to the determined pedestrian and (b) direction from the equipped vehicle toward the determined pedestrian;

wherein said auxiliary near-infrared light source of the equipped vehicle comprises a plurality of near-infrared light emitting diodes, and wherein adjustment of said near-infrared light beam of said auxiliary near-infrared light source comprises activating selected light emitting diodes of said plurality of near-infrared light emitting diodes to aim said near-infrared light beam toward the determined pedestrian to illuminate the determined pedestrian; and

wherein, irrespective of determination of presence of a pedestrian, adjustment of said near-infrared light beam of said auxiliary near-infrared light source is limited responsive to an output of a Global Positioning System of the equipped vehicle.

2. The driver assistance system of claim 1, wherein said auxiliary near-infrared light source comprises at least one of (a) a baffle and (b) a light guiding element.

3. The driver assistance system of claim 1, wherein said auxiliary near-infrared light source comprises a baffle and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable via said baffle.

4. The driver assistance system of claim 1 wherein said alert comprises at least one of (a) a visual display, (b) a warning light, (c) an audible signal and (d) a haptic alert.

5. The driver assistance system of claim 1, wherein said auxiliary near-infrared light source comprises a light guiding element.

6. The driver assistance system of claim 1, wherein adjustment of said near-infrared light beam of said auxiliary near-infrared light source comprises activating some light emitting diodes of said plurality of near-infrared light emitting diodes to aim said near-infrared light beam of said auxiliary near-infrared light source in the direction of the determined pedestrian and activating other light emitting diodes of said plurality of near-infrared light emitting diodes to aim another near-infrared light beam of said auxiliary near-infrared light source in another direction.

7. The driver assistance system of claim 6, wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable via selectively activating at least some individual near-infrared light emitting diodes of said plurality of near-infrared light emitting diodes.

8. The driver assistance system of claim 7, wherein said plurality of near-infrared light emitting diodes comprises an array of near-infrared light emitting diodes.

9. The driver assistance system of claim 1, wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable horizontally and vertically.

10. The driver assistance system of claim 1, wherein said driver assistance system is enabled and disabled in response to an output of at least one of (a) a human-machine interface, (b) the Global Positioning System, (c) a roadside information system, (d) the internet, (e) an intelligent transportation system, (f) a communication system, (g) a telematics system and (h) a navigation system.

11. The driver assistance system of claim 1, comprising a gaze detection device operable to determine a gaze direction of the driver or a driving instructor of the equipped vehicle, wherein said gaze detection device comprises a second camera for capturing image data, said second camera having a field of view generally toward the head of the driver or driving instructor of the equipped vehicle, wherein an image processing device is operable to process image data captured by said second camera to determine the gaze direction of the driver or driving instructor of the equipped vehicle.

12. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a camera disposed at and viewing forwardly through a windshield of a vehicle equipped with said driver assistance system;

wherein said camera comprises a plurality of CMOS photosensors arranged in a two dimensional array;

wherein said camera is operable to capture image data;

a control operable to process captured image data utilizing algorithmic decision-making;

wherein said control is operable to process captured image data to detect a pedestrian present in the field of view of said camera;

wherein said control is operable to process captured image data to detect an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle;

a headlight of the equipped vehicle operable to illuminate at least one of generally forwardly of the equipped vehicle and generally sidewardly of the equipped vehicle;

wherein, responsive to said pedestrian detection, said control is operable to generate an alert to a driver of the equipped vehicle;

wherein said alert comprises at least one of (a) a visual display, (b) a warning light, (c) an audible signal and (d) a haptic alert;

wherein, responsive to said detection of an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle, a light beam of said headlight is adjusted;

wherein, responsive to said algorithmic decision-making determining presence of a pedestrian present in the field of view of said camera, a near-infrared light beam of an auxiliary near-infrared light source of the equipped vehicle is adjusted to at least briefly illuminate the pedestrian determined to be present in the field of view of said camera, and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjusted at least in part responsive to (a) distance from the equipped vehicle to the determined pedestrian and (b) direction from the equipped vehicle toward the determined pedestrian;

wherein said headlight comprises at least one of (a) a baffle, (b) a light guiding element and (c) a light emitting diode;

wherein said auxiliary near-infrared light source of the equipped vehicle comprises a plurality of near-infrared light emitting diodes, and wherein adjustment of said near-infrared light beam of said auxiliary near-infrared light source comprises activating selected light emitting diodes of said plurality of near-infrared light emitting diodes to aim said near-infrared light beam toward the determined pedestrian to illuminate the determined pedestrian; and

wherein, irrespective of determination of presence of a pedestrian, adjustment of said near-infrared light beam of said auxiliary near-infrared light source is limited responsive to an output of a Global Positioning System of the equipped vehicle.

13. The driver assistance system of claim 12, wherein said auxiliary near-infrared light source comprises a baffle and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable via said baffle.

14. The driver assistance system of claim 12, wherein said auxiliary near-infrared light source comprises a light guiding element.

15. The driver assistance system of claim 12, wherein adjustment of said near-infrared light beam of said auxiliary near-infrared light source comprises activating some light emitting diodes of said plurality of near-infrared light emitting diodes to aim said near-infrared light beam of said auxiliary near-infrared light source in the direction of the determined pedestrian and activating other light emitting diodes of said plurality of near-infrared light emitting diodes to aim another near-infrared light beam of said auxiliary near-infrared light source in another direction.

16. The driver assistance system of claim 15, wherein said plurality of near-infrared light emitting diodes comprises an array of near-infrared light emitting diodes.

17. The driver assistance system of claim 12, wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable horizontally and vertically.

18. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a camera disposed at and viewing forwardly through a windshield of a vehicle equipped with said driver assistance system;

wherein said camera comprises a plurality of CMOS photosensors arranged in a two dimensional array;

wherein said camera is operable to capture image data;

a control operable to process captured image data utilizing algorithmic decision-making;

wherein said control is operable to process captured image data to detect a pedestrian present in the field of view of said camera;

wherein said control is operable to process captured image data to detect an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle;

a headlight of the equipped vehicle operable to illuminate at least one of generally forwardly of the equipped vehicle and generally sidewardly of the equipped vehicle;

wherein, responsive to said pedestrian detection, said control is operable to generate an alert to a driver of the equipped vehicle;

wherein said alert comprises at least one of (a) a visual display, (b) a warning light, (c) an audible signal and (d) a haptic alert;

wherein, responsive to said detection of an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle, a light beam of said headlight is adjusted;

wherein, responsive to said algorithmic decision-making determining presence of a pedestrian present in the field of view of said camera, a near-infrared light beam of an auxiliary near-infrared light source of the equipped vehicle is adjusted to at least briefly illuminate the pedestrian determined to be present in the field of view of said camera, and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjusted at least in part responsive to (a) distance from the equipped vehicle to the determined pedestrian and (b) direction from the equipped vehicle toward the determined pedestrian;

wherein said auxiliary near-infrared light source comprises a plurality of near-infrared light emitting diodes, and wherein adjustment of said near-infrared light beam of said auxiliary near-infrared light source comprises activating selected light emitting diodes of said plurality of near-infrared light emitting diodes to aim said near-infrared light beam toward the determined pedestrian to illuminate the determined pedestrian; and

wherein, irrespective of determination of presence of a pedestrian, adjustment of said near-infrared light beam of said auxiliary near-infrared light source is limited responsive to an output of a Global Positioning System of the equipped vehicle.

19. The driver assistance system of claim 18, wherein said plurality of near-infrared light emitting diodes comprises an array of near-infrared light emitting diodes.

20. The driver assistance system of claim 19, wherein said pedestrian detection is based, at least in part, on a plurality of attributes selected from the group consisting of (a) size of the pedestrian, (b) shape of the pedestrian, (c) distance from the equipped vehicle to the pedestrian and (d) direction from the equipped vehicle toward the pedestrian.

21. A driver assistance system suitable for use in a vehicle, said driver assistance system comprising:

a camera disposed at and viewing forwardly through a windshield of a vehicle equipped with said driver assistance system;

wherein said camera comprises a plurality of CMOS photosensors arranged in a two dimensional array;

wherein said camera is operable to capture image data;

a control operable to process captured image data utilizing algorithmic decision-making;

wherein said control is operable to process captured image data to detect a pedestrian present in the field of view of said camera;

wherein said control is operable to process captured image data to detect an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle;

a headlight of the equipped vehicle operable to illuminate at least one of generally forwardly of the equipped vehicle and generally sidewardly of the equipped vehicle;

wherein, responsive to said pedestrian detection, said control is operable to generate an alert to a driver of the equipped vehicle;

wherein, responsive to said detection of an oncoming headlight or a leading taillight of another vehicle ahead of the equipped vehicle, a light beam of said headlight is adjusted;

wherein, responsive to said algorithmic decision-making determining presence of a pedestrian present in the field of view of said camera, a near-infrared light beam of an auxiliary near-infrared light source of the equipped vehicle is adjusted to at least briefly illuminate the pedestrian determined to be present in the field of view of said camera, and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjusted at least in part responsive to (a) distance from the equipped vehicle to the pedestrian and (b) direction from the equipped vehicle toward the pedestrian;

wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable at least one of horizontally and vertically;

wherein said auxiliary near-infrared light source of the equipped vehicle comprises a plurality of near-infrared light emitting diodes, and wherein adjustment of said near-infrared light beam of said auxiliary near-infrared light source comprises activating selected light emitting diodes of said plurality of near-infrared light emitting diodes to aim said near-infrared light beam in the direction toward the determined pedestrian to illuminate the determined pedestrian; and

wherein, irrespective of determination of presence of a pedestrian, adjustment of said near-infrared light beam of said auxiliary near-infrared light source is limited responsive to an output of a Global Positioning System of the equipped vehicle.

22. The driver assistance system of claim 21, wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable horizontally and vertically.

23. The driver assistance system of claim 22, wherein said auxiliary near-infrared light source comprises at least one of (a) a baffle and (b) a light guiding element.

24. The driver assistance system of claim 23, wherein said alert comprises at least one of (a) a visual display, (b) a warning light, (c) an audible signal and (d) a haptic alert.

25. The driver assistance system of claim 24, wherein said plurality of near-infrared light emitting diodes comprises an array of near-infrared light emitting diodes.

26. The driver assistance system of claim 21, wherein said auxiliary near-infrared light source comprises a baffle and wherein said near-infrared light beam of said auxiliary near-infrared light source is adjustable via said baffle.

27. The driver assistance system of claim 21, wherein said auxiliary near-infrared light source comprises a light guiding element.