Driver assistance system for vehicle

• US 9,187,028 B2
• Filed: 02/14/2013
• Issued: 11/17/2015
• Est. Priority Date: 05/15/2009
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Higgins-Luthman, Michael J.
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): Kong, Sze-Hon
• Application Number:
  US13/767,208
• Publication Number:
  US 20130158796A1
• Time in Patent Office: 1,006 Days
• Field of Search: 701/36, 701/49, 340/905, 340/523, 362/464, 362/466, 362/512, 362/523, 348/148, 315/82, 382/104
• US Class Current: 1/1
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/146 Abnormalities, e.g. fail-safe
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: B60Q 2300/322 Road curvature
• CPC Class Codes: B60Q 2300/33 Driving situation
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60Q 2300/45 Special conditions, e.g. pedestrians, road signs or potential dangers
• CPC Class Codes: B60Q 2300/47 Direct command from other road users, i.e. the command for switching or changing the beam is sent by other vehicles or road devices
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/80 characterised by the intended use of the viewing arrangement
• CPC Class Codes: B60S 1/54 using gas, e.g. hot air
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A driver assistance system for a vehicle includes a camera and a control. The camera is disposed at the vehicle and views forward of the vehicle and is operable to capture image data. The control includes an image processor operable to process image data captured by the camera. The control, responsive at least in part to image data processing by the image processor, is operable to determine when the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone. The image data processing by the image processor may include at least one of (a) traffic sign recognition, (b) character recognition, (c) object detection, (d) object recognition, (e) spectral discrimination, (f) spatial recognition and (g) lane marker detection.

Claims

1. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera disposed at a vehicle equipped with said driver assistance system, wherein said camera views forward of the equipped vehicle and wherein said camera is operable to capture image data;

a control device comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein, responsive to processing of captured image data by said image processor, said driver assistance system is operable to adjust a light beam emitted by a headlamp of the equipped vehicle;

wherein said control device, responsive at least in part to image data processing by said image processor, is operable to determine when the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone;

wherein image data processing by said image processor comprises at least one of (a) traffic sign recognition, (b) character recognition, (c) object detection, (d) object recognition, (e) spectral discrimination, (f) spatial recognition and (g) lane marker detection;

wherein determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone comprises spectral recognition of an orange construction sign;

wherein, responsive to determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said control device enters an enhanced mode that enhances image processing of captured image data by said image processor to discriminate orange construction zone signs from taillights of leading vehicles so as to adjust the light beam emitted by the headlamp of the equipped vehicle to a higher beam state when no taillights of leading vehicles are present; and

wherein, responsive to determination of the equipped vehicle exiting the construction zone, said control device returns to a normal mode to adjust the light beam emitted by the headlamp of the equipped vehicle responsive to determination of headlamps of approaching vehicles and taillights of leading vehicles.

2. The driver assistance system of claim 1, wherein, responsive at least in part to said control device determining that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said driver assistance system is operable to adjust the light beam emitted by the headlamp of the equipped vehicle.

3. The driver assistance system of claim 2, wherein said adjustment of the light beam comprises changing a beam state of the light beam emitted by the headlamp of the equipped vehicle.

4. The driver assistance system of claim 1, wherein said driver assistance system is operable to recognize a construction zone sign.

5. The driver assistance system of claim 1, wherein said driver assistance system is operable to recognize at least one of (i) cones indicative of a construction zone, (ii) barrels indicative of a construction zone and (iii) a traffic shift.

6. The driver assistance system of claim 1, wherein, at least when said image processing of captured image data is operating in said enhanced mode, said driver assistance system is operable to discriminate orange from red.

7. The driver assistance system of claim 6, wherein said driver assistance system, at least when said image processing of captured image data is operating in said enhanced mode, is operable to discriminate between reflection of light off an orange sign and red light emitted by a vehicle taillight.

8. The driver assistance system of claim 7, wherein said driver assistance system, at least when said image processing of captured image data is operating in said enhanced mode, is operable to discriminate between reflection of light off an orange sign and red light emitted by a taillight of a leading vehicle based on at least one of (i) the color of the detected light source, (ii) the location of the detected light source relative to the equipped vehicle, (iii) recognition of a reflection of the headlamps of the equipped vehicle and (iv) recognition of a reflection of the headlamps of the equipped vehicle by superimposing a pattern on an output of the headlamps of the equipped vehicle.

9. The driver assistance system of claim 1, wherein said driver assistance system is operable to recognize construction zone signs by at least one of (i) a location of signs along the road traveled by the equipped vehicle and (ii) a number of signs along the road traveled by the equipped vehicle.

10. The driver assistance system of claim 1, wherein said control device, responsive at least in part to at least one of (i) a global positioning system of the equipped vehicle and (ii) a navigation system of the equipped vehicle, is operable to identify when the current geographic location of the equipped vehicle corresponds to a construction zone.

11. The driver assistance system of claim 1, wherein said control device is operable to determine that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone responsive at least in part to (a) a traffic sign recognition system of the equipped vehicle, (b) a lane departure warning system of the equipped vehicle, (c) a forward collision warning system of the equipped vehicle, (d) an object detection system of the equipped vehicle, (e) a global positioning system of the equipped vehicle and (f) a navigation system of the equipped vehicle.

12. The driver assistance system of claim 1, wherein said image processor processes image data captured by said camera for at least one of (a) a traffic sign recognition system of the equipped vehicle, (b) a lane departure warning system of the equipped vehicle, (c) a forward collision warning system of the equipped vehicle and (d) an object detection system of the equipped vehicle.

13. The driver assistance system of claim 1, wherein said camera views through the windshield of the equipped vehicle.

14. The driver assistance system of claim 13, wherein said camera is disposed at one of (i) an interior rearview mirror assembly of the equipped vehicle and (ii) a windshield electronics module of the equipped vehicle.

15. The driver assistance system of claim 13, wherein said camera views through the windshield of the equipped vehicle at a location that is swept by a windshield wiper of the equipped vehicle.

16. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera disposed at a vehicle equipped with said driver assistance system, wherein said camera views forward of the equipped vehicle through the windshield of the equipped vehicle and wherein said camera is operable to capture image data;

a control device comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein, responsive to processing of captured image data by said image processor, said driver assistance system is operable to adjust a light beam emitted by a headlamp of the equipped vehicle;

wherein said control device, at least in part responsive to image data processing by said image processor, is operable to determine when the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone;

wherein image data processing by said image processor comprises at least one of (a) traffic sign recognition, (b) character recognition, (c) object detection, (d) object recognition, (e) spectral discrimination, (f) spatial recognition and (g) lane marker detection;

wherein said image processor processes image data captured by said camera for at least one of (a) a traffic sign recognition system of the equipped vehicle, (b) a lane departure warning system of the equipped vehicle, (c) a forward collision warning system of the equipped vehicle and (d) an object detection system of the equipped vehicle;

wherein determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone comprises spectral recognition of an orange construction sign;

wherein, responsive to determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said control device enters an enhanced mode that enhances image processing of captured image data by said image processor to discriminate orange construction zone signs from taillights of leading vehicles so as to adjust the light beam emitted by the headlamp of the equipped vehicle to a higher beam state when no taillights of leading vehicles are present; and

wherein, responsive to determination of the equipped vehicle exiting the construction zone, said control device returns to a normal mode to adjust the light beam emitted by the headlamp of the equipped vehicle responsive to determination of headlamps of approaching vehicles and taillights of leading vehicles.

17. The driver assistance system of claim 16, wherein, responsive at least in part to said control device determining that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said driver assistance system is operable to adjust the light beam emitted by the headlamp of the equipped vehicle.

18. The driver assistance system of claim 17, wherein said driver assistance system is operable to recognize at least one of (i) cones indicative of a construction zone, (ii) barrels indicative of a construction zone and (iii) a traffic shift.

19. The driver assistance system of claim 16, wherein said driver assistance system is operable to recognize a construction zone sign.

20. The driver assistance system of claim 16, wherein said driver assistance system, at least when said image processing of captured image data is operating in said enhanced mode, is operable to discriminate orange from red.

21. The driver assistance system of claim 20, wherein said driver assistance system, at least when said image processing of captured image data is operating in said enhanced mode, is operable to discriminate between reflection of light off an orange sign and red light emitted by a taillight of a leading vehicle based on at least one of (i) the color of the detected light source, (ii) the location of the detected light source relative to the equipped vehicle, (iii) recognition of a reflection of the headlamps of the equipped vehicle and (iv) recognition of a reflection of the headlamps of the equipped vehicle by superimposing a pattern on an output of the headlamps of the equipped vehicle.

22. The driver assistance system of claim 16, wherein said control device, responsive at least in part to at least one of (i) a global positioning system of the equipped vehicle and (ii) a navigation system of the equipped vehicle, is operable to identify when the current geographic location of the equipped vehicle corresponds to a construction zone.

23. The driver assistance system of claim 16, wherein at least one of (i) said camera is disposed at an interior rearview mirror assembly of the equipped vehicle, (ii) said camera is disposed at a windshield electronics module of the equipped vehicle and (iii) said camera views through the windshield of the equipped vehicle at a location that is swept by a windshield wiper of the equipped vehicle.

24. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera disposed at a vehicle equipped with said driver assistance system, wherein said camera views forward of the equipped vehicle through the windshield of the equipped vehicle at a location that is swept by a windshield wiper of the equipped vehicle and wherein said camera is operable to capture image data;

a control device comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein, responsive to processing of captured image data by said image processor, said driver assistance system is operable to adjust a light beam emitted by a headlamp of the equipped vehicle;

wherein said control device, responsive at least in part to image data processing by said image processor, is operable to determine when the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone;

wherein image data processing by said image processor comprises at least one of (a) traffic sign recognition, (b) character recognition, (c) object detection, (d) object recognition, (e) spectral discrimination, (f) spatial recognition and (g) lane marker detection;

wherein determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone comprises spectral recognition of an orange construction sign;

wherein said driver assistance system is operable to recognize at least one of (i) cones indicative of a construction zone, (ii) barrels indicative of a construction zone and (iii) a traffic shift;

wherein, responsive to determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said control device enters an enhanced mode that enhances image processing of captured image data by said image processor to discriminate orange construction zone signs from taillights of leading vehicles so as to adjust the light beam emitted by the headlamp of the equipped vehicle to a higher beam state when no taillights of leading vehicles are present; and

wherein, responsive to determination of the equipped vehicle exiting the construction zone, said control device returns to a normal mode to adjust the light beam emitted by the headlamp of the equipped vehicle responsive to determination of headlamps of approaching vehicles and taillights of leading vehicles.

25. The driver assistance system of claim 24, wherein said image processor processes image data captured by said camera for at least one of (a) a traffic sign recognition system of the equipped vehicle, (b) a lane departure warning system of the equipped vehicle, (c) a forward collision warning system of the equipped vehicle and (d) an object detection system of the equipped vehicle.

26. The driver assistance system of claim 24, wherein, responsive at least in part to said control device determining that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said driver assistance system is operable to adjust the light beam emitted by the headlamp of the equipped vehicle.

27. The driver assistance system of claim 24, wherein said driver assistance system is operable to recognize a construction zone sign.

28. The driver assistance system of claim 24, wherein said driver assistance system, at least when said image processing of captured image data is operating in said enhanced mode, is operable to discriminate orange from red.

29. The driver assistance system of claim 24, wherein said control device, responsive at least in part to at least one of (i) a global positioning system of the equipped vehicle and (ii) a navigation system of the equipped vehicle, is operable to identify when the current geographic location of the equipped vehicle corresponds to a construction zone.

30. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera disposed at a vehicle equipped with said driver assistance system, wherein said camera views forward of the equipped vehicle through the windshield of the equipped vehicle and wherein said camera is operable to capture image data;

a control device comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein, responsive to processing of captured image data by said image processor, said driver assistance system is operable to adjust a light beam emitted by a headlamp of the equipped vehicle;

wherein said control device, responsive at least in part to image data processing by said image processor, is operable to determine when the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone;

wherein said image processor processes image data captured by said camera for at least one of (a) a traffic sign recognition system of the equipped vehicle, (b) a lane departure warning system of the equipped vehicle, (c) a forward collision warning system of the equipped vehicle and (d) an object detection system of the equipped vehicle;

wherein determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone comprises spectral recognition of an orange construction sign;

wherein, responsive to determination that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said control device enters an enhanced mode that enhances image processing of captured image data by said image processor to discriminate orange construction zone signs from taillights of leading vehicles so as to adjust the light beam emitted by the headlamp of the equipped vehicle to a higher beam state when no taillights of leading vehicles are present; and

wherein, responsive to determination of the equipped vehicle exiting the construction zone, said control device returns to a normal mode to adjust the light beam emitted by the headlamp of the equipped vehicle responsive to determination of headlamps of approaching vehicles and taillights of leading vehicles.

31. The driver assistance system of claim 30, wherein, responsive at least in part to said control device determining that the equipped vehicle is at least one of (i) approaching a construction zone, (ii) entering a construction zone and (iii) driving along a construction zone, said driver assistance system is operable to adjust the light beam emitted by the headlamp of the equipped vehicle.

32. The driver assistance system of claim 30, wherein said driver assistance system is operable to recognize a construction zone sign.

33. The driver assistance system of claim 30, wherein said driver assistance system, at least when said image processing of captured image data is operating in said enhanced mode, is operable to discriminate orange from red.

34. The driver assistance system of claim 30, wherein said driver assistance system is operable to recognize at least one of (i) cones indicative of a construction zone, (ii) barrels indicative of a construction zone and (iii) a traffic shift.