Driver assistance system for vehicle

• US 10,005,394 B2
• Filed: 11/16/2015
• Issued: 06/26/2018
• Est. Priority Date: 05/15/2009
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Higgins-Luthman, Michael J.
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): Kong, Sze-Hon
• Application Number:
  US14/942,088
• Publication Number:
  US 20160075283A1
• Time in Patent Office: 953 Days
• Field of Search: None
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/146 Abnormalities, e.g. fail-safe
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: B60Q 2300/322 Road curvature
• CPC Class Codes: B60Q 2300/33 Driving situation
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60Q 2300/45 Special conditions, e.g. pedestrians, road signs or potential dangers
• CPC Class Codes: B60Q 2300/47 Direct command from other road users, i.e. the command for switching or changing the beam is sent by other vehicles or road devices
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/80 characterised by the intended use of the viewing arrangement
• CPC Class Codes: B60S 1/54 using gas, e.g. hot air
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A driver assistance system for a vehicle includes a camera that, when disposed at the vehicle, views through a windshield of the vehicle. The camera is disposed at a windshield electronics module attached at the windshield of the vehicle. The camera captures image data of a scene forward of the vehicle. A control includes an image processor that processes captured image data. The control, responsive to the image processor processing captured image data, detects an object of interest external to the vehicle. The control utilizes a blockage detection algorithm and, responsive to the image processor processing captured image data, is operable to detect at least a partial blocking condition at the camera.

Claims

1. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera configured to be disposed at a vehicle equipped with said driver assistance system;

wherein said camera, when disposed at the equipped vehicle, views through a windshield of the equipped vehicle;

wherein said camera is disposed at a windshield electronics module attached at the windshield of the equipped vehicle;

wherein said camera views forwardly through the windshield of the equipped vehicle at a location that is swept by a windshield wiper of the equipped vehicle;

said camera capturing image data of a scene forward of the equipped vehicle;

a controller comprising an image processor;

said image processor processing captured image data;

wherein said controller, responsive to said image processor processing captured image data, detects an object of interest external to the vehicle;

wherein said image processor, when processing captured image data, utilizes a blockage detection algorithm to detect at least a partial blocking condition at said camera;

wherein said controller determines a driving condition of the vehicle;

wherein, responsive to determination of a driving condition that is indicative of end of line vehicle testing of the vehicle at a vehicle assembly plant, and responsive to said image processor processing captured image data and said image processor utilizing said blockage detection algorithm, said image processor detects at least a partial blocking condition at said camera; and

wherein, during the determined end of line vehicle testing of the vehicle at the vehicle assembly plant and with the vehicle driven on rollers to check engine performance, said controller ignores the detected partial blockage condition at said camera.

2. The driver assistance system of claim 1, wherein said controller does not ignore the detected partial blockage condition at said camera when the determined driving condition is not indicative of end of line vehicle testing of the vehicle.

3. The driver assistance system of claim 2, wherein the determined driving condition comprises a low lighting condition, and wherein the low lighting condition is determined responsive to image processing by said image processor of captured image data.

4. The driver assistance system of claim 2, wherein captured image data is processed differently by said image processor depending on the driving condition to reduce false blockage detection.

5. The driver assistance system of claim 4, wherein processing by said image processor comprises comparison of different regions of captured image data.

6. The driver assistance system of claim 1, wherein detection of an at least partial blocking condition is inhibited during an initial start-up period of the vehicle immediately following when the vehicle is turned on.

7. The driver assistance system of claim 1, wherein processing of captured image data by said image processor adjusts responsive to a determination that the vehicle is traveling along a curved road.

8. The driver assistance system of claim 1, wherein processing of captured image data by said image processor adjusts responsive to a determination that the vehicle is traveling along an on-ramp or off-ramp of an expressway or freeway.

9. The driver assistance system of claim 1, wherein said blockage detection algorithm comprises a total blockage algorithm that, for a frame of captured image data, counts the number of pixels of a pixelated imaging array of said camera above an intensity threshold and if, over a number of subsequent frames of captured image data, the count is continuously below a threshold level, said controller concludes that said camera is substantially or totally blocked.

10. The driver assistance system of claim 1, wherein said blockage detection algorithm comprises a partial blockage algorithm wherein region-based processing of captured image data by said image processor takes into account intensity variations in different regions of a pixelated imaging array of said camera, and wherein, based on intensity variations with neighboring or adjacent regions and the continuity of the variations over time, said controller determines that the imaging array is partially blocked.

11. The driver assistance system of claim 1, wherein said image processor, when in a night mode, processes a blocked pixel region of a pixelated imaging array of said camera to reduce or substantially preclude false blockage detection.

12. The driver assistance system of claim 1, wherein said camera comprises a pixelated imaging array, and wherein, if either partial or total blockage is determined when the determined driving condition is not indicative of end of line vehicle testing of the vehicle, processing of captured image data by said image processor adapts to accommodate blocked pixels.

13. The driver assistance system of claim 12, wherein a driver of the vehicle is alerted that pixels are blocked.

14. The driver assistance system of claim 12, wherein a blower system of the vehicle is activated to direct or force or blow air towards the windshield to remove or dissipate the blockage.

15. The driver assistance system of claim 12, wherein said controller automatically detects that the blockage has been removed and resumes normal functionality.

16. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera configured to be disposed at a vehicle equipped with said driver assistance system;

wherein said camera, when disposed at the equipped vehicle, views through a windshield of the equipped vehicle;

wherein said camera is disposed at a windshield electronics module attached at the windshield of the equipped vehicle;

wherein said camera views forwardly through the windshield of the equipped vehicle at a location that is swept by a windshield wiper of the equipped vehicle;

said camera capturing image data of a scene forward of the equipped vehicle;

a controller comprising an image processor;

said image processor processing captured image data;

wherein said controller, responsive to said image processor processing captured image data, detects an object of interest external to the vehicle;

wherein said image processor, when processing captured image data, utilizes a blockage detection algorithm to detect at least a partial blocking condition at said camera;

wherein said controller determines a driving condition of the vehicle;

wherein, responsive to determination of a driving condition that is indicative of end of line vehicle testing of the vehicle at a vehicle assembly plant, and responsive to said image processor processing captured image data and said image processor utilizing said blockage detection algorithm, said image processor detects at least a partial blocking condition at said camera;

wherein, during the determined end of line vehicle testing of the vehicle at the vehicle assembly plant and with the vehicle driven on rollers to check engine performance, said controller ignores the detected partial blockage condition at said camera;

wherein said camera comprises a pixelated imaging array, and wherein, if either partial or total blockage is determined when the determined driving condition is not indicative of end of line vehicle testing of the vehicle, processing of captured image data by said image processor adapts to accommodate blocked pixels; and

wherein said controller automatically detects that the blockage has been removed and resumes normal functionality.

17. The driver assistance system of claim 16, wherein said controller does not ignore the detected partial blockage condition at said camera when the determined driving condition is not indicative of end of line vehicle testing of the vehicle.

18. The driver assistance system of claim 16, wherein said controller, when in a night mode, processes a blocked pixel region of said pixelated imaging array of said camera to reduce or substantially preclude false blockage detection.

19. A driver assistance system for a vehicle, said driver assistance system comprising:

a camera configured to be disposed at a vehicle equipped with said driver assistance system;

wherein said camera, when disposed at the equipped vehicle, views through a windshield of the equipped vehicle;

wherein said camera is disposed at a windshield electronics module attached at the windshield of the equipped vehicle;

wherein said camera views forwardly through the windshield of the equipped vehicle at a location that is swept by a windshield wiper of the equipped vehicle;

said camera capturing image data of a scene forward of the equipped vehicle;

a controller comprising an image processor;

said image processor processing captured image data;

wherein said controller, responsive to said image processor processing captured image data, detects an object of interest external to the vehicle;

wherein said image processor, when processing captured image data, utilizes a blockage detection algorithm to detect at least a partial blocking condition at said camera;

wherein said controller determines a driving condition of the vehicle;

wherein, responsive to determination of a driving condition that is indicative of end of line vehicle testing of the vehicle at a vehicle assembly plant, and responsive to said image processor processing captured image data and said image processor utilizing said blockage detection algorithm, said image processor detects at least a partial blocking condition at said camera;

wherein, during the determined end of line vehicle testing of the vehicle at the vehicle assembly plant and with the vehicle driven on rollers to check engine performance, said controller ignores the detected partial blockage condition at said camera;

wherein captured image data is processed differently by said image processor depending on the determined driving condition to reduce false blockage detection; and

wherein said camera comprises a pixelated imaging array, and wherein, if either partial or total blockage is determined when the determined driving condition is not indicative of end of line vehicle testing, processing of captured image data by said image processor adapts to accommodate blocked pixels.

20. The driver assistance system of claim 19, wherein said driving condition comprises a low lighting condition, and wherein the low lighting condition is determined responsive to image processing by said image processor of captured image data.