Driver assistance system for vehicle

• US 10,623,704 B2
• Filed: 03/09/2015
• Issued: 04/14/2020
• Est. Priority Date: 09/30/2004
• Status: Active Grant

• Current Assignee: Donnelly Corporation (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Camilleri, Joseph, Gibson, Joel S., Schofield, Kenneth
• Primary Examiner(s): Motsinger, Sean T
• Application Number:
  US14/641,814
• Publication Number:
  US 20150181175A1
• Time in Patent Office: 1,863 Days
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/101 using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/106 using night vision cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control
• CPC Class Codes: H04N 7/188 : Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: Y10S 348/904 : Separation or joining of side and center panels

Abstract

A driver assistance system for a vehicle includes an imager disposed at the vehicle and viewing exterior the vehicle. A control includes an image processor and is operable to process captured image data for at least a first application and a second application and to adjust the image sensor to at least two settings and to process captured image data via at least two processing techniques. The control is operable to synchronize the at least two settings of the image sensor and the at least two processing techniques to extract respective information from the captured image data for the first and second applications. The control adjusts a setting of the image sensor to capture image data suitable for the first application or the second application. The image processor processes captured image data via a processing technique suitable for the first application or the second application.

Claims

1. A driver assistance system for a vehicle, said driver assistance system comprising:

an imager disposed at a vehicle equipped with said driver assistance system and viewing one of (i) forward of the equipped vehicle and (ii) rearward of the equipped vehicle;

said imager having a field of view exterior the equipped vehicle and operable to capture image data;

said imager comprising (i) a lens, (ii) a spectral filter and (iii) an image sensor comprising a CMOS photosensor array of photosensor elements;

a control comprising an image processor;

wherein said control is operable to process captured image data for at least a first application and a second application, and wherein said first application comprises lane departure warning and said second application comprises headlamp control;

wherein said control is operable to adjust said image sensor to at least two settings including at least a first setting and a second setting;

wherein said control is operable to process captured image data via at least two processing techniques;

wherein said control is operable to synchronize said at least two settings of said image sensor and said at least two processing techniques to extract information from said captured image data for said first and second applications;

wherein said control adjusts a setting of said image sensor to said first setting to capture image data suitable for said first application;

wherein said control adjusts a setting of said image sensor to said second setting to capture image data suitable for said second application;

wherein said image processor processes captured image data captured by said image sensor at said first setting via a processing technique suitable for said first application;

wherein said image processor processes captured image data captured by said image sensor at said second setting via a processing technique suitable for said second application;

wherein said driver assistance system comprises an auxiliary sensor;

wherein said auxiliary sensor is selected from the group consisting of (i) an ultrasonic sensor, (ii) a radar sensor and (iii) a lidar sensor;

wherein said auxiliary sensor is operable to detect an object exterior the equipped vehicle; and

wherein, responsive at least in part to detection of the object by said auxiliary sensor, at least one of (i) a setting of said image sensor is adjusted and (ii) processing of image data that corresponds to a region at which the object is detected is enhanced.

2. The driver assistance system of claim 1, and wherein said first application also includes an application selected from the group consisting of (i) vehicle detection and (ii) object detection.

3. The driver assistance system of claim 2, wherein said second application also includes an application selected from the group consisting of (i) driving separation indication, (ii) backup assist and (iii) object detection.

4. The driver assistance system of claim 1, wherein said control is operable to process captured image data for said first application from a first set of captured image data in a first image processing to generate a first output in response to the first image processing, and wherein said control is operable to process captured image data for said second application from a second set of captured image data in a second image processing to generate a second output in response to the second image processing.

5. The driver assistance system of claim 1, wherein, responsive to processing by said control of captured image data, said control determines an ambient light level exterior the equipped vehicle.

6. The driver assistance system of claim 1, wherein said control is operable to process captured image data for a third application.

7. The driver assistance system of claim 1, wherein said imager and at least a part of said control are disposed in an accessory module of the equipped vehicle and wherein said imager views forward of the equipped vehicle through a windshield of the equipped vehicle.

8. The driver assistance system of claim 1, wherein image data captured by said imager are output via LVDS.

9. The driver assistance system of claim 1, wherein the frame rate used to capture image data for said first application differs from the frame rate used to capture image data for said second application.

10. The driver assistance system of claim 1, wherein said control is operable to at least one of (a) provide enhanced imaging of an object viewed by said imager and (b) provide enhanced processing of at least a portion of an image captured by said imager that corresponds to a region exterior the equipped vehicle at which an object is viewed by said imager.

11. The driver assistance system of claim 1, wherein said control is operable to selectively or intermittently or occasionally adjust a setting of said image sensor to extract information from said captured image data for headlamp control and for lane departure warning.

12. The driver assistance system of claim 11, wherein said control is operable to selectively or intermittently or occasionally adjust a processing technique to extract information from said captured image data for headlamp control and for lane departure warning.

13. A driver assistance system for a vehicle, said driver assistance system comprising:

an imager disposed at a vehicle equipped with said driver assistance system and viewing one of (i) forward of the equipped vehicle through a windshield of the equipped vehicle and (ii) rearward of the equipped vehicle;

said imager having a field of view exterior the equipped vehicle and operable to capture image data;

said imager comprising (i) a lens, (ii) a spectral filter and (iii) an image sensor comprising a CMOS photosensor array of photosensor elements;

a control comprising an image processor;

wherein said control is operable to process captured image data for at least a first application and a second application, and wherein said first application comprises lane departure warning and said second application comprises headlamp control;

wherein said control is operable to adjust said image sensor to at least two settings including at least a first setting and a second setting;

wherein said control is operable to process captured image data via at least two processing techniques;

wherein said control is operable to synchronize said at least two settings of said image sensor and said at least two processing techniques to extract information from said captured image data for said first and second applications;

wherein said control adjusts a setting of said image sensor to said first setting to capture image data suitable for said first application;

wherein said control adjusts a setting of said image sensor to said second setting to capture image data suitable for said second application;

wherein said image processor processes captured image data captured by said image sensor at said first setting via a processing technique suitable for said first application;

wherein said image processor processes captured image data captured by said image sensor at said second setting via a processing technique suitable for said second application;

wherein said control is operable to process captured image data for a third application;

wherein said driver assistance system comprises an auxiliary sensor;

wherein said auxiliary sensor is selected from the group consisting of (i) an ultrasonic sensor, (ii) a radar sensor and (iii) a lidar sensor;

wherein said auxiliary sensor is operable to detect an object exterior the equipped vehicle; and

wherein, responsive at least in part to detection of the object by said auxiliary sensor, at least one of (i) a setting of said image sensor is adjusted and (ii) processing of image data that corresponds to a region at which the object is detected is enhanced.

14. The driver assistance system of claim 13, wherein said control is operable to at least one of (a) provide enhanced imaging of an object viewed by said imager and (b) provide enhanced processing of at least a portion of an image captured by said imager that corresponds to a region exterior the equipped vehicle at which an object is viewed by said imager.

15. The driver assistance system of claim 13, wherein at least one of (a) said control is operable to selectively or intermittently or occasionally adjust a setting of said image sensor to extract information from said captured image data for headlamp control and for lane departure warning and (b) wherein said control is operable to selectively or intermittently or occasionally adjust a processing technique to extract information from said captured image data for headlamp control and for lane departure warning.

16. A driver assistance system for a vehicle, said driver assistance system comprising:

an imager disposed at a vehicle equipped with said driver assistance system and viewing forward of the equipped vehicle through a windshield of the equipped vehicle;

said imager having a field of view exterior the equipped vehicle and operable to capture image data;

said imager comprising (i) a lens, (ii) a spectral filter and (iii) an image sensor comprising a CMOS photosensor array of photosensor elements;

a control comprising an image processor;

wherein said control is operable to process captured image data for at least a first application and a second application, and wherein said first application comprises lane departure warning and said second application comprises headlamp control;

wherein said control is operable to adjust said image sensor to at least two settings including at least a first setting and a second setting;

wherein said control is operable to process captured image data via at least two processing techniques;

wherein said control is operable to synchronize said at least two settings of said image sensor and said at least two processing techniques to extract information from said captured image data for said first and second applications;

wherein said control adjusts a setting of said image sensor to said first setting to capture image data suitable for said first application;

wherein said control adjusts a setting of said image sensor to said second setting to capture image data suitable for said second application;

wherein said image processor processes captured image data captured by said image sensor at said first setting via a processing technique suitable for said first application;

wherein said image processor processes captured image data captured by said image sensor at said second setting via a processing technique suitable for said second application;

wherein said control is operable to process captured image data for a third application;

wherein said imager and at least a part of said control are disposed in an accessory module of the equipped vehicle and wherein said accessory module is mounted at the inner-cabin surface of the windshield of the equipped vehicle;

wherein said driver assistance system comprises an auxiliary sensor;

wherein said auxiliary sensor is selected from the group consisting of (i) an ultrasonic sensor, (ii) a radar sensor and (iii) a lidar sensor;

wherein said auxiliary sensor is operable to detect an object exterior the equipped vehicle; and

wherein, responsive at least in part to detection of the object by said auxiliary sensor, at least one of (i) a setting of said image sensor is adjusted and (ii) processing of image data that corresponds to a region at which the object is detected is enhanced.

17. The driver assistance system of claim 16, wherein said control is operable to at least one of (a) provide enhanced imaging of an object viewed by said imager and (b) provide enhanced processing of at least a portion of an image captured by said imager that corresponds to a region exterior the equipped vehicle at which an object is viewed by said imager.

18. The driver assistance system of claim 16, wherein at least one of (a) said control is operable to selectively or intermittently or occasionally adjust a setting of said image sensor to extract information from said captured image data for headlamp control and for lane departure warning and (b) wherein said control is operable to selectively or intermittently or occasionally adjust a processing technique to extract information from said captured image data for headlamp control and for lane departure warning.