Driver assistance system for vehicle

• US 8,977,008 B2
• Filed: 07/08/2013
• Issued: 03/10/2015
• Est. Priority Date: 09/30/2004
• Status: Active Grant

• Current Assignee: Donnelly Corporation (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Camilleri, Joseph, Gibson, Joel S., Schofield, Kenneth
• Primary Examiner(s): MOTSINGER, SEAN T
• Application Number:
  US13/936,701
• Publication Number:
  US 20130293715A1
• Time in Patent Office: 610 Days
• Field of Search: None
• US Class Current: 382/104
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/101 using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/106 using night vision cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control
• CPC Class Codes: H04N 7/188 : Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: Y10S 348/904 : Separation or joining of side and center panels

Abstract

A driver assistance system for a vehicle includes an imager disposed in the vehicle and viewing forward of the vehicle through the vehicle windshield. The imager has a field of view exterior the vehicle and is operable to capture image data. The imager includes (i) a lens, (ii) a spectral filter and (iii) a CMOS photosensor array of photosensor elements. The system includes a control that may be operable to process captured image data for at least a first application and a second application, with the first application including lane departure warning and the second application selected from the group consisting of (i) headlamp control, (ii) vehicle detection and (iii) rain sensing. The control may be operable to adjust a parameter or setting of the imager.

Claims

1. A driver assistance system for a vehicle, said driver assistance system comprising:

an imager disposed at a vehicle equipped with said driver assistance system and viewing one of (i) forward of the equipped vehicle through a windshield of the equipped vehicle and (ii) rearward of the equipped vehicle;

said imager having a field of view exterior the equipped vehicle and operable to capture color video images;

said imager comprising (i) a lens, (ii) a spectral filter and (iii) a CMOS photosensor array of photosensor elements;

a control comprising an image processor;

wherein said control is operable to process captured video images for at least a first application and a second application, and wherein said first application is selected from the group consisting of (i) headlamp control, (ii) vehicle detection, (iii) rain sensing, (iv) lane departure warning, (v) ambient light sensing, (vi) collision avoidance, (vii) driving separation indication, (viii) backup assist and (ix) object detection;

wherein said second application is another application selected from the group consisting of (i) headlamp control, (ii) vehicle detection, (iii) rain sensing, (iv) lane departure warning, (v) ambient light sensing, (vi) collision avoidance, (vii) driving separation indication, (viii) backup assist and (ix) object detection;

wherein said control is operable to adjust a parameter of said imager;

a display disposed in the equipped vehicle and viewable by a driver of the equipped vehicle; and

wherein said control is operable to provide color management for display of captured color video images by said display;

wherein said imager communicates an image signal to said display via a communication link, and wherein a display microcontroller affects the image signal in response to at least one user input, and wherein said control monitors the image signal on said communication link and adjusts a function of said imager in response to a detection of the affected image signal, and wherein said display microcontroller affects the image signal by disabling a video termination at said display.

2. The driver assistance system of claim 1, wherein the adjusted imager parameter comprises sensitivity of said imager.

3. The driver assistance system of claim 1, wherein the adjusted imager parameter comprises a setting of said imager.

4. The driver assistance system of claim 1, wherein said control is operable to process captured video images for said first application from a first set of captured video images in a first image processing to generate a first output in response to the first image processing, and wherein said control is operable to process captured video images for said second application from a second set of captured video images in a second image processing to generate a second output in response to the second image processing.

5. The driver assistance system of claim 4, wherein the adjusted imager parameter used for said first set of captured video images differs from the adjusted imager parameter used for said second set of captured video images.

6. The driver assistance system of claim 4, wherein said second application comprises vehicle detection.

7. The driver assistance system of claim 4, wherein said second application comprises headlamp control.

8. The driver assistance system of claim 4, wherein said control is operable to process captured video images for a third application from a third set of captured video images in a third image processing to generate a third output in response to a third image processing.

9. The driver assistance system of claim 1, wherein said imager and at least a part of said control are disposed in an accessory module of the equipped vehicle.

10. The driver assistance system of claim 1, wherein video images captured by said imager are output via LVDS.

11. The driver assistance system of claim 1, wherein the adjusted imager parameter comprises sensitivity of said imager and wherein sensitivity of said imager is increased when the equipped vehicle is operated under nighttime conditions.

12. The driver assistance system of claim 1, wherein said control is operable to adjust said imager to at least two settings, and wherein said control is operable to process captured video images via at least two processing techniques for respective ones of said at least two settings.

13. The driver assistance system of claim 1, wherein the frame rate used to capture video images for said first application differs from the frame rate used to capture video images for said second application.

14. The driver assistance system of claim 1, wherein said control is operable to at least one of (a) provide enhanced imaging of an object viewed by said imager and (b) provide enhanced processing of at least a portion of an image captured by said imager that corresponds to the region exterior the equipped vehicle at which an object is viewed by said imager.

15. The driver assistance system of claim 1, wherein, responsive to processing by said control of captured video images, said controls determines an ambient light level exterior the equipped vehicle.

16. A driver assistance system for a vehicle, said driver assistance system comprising:

an imager disposed at a vehicle equipped with said driver assistance system and one of (i) viewing forward of the equipped vehicle through a windshield of the equipped vehicle and (ii) viewing rearward of the equipped vehicle;

said imager having a field of view exterior the equipped vehicle and operable to capture color video images;

said imager comprising (i) a lens, (ii) a spectral filter and (iii) a CMOS photosensor array of photosensor elements;

a control comprising an image processor;

wherein said control is operable to at least two of (i) process captured video images in a manner that is suitable for headlamp detection, (ii) process captured video images in a manner that is suitable for ambient light detection, (iii) process captured video images in a manner that is suitable for vehicle detection, (iv) process captured video images in a manner that is suitable for rain detection, (v) process captured video images in a manner that is suitable for lane detection, (vi) process captured video images in a manner that is suitable for collision avoidance, (vii) process captured video images in a manner that is suitable for driving separation indication, (viii) process captured video images in a manner that is suitable for backup assist and (ix) process captured video images in a manner that is suitable for object detection;

wherein said control is operable to adjust at least one of (a) a setting of said imager, (b) a sensitivity of said imager and (c) a focus of said imager;

a display disposed in the equipped vehicle and viewable by a driver of the equipped vehicle; and

wherein said control is operable to provide color management for display of

captured color video images by said display;

wherein said imager communicates an image signal to said display via a communication link, and wherein a display microcontroller affects the image signal in response to at least one user input, and wherein said control monitors the image signal on said communication link and adjusts a function of said imager in response to a detection of the affected image signal, and wherein said display microcontroller affects the image signal by disabling a video termination at said display.

17. The driver assistance system of claim 16, wherein said control is operable to process captured video images in a manner suitable for a first application from a first set of captured video images in a first image processing to generate a first output in response to the first image processing, and wherein said control is operable to process captured video images in a manner suitable for a second application from a second set of captured video images in a second image processing to generate a second output in response to the second image processing, and wherein an imager parameter used for said first set of captured video images differs from an imager parameter used for said second set of captured video images.

18. A driver assistance system for a vehicle, said driver assistance system comprising:

an imager disposed at a vehicle equipped with said driver assistance system and one of (i) viewing forward of the equipped vehicle through a windshield of the equipped vehicle and (ii) viewing rearward of the equipped vehicle;

said imager having a field of view exterior the equipped vehicle and operable to capture color video images;

said imager comprising (i) a lens, (ii) a spectral filter and (iii) a CMOS photosensor array of photosensor elements;

a control comprising an image processor;

wherein said control is operable to at least two of (i) process captured video images in a manner that is suitable for headlamp detection, (ii) process captured video images in a manner that is suitable for ambient light detection, (iii) process captured video images in a manner that is suitable for vehicle detection and (iv) process captured video images in a manner that is suitable for rain detection, (v) process captured video images in a manner that is suitable for lane detection, (vi) process captured video images in a manner that is suitable for collision avoidance, (vii) process captured video images in a manner that is suitable for driving separation indication, (viii) process captured video images in a manner that is suitable for backup assist and (ix) process captured video images in a manner that is suitable for object detection;

wherein said control is operable to adjust a setting of said imager;

a display disposed in the equipped vehicle and viewable by a driver of the equipped vehicle; and

wherein said control is operable to provide color management for display of

captured color video images by said display;

wherein said imager communicates an image signal to said display via a communication link, and wherein a display microcontroller affects the image signal in response to at least one user input, and wherein said control monitors the image signal on said communication link and adjusts a function of said imager in response to a detection of the affected image signal, and wherein said display microcontroller affects the image signal by disabling a video termination at said display.

19. The driver assistance system of claim 18, wherein said control is operable to adjust said imager to at least two settings, and wherein said driver assistance system is operable to process video images captured by said imager via at least two processing techniques for respective ones of said at least two settings.