VEHICULAR IMAGING SYSTEM WITH BLOCKAGE DETERMINATION AND MISALIGNMENT CORRECTION

• US 20180260973A1
• Filed: 05/14/2018
• Published: 09/13/2018
• Est. Priority Date: 08/17/2007
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Lu, Yuesheng, Higgins-Luthman, Michael J., Jeyaraj, Antony V., Phirke, Manoj R.
• Granted Patent: US 10,726,578 B2
• Time in Patent Office: Days
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30256 Lane; Road marking
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A vehicular imaging system includes an imaging device having a single imaging sensor capturing image data within a field of view. A control within the vehicle includes an image processor and receives image data captured by the single imaging sensor and receives vehicle data via a communication bus of the vehicle. Responsive at least in part to image processing of captured image data, the control detects converging road features along the road the vehicle is travelling and determines a point of intersection where the converging road features would converge. Responsive at least in part to image processing of captured image data, the control automatically corrects for misalignment of the imaging device mounted at the vehicle.

Claims

1. A vehicular imaging system comprising:

an imaging device comprising a single imaging sensor;

said single imaging sensor comprising a plurality of photosensor pixels;

said imaging device mounted at a vehicle equipped with said vehicular imaging system and having a field of view exterior of the equipped vehicle;

wherein said field of view exterior of the equipped vehicle encompasses a scene forward of the equipped vehicle;

wherein said imaging device is disposed in the equipped vehicle behind the windshield of the equipped vehicle and views through a portion of the windshield;

wherein said portion of the windshield comprises a portion cleaned by a windshield wiper of the equipped vehicle;

wherein said imaging device comprises a CMOS imaging device;

said single imaging sensor of said imaging device capturing image data within said field of view;

wherein a control within the equipped vehicle receives said image data;

said control comprising an image processor;

wherein said control receives vehicle data via a communication bus of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by said single imaging sensor, said control automatically corrects for misalignment of said imaging device mounted at the equipped vehicle;

wherein said automatic correction for misalignment of said imaging device mounted at the equipped vehicle comprises, at least in part, said control comparing an imaged location of an object present in the field of view of said single imaging sensor to an expected location of said object, wherein the imaged location is determined by image processing by said image processor of image data captured by said single imaging sensor and wherein the expected location is determined responsive to vehicle data carried to said control via said communication bus; and

wherein, responsive at least in part to image processing by said image processor of image data captured by said single imaging sensor, said control controls, at least in part, a lane departure warning system of the equipped vehicle and at least one of (i) an automatic high beam control system of the equipped vehicle, (ii) a collision avoidance system of the equipped vehicle, (iii) an object detection system of the equipped vehicle and (iv) an adaptive front lighting system of the equipped vehicle.

2. The vehicular imaging system of claim 1, wherein said control concludes that said single imaging sensor is totally blocked when, over a plurality of frames of image data captured by said single imaging sensor, processing of image data by said image processor determines that the count of bright pixels remains below a threshold.

3. The vehicular imaging system of claim 1, wherein said control concludes that said single imaging sensor is partially blocked by said image processor performing region-based image processing to take into account intensity variations in different regions of said single imaging sensor.

4. The vehicular imaging system of claim 1, wherein said control is operable to detect and ameliorate a bad photosensor pixel of said plurality of photosensor pixels.

5. The vehicular imaging system of claim 1, wherein said vehicle data comprises vehicle yaw information and vehicle steering information.

6. A vehicular imaging system comprising:

an imaging device comprising a single imaging sensor;

said single imaging sensor comprising a plurality of photosensor pixels;

said imaging device mounted at a vehicle equipped with said vehicular imaging system and having a field of view exterior of the equipped vehicle;

wherein said field of view exterior of the equipped vehicle encompasses a scene forward of the equipped vehicle;

wherein said imaging device is disposed in the equipped vehicle behind the windshield of the equipped vehicle and views through a portion of the windshield;

wherein said portion of the windshield comprises a portion cleaned by a windshield wiper of the equipped vehicle;

said single imaging sensor of said imaging device capturing image data within said field of view;

wherein a control within the equipped vehicle receives said image data;

said control comprising an image processor;

wherein said control receives vehicle data via a communication bus of the equipped vehicle;

wherein, responsive at least in part to image processing by said image processor of image data captured by said single imaging sensor, said control automatically corrects for misalignment of said imaging device mounted at the equipped vehicle;

wherein said automatic correction for misalignment of said imaging device mounted at the equipped vehicle comprises, at least in part, said control comparing an imaged location of an object present in the field of view of said single imaging sensor to an expected location of said object, wherein the imaged location is determined by image processing by said image processor of image data captured by said single imaging sensor and wherein the expected location is determined responsive to vehicle data carried to said control via said communication bus;

wherein, responsive at least in part to image processing by said image processor of image data captured by said single imaging sensor, said control controls, at least in part, a driver assistance system of the equipped vehicle; and

wherein, responsive at least in part to image processing by said image processor of image data captured by said single imaging sensor, said control determines the driving side of the road the equipped vehicle is travelling on.

7. The vehicular imaging system of claim 6, wherein said control concludes that said single imaging sensor is totally blocked when, over a plurality of frames of image data captured by said single imaging sensor, processing of image data by said image processor determines that the count of bright pixels remains below a threshold.

8. The vehicular imaging system of claim 7, wherein said control concludes that said single imaging sensor is partially blocked by said image processor performing region-based image processing to take into account intensity variations in different regions of said single imaging sensor.

9. The vehicular imaging system of claim 6, wherein said control is operable to detect and ameliorate a bad photosensor pixel of said plurality of photosensor pixels.

10. The vehicular imaging system of claim 6, wherein said vehicle data comprises vehicle yaw information and vehicle steering information.

11. The vehicular imaging system of claim 6, wherein said driver assistance system comprises at least two of (i) an automatic high beam control system of the equipped vehicle, (ii) a collision avoidance system of the equipped vehicle, (iii) an object detection system of the equipped vehicle, (iv) a lane departure warning system of the equipped vehicle and (v) an adaptive front lighting system of the equipped vehicle.

12. The vehicular imaging system of claim 11, wherein said imaging device comprises a CMOS imaging device and wherein said vehicle data comprises vehicle yaw information and vehicle steering information.