Driver assist system for vehicle
First Claim
1. A vehicular driver assist system suitable for use in a vehicle, said vehicular driver assist system comprising:
- a video processor module disposed at a vehicle equipped with said vehicular driver assist system;
said video processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle;
said video processor module receiving and processing sensor data provided by a plurality of non-video sensors disposed at the equipped vehicle;
said plurality of video sensors comprising at least five vehicular cameras;
said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle;
said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle;
said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle;
said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle;
said at least five vehicular cameras comprising a fifth vehicular camera disposed at, and viewing forwardly through, an in-cabin side of a windshield of the equipped vehicle;
wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data;
wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data;
wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data;
wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data;
wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data;
wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor and wherein said fifth vehicular camera comprises a CMOS imaging sensor;
said plurality of non-video sensors comprising at least one non-video sensor selected from the group consisting of a radar sensor, a near-infrared sensor, a far-infrared sensor, a thermal sensor and a sonar sensor;
wherein said video processor module receives first image data captured by said first vehicular camera;
wherein said video processor module receives second image data captured by said second vehicular camera;
wherein said video processor module receives third image data captured by said third vehicular camera;
wherein said video processor module receives fourth image data captured by said fourth vehicular camera;
wherein said video processor module receives fifth image data captured by said fifth vehicular camera;
wherein said video processor module receives sensor data captured by said plurality of non-video sensors;
wherein said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle;
wherein received image data is processed at said video processor module to generate a synthesized image;
wherein said synthesized image is output from said video processor module for display by a single display screen of a display device of the equipped vehicle that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle;
wherein said synthesized image displayed by said display screen approximates a view as would be viewed from a single virtual camera located exterior the equipped vehicle; and
wherein, responsive at least in part to processing of image data and sensor data at said video processor module, a driver assistance system of the equipped vehicle is controlled.
0 Assignments
0 Petitions
Accused Products
Abstract
A vehicular driver assist system suitable for use in a vehicle includes a video processor module receiving and processing image data provided by a plurality of video sensors and sensor data provided by a plurality of non-video sensors. The video processor module communicates with other vehicle systems via a vehicle bus. The received image data may be processed at the video processor module to generate a synthesized image, which may be output from the video processor module for display by a single display screen of a display device that is viewable by a driver of the vehicle. An object external to the vehicle may be detected, at least in part, via processing of image data at the video processor module. Responsive at least in part to processing of image data and sensor data at the video processor module, a driver assistance system of the vehicle is controlled.
537 Citations
46 Claims
-
1. A vehicular driver assist system suitable for use in a vehicle, said vehicular driver assist system comprising:
-
a video processor module disposed at a vehicle equipped with said vehicular driver assist system; said video processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle; said video processor module receiving and processing sensor data provided by a plurality of non-video sensors disposed at the equipped vehicle; said plurality of video sensors comprising at least five vehicular cameras; said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle; said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle; said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; said at least five vehicular cameras comprising a fifth vehicular camera disposed at, and viewing forwardly through, an in-cabin side of a windshield of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor and wherein said fifth vehicular camera comprises a CMOS imaging sensor; said plurality of non-video sensors comprising at least one non-video sensor selected from the group consisting of a radar sensor, a near-infrared sensor, a far-infrared sensor, a thermal sensor and a sonar sensor; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives fifth image data captured by said fifth vehicular camera; wherein said video processor module receives sensor data captured by said plurality of non-video sensors; wherein said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle; wherein received image data is processed at said video processor module to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device of the equipped vehicle that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein said synthesized image displayed by said display screen approximates a view as would be viewed from a single virtual camera located exterior the equipped vehicle; and wherein, responsive at least in part to processing of image data and sensor data at said video processor module, a driver assistance system of the equipped vehicle is controlled. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
-
-
36. A vehicular driver assist system suitable for use in a vehicle, said vehicular driver assist system comprising:
-
a video processor module disposed at a vehicle equipped with said vehicular driver assist system; said video processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle; said video processor module receiving and processing sensor data provided by a plurality of radar sensors disposed at the equipped vehicle; said plurality of video sensors comprising at least five vehicular cameras; said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle; said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle; said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; said at least five vehicular cameras comprising a fifth vehicular camera disposed at, and viewing forwardly through, an in-cabin side of a windshield of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data; wherein said third vehicular camera disposed at the rear portion of the equipped vehicle is located at or proximate to a longitudinal centerline of the equipped vehicle; wherein said fourth vehicular camera disposed at the front portion of the equipped vehicle is located at or proximate to the longitudinal centerline of the equipped vehicle; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor and wherein said fifth vehicular camera comprises a CMOS imaging sensor; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives fifth image data captured by said fifth vehicular camera; wherein said video processor module receives sensor data captured by said radar sensors; wherein an object external to the equipped vehicle is detected, at least in part, via processing of image data at said video processor module; wherein the detected object external to the equipped vehicle is tracked based at least in part on processing of captured image data and sensed sensor data at said video processor module; and wherein, responsive at least in part to processing of image data and sensor data at said video processor module, a driver assistance system of the equipped vehicle is controlled. - View Dependent Claims (37, 38, 39, 40, 41, 42)
-
-
43. A vehicular driver assist system suitable for use in a vehicle, said vehicular driver assist system comprising:
-
a video processor module disposed at a vehicle equipped with said vehicular driver assist system; said video processor module receiving and processing image data provided by a plurality of video sensors disposed at the equipped vehicle; said video processor module receiving and processing sensor data provided by a plurality of radar sensors disposed at the equipped vehicle; said plurality of video sensors comprising at least five vehicular cameras; said at least five vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle; said at least five vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle; said at least five vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least five vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; said at least five vehicular cameras comprising a fifth vehicular camera disposed at, and viewing forwardly through, an in-cabin side of a windshield of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein said fifth vehicular camera has a fifth field of view exterior of the equipped vehicle and is operable to capture fifth image data; wherein said third vehicular camera disposed at the rear portion of the equipped vehicle is located at or proximate to a longitudinal centerline of the equipped vehicle; wherein said fourth vehicular camera disposed at the front portion of the equipped vehicle is located at or proximate to the longitudinal centerline of the equipped vehicle; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives fifth image data captured by said fifth vehicular camera; wherein said video processor module receives sensor data captured by said radar sensors; wherein an object external to the equipped vehicle is detected, at least in part, via processing of image data at said video processor module; wherein the detected objects external to the equipped vehicle is tracked based at least in part on processing of captured image data and sensed sensor data at said video processor module; wherein image data captured by said fifth vehicular camera is processed at said video processor module for at least one of (i) an automatic headlamp controller of the equipped vehicle and (ii) a lane departure warning system of the equipped vehicle; wherein, responsive at least in part to processing of image data and sensor data at said video processor module, a driver assistance system of the equipped vehicle is controlled; and wherein said driver assistance system of the equipped vehicle comprises at least one of (i) an adaptive speed control system of the equipped vehicle, (ii) a crash warning system of the equipped vehicle, (iii) a blind spot detection system of the equipped vehicle, (iv) a lane change aid system of the equipped vehicle, (v) a reverse aid warning system of the equipped vehicle and (vi) a side object detection system of the equipped vehicle. - View Dependent Claims (44, 45, 46)
-
Specification