DRIVER ASSIST SYSTEM FOR VEHICLE
First Claim
1. A driver assist system suitable for use in a vehicle, said driver assist system comprising:
- a plurality of video sensors disposed at a vehicle equipped with said vehicular driver assist system;
said plurality of video sensors comprising at least four vehicular cameras;
said at least four vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle;
said at least four vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle;
said at least four vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle;
said at least four vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle;
wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data;
wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data;
wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data;
wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data;
wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor;
a plurality of non-video sensors disposed at the equipped vehicle;
said plurality of non-video sensors comprising at least one non-video sensor selected from the group consisting of a radar sensor, a near-infrared sensor, a far-infrared sensor, a thermal sensor and a sonar sensor;
wherein said at least one non-video sensor is operable to capture sensor data;
a video processor module;
wherein said video processor module receives first image data captured by said first vehicular camera;
wherein said video processor module receives second image data captured by said second vehicular camera;
wherein said video processor module receives third image data captured by said third vehicular camera;
wherein said video processor module receives fourth image data captured by said fourth vehicular camera;
wherein said video processor module receives sensor data captured by said at least one non-video sensor;
wherein received image data is fused with received sensor data at said video processor module;
wherein said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle;
wherein received image data is processed at said video processor module to generate a synthesized image;
wherein said synthesized image is output from said video processor module for display by a single display screen of a display device of the equipped vehicle that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle;
wherein said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle; and
wherein, responsive at least in part to fusing of image data and sensor data at said video processor module, a driver assistance system of the equipped vehicle is controlled.
0 Assignments
0 Petitions
Accused Products
Abstract
A driver assist system suitable for use in a vehicle includes a plurality of vehicular cameras disposed at the vehicle and a plurality of non-video sensors disposed at the vehicle. The cameras capture image data and at least one non-video sensor captures sensor data. A video processor module receives image data captured by the cameras and receives sensor data captured by the at least one non-video sensor. The received image data is fused with received sensor data at the video processor module. The video processor module communicates with other vehicle systems via a vehicle bus of the vehicle. Received image data is processed at the video processor module to generate a synthesized image, which is displayed by a display screen. Responsive at least in part to fusing of image data and sensor data at the video processor module, a driver assistance system of the equipped vehicle is controlled.
-
Citations
27 Claims
-
1. A driver assist system suitable for use in a vehicle, said driver assist system comprising:
-
a plurality of video sensors disposed at a vehicle equipped with said vehicular driver assist system; said plurality of video sensors comprising at least four vehicular cameras; said at least four vehicular cameras comprising a first vehicular camera disposed at a driver side of the equipped vehicle; said at least four vehicular cameras comprising a second vehicular camera disposed at a passenger side of the equipped vehicle; said at least four vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least four vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor; a plurality of non-video sensors disposed at the equipped vehicle; said plurality of non-video sensors comprising at least one non-video sensor selected from the group consisting of a radar sensor, a near-infrared sensor, a far-infrared sensor, a thermal sensor and a sonar sensor; wherein said at least one non-video sensor is operable to capture sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives sensor data captured by said at least one non-video sensor; wherein received image data is fused with received sensor data at said video processor module; wherein said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle; wherein received image data is processed at said video processor module to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device of the equipped vehicle that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle; and wherein, responsive at least in part to fusing of image data and sensor data at said video processor module, a driver assistance system of the equipped vehicle is controlled. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A driver assist system suitable for use in a vehicle, said driver assist system comprising:
-
a plurality of video sensors disposed at a vehicle equipped with said vehicular driver assist system; said plurality of video sensors comprising at least four vehicular cameras; said at least four vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least four vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least four vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least four vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor; a plurality of radar sensors disposed at the equipped vehicle; wherein said radar sensors are operable to capture radar data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives radar data captured by said radar sensors; wherein said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle; wherein received image data is processed at said video processor module to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device of the equipped vehicle that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle; wherein image data captured by a forward-facing camera viewing through a windshield of the equipped vehicle is provided to said video processor module; and wherein image data captured by said forward-facing camera is processed at said video processor module for an automatic headlamp controller of the equipped vehicle. - View Dependent Claims (15, 16, 17, 18, 19)
-
-
20. A driver assist system suitable for use in a vehicle, said driver assist system comprising:
-
a plurality of video sensors disposed at a vehicle equipped with said vehicular driver assist system; said plurality of video sensors comprising at least four vehicular cameras; said at least four vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least four vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least four vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least four vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor; a plurality of non-video sensors disposed at the equipped vehicle; wherein said non-video sensors are operable to capture sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives sensor data captured by said non-video sensors; wherein said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle; wherein received image data is processed at said video processor module to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device of the equipped vehicle that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle; wherein image data captured by a forward-facing camera viewing through a windshield of the equipped vehicle is provided to said video processor module; wherein image data captured by said forward-facing camera is processed at said video processor module for an automatic headlamp controller of the equipped vehicle; wherein image data captured by said forward-facing camera is processed at said video processor module for a lane departure warning system of the equipped vehicle; and wherein objects external to the equipped vehicle are tracked based at least in part on processing of captured image data and captured sensor data at said video processor module. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27)
-
Specification