Vehicular vision system
First Claim
1. A vision system suitable for use in a vehicle, said vision system comprising:
- at least three vehicular cameras disposed at a vehicle equipped with said vehicular vision system;
said at least three vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle;
said at least three vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle;
said at least three vehicular cameras comprising a third vehicular camera disposed at one of (a) a front portion of the equipped vehicle and (b) a rear portion of the equipped vehicle;
wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data;
wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data;
wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data;
wherein at least one of said first vehicular camera, said second vehicular camera and said third vehicular camera comprises a wide-angle lens;
at least one non-imaging sensor disposed at the equipped vehicle, wherein said at least one non-imaging sensor comprises one of (i) an infrared sensor, (ii) a radar sensor, (iii) a sonar sensor and (iv) a thermal sensor;
wherein said at least one non-imaging sensor has a field of sensing exterior of the equipped vehicle and wherein said at least one non-imaging sensor captures sensor data;
a video processor module;
wherein said video processor module receives first image data captured by said first vehicular camera;
wherein said video processor module receives second image data captured by said second vehicular camera;
wherein said video processor module receives third image data captured by said third vehicular camera;
wherein said video processor module receives sensor data captured by said at least one non-imaging sensor;
wherein image data and sensor data received at said video processor module is processed by a video processor of said video processor module;
wherein said video processor processes captured image data and captured sensor data for at least one of (i) object tracking, (ii) object identification and (iii) object classification;
wherein image data received by said video processor is processed by said video processor to generate a synthesized image;
wherein said synthesized image is output from said video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle;
wherein said video processor is operable for least one of (i) diagnostics, (ii) camera selection, (iii) camera control, (iv) on-screen display generation, (v) data storage and (vi) data exchange; and
wherein image data captured by said first, second and third vehicular cameras is processed by said video processor (i) for displaying merged images by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle and (ii) to reduce distortion created by said wide-angle lens for displaying images with reduced distortion by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; and
wherein a graphical overlay is superimposed on images displayed by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle.
4 Assignments
0 Petitions
Accused Products
Abstract
A vehicular vision system includes at least three cameras disposed at the vehicle and having respective fields of view exterior of the vehicle and operable to capture image data. Image data received at a video processor module is processed by a video processor of the video processor module. The received image data is processed by the video processor to generate a synthesized image. The synthesized image is output from the video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the vehicle. The video processor may be operable for least one of (i) object tracking, (ii) object classification, (iii) diagnostics, (iv) camera selection, (v) camera control, (vi) on-screen display generation, (vii) data storage and (viii) data exchange.
-
Citations
83 Claims
-
1. A vision system suitable for use in a vehicle, said vision system comprising:
-
at least three vehicular cameras disposed at a vehicle equipped with said vehicular vision system; said at least three vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a third vehicular camera disposed at one of (a) a front portion of the equipped vehicle and (b) a rear portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein at least one of said first vehicular camera, said second vehicular camera and said third vehicular camera comprises a wide-angle lens; at least one non-imaging sensor disposed at the equipped vehicle, wherein said at least one non-imaging sensor comprises one of (i) an infrared sensor, (ii) a radar sensor, (iii) a sonar sensor and (iv) a thermal sensor; wherein said at least one non-imaging sensor has a field of sensing exterior of the equipped vehicle and wherein said at least one non-imaging sensor captures sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives sensor data captured by said at least one non-imaging sensor; wherein image data and sensor data received at said video processor module is processed by a video processor of said video processor module; wherein said video processor processes captured image data and captured sensor data for at least one of (i) object tracking, (ii) object identification and (iii) object classification; wherein image data received by said video processor is processed by said video processor to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein said video processor is operable for least one of (i) diagnostics, (ii) camera selection, (iii) camera control, (iv) on-screen display generation, (v) data storage and (vi) data exchange; and wherein image data captured by said first, second and third vehicular cameras is processed by said video processor (i) for displaying merged images by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle and (ii) to reduce distortion created by said wide-angle lens for displaying images with reduced distortion by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; and wherein a graphical overlay is superimposed on images displayed by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A vision system suitable for use in a vehicle, said vision system comprising:
-
at least three vehicular cameras disposed at a vehicle equipped with said vehicular vision system; said at least three vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein at least one of said first vehicular camera, said second vehicular camera and said third vehicular camera comprises a wide-angle lens; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor; at least one non-imaging sensor disposed at the equipped vehicle, wherein said at least one non-imaging sensor comprises one of (i) an infrared sensor, (ii) a radar sensor, (iii) a sonar sensor and (iv) a thermal sensor; wherein said at least one non-imaging sensor has a field of sensing exterior of the equipped vehicle and wherein said at least one non-imaging sensor captures sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera at a first interface; wherein said video processor module receives second image data captured by said second vehicular camera at a second interface; wherein said video processor module receives third image data captured by said third vehicular camera at a third interface; wherein said video processor module receives sensor data captured by said at least one non-imaging sensor; wherein image data and sensor data received at said video processor module is processed by a video processor of said video processor module; wherein said video processor processes captured image data and captured sensor data for at least one of (i) object tracking, (ii) object identification and (iii) object classification; wherein image data received by said video processor is processed by said video processor to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein said video processor module receives first image data captured by said first vehicular camera at said first interface via a vehicle bus of the equipped vehicle and wherein said video processor module receives second image data captured by said second vehicular camera at said second interface via a vehicle bus of the equipped vehicle and wherein said video processor module receives third image data captured by said third vehicular camera at said third interface via a vehicle bus of the equipped vehicle; wherein image data captured by said first, second and third vehicular cameras is processed by said video processor for displaying merged images by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; wherein image data captured by said first, second and third vehicular cameras is processed by said video processor to reduce distortion created by said wide-angle lens for displaying images with reduced distortion by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; and wherein a graphical overlay is superimposed on images displayed by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37)
-
-
38. A vision system suitable for use in a vehicle, said vision system comprising:
-
at least three vehicular cameras disposed at a vehicle equipped with said vehicular vision system; said at least three vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein at least one of said first vehicular camera, said second vehicular camera and said third vehicular camera comprises a wide-angle lens; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor; at least one non-imaging sensor disposed at the equipped vehicle, wherein said at least one non-imaging sensor comprises one of (i) an infrared sensor, (ii) a radar sensor, (iii) a sonar sensor and (iv) a thermal sensor; wherein said at least one non-imaging sensor has a field of sensing exterior of the equipped vehicle and wherein said at least one non-imaging sensor captures sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera at a first interface; wherein said video processor module receives second image data captured by said second vehicular camera at a second interface; wherein said video processor module receives third image data captured by said third vehicular camera at a third interface; wherein said video processor module receives sensor data captured by said at least one non-imaging sensor; wherein image data and sensor data received at said video processor module is processed by a video processor of said video processor module; wherein said video processor processes captured image data and captured sensor data for at least one of (i) object tracking, (ii) object identification and (iii) object classification; wherein image data received by said video processor is processed by said video processor to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein at least one of (a) said synthesized image displayed by said display screen approximates a view as would be viewed by a single virtual camera located exterior the equipped vehicle, (b) said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle, (c) said synthesized image displayed by said display screen approximates a panoramic view as would be viewed from a single virtual camera located exterior the equipped vehicle and (d) said synthesized image displayed by said display screen approximates a substantially seamless panoramic view as would be viewed from a single virtual camera located exterior the equipped vehicle; wherein image data captured by said first, second and third vehicular cameras is processed by said video processor for displaying merged images by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; wherein image data captured by said first, second and third vehicular cameras is processed by said video processor to reduce distortion created by said wide-angle lens for displaying images with reduced distortion by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; and wherein a graphical overlay is superimposed on images displayed by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle. - View Dependent Claims (39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57)
-
-
58. A vision system suitable for use in a vehicle, said vision system comprising:
-
at least three vehicular cameras disposed at a vehicle equipped with said vehicular vision system; said at least three vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least three vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein at least one of said first vehicular camera, said second vehicular camera and said third vehicular camera comprises a wide-angle lens; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor; at least one non-imaging sensor disposed at the equipped vehicle, wherein said at least one non-imaging sensor comprises one of (i) an infrared sensor, (ii) a radar sensor, (iii) a sonar sensor and (iv) a thermal sensor; wherein said at least one non-imaging sensor has a field of sensing exterior of the equipped vehicle and wherein said at least one non-imaging sensor captures sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives sensor data captured by said at least one non-imaging sensor; wherein image data and sensor data received at said video processor module is processed by a video processor of said video processor module; wherein said video processor processes captured image data and captured sensor data for at least one of (i) object tracking, (ii) object identification and (iii) object classification; wherein at least one of (a) said video processor module communicates with said at least one non-imaging sensor via a vehicle bus of the equipped vehicle and (b) said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle; wherein image data received by said video processor is processed by said video processor to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein at least one of (a) said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle, (b) said synthesized image displayed by said display screen approximates a panoramic view as would be viewed from a single virtual camera located exterior the equipped vehicle and (c) said synthesized image displayed by said display screen approximates a substantially seamless panoramic view as would be viewed from a single virtual camera located exterior the equipped vehicle; wherein image data captured by said first, second and third vehicular cameras is processed by said video processor (i) for displaying merged images by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle and (ii) to reduce distortion created by said wide-angle lens for displaying images with reduced distortion by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; and wherein a graphical overlay is superimposed on images displayed by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle. - View Dependent Claims (59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70)
-
-
71. A vision system suitable for use in a vehicle, said vision system comprising:
-
at least four vehicular cameras disposed at a vehicle equipped with said vehicular vision system; said at least four vehicular cameras comprising a first vehicular camera disposed at a driver-side exterior mirror assembly of the equipped vehicle; said at least four vehicular cameras comprising a second vehicular camera disposed at a passenger-side exterior mirror assembly of the equipped vehicle; said at least four vehicular cameras comprising a third vehicular camera disposed at a rear portion of the equipped vehicle; said at least four vehicular cameras comprising a fourth vehicular camera disposed at a front portion of the equipped vehicle; wherein said first vehicular camera has a first field of view exterior of the equipped vehicle and is operable to capture first image data; wherein said second vehicular camera has a second field of view exterior of the equipped vehicle and is operable to capture second image data; wherein said third vehicular camera has a third field of view exterior of the equipped vehicle and is operable to capture third image data; wherein said fourth vehicular camera has a fourth field of view exterior of the equipped vehicle and is operable to capture fourth image data; wherein at least one of said first vehicular camera, said second vehicular camera, said third vehicular camera and said fourth vehicular camera comprises a wide-angle lens; wherein said first vehicular camera comprises a CMOS imaging sensor and wherein said second vehicular camera comprises a CMOS imaging sensor and wherein said third vehicular camera comprises a CMOS imaging sensor and wherein said fourth vehicular camera comprises a CMOS imaging sensor; at least one non-imaging sensor disposed at the equipped vehicle, wherein said at least one non-imaging sensor comprises one of (i) an infrared sensor, (ii) a radar sensor, (iii) a sonar sensor and (iv) a thermal sensor; wherein said at least one non-imaging sensor has a field of sensing exterior of the equipped vehicle and wherein said at least one non-imaging sensor captures sensor data; a video processor module; wherein said video processor module receives first image data captured by said first vehicular camera; wherein said video processor module receives second image data captured by said second vehicular camera; wherein said video processor module receives third image data captured by said third vehicular camera; wherein said video processor module receives fourth image data captured by said fourth vehicular camera; wherein said video processor module receives sensor data captured by said at least one non-imaging sensor; wherein image data and sensor data received at said video processor module is processed by a video processor of said video processor module; wherein said video processor processes captured image data and captured sensor data for at least one of (i) object tracking, (ii) object identification and (iii) object classification; wherein at least one of (a) said video processor module communicates with said at least one non-imaging sensor via a vehicle bus of the equipped vehicle and (b) said video processor module communicates with other vehicle systems via a vehicle bus of the equipped vehicle; wherein image data received by said video processor is processed by said video processor to generate a synthesized image; wherein said synthesized image is output from said video processor module for display by a single display screen of a display device that is viewable by a driver of the equipped vehicle when normally operating the equipped vehicle; wherein at least one of (a) said synthesized image displayed by said display screen approximates a substantially seamless view as would be viewed from a single virtual camera located exterior the equipped vehicle, (b) said synthesized image displayed by said display screen approximates a panoramic view as would be viewed from a single virtual camera located exterior the equipped vehicle and (c) said synthesized image displayed by said display screen approximates a substantially seamless panoramic view as would be viewed from a single virtual camera located exterior the equipped vehicle; and wherein image data captured by said first, second, third and fourth vehicular cameras is processed by said video processor (i) for displaying merged images by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle and (ii) to reduce distortion created by said wide-angle lens for displaying images with reduced distortion by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle; and wherein a graphical overlay is superimposed on images displayed by said single display screen for viewing and use by the driver of the equipped vehicle when the equipped vehicle is driven by the driver of the equipped vehicle. - View Dependent Claims (72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83)
-
Specification