Vehicle vision system using kinematic model of vehicle motion
First Claim
1. A vision system for a vehicle, said vision system comprising:
- a plurality of cameras disposed at a vehicle equipped with said vision system;
said plurality of cameras comprising at least (i) a first camera disposed at a rear portion of the equipped vehicle, (ii) a second camera disposed at a driver side portion of the equipped vehicle and (iii) a third camera disposed at a passenger side of the equipped vehicle;
wherein each of said first, second and third cameras has a respective field of view exterior of the equipped vehicle;
wherein each of said first, second and third cameras is operable to capture frames of image data;
an electronic control unit, said electronic control unit comprising an image processor operable to process image data captured by any or all of said first, second and third cameras;
wherein, responsive to image processing by said image processor of captured image data, said electronic control unit is operable to determine objects present in the field of view of at least one of said first, second and third cameras;
wherein, responsive to vehicle data, said electronic control unit determines a vehicle motion vector during driving of the equipped vehicle by a driver of the equipped vehicle;
wherein the vehicle data includes steering information of the equipped vehicle and at least one of (i) speed of the equipped vehicle and (ii) distance traveled by the equipped vehicle;
wherein, during driving of the equipped vehicle by the driver of the equipped vehicle, said electronic control unit determines movement of an object relative to the equipped vehicle via image processing by said image processor of at least two frames of image data captured by said at least one of said first, second and third cameras;
wherein said electronic control unit compares the determined relative movement of the object to the determined vehicle motion vector;
wherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said electronic control unit determines a misalignment of said at least one of said first, second and third cameras; and
wherein image data captured by cameras of said plurality of cameras is used by a surround view system of the equipped vehicle.
0 Assignments
0 Petitions
Accused Products
Abstract
A vision system for a vehicle includes a plurality of cameras disposed at the vehicle and respective fields of view exterior of the vehicle. An electronic control unit includes an image processor operable to process image data captured by any or all of the cameras. Responsive to image processing of captured image data, the electronic control unit is operable to determine objects present in the field of view of at least one of the cameras. Responsive to vehicle data, the electronic control unit determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle. The electronic control unit compares the determined relative movement of a determined object to the determined vehicle motion vector and, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, the electronic control unit determines a misalignment of the at least one camera.
-
Citations
27 Claims
-
1. A vision system for a vehicle, said vision system comprising:
-
a plurality of cameras disposed at a vehicle equipped with said vision system; said plurality of cameras comprising at least (i) a first camera disposed at a rear portion of the equipped vehicle, (ii) a second camera disposed at a driver side portion of the equipped vehicle and (iii) a third camera disposed at a passenger side of the equipped vehicle; wherein each of said first, second and third cameras has a respective field of view exterior of the equipped vehicle; wherein each of said first, second and third cameras is operable to capture frames of image data; an electronic control unit, said electronic control unit comprising an image processor operable to process image data captured by any or all of said first, second and third cameras; wherein, responsive to image processing by said image processor of captured image data, said electronic control unit is operable to determine objects present in the field of view of at least one of said first, second and third cameras; wherein, responsive to vehicle data, said electronic control unit determines a vehicle motion vector during driving of the equipped vehicle by a driver of the equipped vehicle; wherein the vehicle data includes steering information of the equipped vehicle and at least one of (i) speed of the equipped vehicle and (ii) distance traveled by the equipped vehicle; wherein, during driving of the equipped vehicle by the driver of the equipped vehicle, said electronic control unit determines movement of an object relative to the equipped vehicle via image processing by said image processor of at least two frames of image data captured by said at least one of said first, second and third cameras; wherein said electronic control unit compares the determined relative movement of the object to the determined vehicle motion vector; wherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said electronic control unit determines a misalignment of said at least one of said first, second and third cameras; and wherein image data captured by cameras of said plurality of cameras is used by a surround view system of the equipped vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A vision system for a vehicle, said vision system comprising:
-
a plurality of cameras disposed at a vehicle equipped with said vision system; said plurality of cameras comprising at least (i) a first camera disposed at a rear portion of the equipped vehicle, (ii) a second camera disposed at a driver side portion of the equipped vehicle, (iii) a third camera disposed at a passenger side of the equipped vehicle and (iv) a fourth camera disposed at a front portion of the equipped vehicle; wherein each of said first, second, third and fourth cameras has a respective field of view exterior of the equipped vehicle; wherein each of said first, second, third and fourth cameras is operable to capture frames of image data; an electronic control unit, said electronic control unit comprising an image processor operable to process image data captured by any or all of said first, second, third and fourth cameras; wherein, responsive to image processing by said image processor of image data captured by said second camera, said electronic control unit is operable to determine objects present in the field of view of said second camera; wherein, responsive to vehicle data, said electronic control unit determines a vehicle motion vector during driving of the equipped vehicle by a driver of the equipped vehicle; wherein the vehicle data includes steering information of the equipped vehicle and at least one of (i) speed of the equipped vehicle and (ii) distance traveled by the equipped vehicle; wherein, during driving of the equipped vehicle by the driver of the equipped vehicle, said electronic control unit determines movement of an object within the field of view of said second camera relative to the equipped vehicle via image processing by said image processor of at least two frames of image data captured by said second camera; wherein said electronic control unit compares the determined relative movement of the object to the determined vehicle motion vector; and wherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said electronic control unit determines a misalignment of said second camera. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. A vision system for a vehicle, said vision system comprising:
-
a plurality of cameras disposed at a vehicle equipped with said vision system; said plurality of cameras comprising at least (i) a first camera disposed at a rear portion of the equipped vehicle, (ii) a second camera disposed at a driver side portion of the equipped vehicle, (iii) a third camera disposed at a passenger side of the equipped vehicle and (iv) a fourth camera disposed at a front portion of the equipped vehicle; wherein each of said first, second, third and fourth cameras has a respective field of view exterior of the equipped vehicle; wherein each of said first, second, third and fourth cameras is operable to capture frames of image data; an electronic control unit, said electronic control unit comprising an image processor operable to process image data captured by any or all of said first, second, third and fourth cameras; wherein, responsive to image processing by said image processor of image data captured by said third camera, said electronic control unit is operable to determine objects present in the field of view of said third camera; wherein, responsive to vehicle data, said electronic control unit determines a vehicle motion vector during driving of the equipped vehicle by a driver of the equipped vehicle; wherein the vehicle data includes steering information of the equipped vehicle and at least one of (i) speed of the equipped vehicle and (ii) distance traveled by the equipped vehicle; wherein the vehicle data includes geometry of the equipped vehicle; wherein the vehicle data is communicated to the electronic control unit via a communication bus of the equipped vehicle; wherein, during driving of the equipped vehicle by the driver of the equipped vehicle, said electronic control unit determines movement of an object within the field of view of said third camera relative to the equipped vehicle via image processing by said image processor of at least two frames of image data captured by said third camera; wherein said electronic control unit compares the determined relative movement of the object to the determined vehicle motion vector; wherein said electronic control unit compares the determined vehicle motion vector to an object vector determined between a first position of the object in a first frame of image data captured by said third camera and a second position of the object in a second frame of image data captured by said third camera, and wherein said electronic control unit determines a misalignment of said third camera responsive to a difference between a direction or magnitude of the determined vehicle motion vector and a direction or magnitude of the determined object vector; wherein, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, said electronic control unit determines a misalignment of said third camera; and wherein, responsive to a determined misalignment of said third camera, said electronic control unit is operable to calibrate said third camera. - View Dependent Claims (24, 25, 26, 27)
-
Specification