Vehicular vision system with image processing
First Claim
1. A vehicular vision system, said vehicular vision system comprising:
- a CMOS camera disposed at a windshield of a vehicle and having a field of view at least forward and through the windshield of the vehicle;
wherein said camera comprises a two dimensional imaging array of photosensing elements arranged in at least 1200 columns of photosensing elements and at least 800 rows of photosensing elements;
wherein said camera, when disposed at the vehicle, is at a known height relative to a ground surface at which the vehicle is located;
an image processor operable to process frames of image data captured by said camera;
wherein said image processor, using a kinematics model of the vehicle, processes two or more frames of captured image data to determine a path of travel of the vehicle;
wherein said vehicular vision system uses ground points segmentation and the kinematics model of the vehicle to determine distance traveled by the vehicle between frames of captured image data;
wherein said vehicular vision system determines image data points that travel the same distance as the vehicle but in a direction opposite to that of the vehicle to be ground;
wherein said vehicular vision system tracks image data of a three dimensional object present in the field of view of said camera to determine movement of the image data of the three dimensional object relative to the determined ground;
wherein, responsive to tracking the image data of the three dimensional object, said vehicular vision system determines presence of a bicycle ahead of the vehicle and in the field of view of said camera;
wherein, responsive to processing of captured image data by said image processor, said vehicular vision system determines a distal portion of the determined bicycle relative to the vehicle and determines a ground location at which the determined distal portion of the determined bicycle is located;
wherein, responsive to the determined ground location of the determined distal portion of the determined bicycle and responsive to the known height of said camera relative to the ground surface, said vehicular vision system determines distance to the determined bicycle; and
wherein, at least in part responsive to the determined bicycle being within a threshold distance to the vehicle, and at least in part responsive to the determined bicycle being in the determined path of travel of the vehicle, said vehicular vision system generates an output indicative of determination of the bicycle being in the determined path of travel of the vehicle.
0 Assignments
0 Petitions
Accused Products
Abstract
A vehicular vision system includes a camera and an image processor that processes frames of captured image data to determine a path of travel of the vehicle. The system determines some image data points to be ground and tracks image data of a three dimensional object present in the field of view of the camera to determine movement of the image data of the object relative to the determined ground. Responsive to a determined ground location of a determined bicycle and responsive to the known height of the camera, the system determines distance to the bicycle. At least in part responsive to the bicycle being within a threshold distance to the vehicle and in the determined path of travel of the vehicle, the system generates an output indicative of determination of the bicycle being in the determined path of travel of the vehicle.
-
Citations
20 Claims
-
1. A vehicular vision system, said vehicular vision system comprising:
-
a CMOS camera disposed at a windshield of a vehicle and having a field of view at least forward and through the windshield of the vehicle; wherein said camera comprises a two dimensional imaging array of photosensing elements arranged in at least 1200 columns of photosensing elements and at least 800 rows of photosensing elements; wherein said camera, when disposed at the vehicle, is at a known height relative to a ground surface at which the vehicle is located; an image processor operable to process frames of image data captured by said camera; wherein said image processor, using a kinematics model of the vehicle, processes two or more frames of captured image data to determine a path of travel of the vehicle; wherein said vehicular vision system uses ground points segmentation and the kinematics model of the vehicle to determine distance traveled by the vehicle between frames of captured image data; wherein said vehicular vision system determines image data points that travel the same distance as the vehicle but in a direction opposite to that of the vehicle to be ground; wherein said vehicular vision system tracks image data of a three dimensional object present in the field of view of said camera to determine movement of the image data of the three dimensional object relative to the determined ground; wherein, responsive to tracking the image data of the three dimensional object, said vehicular vision system determines presence of a bicycle ahead of the vehicle and in the field of view of said camera; wherein, responsive to processing of captured image data by said image processor, said vehicular vision system determines a distal portion of the determined bicycle relative to the vehicle and determines a ground location at which the determined distal portion of the determined bicycle is located; wherein, responsive to the determined ground location of the determined distal portion of the determined bicycle and responsive to the known height of said camera relative to the ground surface, said vehicular vision system determines distance to the determined bicycle; and wherein, at least in part responsive to the determined bicycle being within a threshold distance to the vehicle, and at least in part responsive to the determined bicycle being in the determined path of travel of the vehicle, said vehicular vision system generates an output indicative of determination of the bicycle being in the determined path of travel of the vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A vehicular vision system, said vehicular vision system comprising:
-
a CMOS camera disposed at a vehicle and having a field of view at least sideward and to the rear of the vehicle; wherein said camera comprises a two dimensional imaging array of photosensing elements arranged in at least 1200 columns of photosensing elements and at least 800 rows of photosensing elements; wherein said camera, when disposed at the vehicle, is at a known height relative to a ground surface at which the vehicle is located; an image processor operable to process frames of image data captured by said camera; wherein said image processor, using a kinematics model of the vehicle, processes two or more frames of captured image data to determine motion of the vehicle; wherein said vehicular vision system uses ground points segmentation and the kinematics model of the vehicle to determine distance traveled by the vehicle between frames of captured image data; wherein said vehicular vision system determines image data points that travel the same distance as the vehicle but in a direction opposite to that of the vehicle to be ground; wherein said vehicular vision system tracks image data of a three dimensional object present in the field of view of said camera to determine movement of the image data of the three dimensional object relative to the determined ground; wherein, responsive to tracking the image data of the three dimensional object, said vehicular vision system determines presence of a bicycle sideward and rearward of the vehicle and in the field of view of said camera; wherein, responsive to processing of captured image data by said image processor, said vehicular vision system determines a distal portion of the determined bicycle relative to the vehicle and determines a ground location at which the determined distal portion of the determined bicycle is located; wherein, responsive to the determined ground location of the determined distal portion of the determined bicycle and responsive to the known height of said camera relative to the ground surface, said vehicular vision system determines distance to the determined bicycle; and wherein, at least in part responsive to the determined bicycle being within a threshold distance to the vehicle, and at least in part responsive to the determined bicycle approaching the vehicle from the rear, said vehicular vision system generates an output indicative of determination of the bicycle approaching the vehicle from the rear. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A vehicular vision system, said vehicular vision system comprising:
-
a CMOS camera disposed at a vehicle and having a field of view exterior of the vehicle; wherein said camera comprises a two dimensional imaging array of photosensing elements arranged in at least 1200 columns of photosensing elements and at least 800 rows of photosensing elements; wherein said camera, when disposed at the vehicle, is at a known height relative to a ground surface at which the vehicle is located; an image processor operable to process frames of image data captured by said camera; wherein said image processor, using a kinematics model of the vehicle, processes two or more frames of captured image data to determine motion of the vehicle; wherein said vehicular vision system uses ground points segmentation and the kinematics model of the vehicle to determine distance traveled by the vehicle between frames of captured image data; wherein said vehicular vision system determines image data points that travel the same distance as the vehicle but in a direction opposite to that of the vehicle to be ground; wherein said vehicular vision system tracks image data of a three dimensional object present in the field of view of said camera to determine movement of the image data of the three dimensional object relative to the determined ground; wherein, responsive to tracking the image data of the three dimensional object, said vehicular vision system determines presence of a bicycle in the field of view of said camera; wherein said image processor tracks the determined bicycle over multiple frames of captured image data; wherein, responsive to processing of captured image data by said image processor, said vehicular vision system determines a distal portion of the determined bicycle relative to the vehicle and determines a ground location at which the determined distal portion of the determined bicycle is located; wherein, responsive to the determined ground location of the determined distal portion of the determined bicycle and responsive to the known height of said camera relative to the ground surface, said vehicular vision system determines distance to the determined bicycle; and wherein, at least in part responsive to the determined bicycle being within a threshold distance to the vehicle, and at least in part responsive to the determined bicycle approaching the vehicle, said vehicular vision system generates an output indicative of determination of the bicycle approaching the vehicle. - View Dependent Claims (17, 18, 19, 20)
-
Specification