Targetless vehicular camera calibration method
First Claim
1. A method of calibrating a vehicular camera, said method comprising:
- disposing a camera at a vehicle so as to have a field of view exterior of the vehicle, wherein the camera comprises a two-dimensional photosensor array having a plurality of photosensing elements;
moving the vehicle along an arbitrary path;
capturing image data with the camera as the vehicle moves along the arbitrary path;
processing, via a processor, image data captured by the camera;
receiving at the processor vehicle data representative of vehicle kinematic motion as the vehicle moves along the arbitrary path;
responsive to processing by the processor of multiple frames of image data captured by the camera as the vehicle moves along the arbitrary path, determining at least one feature present in the multiple frames of image data captured by the camera and tracking the determined at least one feature across the multiple frames of image data captured by the camera;
responsive to tracking the determined at least one feature across the multiple frames of image data captured by the camera during movement of the vehicle along the arbitrary path, and responsive to the received vehicle data representative of the movement of the vehicle along the arbitrary path, determining misalignment of the camera in one or more of (i) its yaw angle, (ii) its pitch angle and (iii) its roll angle;
correcting the determined misalignment of the camera;
wherein correcting the determined misalignment of the camera starts from at least one of (i) an initial estimation of camera calibration and (ii) an intrinsic parameter of the camera; and
wherein correcting the determined misalignment of the camera is achieved (i) without use of a target in the field of view of the camera as the vehicle moves along the arbitrary path and (ii) without processing of image data captured by the camera that is representative of a target in the field of view of the camera as the vehicle moves along the arbitrary path.
0 Assignments
0 Petitions
Accused Products
Abstract
A method of calibrating a vehicular camera includes disposing a camera at a vehicle, moving the vehicle along an arbitrary path, capturing image data with the camera, and processing, via a processor, image data captured by the camera. Responsive to tracking a determined feature across multiple frames of captured image data during movement of the vehicle along the arbitrary path, and responsive to received vehicle data representative of the movement of the vehicle along the arbitrary path, misalignment of the camera is determined. The determined camera misalignment is corrected (i) without use of a target in the field of view of the camera as the vehicle moves along the arbitrary path and (ii) without processing of image data captured by the camera that is representative of a target in the field of view of the camera as the vehicle moves along the arbitrary path.
-
Citations
37 Claims
-
1. A method of calibrating a vehicular camera, said method comprising:
-
disposing a camera at a vehicle so as to have a field of view exterior of the vehicle, wherein the camera comprises a two-dimensional photosensor array having a plurality of photosensing elements; moving the vehicle along an arbitrary path; capturing image data with the camera as the vehicle moves along the arbitrary path; processing, via a processor, image data captured by the camera; receiving at the processor vehicle data representative of vehicle kinematic motion as the vehicle moves along the arbitrary path; responsive to processing by the processor of multiple frames of image data captured by the camera as the vehicle moves along the arbitrary path, determining at least one feature present in the multiple frames of image data captured by the camera and tracking the determined at least one feature across the multiple frames of image data captured by the camera; responsive to tracking the determined at least one feature across the multiple frames of image data captured by the camera during movement of the vehicle along the arbitrary path, and responsive to the received vehicle data representative of the movement of the vehicle along the arbitrary path, determining misalignment of the camera in one or more of (i) its yaw angle, (ii) its pitch angle and (iii) its roll angle; correcting the determined misalignment of the camera; wherein correcting the determined misalignment of the camera starts from at least one of (i) an initial estimation of camera calibration and (ii) an intrinsic parameter of the camera; and wherein correcting the determined misalignment of the camera is achieved (i) without use of a target in the field of view of the camera as the vehicle moves along the arbitrary path and (ii) without processing of image data captured by the camera that is representative of a target in the field of view of the camera as the vehicle moves along the arbitrary path. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A method of calibrating a vehicular camera, said method comprising:
-
disposing a camera at a vehicle so as to have a field of view exterior of the vehicle, wherein the camera comprises a two-dimensional photosensor array having a plurality of photosensing elements; moving the vehicle along an arbitrary path; capturing image data with the camera as the vehicle moves along the arbitrary path; processing, via a processor, image data captured by the camera; receiving at the processor vehicle data representative of vehicle kinematic motion as the vehicle moves along the arbitrary path, wherein the vehicle data comprises vehicle steering data and vehicle speed data; responsive to processing by the processor of multiple frames of image data captured by the camera as the vehicle moves along the arbitrary path, determining at least one feature present in the multiple frames of image data captured by the camera and tracking the determined at least one feature across the multiple frames of image data captured by the camera; responsive to tracking the determined at least one feature across the multiple frames of image data captured by the camera during movement of the vehicle along the arbitrary path, and responsive to the received vehicle data representative of the movement of the vehicle along the arbitrary path, determining misalignment of the camera in one or more of (i) its yaw angle, (ii) its pitch angle and (iii) its roll angle; correcting the determined misalignment of the camera; wherein correcting the determined misalignment of the camera starts from an intrinsic parameter of the camera; and wherein correcting the determined misalignment of the camera is achieved (i) without use of a target in the field of view of the camera as the vehicle moves along the arbitrary path and (ii) without processing of image data captured by the camera that is representative of a target in the field of view of the camera as the vehicle moves along the arbitrary path. - View Dependent Claims (24, 25, 26, 27, 28)
-
-
29. A method of calibrating a vehicular camera, said method comprising:
-
providing a plurality of cameras, the plurality of cameras comprising a driver-side camera, a passenger-side camera and a rear camera; disposing the driver-side camera at a driver side of a vehicle so as to have a field of view exterior and sideward of the vehicle; disposing the passenger-side camera at a passenger side of the vehicle so as to have a field of view exterior and sideward of the vehicle; disposing the rear camera at a rear side of the vehicle so as to have a field of view exterior and rearward of the vehicle; wherein each of the cameras comprises a two-dimensional photosensor array having a plurality of photosensing elements; moving the vehicle along an arbitrary path, wherein moving the vehicle along the arbitrary path comprises moving the vehicle along an assembly line at a vehicle manufacturer; capturing image data with the cameras as the vehicle moves along the arbitrary path; processing, via a processor, image data captured by the cameras; receiving at the processor vehicle data representative of vehicle kinematic motion as the vehicle moves along the arbitrary path; responsive to processing by the processor of multiple frames of image data captured by the cameras as the vehicle moves along the arbitrary path, determining at least one feature present in the multiple frames of image data captured by a respective camera of the cameras and tracking the determined at least one feature across the multiple frames of image data captured by the respective camera of the cameras; responsive to tracking the determined at least one feature across the multiple frames of image data captured by the respective camera of the cameras during movement of the vehicle along the arbitrary path, and responsive to the received vehicle data representative of the movement of the vehicle along the arbitrary path, determining misalignment of the respective camera of the cameras in one or more of (i) its yaw angle, (ii) its pitch angle and (iii) its roll angle; correcting the determined misalignment of the respective camera of the cameras; and wherein correcting the determined misalignment of the respective camera of the cameras is achieved (i) without use of a target in the respective field of view of the respective camera as the vehicle moves along the arbitrary path and (ii) without processing of image data representative of a target in the respective field of view of respective camera as the vehicle moves along the arbitrary path. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36, 37)
-
Specification