METHOD FOR DYNAMICALLY CALIBRATING VEHICULAR CAMERAS
First Claim
1. A method of dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom, the method comprising:
- disposing a forward viewing camera at a vehicle, the forward viewing camera, when disposed at the vehicle, having a field of view exterior and forward of the vehicle;
providing a control having a processor operable for processing image data captured by the forward viewing camera;
driving the vehicle so that the vehicle is in motion;
wherein driving the vehicle comprises steering the vehicle so as to establish a plurality of vehicle steering angles;
operating the forward viewing camera to acquire multiple frames of image data captured by the forward viewing camera while the vehicle is in motion and steered within at least two ranges of steering angles, wherein each frame of captured image data defines an image plane having a horizontal axis and a vertical axis;
determining, via processing at the control of a first image frame of image data captured by the forward viewing camera, first and second feature points in the first image frame of captured image data;
tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the first image frame, a motion trajectory of the first feature point and of the second feature point while the vehicle is moving and steered within a first range of steering angles;
determining a first vanishing point based on the tracked first feature point and second feature point;
determining, via processing at the control of a second image frame of image data captured by the forward viewing camera, third and fourth feature points in the second image frame of captured image data;
tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the second image frame, a motion trajectory of the third feature point and of the fourth feature point while the vehicle is moving and steered within a second range of steering angles that is different from the first range of steering angles;
determining a second vanishing point based on the tracked third feature point and fourth feature point;
determining a vanishing line based on the first and second vanishing points;
determining whether the vanishing line is non-parallel to the horizontal axis of the image plane; and
responsive to determining that the vanishing line is non-parallel to the horizontal axis of the image plane, adjusting at least one selected from the group consisting of pitch of the forward viewing camera, roll of the forward viewing camera and yaw of the forward viewing camera to correct for rotational misalignment of the forward viewing camera.
0 Assignments
0 Petitions
Accused Products
Abstract
A method for dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom includes disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data as the vehicle is moving and steered through a plurality of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A vanishing point is established in the image plane for the feature points for the respective range of steering angles. Based on established vanishing points, a vanishing line is determined. When the vanishing line is determined to be non-horizontal, at least one of pitch, roll or yaw of the camera is adjusted.
-
Citations
24 Claims
-
1. A method of dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom, the method comprising:
-
disposing a forward viewing camera at a vehicle, the forward viewing camera, when disposed at the vehicle, having a field of view exterior and forward of the vehicle; providing a control having a processor operable for processing image data captured by the forward viewing camera; driving the vehicle so that the vehicle is in motion; wherein driving the vehicle comprises steering the vehicle so as to establish a plurality of vehicle steering angles; operating the forward viewing camera to acquire multiple frames of image data captured by the forward viewing camera while the vehicle is in motion and steered within at least two ranges of steering angles, wherein each frame of captured image data defines an image plane having a horizontal axis and a vertical axis; determining, via processing at the control of a first image frame of image data captured by the forward viewing camera, first and second feature points in the first image frame of captured image data; tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the first image frame, a motion trajectory of the first feature point and of the second feature point while the vehicle is moving and steered within a first range of steering angles; determining a first vanishing point based on the tracked first feature point and second feature point; determining, via processing at the control of a second image frame of image data captured by the forward viewing camera, third and fourth feature points in the second image frame of captured image data; tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the second image frame, a motion trajectory of the third feature point and of the fourth feature point while the vehicle is moving and steered within a second range of steering angles that is different from the first range of steering angles; determining a second vanishing point based on the tracked third feature point and fourth feature point; determining a vanishing line based on the first and second vanishing points; determining whether the vanishing line is non-parallel to the horizontal axis of the image plane; and responsive to determining that the vanishing line is non-parallel to the horizontal axis of the image plane, adjusting at least one selected from the group consisting of pitch of the forward viewing camera, roll of the forward viewing camera and yaw of the forward viewing camera to correct for rotational misalignment of the forward viewing camera. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A method of dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom, the method comprising:
-
disposing a forward viewing camera at a vehicle, the forward viewing camera, when disposed at the vehicle, having a field of view exterior and forward of the vehicle; providing a control having a processor operable for processing image data captured by the forward viewing camera; driving the vehicle so that the vehicle is in motion; wherein driving the vehicle comprises steering the vehicle so as to establish a plurality of vehicle steering angles; operating the forward viewing camera to acquire multiple frames of image data captured by the forward viewing camera while the vehicle is in motion and steered within at least two ranges of steering angles, wherein each frame of captured image data defines an image plane having a horizontal axis and a vertical axis; determining, via processing at the control of a first image frame of image data captured by the forward viewing camera, first and second feature points in the first image frame of captured image data; tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the first image frame, a motion trajectory of the first feature point and of the second feature point while the vehicle is moving and steered within a first range of steering angles, wherein the first range of steering angles comprises steering angles close to or at zero degrees such that the vehicle is traveling in a straight line; determining a first vanishing point based on the tracked first feature point and second feature point; determining, via processing at the control of a second image frame of image data captured by the forward viewing camera, third and fourth feature points in the second image frame of captured image data; tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the second image frame, a motion trajectory of the third feature point and of the fourth feature point while the vehicle is moving and steered within a second range of steering angles, wherein the second range of steering angles comprises steering angles that do not include angles close to or at zero degrees such that the vehicle is traveling along a curve; determining a second vanishing point based on the tracked third feature point and fourth feature point; determining a vanishing line based on the first and second vanishing points; determining whether the vanishing line is non-parallel to the horizontal axis of the image plane; and responsive to determining that the vanishing line is non-parallel to the horizontal axis of the image plane, adjusting at least one selected from the group consisting of pitch of the forward viewing camera, roll of the forward viewing camera and yaw of the forward viewing camera to correct for rotational misalignment of the forward viewing camera. - View Dependent Claims (16, 17, 18, 19, 20)
-
-
21. A method of dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom, the method comprising:
-
disposing a forward viewing camera at a vehicle, the forward viewing camera, when disposed at the vehicle, having a field of view exterior and forward of the vehicle; providing a control having a processor operable for processing image data captured by the forward viewing camera; driving the vehicle so that the vehicle is in motion; wherein driving the vehicle comprises steering the vehicle so as to establish a plurality of vehicle steering angles; operating the forward viewing camera to acquire multiple frames of image data captured by the forward viewing camera while the vehicle is in motion and steered within at least two ranges of steering angles, wherein each frame of captured image data defines an image plane having a horizontal axis and a vertical axis; determining, via processing at the control of a first image frame of image data captured by the forward viewing camera, first and second feature points in the first image frame of captured image data; tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the first image frame, a motion trajectory of the first feature point and of the second feature point while the vehicle is moving and steered within a first range of steering angles; determining a first vanishing point based on the tracked first feature point and second feature point; determining, via processing at the control of a second image frame of image data captured by the forward viewing camera, third and fourth feature points in the second image frame of captured image data; tracking, via processing at the control of image frames of image data captured by the forward viewing camera subsequent to the second image frame, a motion trajectory of the third feature point and of the fourth feature point while the vehicle is moving and steered within a second range of steering angles that is different from the first range of steering angles; determining a second vanishing point based on the tracked third feature point and fourth feature point; determining a vanishing line based on the first and second vanishing points; determining whether the vanishing line is non-parallel to the horizontal axis of the image plane; receiving at the control vehicle data via a communication bus of the vehicle, and wherein the received vehicle data includes vehicle speed data and vehicle steering angle data; responsive to determining that the vanishing line is non-parallel to the horizontal axis of the image plane, adjusting at least one selected from the group consisting of pitch of the forward viewing camera, roll of the forward viewing camera and yaw of the forward viewing camera to correct for rotational misalignment of the forward viewing camera; and wherein image data captured by the forward viewing camera is processed at the control for at least one selected from the group consisting of (i) object detection, (ii) lane departure warning and (iii) automatic high beam control. - View Dependent Claims (22, 23, 24)
-
Specification