CALIBRATION METHOD AND APPARATUS FOR AUTOMOTIVE CAMERA SYSTEM, AND METHOD AND ECU FOR DETERMINING ANGULAR MISALIGNMENTS OF AUTOMOTIVE CAMERA SYSTEM
First Claim
Patent Images
1. Method of calibrating a camera equipped on vehicle, comprising the steps:
- a) capturing a first image featuring at least two targets with a camera attached to each side of the vehicle, the targets being placed in the peripheral area of the vehicle;
b) displacing the vehicle in the longitudinal direction without moving the targets;
c) capturing a second image featuring the targets at the displaced position;
d) detecting the targets on the captured first and second images;
e) calculating world coordinates of the targets based on the captured images; and
f) searching for misalignment angles while optimizing a metric function based on the calculated world coordinates of the targets.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of automotive camera system calibration is disclosed in the present invention. At least two targets are placed within the field of view of each camera included in the system. Each camera captures the targets. Then, the vehicle is moved, and another image is captured. The images are used to derive the camera orientation parameters. Based on these parameters, misalignment of the cameras can be compensated by the image processing unit.
-
Citations
16 Claims
-
1. Method of calibrating a camera equipped on vehicle, comprising the steps:
-
a) capturing a first image featuring at least two targets with a camera attached to each side of the vehicle, the targets being placed in the peripheral area of the vehicle; b) displacing the vehicle in the longitudinal direction without moving the targets; c) capturing a second image featuring the targets at the displaced position; d) detecting the targets on the captured first and second images; e) calculating world coordinates of the targets based on the captured images; and f) searching for misalignment angles while optimizing a metric function based on the calculated world coordinates of the targets. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. Apparatus for calibrating a camera equipped on vehicle, comprising:
-
a plurality of camera units attached to four sides of vehicle, each camera unit being configured to capture a image featuring at least two targets; and a electronic control unit configured to form a single top view by synthesizing the images captured by each of the plurality of camera units, wherein the electronic control unit determines an angular misalignment of vehicle with a method comprising the steps; a) capturing a first image featuring at least two targets per camera unit attached to a side of the vehicle, the targets being placed in the peripheral area of the vehicle; b) displacing the vehicle in the longitudinal direction without moving the targets; c) capturing a second image featuring the targets at the displaced position; d) detecting the targets on the captured first and second images; e) calculating world coordinates of the targets based on the captured images; and f) searching for misalignment angles while optimizing a metric function based on the calculated world coordinates of the targets. - View Dependent Claims (9, 10)
-
-
11. Method for determining an angular misalignment of a camera equipped on vehicle, comprising:
-
a) capturing a first image featuring at least two targets placed at one side in the peripheral area of the vehicle at a first position of the vehicle; b) capturing a second image featuring the targets at a second position away from the first position of the vehicle in the longitudinal direction; c) detecting the targets on the first and second images and obtaining their coordinates on an imager; d) initiating rotation angles α
, β
, γ
with nominal angle values, respectively;e) calculating angles φ and
θ
for each of the targets at the first and second positions, the angles φ and
θ
defining chief ray in the spherical coordinate system whose origin coincides with world coordinate system'"'"'s origin;f) calculating an affine transformation rotation matrix with current values of α
, β
, γ
;g) calculating world coordinates for the targets at the first and second positions using the angles θ and
φ
, and elevation of the camera over the ground;h) calculating metric used for rotation angles optimization using the calculated world coordinates; i) updating the angles α
, β
, γ
with optimization method until a termination criterion specific for the optimization method is met; andj) calculating misalignment angles from the differences between the undated angles α
, β
, γ
meeting the termination criterion specific and the nominal rotation angles.
-
-
12. Electronic control unit for determining an angular misalignment of a camera equipped on vehicle, the electronic control unit being configured to control and/or perform the steps comprising:
-
a) at a first position of the vehicle and at a second position away from the first position of the vehicle in the longitudinal direction, capturing first and second images each featuring at least two targets placed at one side in the peripheral area of the vehicle, and in turn detecting the targets on the first and second images and then obtaining their coordinates on an imager; b) initiating rotation angles α
, β
, γ
with nominal angle values, respectively;c) calculating angles φ and
θ
for each of the targets at the first and second positions, the angles φ and
θ
defining chief ray in the spherical coordinate system whose origin coincides with world coordinate system'"'"'s origin;d) calculating an affine transformation rotation matrix with current values of α
, β
, γ
;e) calculating world coordinates for the targets at the first and second positions using the angles θ
0 and φ
, and elevation of the camera over the ground;f) calculating metric used for rotation angles optimization using the calculated world coordinates; g) updating the angles α
, β
, γ
with optimization method until a termination criterion specific for the optimization method is met; andh) calculating misalignment angles from the differences between the undated angles α
, β
, γ
meeting the termination criterion specific and the nominal rotation angles. - View Dependent Claims (13, 14, 15, 16)
-
Specification