VEHICULAR CAMERA CALIBRATION SYSTEM

• US 20180281698A1
• Filed: 03/30/2018
• Published: 10/04/2018
• Est. Priority Date: 03/31/2017
• Status: Active Application

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Tang, Minwei, Singh, Jagmal, Berndt, Sven
• Application Number:
  US15/941,036
• Publication Number:
  US 20180281698A1
• Time in Patent Office: Days
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/402 Image calibration
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06T 7/85 Stereo camera calibration
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A camera calibration system for cameras of a vehicle includes a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle. The fields of view of at least two of the cameras overlap. An image processor is operable to process image data captured by the cameras to determine features in the overlapping regions of the fields of view of the at least two cameras. The camera calibration system determines a best fitting camera model based on actual geometric properties of each of the cameras. A display screen is disposed in the vehicle for displaying images derived from image data captured by the at least two cameras for viewing by a driver of the vehicle. Responsive to determining a best fitting camera model, the display screen displays images derived from image data captured by the at least two cameras.

Claims

1. A camera calibration system for cameras of a vehicle, said camera calibration system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle, wherein the fields of view of at least two of said cameras overlap, and wherein each of said cameras comprises an imager and a lens;

an image processor operable to process image data captured by said cameras;

wherein said image processor processes image data captured by said at least two of said cameras to determine features in the overlapping regions of the fields of view of said at least two of said cameras;

wherein said camera calibration system determines a best fitting camera model based on actual geometric properties of each of said cameras;

a display screen disposed in the vehicle for displaying images derived from image data captured by said at least two of said plurality of cameras for viewing by a driver of the vehicle during a driving maneuver of the vehicle; and

wherein, responsive to determining a best fitting camera model, the display screen displays images derived from image data captured by said at least two of said plurality of cameras and based at least in part on the best fitting camera model.

2. The camera calibration system of claim 1, wherein, responsive to processing by said image processor of image data captured by said at least two of said cameras, and responsive to determination of the best fitting camera model, said camera calibration system compares extracted image coordinates of determined features with projected image coordinates of determined features and minimizes their differences.

3. The camera calibration system of claim 1, wherein said camera calibration system uses a polynomial model to estimate a distortion effect of said lenses of said cameras.

4. The camera calibration system of claim 3, wherein the polynomial model comprises a single polynomial function to model radial and tangential distortions.

5. The camera calibration system of claim 1, wherein said plurality of cameras comprises at least four cameras for a surround view vision system of the vehicle.

6. The camera calibration system of claim 1, wherein said at least two of said cameras comprises a rearward viewing camera disposed at a rear of the vehicle and a sideward and rearward viewing camera disposed at a side of the vehicle.

7. The camera calibration system of claim 1, wherein said plurality of cameras comprises multiple cameras at the rear of the vehicle and multiple cameras at each side of the vehicle.

8. The camera calibration system of claim 1, wherein said at least two of said cameras each comprise a fish-eye lens providing a wide angle field of view for the respective camera.

9. A camera calibration system for cameras of a vehicle, said camera calibration system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle, wherein the fields of view of at least two of said cameras overlap, and wherein each of said cameras comprises an imager and a fish-eye lens that provides a field of view greater than 180 degrees;

an image processor operable to process image data captured by said plurality of cameras;

wherein said image processor processes image data of said at least two of said cameras to determine features in the overlapping regions of the fields of view of said at least two of said cameras;

wherein said camera calibration system determines a best fitting camera model based on actual geometric properties of each of said plurality of cameras;

a display screen disposed in the vehicle for displaying images derived from image data captured by said at least two of said plurality of cameras for viewing by a driver of the vehicle during a driving maneuver of the vehicle; and

wherein, responsive to determining a best fitting camera model, the display screen displays images derived from image data captured by at least one of said plurality of cameras and based at least in part on the best fitting camera model.

10. The camera calibration system of claim 9, wherein, responsive to processing by said image processor of image data captured by said at least two of said cameras, and responsive to determination of the best fitting camera model, said camera calibration system compares extracted image coordinates of determined features with projected image coordinates of determined features and minimizes their differences.

11. The camera calibration system of claim 9, wherein said camera calibration system uses a polynomial model to estimate a distortion effect of said lens of said camera.

12. The camera calibration system of claim 9, wherein the polynomial model comprises a single polynomial function to model radial and tangential distortions.

13. The camera calibration system of claim 9, wherein said plurality of cameras comprises at least four cameras for a surround view vision system of the vehicle.

14. The camera calibration system of claim 13, wherein said at least two of said cameras comprises a rearward viewing camera disposed at a rear of the vehicle and a sideward and rearward viewing camera disposed at a side of the vehicle.

15. The camera calibration system of claim 9, wherein said plurality of cameras comprises multiple cameras at the rear of the vehicle and multiple cameras at each side of the vehicle.

16. A camera calibration system for cameras of a vehicle, said camera calibration system comprising:

a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle, wherein the fields of view of at least two of said cameras overlap, and wherein each of said cameras comprises an imager and a lens;

an image processor operable to process image data captured by said cameras;

wherein said image processor processes image data of said at least two of said cameras to determine features in the overlapping regions of the fields of view of said at least two of said cameras;

wherein said camera calibration system determines a best fitting camera model based on actual geometric properties of each of said cameras by using a polynomial model to estimate a distortion effect of said lens of each of said at least two of said cameras, and wherein the polynomial model discards coefficients above a polynomial threshold;

a display screen disposed in the vehicle for displaying images derived from image data captured by said at least two of said plurality of cameras for viewing by a driver of the vehicle during a driving maneuver of the vehicle; and

wherein, responsive to determining a best fitting camera model, the display screen displays images derived from image data captured by said at least two of said plurality of cameras and based at least in part on the best fitting camera model.

17. The camera calibration system of claim 16, wherein, responsive to processing by said image processor of image data captured by said at least two of said cameras, and responsive to determination of the best fitting camera model, said camera calibration system compares extracted image coordinates of determined features with projected image coordinates of determined features and minimizes their differences.

18. The camera calibration system of claim 16, wherein said plurality of cameras comprises at least four cameras for a surround view vision system of the vehicle.

19. The camera calibration system of claim 16, wherein the polynomial model comprises a single polynomial function to model radial and tangential distortions.

20. The camera calibration system of claim 16, wherein each of said at least two of said cameras comprises a fish-eye lens providing a wide angle field of view for the respective camera.