Surround View System Camera Automatic Calibration

• US 20120287232A1
• Filed: 05/08/2012
• Published: 11/15/2012
• Est. Priority Date: 05/10/2011
• Status: Abandoned Application

• Current Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Inventors: Natroshvili, Koba, Gassmann, Bernd
• Application Number:
  US13/466,743
• Publication Number:
  US 20120287232A1
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/85 Stereo camera calibration

Abstract

A system for calibrating a surround view system of an object, such as a vehicle. The system may be implemented via calibration logic that may include software, hardware, firmware, or a combination thereof. The system may include positioning a set of markers on a plane at least partially surrounding the object. The plane may be in a field of view of a camera of the surround view system, and the camera may include a predetermined intrinsic calibration. The system may also include determining a first plurality of extrinsic parameters of the camera with respect to the set of markers. The system may repeat the positioning of the set of markers and the determination of the first plurality of extrinsic parameters for at least one other camera of the surround view system.

Claims

1. Logic for calibrating a surround view system of an object, configured to:

position a set of markers on a plane at least partially surrounding the object, where the plane is in a field of view of a camera, where the camera comprises a predetermined intrinsic calibration, and where the camera is part of the surround view system;

determine a first plurality of extrinsic parameters of the camera with respect to the set of markers, where the set of markers comprises an origin and the first plurality of extrinsic parameters includes a reference to the origin; and

repeat the positioning of the set of markers and the determination of the first plurality of extrinsic parameters for at least one other camera of the surround view system.

2. The logic according to claim 1, where the object is a vehicle.

3. The logic according to claim 1, where the field of view of the camera at least partially overlaps the field of view of another camera of the surround view system.

4. The logic according to claim 3, where logic is further configured to:

select markers in an overlapping region of the field of views of a plurality of the cameras of the surround view system.

5. The logic according to claim 1, where logic is further configured to:

determine a second plurality of extrinsic parameters of the camera with respect to the set of markers and with respect to the first plurality of extrinsic parameters of the at least one other camera of the surround view system.

6. The logic according to claim 5, where logic is further configured to:

estimate a third plurality of extrinsic parameters of the camera with respect to the set of markers and with respect to the origin.

7. The logic according to claim 6, where logic is further configured to:

optimize the first, second, and third plurality of extrinsic parameters.

8. The logic according to claim 7, where each plurality of extrinsic parameters includes an error related to re-projections on the set of markers, and where the optimization minimizes the error related to re-projections.

9. The logic according to claim 7, where the optimization utilizes the third plurality of extrinsic parameters.

10. The logic according to claim 7, where the optimization minimizes differences between overlapping values in the second plurality of extrinsic parameters.

11. The logic according to claim 7, where logic is further configured to:

constrain the optimization by using an additional set of markers at known positions in front of the camera.

12. The logic according to claim 1, where logic is further configured to:

approximate distortion perpendicular to the plane by polynomial approximation.

13. A surround view system, comprising:

a plurality of cameras;

a control unit linking the cameras to calibration logic; and

where the calibration logic is configured to;

position a set of markers on a plane at least partially surrounding an object, where the plane is in a field of view of a camera of the plurality of cameras, and where the camera comprises a predetermined intrinsic calibration;

determine a first plurality of extrinsic parameters of the camera with respect to the set of markers, where the set of markers comprises an origin and the first plurality of extrinsic parameters includes a reference to the origin; and

repeat the positioning of the set of markers and the determination of the first plurality of extrinsic parameters for at least one other camera of the plurality of cameras.

14. The surround view system according to claim 13, where each camera of the plurality of cameras comprises a fisheye lens.

15. The surround view system according to claim 13, where the plurality of cameras is positioned symmetrically with respect to at least one axis of the object.

16. The surround view system according to claim 13, where the surround view system comprises four cameras.

17. A method comprising:

positioning a set of markers on a plane, where the plane at least partially surrounds an object, where the plane is in a field of view of a camera that is part of a surround view system hosted by the object, and where the camera comprises a predetermined intrinsic calibration;

determining a first plurality of extrinsic parameters of the camera with respect to the set of markers, where the set of markers comprises an origin and the first plurality of extrinsic parameters includes a reference to the origin; and

repeating the positioning a set of markers and the determining a first plurality of extrinsic parameters for at least one other camera of the surround view system.

18. The method of claim 17, further comprising:

determining a second plurality of extrinsic parameters of the camera with respect to the set of markers and relative to the first plurality of extrinsic parameters of the at least one other camera of the surround view system.

19. The method of claim 17, further comprising:

estimating a third plurality of extrinsic parameters of the camera with respect to the set of markers, and relative to the origin.

20. The method of claim 17, further comprising:

optimizing the first, second, and third plurality of extrinsic parameters.