VEHICLE VISION SYSTEM WITH CAMERA CALIBRATION

• US 20180053322A1
• Filed: 08/15/2017
• Published: 02/22/2018
• Est. Priority Date: 08/17/2016
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Singh, Jagmal, Pliefke, Sebastian
• Granted Patent: US 10,380,765 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

A camera calibration system for a vehicle includes a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle. An image processor is operable to process image data captured by the cameras. The image processor is operable, via processing of image data captured by the cameras, to determine a change in orientation of at least one of the cameras. The image processor determines the change in orientation from a previous orientation during a previous ignition cycle of the vehicle and a current orientation at the onset of a current or subsequent ignition cycle of the vehicle.

Claims

1. A camera calibration system for a vehicle, said camera calibration system comprising:

at least one camera disposed at a vehicle and having a field of view exterior of the vehicle;

an image processor operable to process image data captured by said at least one camera; and

wherein said image processor is operable, via processing of image data captured by said at least one camera, to determine a change in orientation of said at least one camera, and wherein said image processor determines the change in orientation from a previous orientation during a previous ignition cycle of the vehicle and a current orientation at the onset of a current ignition cycle of the vehicle that is subsequent to the previous ignition cycle.

2. The camera calibration system of claim 1, wherein said camera calibration stores image data captured by said at least one camera at or near an end of the previous ignition cycle of the vehicle, and wherein, at the onset of the current ignition cycle of the vehicle, said camera calibration compares image data captured by said at least one camera during the current ignition cycle to the stored captured image data to determine a change in orientation of said at least one camera.

3. The camera calibration system of claim 2, wherein said camera calibration system compares detected features of image data captured by said at least one camera during the current ignition cycle to detected features of the stored captured image data to determine the change in orientation of said at least one camera.

4. The camera calibration system of claim 2, wherein said camera calibration system stores image data captured by said at least one camera when the vehicle is stationary at or near the end of the previous ignition cycle of the vehicle.

5. The camera calibration system of claim 2, wherein said camera calibration system stores image data captured by said at least one camera when the vehicle is stationary at or near the start of the current ignition cycle of the vehicle.

6. The camera calibration system of claim 1, wherein said camera calibration system determines a change in orientation of said at least one camera that is indicative of loading or unloading of the vehicle between the previous and current ignition cycles.

7. The camera calibration system of claim 1, comprising a display operable to display video images derived from image data captured by said at least one camera.

8. The camera calibration system of claim 7, wherein, responsive to determination of a change in orientation of said at least one camera, said camera calibration system adjusts processing of captured image data to accommodate the determined change in orientation.

9. The camera calibration system of claim 1, wherein said at least one camera comprises a rear camera disposed at a rear portion of the vehicle and having a field of view rearward of the vehicle.

10. The camera calibration system of claim 1, wherein said at least one camera comprises a plurality of cameras disposed at the vehicle and having respective fields of view exterior of the vehicle.

11. A camera calibration system for a vehicle, said camera calibration system comprising:

at least one camera disposed at a vehicle and having a field of view exterior of the vehicle;

an image processor operable to process image data captured by said at least one camera;

wherein said image processor is operable, via processing of image data captured by said at least one camera, to determine a change in orientation of said at least one camera;

wherein said camera calibration system stores image data captured by said at least one camera when the vehicle is stationary at or near the end of a previous ignition cycle of the vehicle;

wherein said at least one camera captures image data when the vehicle is stationary at an onset of a current ignition cycle of the vehicle that is subsequent to the previous ignition cycle; and

wherein said camera calibration system compares detected features of the image data captured by said at least one camera at the onset of the current ignition cycle to detected features of the stored image data captured by said at least one camera at or near the end of the previous ignition cycle to determine the change in orientation of said at least one camera.

12. The camera calibration system of claim 11, wherein said camera calibration system determines a change in orientation of said at least one camera that is indicative of loading or unloading of the vehicle between the previous and current ignition cycles.

13. The camera calibration system of claim 11, comprising a display operable to display video images derived from image data captured by said at least one camera.

14. The camera calibration system of claim 13, wherein, responsive to determination of a change in orientation of said at least one camera, said camera calibration system adjusts processing of captured image data to accommodate the determined change in orientation.

15. The camera calibration system of claim 11, wherein said at least one camera comprises a rear camera disposed at a rear portion of the vehicle and having a field of view rearward of the vehicle.

16. The camera calibration system of claim 11, wherein said at least one camera comprises a plurality of cameras disposed at the vehicle and having respective fields of view exterior of the vehicle.

17. A camera calibration system for a vehicle, said camera calibration system comprising:

at least one camera disposed at a vehicle and having a field of view exterior of the vehicle;

an image processor operable to process image data captured by said at least one camera;

a display operable to display video images derived from image data captured by said at least one camera;

wherein said image processor is operable, via processing of image data captured by said at least one camera, to determine a change in orientation of said at least one camera, and wherein said image processor determines the change in orientation from a previous orientation during a previous ignition cycle of the vehicle and a current orientation at the onset of a current ignition cycle of the vehicle that is subsequent to the previous ignition cycle;

wherein said camera calibration system determines a change in orientation of said at least one camera that is indicative of loading or unloading of the vehicle between the previous and current ignition cycles; and

wherein, responsive to determination of a change in orientation of said at least one camera, said camera calibration system adjusts processing of captured image data to accommodate the determined change in orientation.

18. The camera calibration system of claim 17, wherein said camera calibration stores image data captured by said at least one camera at or near an end of the previous ignition cycle of the vehicle, and wherein, at the onset of the current ignition cycle of the vehicle, said camera calibration compares image data captured by said at least one camera during the current ignition cycle to the stored captured image data to determine a change in orientation of said at least one camera, and wherein said camera calibration system compares detected features of image data captured by said at least one camera during the current ignition cycle to detected features of the stored captured image data to determine the change in orientation of said at least one camera.

19. The camera calibration system of claim 17, wherein said at least one camera comprises a rear camera disposed at a rear portion of the vehicle and having a field of view rearward of the vehicle.

20. The camera calibration system of claim 17, wherein said at least one camera comprises a plurality of cameras disposed at the vehicle and having respective fields of view exterior of the vehicle.