TRAILER PARKING ASSIST SYSTEM FOR VEHICLE

• US 20170050672A1
• Filed: 08/16/2016
• Published: 02/23/2017
• Est. Priority Date: 08/18/2015
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Gieseke, Achim, Latotzki, Ralph, Boegel, Ruediger
• Granted Patent: US 10,086,870 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8086 for vehicle path indication
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60W 10/184 with wheel brakes
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 2300/14 Tractor-trailers, i.e. combinations of a towing vehicle and one or more towed vehicles, e.g. caravans; Road trains
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2420/42 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2520/06 Direction of travel
• CPC Class Codes: B60W 30/06 Automatic manoeuvring for parking
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B62D 13/06 for backing a normally drawn trailer
• CPC Class Codes: B62D 15/0295 by overlaying a vehicle path based on present steering angle over an image without processing that image

Abstract

A driver assist system for a vehicle includes a plurality of vehicle cameras and at least one trailer camera, with the vehicle cameras configured to be disposed at a vehicle and having respective fields of view exterior of the vehicle and the trailer camera configured to be disposed at a trailer towed by the vehicle. An image processor is operable to process image data captured by the vehicle cameras and the trailer camera. Responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, the image processor is operable to calibrate the trailer camera with the vehicle cameras. Responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, the image processor is operable to determine objects rearward of the trailer that are not in the fields of view of the vehicle cameras.

Claims

1. A driver assist system for a vehicle, said driver assist system comprising:

a plurality of vehicle cameras configured to be disposed at a vehicle and having respective fields of view exterior of the vehicle;

at least one trailer camera configured to be disposed at a trailer towed by the vehicle;

an image processor operable to process image data captured by said vehicle cameras and said trailer camera;

wherein, with said vehicle cameras disposed at the vehicle and said at least one trailer camera disposed at the trailer towed by the vehicle, and responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to calibrate said trailer camera with said vehicle cameras; and

wherein, responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to determine objects rearward of the trailer that are not in the fields of view of said vehicle cameras.

2. The driver assist system of claim 1, comprising a display screen configured to be disposed in the vehicle for viewing by a driver of the vehicle, and wherein said driver assist system displays video images derived from image data captured by said vehicle cameras and said at least one trailer camera.

3. The driver assist system of claim 2, wherein said driver assist system is operable to generate graphic overlays at said display screen to indicate a projected path of the vehicle and trailer for reversing the vehicle and trailer towards a target parking space.

4. The driver assist system of claim 3, wherein, responsive to a determination of an object rearward of the trailer, said driver assist system adjusts the projected path to avoid the object.

5. The driver assist system of claim 1, wherein, responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to initialize said at least one trailer camera in coordinates that correspond to coordinates of said vehicle cameras.

6. The driver assist system of claim 1, wherein said image processor is operable to calibrate said at least one trailer camera with said vehicle cameras responsive at least in part to a determination of a trailer angle of the trailer relative to the vehicle.

7. The driver assist system of claim 6, wherein said image processor is operable to determine the trailer angle responsive at least in part to image processing of captured image data.

8. The driver assist system of claim 1, wherein, responsive to a determination of an object rearward of the trailer, said driver assist system is operable to at least one of (i) generate an alert to the driver of the vehicle, (ii) control a braking system of the vehicle and (iii) control a steering system of the vehicle.

9. The driver assist system of claim 1, wherein said driver assist system utilizes a trailer identifying and angle detection algorithm.

10. The driver assist system of claim 1, wherein said driver assist system uses a two stage path planner having a geometric planning with consecutive optimal control minimization algorithm.

11. A driver assist system for a vehicle, said driver assist system comprising:

a plurality of vehicle cameras configured to be disposed at a vehicle and having respective fields of view exterior of the vehicle;

at least one trailer camera configured to be disposed at a trailer towed by the vehicle;

an image processor operable to process image data captured by said vehicle cameras and said trailer camera;

wherein, with said vehicle cameras disposed at the vehicle and said at least one trailer camera disposed at the trailer towed by the vehicle, and responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to calibrate said trailer camera with said vehicle cameras;

wherein, responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to initialize said at least one trailer camera in coordinates that correspond to coordinates of said vehicle cameras;

wherein, responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to determine objects rearward of the trailer that are not in the fields of view of said vehicle cameras;

a display screen configured to be disposed in the vehicle for viewing by a driver of the vehicle, and wherein said driver assist system displays video images derived from image data captured by said vehicle cameras and said at least one trailer camera; and

wherein the displayed video images include patched portions derived from previously captured frames of image data to fill in areas that are not encompassed by any of said vehicle cameras and said at least one trailer camera.

12. The driver assist system of claim 11, wherein said driver assist system is operable to generate graphic overlays at said display screen to indicate a projected path of the vehicle and trailer for reversing the vehicle and trailer towards a target parking space, and wherein, responsive to a determination of an object rearward of the trailer, said driver assist system adjusts the projected path to avoid the object.

13. The driver assist system of claim 11, wherein said image processor is operable to calibrate said at least one trailer camera with said vehicle cameras responsive at least in part to a determination of a trailer angle of the trailer relative to the vehicle, and wherein said image processor is operable to determine the trailer angle responsive at least in part to image processing of captured image data.

14. The driver assist system of claim 11, wherein, responsive to a determination of an object rearward of the trailer, said driver assist system is operable to at least one of (i) generate an alert to the driver of the vehicle, (ii) control a braking system of the vehicle and (iii) control a steering system of the vehicle.

15. The driver assist system of claim 11, wherein said driver assist system utilizes a trailer identifying and angle detection algorithm.

16. The driver assist system of claim 11, wherein said driver assist system is operable to highlight the patched portions of the displayed images to alert the driver that those areas are not encompassed by any of said vehicle cameras and said at least one trailer camera.

17. A driver assist system for a vehicle, said driver assist system comprising:

a plurality of vehicle cameras configured to be disposed at a vehicle and having respective fields of view exterior of the vehicle;

at least one trailer camera configured to be disposed at a trailer towed by the vehicle;

an image processor operable to process image data captured by said vehicle cameras and said trailer camera;

wherein, with said vehicle cameras disposed at the vehicle and said at least one trailer camera disposed at the trailer towed by the vehicle, and responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to calibrate said trailer camera with said vehicle cameras;

wherein, responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to determine objects rearward of the trailer that are not in the fields of view of said vehicle cameras;

a display screen configured to be disposed in the vehicle for viewing by a driver of the vehicle, and wherein said driver assist system displays video images derived from image data captured by said vehicle cameras and said at least one trailer camera;

wherein said driver assist system is operable to generate graphic overlays at said display screen to indicate a projected path of the vehicle and trailer for reversing the vehicle and trailer towards a target parking space;

wherein, responsive to a determination of an object rearward of the trailer via processing of captured image data by said image processor, said driver assist system adjusts the projected path to avoid the object; and

wherein, responsive to a determination of an object rearward of the trailer via processing of captured image data by said image processor, said driver assist system is operable to at least one of (i) generate an alert to the driver of the vehicle, (ii) control a braking system of the vehicle and (iii) control a steering system of the vehicle.

18. The driver assist system of claim 17, wherein, responsive to processing of captured image data during forward or rearward motion of the vehicle and trailer, said image processor is operable to initialize said at least one trailer camera in coordinates that correspond to coordinates of said vehicle cameras.

19. The driver assist system of claim 17, wherein said image processor is operable to calibrate said at least one trailer camera with said vehicle cameras responsive at least in part to a determination of a trailer angle of the trailer relative to the vehicle, and wherein said image processor is operable to determine the trailer angle responsive at least in part to image processing of captured image data.

20. The driver assist system of claim 17, wherein said driver assist system utilizes a trailer identifying and angle detection algorithm, and wherein said driver assist system uses a two stage path planner having a geometric planning with consecutive optimal control minimization algorithm.