VEHICULAR CONTROL SYSTEM WITH TRAILERING ASSIST FUNCTION

• US 20190042864A1
• Filed: 10/01/2018
• Published: 02/07/2019
• Est. Priority Date: 09/26/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Pliefke, Sebastian, Jarmola, Paul, Wierich, Thomas, Byrne, Steven V., Lu, Yuesheng
• Granted Patent: US 10,586,119 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2360/29 Holographic features
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/211 producing three-dimensional [3D] effects, e.g. stereoscopic images
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/80 characterised by the intended use of the viewing arrangement
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/808 : for facilitating docking to a trailer
• CPC Class Codes: B60R 2300/8086 : for vehicle path indication
• CPC Class Codes: B60Y 2400/92 : Driver displays
• CPC Class Codes: B62D 13/06 : for backing a normally drawn trailer
• CPC Class Codes: B62D 15/0295 : by overlaying a vehicle path based on present steering angle over an image without processing that image
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 5/272 : Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A vehicular control system includes a camera having an exterior field of view at least rearward of the vehicle and operable to capture image data. A trailer is attached to the vehicle and image data captured by the camera includes image data captured when the vehicle is maneuvered with the trailer at an angle relative to the vehicle. The vehicular control system determines a path of the trailer responsive at least to a steering angle of the vehicle. The vehicular control system detects an object present exterior of the vehicle during maneuvering of the vehicle and the trailer and based at least in part on image processing of captured image data. The vehicular control system plans a driving path for the vehicle that avoids the detected object so that the vehicle and the trailer do not run over or contact the detected object.

Claims

1. A vehicular control system, said vehicular control system comprising:

a camera disposed at a vehicle, said camera having a field of view exterior of the vehicle;

wherein a trailer is attached to the vehicle;

wherein, during maneuvering of the vehicle and the trailer, said camera captures image data;

an image processor that processes image data captured by said camera;

wherein image data captured by said camera during maneuvering of the vehicle and the trailer includes image data captured by said camera when the vehicle is maneuvered with the trailer at an angle relative to the vehicle;

wherein said vehicular control system determines a path of the trailer responsive at least in part to a steering angle of the vehicle;

wherein said vehicular control system detects an object present exterior of the vehicle which ought not be impacted during maneuvering of the vehicle and the trailer;

wherein said vehicular control system detects the object which ought not be impacted during maneuvering of the vehicle and the trailer based at least in part on image processing by said image processor of image data captured by said camera; and

wherein, responsive at least in part to detection of the object present exterior of the vehicle which ought not be impacted during maneuvering of the vehicle and the trailer, said vehicular control system plans a driving path for the vehicle and the trailer that avoids the detected object so that the vehicle and the trailer do not run over or contact the detected object.

2. The vehicular control system of claim 1, wherein, responsive at least in part to image processing by said image processor of image data captured by said camera, said vehicular control system classifies the detected object.

3. The vehicular control system of claim 1, wherein said camera disposed at the vehicle views at least rearward of the vehicle.

4. The vehicular control system of claim 3, wherein said vehicular control system, responsive at least in part to image processing by said image processor of image data captured by said camera, determines a trailer angle of the trailer.

5. The vehicular control system of claim 4, wherein said vehicular control system determines the path of the trailer responsive at least in part to the steering angle of the vehicle and the determined trailer angle of the trailer relative to the vehicle.

6. The vehicular control system of claim 4, wherein, based at least in part on image processing by said image processor of image data captured by said camera, said vehicular control system estimates height of center of mass of the trailer.

7. The vehicular control system of claim 6, wherein said vehicular control system estimates the height of the center of mass of the trailer during maneuvering of the vehicle and the trailer around a curve.

8. The vehicular control system of claim 4, wherein, based at least in part on image processing by said image processor of image data captured by said camera, said vehicular control system estimates the trailer'"'"'s nicking angle while the vehicle steers around a curve.

9. The vehicular control system of claim 4, wherein said vehicular control system, based at least in part on image processing by said image processor of image data captured by said camera during maneuvering of the vehicle and the trailer, determines a distance between the trailer turning axis and a nicking point of the trailer by the trailer'"'"'s nicking behavior while the vehicle and the trailer are in motion.

10. The vehicular control system of claim 1, wherein said vehicular control system determines the object which ought not be impacted during maneuvering of the vehicle and the trailer based at least in part on data wirelessly transmitted to the vehicle.

11. The vehicular control system of claim 1, wherein said camera disposed at the vehicle views at least forward of the vehicle.

12. The vehicular control system of claim 11, wherein, based at least in part on image processing by said image processor of image data captured by said camera during maneuvering of the vehicle and the trailer, said vehicular control system classifies a road surface viewed by said camera.

13. The vehicular control system of claim 1, wherein said vehicular control system displays, at a display screen of the vehicle, images derived from image data captured by said camera, and wherein an overlay overlaid over the displayed images indicates a steering path for the vehicle that maneuvers the vehicle and the trailer around the determined obstacle.

14. The vehicular control system of claim 13, wherein the steering path for the vehicle is determined at least in part responsive to the steering angle of the vehicle.

15. The vehicular control system of claim 1, wherein said vehicular control system, based at least in part on image processing by said image processor of image data captured by said camera during maneuvering of the vehicle and the trailer, determines the trailer'"'"'s width.

16. The vehicular control system of claim 1, wherein said vehicular control system gathers trailer data pertaining to physical characteristics of the trailer, and wherein said vehicular control system determines the path of the trailer at least in part responsive to the trailer data gathered.

17. The vehicular control system of claim 1, wherein said vehicular control system stores properties of the trailer in a data file that is accessed when that trailer is attached to the vehicle.

18. The vehicular control system of claim 1, wherein, when the vehicle and the trailer are maneuvering, and based at least in part on image processing by said image processor of image data captured by said camera during maneuvering of the vehicle and the trailer, said vehicular control system estimates a dimension of the trailer.

19. The vehicular control system of claim 18, wherein the dimension of the trailer comprises width of the trailer.

20. The vehicular control system of claim 18, wherein the dimension of the trailer comprises length of the trailer.

21. A vehicular control system, said vehicular control system comprising:

a camera disposed at a vehicle, said camera having a field of view exterior of the vehicle;

wherein a trailer is attached to the vehicle;

wherein, during maneuvering of the vehicle and the trailer, said camera captures image data;

an image processor that processes image data captured by said camera;

wherein image data captured by said camera during maneuvering of the vehicle and the trailer includes image data captured by said camera when the vehicle is maneuvered with the trailer at an angle relative to the vehicle;

wherein said vehicular control system, responsive at least in part to image processing by said image processor of image data captured by said camera, determines a trailer angle of the trailer;

wherein said vehicular control system determines a path of the trailer responsive at least in part to the determined trailer angle of the trailer relative to the vehicle;

wherein said vehicular control system detects an object present exterior of the vehicle which ought not be impacted during maneuvering of the vehicle and the trailer;

wherein said vehicular control system detects the object which ought not be impacted during maneuvering of the vehicle and the trailer based at least in part on image processing by said image processor of image data captured by said camera; and

wherein, responsive at least in part to detection of the object present exterior of the vehicle which ought not be impacted during maneuvering of the vehicle and the trailer, said vehicular control system plans a driving path for the vehicle and the trailer that avoids the detected object so that the vehicle and the trailer do not run over or contact the detected object.

22. The vehicular control system of claim 21, wherein, when the vehicle and the trailer are maneuvering, and based at least in part on image processing by said image processor of image data captured by said camera during maneuvering of the vehicle and the trailer, said vehicular control system estimates a dimension of the trailer.

23. The vehicular control system of claim 21, wherein said vehicular control system determines the path for the vehicle and the trailer at least in part responsive to trailer data pertaining to physical characteristics of the trailer.

24. A vehicular control system, said vehicular control system comprising:

a camera disposed at a vehicle, said camera having a field of view exterior of the vehicle;

wherein a trailer is attached to the vehicle;

wherein said vehicular control system stores properties of the trailer in a data file that is accessed when that trailer is attached to the vehicle;

wherein, during maneuvering of the vehicle and the trailer, said camera captures image data;

an image processor operable that processes image data captured by said camera;

wherein image data captured by said camera during maneuvering of the vehicle and the trailer includes image data captured by said camera when the vehicle is maneuvered with the trailer at an angle relative to the vehicle;

wherein said vehicular control system determines a path of the trailer responsive at least in part to a steering angle of the vehicle;

wherein said vehicular control system detects an object present exterior of the vehicle which ought not be impacted during maneuvering of the vehicle and the trailer;

wherein said vehicular control system detects the object which ought not be impacted during maneuvering of the vehicle and the trailer based at least in part on image processing by said image processor of image data captured by said camera;

wherein, responsive at least in part to detection of the object present exterior of the vehicle which ought not be impacted during maneuvering of the vehicle and the trailer, said vehicular control system plans a driving path for the vehicle and the trailer that avoids the detected object so that the vehicle and the trailer do not run over or contact the detected object; and

wherein said vehicular control system displays, at a display screen of the vehicle, images derived from image data captured by said camera, and wherein an overlay overlaid over the displayed images indicates a steering path for the vehicle that maneuvers the vehicle and the trailer around the determined obstacle.

25. The vehicular control system of claim 24, wherein, when the vehicle and the trailer are maneuvering, and based at least in part on image processing by said image processor of image data captured by said camera during maneuvering of the vehicle and the trailer, said vehicular control system estimates a dimension of the trailer.

26. The vehicular control system of claim 24, wherein said vehicular control system determines the path for the vehicle and the trailer at least in part responsive to trailer data pertaining to physical characteristics of the trailer.