VEHICLE VISION SYSTEM WITH TRAILER ANGLE DETECTION

• US 20140160276A1
• Filed: 12/11/2013
• Published: 06/12/2014
• Est. Priority Date: 09/26/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Wierich, Thomas, Byrne, Steven V., Lu, Yuesheng, Pliefke, Sebastian, Jarmola, Paul
• Granted Patent: US 9,558,409 B2
• Time in Patent Office: Days
• US Class Current: 348/118
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2360/29 Holographic features
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 2370/152 Displays
• CPC Class Codes: B60K 2370/1531 Three-dimensional displays
• CPC Class Codes: B60K 2370/173 Reversing assist
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60K 2370/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2370/29 Holographic features
• CPC Class Codes: B60K 2370/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/211 producing three-dimensional [3D] effects, e.g. stereoscopic images
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 11/04 : Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/307 : virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/607 : from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/80 : characterised by the intended use of the viewing arrangement
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/808 : for facilitating docking to a trailer
• CPC Class Codes: B60R 2300/8086 : for vehicle path indication
• CPC Class Codes: B60Y 2400/92 : Driver displays
• CPC Class Codes: B62D 13/06 : for backing a normally drawn trailer
• CPC Class Codes: B62D 15/0295 : by overlaying a vehicle path based on present steering angle over an image without processing that image
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 5/272 : Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A vehicular vision system includes at least one camera and an image processor. The camera is disposed at a vehicle and has an exterior field of view rearward of the vehicle. The camera is operable to capture image data. The image processor is operable to process captured image data. The vision system, responsive at least in part to image processing of captured image data, is operable to determine a trailer angle of a trailer that is towed by the vehicle. The vision system is operable to determine a path of the trailer responsive to a steering angle of the vehicle and the vision system is operable to display information for viewing by the driver to assist the driver in driving the vehicle with the trailer.

Claims

1. A vehicular vision system, said vehicular vision system comprising:

a camera disposed at a vehicle and having an exterior field of view rearward of the vehicle, wherein said camera is operable to capture image data;

an image processor operable to process captured image data;

wherein said vision system, responsive at least in part to image processing of captured image data, is operable to determine a trailer angle of a trailer that is towed by the vehicle; and

wherein said vision system is operable to determine a path of the trailer responsive to a steering angle of the vehicle and wherein said vision system is operable to display information for viewing by the driver to assist the driver in driving the vehicle with the trailer.

2. The vehicular vision system of claim 1, wherein said vision system is operable to display images of a road in the direction of travel of the vehicle and trailer and wherein said vision system is operable to display an overlay to indicate to the driver of the vehicle a steering path for the vehicle.

3. The vehicular vision system of claim 2, wherein said vision system displays images of a road in the forward direction of travel of the vehicle and trailer and wherein said overlay indicates a steering path for the vehicle that tows the trailer around an obstacle.

4. The vehicular vision system of claim 2, wherein said vision system displays images of a road in the rearward direction of travel of the vehicle and trailer and wherein said overlay indicates a steering path for the vehicle to drive the trailer into a selected location.

5. The vehicular vision system of claim 2, wherein said overlay comprises markers that indicate a determined path of travel of the front wheels of the vehicle and a path of travel that the wheels of the trailer will follow if the driver of the vehicle steers the front wheels of the vehicle along the determined path of travel of the front wheels.

6. The vehicular vision system of claim 5, wherein the determined path of travel of the front wheels of the vehicle is determined at least in part responsive to the steering angle of the vehicle.

7. The vehicular vision system of claim 1, wherein said vision system is operable to at least one of (a) determine a distance between the trailer turning axis and the hitch'"'"'s nicking point by the trailer'"'"'s nicking behavior while the vehicle and trailer are in motion, (b) determine the trailer'"'"'s total length by trigonometric size comparing of known size to unknown size image features and (c) determine the trailer'"'"'s width by side camera image evaluation.

8. The vehicular vision system of claim 1, wherein said vision system is operable to at least one of (a) estimate the trailer'"'"'s tendency to oscillate when driving forward and (b) estimate the trailer'"'"'s tendency to oscillate when driving forward and cope with that oscillation.

9. The vehicular vision system of claim 1, wherein trailer data is input into said vision system to provide data pertaining to physical characteristics of the trailer, and wherein said vision system is operable to determine the path of the trailer at least in part responsive to the trailer data.

10. The vehicular vision system of claim 1, wherein said vision system is operable to store properties of a certain trailer in a data file that is reloaded when that certain trailer is connected at the vehicle and identified by said vision system.

11. The vehicular vision system of claim 9, wherein, responsive at least in part to image processing of captured image data, said vision system is operable to identify a trailer at the vehicle via identification of a trailer code element of the trailer that is viewable by said camera.

12. The vehicular vision system of claim 11, wherein said trailer code element comprises a target having a Barker code pattern established thereon.

13. A vehicular vision system, said vehicular vision system comprising:

a camera disposed at a vehicle and having an exterior field of view rearward of the vehicle, wherein said camera is operable to capture image data;

an image processor operable to process captured image data;

wherein said vision system, responsive at least in part to image processing of captured image data, is operable to determine a trailer angle of a trailer that is towed by the vehicle;

wherein said vision system is operable to determine a path of the trailer responsive to a steering angle of the vehicle and wherein said vision system is operable to display information for viewing by the driver to assist the driver in driving the vehicle with the trailer;

wherein said vision system is operable to display images of a road in the direction of travel of the vehicle and trailer and wherein said vision system is operable to display an overlay to indicate to the driver of the vehicle a steering path for the vehicle;

wherein said overlay comprises markers that indicate a determined path of travel of the front wheels of the vehicle and a path of travel that the wheels of the trailer will follow if the driver of the vehicle steers the front wheels of the vehicle along the determined path of travel of the front wheels; and

wherein at least one of (i) said vision system displays images of a road in the forward direction of travel of the vehicle and trailer and wherein said overlay indicates a steering path for the vehicle that tows the trailer around an obstacle and (ii) said vision system displays images of a road in the rearward direction of travel of the vehicle and trailer and wherein said overlay indicates a steering path for the vehicle to drive the trailer into a selected location.

14. The vehicular vision system of claim 13, wherein said vision system is operable to at least one of (a) determine a distance between the trailer turning axis and the hitch'"'"'s nicking point by the trailer'"'"'s nicking behavior while the vehicle and trailer are in motion, (b) determine the trailer'"'"'s total length by trigonometric size comparing of known size to unknown size image features and (c) determine the trailer'"'"'s width by side camera image evaluation.

15. The vehicular vision system of claim 13, wherein said vision system is operable to at least one of (a) estimate the trailer'"'"'s tendency to oscillate when driving forward and (b) estimate the trailer'"'"'s tendency to oscillate when driving forward and cope with that oscillation.

16. The vehicular vision system of claim 13, wherein trailer data is input into said vision system to provide data pertaining to physical characteristics of the trailer, and wherein said vision system is operable to determine the path of the trailer at least in part responsive to the trailer data.

17. The vehicular vision system of claim 16, wherein said vision system is operable to store properties of a certain trailer in a data file that is reloaded when that certain trailer is connected at the vehicle and identified by said vision system, and wherein, responsive at least in part to image processing of captured image data, said vision system is operable to identify a trailer at the vehicle via identification of a trailer code element of the trailer that is viewable by said camera, and wherein said trailer code element comprises a target having a coded pattern established thereon.

18. A vehicular vision system, said vehicular vision system comprising:

a camera disposed at a vehicle and having an exterior field of view rearward of the vehicle, wherein said camera is operable to capture image data;

an image processor operable to process captured image data;

wherein said vision system, responsive at least in part to image processing of captured image data, is operable to determine a trailer angle of a trailer that is towed by the vehicle;

wherein said vision system is operable to determine a path of the trailer responsive to a steering angle of the vehicle and wherein said vision system is operable to display information for viewing by the driver to assist the driver in driving the vehicle with the trailer;

wherein, responsive at least in part to image processing of captured image data, said vision system is operable to identify a trailer at the vehicle via identification of a trailer code element of the trailer that is viewable by said camera;

wherein trailer data is input into said vision system to provide data pertaining to physical characteristics of multiple trailers and wherein trailer data for a particular trailer is accessed when that particular trailer is connected at the vehicle and identified by said vision system; and

wherein said vision system is operable to determine the path of the trailer at least in part responsive to the trailer data for the identified trailer.

19. The vehicular vision system of claim 18, wherein said vision system is operable to display images of a road in the direction of travel of the vehicle and trailer, and wherein said vision system is operable to display an overlay to indicate to the driver of the vehicle a steering path for the vehicle, and wherein said overlay comprises markers that indicate a determined path of travel of the front wheels of the vehicle and a path of travel that the wheels of the trailer will follow if the driver of the vehicle steers the front wheels of the vehicle along the determined path of travel of the front wheels.

20. The vehicular vision system of claim 18, wherein said trailer code element comprises a target having a coded pattern established thereon.