Vehicle trailer angle detection system using ultrasonic sensors

• US 10,040,481 B2
• Filed: 05/16/2017
• Issued: 08/07/2018
• Est. Priority Date: 05/17/2016
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Koravadi, Krishna
• Primary Examiner(s): NGUYEN, LEON VIET Q
• Application Number:
  US15/596,350
• Publication Number:
  US 20170334484A1
• Time in Patent Office: 448 Days
• Field of Search: None
• CPC Class Codes: B60R 2300/108 using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B62D 15/021 Determination of steering angle
• CPC Class Codes: B62D 15/027 Parking aids, e.g. instruction means
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 13/87 Combinations of radar systems, e.g. primary radar and secondary radar
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/87 Combinations of sonar systems
• CPC Class Codes: G01S 15/931 of land vehicles
• CPC Class Codes: G01S 2013/9324 Alternative operation using ultrasonic waves
• CPC Class Codes: G01S 2013/93272 in the back of the vehicles
• CPC Class Codes: G01S 2015/937 sensor installation details constructional features of transducers G01S7/521 and B06B; casing of transducers, e.g. housing, cover or filler details, G10K9/22; mounting of transducers, i.e. fixture, fitting or holder details, G10K11/004
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G08G 1/168 Driving aids for parking, e.g. acoustic or visual feedback on parking space

Abstract

A trailer angle detection system for a vehicle includes a camera disposed at a rear portion of the vehicle and viewing rearward of the vehicle. A plurality of ultrasonic sensors is disposed at the rear portion of the vehicle and sense rearward of the vehicle. A control has at least one processor operable to process image data captured by the camera. Responsive to processing of image data captured by the camera, the control detects a trailer rearward of the vehicle and in the field of view of the camera. The at least one processor is operable to process sensor data captured by the ultrasonic sensors to determine a distance to portions of the trailer rearward of the vehicle. Responsive to processing of captured image data and processing of captured sensor data, the trailer angle detection system is operable to determine an angle of the trailer relative to the vehicle.

Claims

1. A trailer angle detection system, for a vehicle, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle and viewing rearward of the vehicle, said camera capturing image data;

a plurality of ultrasonic sensors disposed at a rear portion of the vehicle and sensing rearward of the vehicle, said ultrasonic sensors capturing sensor data;

a control having at least one processor operable to process image data captured by said camera;

wherein, responsive at least in part to processing by said at least one processor of image data captured by said camera, said control detects a trailer rearward of the vehicle and in the field of view of said camera;

wherein said at least one processor is operable to process sensor data captured by said ultrasonic sensors to determine distances to portions of the trailer rearward of the vehicle;

wherein, responsive at least in part to processing of captured image data and processing of captured sensor data, said trailer angle detection system is operable to determine an angle of the trailer relative to the vehicle;

wherein said ultrasonic sensors are part of a parking assist feature or collision alert feature of the vehicle;

wherein said ultrasonic sensors are used to estimate a distance map of the trailer tongue location, and wherein said trailer angle detection system uses the distance map to estimate a first estimated trailer tongue angle; and

wherein said trailer angle detection system uses triangular shape information of the trailer tongue, as determined by image processing of captured image data, to estimate the orientation of the trailer tongue with respect to the vehicle and to estimate a second estimated trailer tongue angle.

2. The trailer angle detection system of claim 1, wherein an output of said at least one processor responsive to processing of captured image data and an output of said at least one processor responsive to processing of captured sensor data are fused.

3. The trailer angle detection system of claim 1, wherein said trailer angle detection system is operable to determine the angle of the trailer relative to the vehicle and a location of the trailer relative to the vehicle to assist the driver in maneuvering the vehicle towards the trailer to hitch the trailer to the vehicle.

4. The trailer angle detection system of claim 1, wherein said control correlates, fuses and tracks the first and second estimated trailer tongue angles to determine the angle of the trailer relative to the vehicle.

5. The trailer angle detection system of claim 1, wherein said system determines the angle of the trailer relative to the vehicle without a target image on the trailer.

6. A trailer angle detection system, for a vehicle, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle and viewing rearward of the vehicle, said camera capturing image data;

a plurality of ultrasonic sensors disposed at a rear portion of the vehicle and sensing rearward of the vehicle, said ultrasonic sensors capturing sensor data;

a control having an image processor operable to process image data captured by said camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said camera, said control detects a trailer rearward of the vehicle and in the field of view of said camera;

a sensor processor operable to process sensor data captured by said ultrasonic sensors to determine distances to portions of the trailer rearward of the vehicle;

wherein, responsive at least in part to processing by said image processor of captured image data and processing by said sensor processor of captured sensor data, said trailer angle detection system is operable to determine an angle of the trailer relative to the vehicle;

wherein said ultrasonic sensors are part of a parking assist feature or collision alert feature of the vehicle; and

wherein said ultrasonic sensors are used to estimate a distance map of the trailer tongue location, and wherein said trailer angle detection system uses the distance map to estimate a first estimated trailer tongue angle, and wherein said trailer angle detection system uses triangular shape information of the trailer tongue, as determined by image processing of captured image data, to estimate the orientation of the trailer tongue with respect to the vehicle and to estimate a second estimated trailer tongue angle.

7. The trailer angle detection system of claim 6, wherein an output of said sensor processor responsive to processing of captured sensor data and an output of said image processor responsive to processing of captured image data are fused.

8. The trailer angle detection system of claim 6, wherein said trailer angle detection system is operable to determine the angle of the trailer relative to the vehicle and a location of the trailer relative to the vehicle to assist the driver in maneuvering the vehicle towards the trailer to hitch the trailer to the vehicle.

9. The trailer angle detection system of claim 6, wherein said control correlates, fuses and tracks the first and second estimated trailer tongue angles to determine the angle of the trailer relative to the vehicle.

10. The trailer angle detection system of claim 6, wherein said system determines the angle of the trailer relative to the vehicle without a target image on the trailer.

11. A trailer angle detection system for a vehicle, said trailer angle detection system comprising:

a camera disposed at a central rear portion of a vehicle and viewing rearward of the vehicle, said camera capturing image data;

a plurality of ultrasonic sensors disposed at a rear portion of the vehicle and sensing rearward of the vehicle, said ultrasonic sensors capturing sensor data, wherein said plurality of ultrasonic sensors comprises at least three ultrasonic sensors that are laterally spaced apart at the rear portion of the vehicle;

a control having at least one processor operable to process image data captured by said camera;

wherein, responsive at least in part to processing by said at least one processor of image data captured by said camera, said control detects a trailer rearward of the vehicle and in the field of view of said camera;

wherein said at least one processor is operable to process sensor data captured by said ultrasonic sensors to determine distances to portions of the trailer rearward of the vehicle; and

wherein said ultrasonic sensors are used to estimate a distance map of the trailer tongue location, and wherein said trailer angle detection system uses the distance map to estimate a first estimated trailer tongue angle, and wherein said trailer angle detection system uses triangular shape information of the trailer tongue, as determined by image processing of captured image data, to estimate the orientation of the trailer tongue with respect to the vehicle and to estimate a second estimated trailer tongue angle; and

wherein said control correlates, fuses and tracks the first and second estimated trailer tongue angles to determine the angle of the trailer relative to the vehicle.

12. The trailer angle detection system of claim 11, wherein an output of said at least one processor responsive to processing of captured image data and an output of said at least one processor responsive to processing of captured sensor data are fused.

13. The trailer angle detection system of claim 11, wherein said trailer angle detection system is operable to determine the angle of the trailer relative to the vehicle and a location of the trailer relative to the vehicle to assist the driver in maneuvering the vehicle towards the trailer to hitch the trailer to the vehicle.

14. The trailer angle detection system of claim 11, wherein said ultrasonic sensors are part of a parking assist feature or collision alert feature of the vehicle.

15. The trailer angle detection system of claim 11, wherein said system determines the angle of the trailer relative to the vehicle without a target image on the trailer.