Trailer angle detection system for vehicle

• US 10,552,976 B2
• Filed: 03/22/2018
• Issued: 02/04/2020
• Est. Priority Date: 03/22/2017
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Diessner, Horst D., Gali, Jyothi P., Gupta, Nikhil, Faraji, Hilda, Okouneva, Galina, Ikuseru, Akinyele O.
• Primary Examiner(s): Jia, Xin
• Application Number:
  US15/928,128
• Publication Number:
  US 20180276839A1
• Time in Patent Office: 684 Days
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

A trailer angle detection system for a vehicle towing a trailer includes a rearward viewing camera disposed at a rear portion of a vehicle, and an image processor operable to process image data captured by the camera. Responsive to processing of captured image data when the vehicle is towing a trailer, the trailer angle detection system determines the presence of the trailer at the rear of the vehicle and attached at the vehicle and determines feature vectors of the detected trailer over multiple frames of captured image data. Responsive to movement of the trailer relative to the vehicle, the trailer angle detection system tracks feature vectors for different positions of the detected trailer. The trailer angle detection system determines an angle of the trailer responsive to detection of tracking of feature vectors the trailer in the field of view of the camera over multiple frames of captured image data.

Claims

1. A trailer angle detection system for a vehicle towing a trailer, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle so as to have a field of view exterior and rearward of the vehicle;

an image processor operable to process frames of image data captured by said camera;

wherein, responsive to processing by said image processor of frames of image data captured by said camera when the vehicle is towing a trailer, said trailer angle detection system determines presence of the trailer at the rear of the vehicle and attached at the vehicle;

wherein said trailer angle detection system determines, via processing by said image processor of frames of captured image data, feature vectors of the determined trailer;

wherein said trailer angle detection system determines feature vectors of the determined trailer by determining, via processing by said image processor of frames of captured image data, features that have similar angular changes between a current frame of image data captured by said camera and a previous frame of image data captured by said camera;

wherein said trailer angle detection system detects features that are not indicative of feature vectors of the determined trailer responsive at least in part to determining, via processing by said image processor of frames of captured image data, that vectors of the detected features have dissimilar angular changes between the current frame of image data captured by said camera and the previous frame of image data captured by said camera;

wherein, responsive to movement of the trailer relative to the vehicle, and via processing by said image processor of frames of captured image data, said trailer angle detection system tracks determined feature vectors over multiple frames of captured image data for different positions of the determined trailer relative to the vehicle; and

wherein said trailer angle detection system determines angle of the determined trailer relative to the vehicle responsive to tracking of determined feature vectors of the determined trailer present in the field of view of said camera over multiple frames of captured image data.

2. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines angle of the determined trailer without use of a target on the trailer.

3. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines feature vectors for a trailer region at different positions to reduce data processing time.

4. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines, at least in part via processing by said image processor of frames of captured image data, multiple reference points at a trailer region to reduce false positives and improve accuracy of the trailer angle determination.

5. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines a mean angular change of the determined feature vectors from a reference frame of captured image data to the current frame of captured image data, and wherein determination of the mean angular change of the determined feature vectors results in a determined change in trailer angle from the reference frame.

6. The trailer angle detection system of claim 5, wherein said trailer angle detection system determines angle of the trailer relative to the vehicle by combining the determined change in trailer angle with an offset angle for the reference frame of captured image data.

7. The trailer angle detection system of claim 1, wherein said trailer angle detection system, responsive to determination of presence of the trailer rearward of the vehicle, determines if the determined trailer is a trailer for which said trailer angle detection system is calibrated.

8. The trailer angle detection system of claim 7, wherein said trailer angle detection system, responsive to determination that the determined trailer is not a trailer for which said trailer angle detection system is calibrated, collects data during a calibration drive, which comprises the vehicle being driven straight for at least a threshold period of time, with the steering angle close to zero degrees, and, after being driven straight, turns such that the trailer angle exceeds ±

5 degrees relative to a longitudinal axis of the vehicle.

9. The trailer angle detection system of claim 8, wherein the threshold period of time is at least three seconds.

10. The trailer angle detection system of claim 8, wherein said trailer angle detection system, responsive to data collection during the calibration drive, estimates a trailer length, which is the distance between the hitch ball and a center of an axle of the trailer.

11. The trailer angle detection system of claim 10, wherein said trailer angle detection system, responsive to estimation of the trailer length, generates a set of trailer parameters for the determined trailer and stores the set of trailer parameters for use in future trailer recognition.

12. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines angle of the determined trailer relative to the vehicle independent of lighting conditions at the vehicle and trailer.

13. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines angle of the determined trailer relative to the vehicle independent of road surfaces along which the vehicle is towing the trailer.

14. A trailer angle detection system for a vehicle towing a trailer, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle so as to have a field of view exterior and rearward of the vehicle;

an image processor operable to process frames of image data captured by said camera;

wherein, responsive to processing by said image processor of image data captured by said camera when the vehicle is towing a trailer, said trailer angle detection system determines presence of the trailer at the rear of the vehicle and attached at the vehicle;

wherein said trailer angle detection system, responsive to determination of presence of the trailer rearward of the vehicle, determines if the determined trailer is a trailer for which said trailer angle detection system is calibrated;

wherein said trailer angle detection system, responsive to determination that the determined trailer is not a trailer for which said trailer angle detection system is calibrated, collects data during a calibration drive, which comprises the vehicle being driven straight for at least a threshold period of time, with the steering angle close to zero degrees, and, after being driven straight, turns such that the trailer angle exceeds ±

5 degrees relative to a longitudinal axis of the vehicle;

wherein, after either determination that the determined trailer is a trailer for which said trailer angle detection system is calibrated or calibration of said trailer angle detection system for the determined trailer, said trailer angle detection system determines, via processing by said image processor of frames of captured image data, feature vectors of the determined trailer;

wherein said trailer angle detection system determines feature vectors of the determined trailer by determining, via processing by said image processor of frames of captured image data, features that have similar angular changes between a current frame of image data captured by said camera and a previous frame of image data captured by said camera;

wherein said trailer angle detection system detects features that are not indicative of feature vectors of the determined trailer responsive at least in part to determining, via processing by said image processor of frames of captured image data, that the vectors of detected features have dissimilar angular changes between the current frame of image data captured by said camera and the previous frame of image data captured by said camera;

wherein, responsive to movement of the trailer relative to the vehicle, and via processing by said image processor of frames of captured image data, said trailer angle detection system tracks determined feature vectors over multiple frames of captured image data for different positions of the determined trailer relative to the vehicle;

wherein said trailer angle detection system determines angle of the determined trailer relative to the vehicle responsive to tracking of determined feature vectors of the determined trailer present in the field of view of said camera over multiple frames of captured image data; and

wherein said trailer angle detection system determines angle of the determined trailer without use of a target on the trailer.

15. The trailer angle detection system of claim 14, wherein the threshold period of time is at least three seconds.

16. The trailer angle detection system of claim 14, wherein said trailer angle detection system, responsive to data collection during the calibration drive, estimates a trailer length, which is the distance between the hitch ball and a center of an axle of the trailer.

17. The trailer angle detection system of claim 16, wherein said trailer angle detection system, responsive to estimation of the trailer length, generates a set of trailer parameters for the determined trailer and stores the set of trailer parameters for use in future trailer recognition.

18. A trailer angle detection system for a vehicle towing a trailer, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle so as to have a field of view exterior and rearward of the vehicle;

an image processor operable to process frames of image data captured by said camera;

wherein, responsive to processing by said image processor of image data captured by said camera when the vehicle is towing a trailer, said trailer angle detection system determines presence of the trailer at the rear of the vehicle and attached at the vehicle;

wherein said trailer angle detection system determines, via processing by said image processor of frames of captured image data, feature vectors of the determined trailer;

wherein said trailer angle detection system determines feature vectors of the determined trailer by determining, via processing by said image processor of frames of captured image data, features that have similar angular changes between a current frame of image data captured by said camera and a previous frame of image data captured by said camera;

wherein said trailer angle detection system detects features that are not indicative of feature vectors of the determined trailer responsive at least in part to determining, via processing by said image processor of frames of captured image data, that vectors of the detected features have dissimilar angular changes between the current frame of image data captured by said camera and the previous frame of image data captured by said camera;

wherein, responsive to movement of the trailer relative to the vehicle, and via processing by said image processor of frames of captured image data, said trailer angle detection system tracks determined feature vectors over multiple frames of captured image data for different positions of the determined trailer relative to the vehicle;

wherein said trailer angle detection system determines angle of the determined trailer relative to the vehicle responsive to tracking of determined feature vectors of the determined trailer present in the field of view of said camera over multiple frames of captured image data;

wherein said trailer angle detection system determines a mean angular change of the determined feature vectors from a reference frame of captured image data to the current frame of captured image data, and wherein determination of the mean angular change of the determined feature vectors results in a determined change in trailer angle from the reference frame; and

wherein said trailer angle detection system determines angle of the determined trailer without use of a target on the trailer.

19. The trailer angle detection system of claim 18, wherein said trailer angle detection system determines, at least in part via processing by said image processor of frames of captured image data, multiple reference points at a trailer region to reduce false positives and improve accuracy of the trailer angle determination.

20. The trailer angle detection system of claim 18, wherein said trailer angle detection system determines angle of the trailer relative to the vehicle by combining the determined change in trailer angle with an offset angle for the reference frame of captured image data.