Trailer angle detection system for vehicle

• US 10,706,291 B2
• Filed: 03/02/2018
• Issued: 07/07/2020
• Est. Priority Date: 03/03/2017
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Diessner, Horst D., Gali, Jyothi P., Gupta, Nikhil, Faraji, Hilda, Okouneva, Galina
• Primary Examiner(s): Hon, Ming Y
• Application Number:
  US15/910,100
• Publication Number:
  US 20180253608A1
• Time in Patent Office: 858 Days
• CPC Class Codes: B60R 1/003 for viewing trailer hitches
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: G06F 18/2413 based on distances to training or reference patterns
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices

Abstract

A trailer angle detection system for a vehicle towing a trailer includes a camera disposed at a rear portion of the vehicle and having a field of view rearward of the vehicle. The camera includes a two dimensional imager array having multiple rows and columns of photosensing elements. An image processor processes image data captured by the camera. With the vehicle towing a trailer, and via processing by the image processor of image data captured by the camera, the trailer angle detection system detects a portion of the trailer that is being towed by the vehicle. The trailer angle detection system determines, via processing by the image processor of image data captured by the camera, an angle of the trailer relative to the vehicle responsive to determination of which columns of photosensing elements sense the detected portion of the trailer in the field of view of the camera.

Claims

1. A trailer angle detection system for a vehicle towing a trailer, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle and having a field of view exterior and rearward of the vehicle;

wherein said camera comprises a two dimensional imager array having multiple rows of photosensing elements and multiple columns of photosensing elements;

an image processor operable to process frames of image data captured by said camera;

wherein, with the vehicle towing a trailer, and via processing by said image processor of image data captured by said camera, said trailer angle detection system detects a portion of the trailer that is being towed by the vehicle;

wherein said trailer angle detection system generates a cylindrical view image based on a frame of image data captured by said camera, wherein the generated cylindrical view image comprises multiple rows of pixels and multiple columns of pixels, and wherein the generated cylindrical view image is generated by linearly distributing a horizontal camera opening angle of the camera over the columns of pixels; and

wherein said trailer angle detection system determines an angle of the trailer relative to the vehicle responsive to determination of which columns of pixels the detected portion of the trailer appears at in the generated cylindrical view image.

2. The trailer angle detection system of claim 1, wherein the detected portion of the trailer is size invariant when located in different regions in the field of view of said camera.

3. The trailer angle detection system of claim 1, wherein an upper edge of the generated cylindrical view image is below the horizon and a lower edge of the generated cylindrical view image is below a hitch ball of the vehicle.

4. The trailer angle detection system of claim 1, wherein the detected portion of the trailer is at the same height and at the same row of pixels in the generated cylindrical view image when the trailer is at different angles relative to the vehicle.

5. The trailer angle detection system of claim 1, wherein the detected portion of the trailer is the same width and at the same row of pixels in the generated cylindrical view image when the trailer is at different angles relative to the vehicle.

6. The trailer angle detection system of claim 1, wherein the horizontal camera opening angle of said camera is linearly distributed over a single row of pixels in the generated cylindrical view image.

7. The trailer angle detection system of claim 1, wherein said trailer angle detection system performs an initial calibration when the vehicle is initially moved when towing the trailer.

8. The trailer angle detection system of claim 1, wherein said trailer angle detection system determines the angle of the trailer without use or detection of a target on the trailer.

9. The trailer angle detection system of claim 1, wherein said trailer angle detection system operates independent of lighting conditions.

10. The trailer angle detection system of claim 1, wherein said trailer angle detection system operates independent of road surfaces.

11. A trailer angle detection system for a vehicle towing a trailer, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle and having a field of view exterior and rearward of the vehicle;

wherein said camera comprises a two dimensional imager array having multiple rows of photosensing elements and multiple columns of photosensing elements;

an image processor operable to process frames of image data captured by said camera;

wherein, with the vehicle towing a trailer, and via processing by said image processor of image data captured by said camera, said trailer angle detection system detects a portion of the trailer that is being towed by the vehicle;

wherein said trailer angle detection system generates a cylindrical view image based on a frame of image data captured by said camera, wherein the generated cylindrical view image comprises multiple rows of pixels and multiple columns of pixels, and wherein the generated cylindrical view image is generated by linearly distributing a horizontal camera opening angle of the camera over the columns of pixels;

wherein an upper edge of the generated cylindrical view image is below the horizon and a lower edge of the generated cylindrical view image is below a hitch ball of the vehicle;

wherein the detected portion of the trailer is size invariant when located in different regions in the field of view of said camera; and

wherein said trailer angle detection system determines an angle of the trailer relative to the vehicle responsive to determination of which columns of pixels the detected portion of the trailer appears at in the generated cylindrical view image.

12. The trailer angle detection system of claim 11, wherein the horizontal camera opening angle of said camera encompasses a single pixel row in the generated cylindrical view image.

13. The trailer angle detection system of claim 11, wherein said trailer angle detection system performs an initial calibration when the vehicle is initially moved when towing the trailer.

14. The trailer angle detection system of claim 11, wherein said trailer angle detection system determines the angle of the trailer without use or detection of a target on the trailer.

15. A trailer angle detection system for a vehicle towing a trailer, said trailer angle detection system comprising:

a camera disposed at a rear portion of a vehicle and having a field of view exterior and rearward of the vehicle;

wherein said camera comprises a two dimensional imager array having multiple rows of photosensing elements and multiple columns of photosensing elements;

an image processor operable to process frames of image data captured by said camera;

wherein, with the vehicle towing a trailer, and via processing by said image processor of image data captured by said camera, said trailer angle detection system detects a portion of the trailer that is being towed by the vehicle;

wherein the detected portion of the trailer is encompassed by a horizontal band of the field of view of said camera throughout a range of angles of the trailer relative to the vehicle;

wherein the horizontal band of the field of view is encompassed by at least one linear row of pixels of said imager array of said camera;

wherein the detected portion of the trailer is size invariant when located in different regions in the horizontal band of the field of view of said camera;

wherein said trailer angle detection system generates a cylindrical view image based on a frame of image data captured by said camera, wherein the generated cylindrical view image comprises multiple rows of pixels and multiple columns of pixels, and wherein the generated cylindrical view image is generated by linearly distributing a horizontal camera opening angle of the camera over the columns of pixels; and

wherein said trailer angle detection system determines an angle of the trailer relative to the vehicle responsive to determination of which columns of pixels the detected portion of the trailer appear at in the generated cylindrical view image.

16. The trailer angle detection system of claim 15, wherein the detected portion of the trailer is at the same height and at the same pixel row in the generated cylindrical view image when the trailer is at different angles relative to the vehicle.

17. The trailer angle detection system of claim 15, wherein the detected portion of the trailer is the same width and at the same pixel row in the generated cylindrical view image when the trailer is at different angles relative to the vehicle.

18. The trailer angle detection system of claim 15, wherein the horizontal band of the field of view of said camera comprises a single pixel row in the generated cylindrical view image.

19. The trailer angle detection system of claim 15, wherein said trailer angle detection system performs an initial calibration when the vehicle is initially moved when towing the trailer.

20. The trailer angle detection system of claim 15, wherein said trailer angle detection system determines the angle of the trailer without use or detection of a target on the trailer.