Smart trailer hitch control using HMI assisted visual servoing
First Claim
1. A method for autonomously aligning a hitch tow ball attached to a back of a towing vehicle with a drawbar attached to a trailer, said method comprising:
- providing rearview images from a rearview camera on the vehicle that show the tow ball and the drawbar;
displaying the images on a touch screen display;
touching the tow ball on the display to register a position of the tow ball in the image;
touching the drawbar on the display to register a position of a target where the tow ball will be aligned with the drawbar;
providing, by a controller including a processor and memory, a template pattern around the registered target in the image;
autonomously moving the vehicle, by the controller, so that the tow ball moves towards the target;
predicting, by the controller, a position of the target in new images as the vehicle moves, using vehicle speed, vehicle steering angle and hitch trajectory;
estimating, by the controller, a new location of the target in the new images as the vehicle moves by comparing the template pattern with an image patch window provided around the predicted position of the target;
determining, by the controller, a distance between the tow ball and the new location of the target; and
stopping the vehicle, by the controller, when the distance between the tow ball and the new location of the target is less than a predetermined threshold.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for autonomously aligning a tow hitch ball on a towing vehicle and a trailer drawbar on a trailer through a human-machine interface (HMI) assisted visual servoing process. The method includes providing rearview images from a rearview camera. The method includes touching the tow ball on a display to register a location of the tow ball in the image and touching the drawbar on the display to register a location of a target where the tow ball will be properly aligned with the drawbar. The method provides a template pattern around the target on the image and autonomously moves the vehicle so that the tow ball moves towards the target. The method predicts a new location of the target as the vehicle moves and identifies the target in new images as the vehicle moves by comparing the previous template pattern with an image patch around the predicted location.
-
Citations
19 Claims
-
1. A method for autonomously aligning a hitch tow ball attached to a back of a towing vehicle with a drawbar attached to a trailer, said method comprising:
-
providing rearview images from a rearview camera on the vehicle that show the tow ball and the drawbar; displaying the images on a touch screen display; touching the tow ball on the display to register a position of the tow ball in the image; touching the drawbar on the display to register a position of a target where the tow ball will be aligned with the drawbar; providing, by a controller including a processor and memory, a template pattern around the registered target in the image; autonomously moving the vehicle, by the controller, so that the tow ball moves towards the target; predicting, by the controller, a position of the target in new images as the vehicle moves, using vehicle speed, vehicle steering angle and hitch trajectory; estimating, by the controller, a new location of the target in the new images as the vehicle moves by comparing the template pattern with an image patch window provided around the predicted position of the target; determining, by the controller, a distance between the tow ball and the new location of the target; and stopping the vehicle, by the controller, when the distance between the tow ball and the new location of the target is less than a predetermined threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for autonomously aligning a hitch tow ball attached to a back of a towing vehicle with a drawbar attached to a trailer, said method comprising:
-
providing rearview images from a rearview camera on the vehicle that show the tow ball and the drawbar; registering a position of the tow ball in the image; registering a position of a target where the tow ball will be aligned with the drawbar; autonomously moving the vehicle, by a controller including a processor and memory, so that the tow ball moves towards the target; determining, by the controller, a distance between the tow ball and a new location of the target; and stopping the vehicle, by the controller, when the distance between the tow ball and the new location of the target is less than a predetermined threshold. - View Dependent Claims (12, 13, 14)
-
-
15. A system for autonomously aligning a hitch tow ball attached to a back of a towing vehicle with a drawbar attached to a trailer, said system comprising:
-
a rearview camera on the vehicle for providing rearview images that show the tow ball and the drawbar; a touch screen display for displaying the images; means for touching the tow ball on the display to register a position of the tow ball in the image; means for touching the drawbar on the display to register a position of a target where the tow ball will be aligned with the drawbar; and a controller including a processor and memory, said controller configured for; providing a template pattern around the target in the image; autonomously moving the vehicle so that the tow ball moves towards the target; predicting a position of the target in new images as the vehicle moves; estimating a new location of the target in the new images as the vehicle moves by comparing the template pattern with an image patch window provided around the predicted position of the target; determining a distance between the tow ball and the new location of the target; and stopping the vehicle when the distance between the tow ball and the new location of the target is less than a predetermined threshold. - View Dependent Claims (16, 17, 18, 19)
-
Specification