Vehicle target identification using human gesture recognition

• US 9,296,421 B2
• Filed: 03/06/2014
• Issued: 03/29/2016
• Est. Priority Date: 03/06/2014
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Lavoie, Erick Michael
• Primary Examiner(s): CAMBY, RICHARD M
• Application Number:
  US14/198,753
• Publication Number:
  US 20150251697A1
• Time in Patent Office: 754 Days
• Field of Search: 701/36
• US Class Current: 1/1
• CPC Class Codes: B60Q 5/005 automatically actuated
• CPC Class Codes: B62D 13/06 for backing a normally drawn trailer
• CPC Class Codes: B62D 15/027 Parking aids, e.g. instruction means
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A trailer target detection system includes a camera located on a vehicle and arranged to capture video images of a trailer towed by the vehicle. The system includes an image processor processing the video images to detect a gesture by a user indicative of position of target on the trailer and identifying location of the target based on the detected gesture. A vehicle trailer backup assist system includes a camera and an image processor for processing images to detect a gesture and determine a command based on the gesture. The processor controls backing of the trailer based on the command.

Claims

1. A method of identifying a target on a trailer for a vehicle backup assist system comprising:

providing a target on a trailer;

generating video images of the trailer using a camera located on a vehicle towing the trailer;

processing the video images to detect a gesture by a user indicative of position of the target on the trailer;

identifying location of the target based on the detected gesture; and

providing a feedback indicative of detection of the target based on the gesture.

2. The method of claim 1, wherein the processing detects a hand of the user pointing at the target.

3. The method of claim 2, wherein the processing detects a tapping motion of a hand.

4. The method of claim 1, wherein the method is employed on a trailer backup assist system for assisting with backing up the trailer connected to the vehicle.

5. The method of claim 4, wherein the target is employed for hitch angle detection.

6. The method of claim 1, wherein the feedback comprises at least one of an audible and visual feedback.

7. The method of claim 1, wherein the gesture is presented on a screen associated with a display device.

8. A trailer target detection system comprising:

a camera located on a vehicle and arranged to capture video images of a trailer towed by the vehicle;

an image processor processing the video images to detect a gesture by a user indicative of position of the target on the trailer and identifying location of the target based on the detected gesture; and

a feedback device providing feedback indicative of detection of the target based on the gesture.

9. The trailer target detection system of claim 8, wherein the image processor detects a hand of the user pointing at the target.

10. The trailer target detection system of claim 9, wherein the image processor detects a tapping motion of a hand.

11. The trailer target detection system of claim 8, wherein the identified location of the target is employed by a trailer backup assist system for assisting with backing up the trailer connected to the vehicle.

12. The trailer target detection system of claim 11, wherein the target is employed for hitch angle detection.

13. The trailer target detection system of claim 8, wherein the feedback comprises at least one of an audible and visual feedback.

14. The trailer target detection system of claim 8, wherein the gesture is presented on a screen associated with a display device.

15. A vehicle backup assist system comprising:

a camera located on a vehicle and arranged to capture video images of a trailer towed by the vehicle;

an image processor for processing the video images to detect a gesture by a user indicative of position of the target on the trailer and to identify a location of the target based on the detected gesture;

a controller for controlling vehicle backup; and

a feedback device for providing feedback indicative of detection of the target based on the gesture.