System and method for detecting the position of a tailgate and adjusting operation of a user interface device based on the tailgate position

• US 10,607,092 B2
• Filed: 01/25/2018
• Issued: 03/31/2020
• Est. Priority Date: 01/25/2018
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Murad, Mohannad, Fowler, Bryan W., Carlos, Princess Len
• Primary Examiner(s): Duley, Janese
• Application Number:
  US15/879,586
• Publication Number:
  US 20190228235A1
• Time in Patent Office: 796 Days
• Field of Search: None
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A system includes an object identification module, a tailgate position module, and a user interface device (UID) control module. The object identification module is configured to identify at least one of a bumper of a vehicle and a tailgate of the vehicle in an image captured by a camera mounted to the tailgate. The tailgate position module is configured to determine that the tailgate is closed when the bumper is identified in the image, and determine that the tailgate is open when at least one of: the tailgate is identified in the image; and the bumper is not identified in the image. The UID control module is configured to adjust operation of a user interface device based on whether the tailgate is open or closed.

Claims

1. A system comprising:

an object detection circuit configured to detect a first object in a first image captured by a camera mounted to a tailgate of a vehicle;

an object identification circuit configured to identify the first object as one of the tailgate and a bumper of the vehicle when at least one of;

a shape of the first object corresponds to a predetermined shape;

a size of the first object corresponds to a predetermined size; and

a location of the first object corresponds to a predetermined location;

a tailgate position circuit configured to;

determine that the tailgate is closed based on the bumper being identified in the first image captured by the camera; and

determine that the tailgate is open based on;

the tailgate being identified in the first image captured by the camera; and

the bumper not being identified in the first image captured by the camera; and

a user interface device (UID) control circuit configured to at least one of;

control a user interface device to display a perspective view image of a first area rearward of the vehicle, to display guidelines representing a travel path of the vehicle over the perspective view image, and to adjust the guidelines based on whether the tailgate is open or closed; and

control the user interface device to alert a driver when the vehicle is approaching a second object located rearward of the vehicle and within a first distance of the vehicle, and to adjust the first distance based on whether the tailgate is open or closed, wherein the user interface device alerts the driver by at least one of playing a sound and generating a vibration.

2. The system of claim 1 wherein the object identification circuit is configured to identify the first object as the bumper when the first object appears at a bottom edge of the first image captured by the camera and the at least one of:

the shape of the first object corresponds to the predetermined shape of the bumper; and

the size of the first object corresponds to the predetermined size of the bumper.

3. The system of claim 1 wherein the object identification circuit is configured to identify the first object as the tailgate when the first object appears at a top edge of the first image captured by the camera and the at least one of:

the shape of the first object corresponds to the predetermined shape of the tailgate; and

the size of the first object corresponds to the predetermined size of the tailgate.

4. A system comprising:

an object detection circuit configured to detect a first object in a first image captured by a camera mounted to a tailgate of a vehicle;

an object identification circuit configured to identify the first object as one of a bumper of the vehicle and the tailgate when at least one of;

a shape of the first object corresponds to a predetermined shape;

a size of the first object corresponds to a predetermined size; and

a location of the first object corresponds to a predetermined location;

a tailgate position circuit configured to;

determine that the tailgate is closed based on the bumper being identified in the first image captured by the camera;

determine that the tailgate is open based on;

the tailgate being identified in the first image captured by the camera; and

the bumper not being identified in the first image captured by the camera; and

a user interface device (UID) control circuit configured to at least one of;

control the user interface device to display a perspective view image of a first area rearward of the vehicle, to display guidelines representing a travel path of the vehicle over the perspective view image, and to adjust the guidelines based on whether the tailgate is open or closed; and

control the user interface device to alert a driver when the vehicle is approaching a second object located rearward of the vehicle and within a first distance of the vehicle, and to adjust the first distance based on whether the tailgate is open or closed.

5. The system of claim 4 wherein the UID control circuit is configured to control the user interface device to display the perspective view image of the first area rearward of the vehicle, to display the guidelines over the perspective view image, and to adjust the guidelines based on whether the tailgate is open or closed.

6. The system of claim 5 wherein:

the guidelines indicate a distance from the vehicle to at least one location rearward of the vehicle; and

the UID control circuit is configured to at least one of increase a length of the guidelines and increase a spacing between the guidelines when the tailgate is opened.

7. The system of claim 4 wherein the UID control circuit is configured to:

control the user interface device to alert the driver when the vehicle is approaching the second object and the second object is within the first distance of the vehicle; and

adjust the first distance based on whether the tailgate is open or closed.

8. The system of claim 7 wherein the UID control circuit is configured to adjust the first distance to a first value when the tailgate is closed and adjust the first distance to a second value that is greater than the first value when the tailgate is open.

9. A system comprising:

a camera configured to be mounted to a tailgate of a vehicle and configured to capture an image of an area rearward of the vehicle;

a camera actuator configured to;

adjust the camera to a first position when the tailgate is closed, wherein a field of view of the camera includes a portion of a bumper of the vehicle when the camera is in the first position and the tailgate is closed; and

adjust the camera to a second position when the tailgate is open, wherein the field of view of the camera includes a portion of the tailgate when the camera is in the second position and the tailgate is open;

an object detection circuit configured to detect a first object in a first image captured by the camera;

an object identification circuit configured to identify of the first object as one of the bumper and the tailgate when at least one of;

a shape of the first object corresponds to a predetermined shape;

a size of the first object corresponds to a predetermined size; and

a location of the first object corresponds to a predetermined location;

a tailgate position circuit configured to;

determine that the tailgate is closed based on the portion of the bumper being identified in the image captured by the camera; and

determine that the tailgate is open based on;

the portion of the tailgate being identified in the image captured by the camera; and

the portion of the bumper not being identified in the image captured by the camera; and

a user interface device (UID) control circuit configured to at least one of;

control the user interface device to display a perspective view image of a first area rearward of the vehicle, to display guidelines representing a travel path of the vehicle over the perspective view image, and to adjust the guidelines based on whether the tailgate is open or closed; and

control the user interface device to alert a driver when the vehicle is approaching a second object located rearward of the vehicle and within a first distance of the vehicle, and to adjust the first distance based on whether the tailgate is open or closed.

10. The system of claim 9 wherein the object identification circuit is configured to identify the first object as the bumper when the second first object appears at a bottom edge of the image captured by the camera and the at least one of:

the shape of the first object corresponds to the predetermined shape of the portion of the bumper; and

the size of the first object corresponds to the predetermined size of the portion of the bumper.

11. The system of claim 9 wherein the object identification circuit is configured to identify the first object as the tailgate when the first object appears at a top edge of the image captured by the camera and the at least one of:

the shape of the first object corresponds to the predetermined shape of the portion of the tailgate; and

the size of the first object corresponds to the predetermined size of the portion of the tailgate.

12. The system of claim 9 wherein the UID control circuit is configured to control the user interface device to display the perspective view image of the first area rearward of the vehicle, to display the guidelines over the perspective view image, and to adjust the guidelines based on whether the tailgate is open or closed.

13. The system of claim 9 wherein the UID control circuit is configured to:

control the user interface device to alert the driver when the vehicle is approaching the second object and the second object is within the first distance of the vehicle; and

adjust the first distance based on whether the tailgate is open or closed.