Vehicle object detection system

• US 10,377,310 B2
• Filed: 10/31/2017
• Issued: 08/13/2019
• Est. Priority Date: 10/28/2014
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan North America Incorporated (Nissan Motor Co., Ltd.)
• Inventors: Tan, Adrian, Tierney, Jr., William M
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dhillon, Peet
• Application Number:
  US15/799,538
• Publication Number:
  US 20180050637A1
• Time in Patent Office: 651 Days
• Field of Search: 348142, 348 46, 348118
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/8093 for obstacle warning

Abstract

A vehicle object detection system having a controller configured to process object information received from the plurality of sensors and determine the distance between an outer surface of a vehicle body structure and an object. The controller displays on a video display a faux representation of the object, a faux representation of the outer surface of the vehicle body structure and a numeric representation of the distance between the outer surface of the vehicle body structure and the object. The controller is further configured to switch between operating the video display in display modes including a parallel parking view mode and a backup mode.

Claims

1. A vehicle object detection system comprising:

a vehicle body structure having an outer surface and defining a vehicle longitudinal direction;

a plurality of sensors configured to detect an object within a prescribed area adjacent to the outer surface of the vehicle body structure;

a video display installed to the vehicle body structure; and

a controller configured to process object information received from the plurality of sensors, determine the distance between the outer surface of the vehicle body structure and the object, and display on the video display a faux representation of the object, a faux representation of the outer surface of the vehicle body structure and a numeric representation of the distance between the outer surface of the vehicle body structure and the object, the controller being further configured to switch between operating the video display in display modes including a parallel parking view mode and a backup mode, such that

in the parallel parking view mode the faux representation of the outer surface includes a faux representation of the one of the passenger'"'"'s side of the vehicle or the driver'"'"'s side of the vehicle looking in a horizontal direction parallel to the vehicle longitudinal direction from one end of the vehicle with a faux representation of the prescribed area being adjacent to the one of the passenger'"'"'s side or the driver'"'"'s side of the vehicle, and

in the backup mode the faux representation of the outer surface includes a faux representation of the rear bumper fascia looking from one side thereof with a faux representation of the prescribed area being adjacent to a rear end of the vehicle.

2. The vehicle object detection system according to claim 1, further comprising

at least one camera aimed at a portion of the prescribed area adjacent to the outer surface of the vehicle body structure, the at least one camera being connected to the controller such that the controller selectively displays images captured by the camera on the video display in a display mode that includes only the images captured by the camera and data received from only one of the plurality of sensors.

3. The vehicle object detection system according to claim 1, wherein

the plurality of sensors are all the same type of sensor device and are selected from the following group of sensors consisting of:

sonar emitting and detecting devices, a radar emitting and detecting devices, infrared emitting and detecting devices and laser light emitting and light detecting devices.

4. The vehicle object detection system according to claim 1, wherein

the controller is further further configured to switch to any one of a plurality of additional display modes, including a side view mode in which the faux representation of the outer surface includes a faux representation of the front bumper fascia looking from one lateral side thereof the vehicle with the prescribed area in a faux representation thereof being adjacent to a front end of the vehicle.

5. The vehicle object detection system according to claim 1, wherein

the controller being further configured to automatically operate the video display in response to the vehicle operating at a speed of below 10 mph.

6. The vehicle object detection system according to claim 1, wherein

the sensing device includes a plurality of video cameras mounted to the vehicle body structure;

and

the controller is configured to display in another display mode on the video display, an overhead composite view including a representation of the vehicle body structure with superimposed video images of areas around the vehicle body structure and further display the object with the distance superimposed between the object and the vehicle body structure.

7. The vehicle object detection system according to claim 1, wherein

the video display is located within the passenger compartment.

8. The vehicle object detection system according to claim 1, wherein

the video display is located within a side view mirror fixed to an outer surface of a vehicle door of the vehicle body structure.

9. The vehicle object detection system according to claim 1, wherein

the sensors are further configured to detect a plurality of objects within the prescribed area adjacent to the outer surface of the vehicle body structure, and

the controller is further configured to process further object information received from the sensing device, determine the distance between the outer surface of the vehicle body structure and each of the plurality of objects, and display on the video display a representation of the plurality of objects and the distances between the outer surface of the vehicle body structure and each of the plurality of objects.

10. The vehicle object detection system according to claim 9, wherein

the controller is further configured to display on the video display the numeric distance between the outer surface and a first of the plurality of object in a first color, and display on the video display the numeric distance between the outer surface and a second of the plurality of object in a second color.

11. The vehicle object detection system according to claim 9, further comprising:

an eye gaze camera installed to the vehicle body structure configured to capture images of a vehicle operator'"'"'s eye, and

the controller is further configured to process images captured by the eye gaze camera and correlate aim of the vehicle operator'"'"'s eye to one objects of the plurality of objects and display on the video display a faux representation of the plurality of objects, and a numeric representation of the distance between the outer surface of the vehicle body structure and the one object.

12. The vehicle object detection system according to claim 1, wherein

the controller is further configured to re-determine the distance between the outer surface of the vehicle body structure and the object in response to movement of the vehicle body structure relative to the object, and display a re-determined distance between the outer surface of the vehicle body structure and the object.

13. The vehicle object detection system according to claim 1, wherein

the controller is further configured determine distances between the outer surface of the vehicle body structure and a plurality of surfaces of a multi-surface object including determining a first distance between the outer surface of the vehicle body structure and a first surface of the object, and determining a second distance between the outer surface of the vehicle body structure and a second surface of the object and further configured to display the first distance adjacent a faux representation of the first surface of the object, and display the second distance adjacent a faux representation of the second surface of the object.

14. A vehicle object detection system comprising:

a vehicle body structure having an outer surface and defining a vehicle longitudinal direction;

a plurality of sensors configured to detect an object within a prescribed area adjacent to the outer surface of the vehicle body structure;

a video display installed to the vehicle body structure; and

a controller configured to process object information received from the plurality of sensors and display on the video display a faux representation of the object and a faux representation of the outer surface of the vehicle body structure, the controller being further configured to switch between operating the video display in display modes including a parallel parking view mode and a backup mode, such that

in the parallel parking view mode the faux representation of the outer surface includes a faux representation of the one of the passenger'"'"'s side of the vehicle or the driver'"'"'s side of the vehicle looking in a horizontal direction parallel to the vehicle longitudinal direction from one end of the vehicle with a faux representation of the prescribed area being adjacent to the one of the passenger'"'"'s side or the driver'"'"'s side of the vehicle, and

in the backup mode the faux representation of the outer surface includes a faux representation of the rear bumper fascia looking from one side thereof with a faux representation of the prescribed area being adjacent to a rear end of the vehicle.

15. The vehicle object detection system according to claim 14, wherein

the controller is further configured to determine the distance between the outer surface of the vehicle body structure and the object, and display on the video display a numeric representation of the distance between the outer surface of the vehicle body structure and the object.

16. The vehicle object detection system according to claim 15, wherein

the controller being further configured to automatically operate the video display in response to the vehicle operating at a speed of below 10 mph.

17. A vehicle object detection system comprising:

a vehicle body structure having an outer surface and defining a vehicle longitudinal direction;

a plurality of sensors configured to detect an object within a prescribed area adjacent to the outer surface of the vehicle body structure;

a video display installed to the vehicle body structure; and

a controller configured to process object information received from the plurality of sensors, and display on the video display a faux representation of the object and a faux representation of the outer surface of the vehicle body structure, the controller being further configured to operate the video display in plurality of display modes including a parallel parking view mode such that in the parallel parking view mode the faux representation of the outer surface includes a faux representation of the one of the passenger'"'"'s side of the vehicle or the driver'"'"'s side of the vehicle looking in a horizontal direction parallel to the vehicle longitudinal direction from one end of the vehicle with a faux representation of the prescribed area being adjacent to the one of the passenger'"'"'s side or the driver'"'"'s side of the vehicle.

18. The vehicle object detection system according to claim 17, wherein

the controller is further configured to switch the video display to operate the video display in a backup mode such that the faux representation of the outer surface includes a faux representation of the rear bumper fascia looking from one side thereof with a faux representation of the prescribed area being adjacent to a rear end of the vehicle.