Vehicle object detection system

• US 9,834,141 B2
• Filed: 10/28/2014
• Issued: 12/05/2017
• Est. Priority Date: 10/28/2014
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan North America Incorporated (Nissan Motor Co., Ltd.)
• Inventors: Tan, Adrian, Tierney, Jr., William M
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): DHILLON, PUNEET S
• Application Number:
  US14/525,397
• Publication Number:
  US 20160114728A1
• Time in Patent Office: 1,134 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/8093 for obstacle warning

Abstract

A vehicle object detection system includes a vehicle body structure, a sensing device, a video display and a controller. The vehicle body structure defines a passenger compartment and has an outer surface. The sensing device is configured to detect an object within a prescribed area adjacent to the outer surface of the vehicle body structure. The video display is viewable from within the passenger compartment and is configured to display images representing the prescribed area adjacent to the outer surface of the vehicle body structure. The controller is configured to process object information received from the sensing device, determine the distance between the outer surface of the vehicle body structure and the object, and display on the video display a representation of the object and a numeric representation of the distance between the outer surface of the vehicle body structure and the object.

Claims

1. A vehicle object detection system comprising:

a vehicle body structure defining a passenger compartment and having an outer surface;

a plurality of sensing devices configured to detect an object within a prescribed area adjacent to the outer surface of the vehicle body structure;

a video display viewable from within the passenger compartment configured to display images representing the prescribed area adjacent to the outer surface of the vehicle body structure; and

a controller configured to process object information received from the plurality of sensing devices, determine the distance between the outer surface of the vehicle body structure and the object, and display on the video display a faux representation of the object, a faux representation of the outer surface of the vehicle body structure and a numeric representation of the distance between the outer surface of the vehicle body structure and the object, the controller being further configured to switch between operating the video display in any one of a plurality of display modes including at least two of a side view mode, a parallel parking view mode and a backup mode, such that

in the side view mode the faux representation of the outer surface includes a representation of the front bumper fascia looking from one side thereof the vehicle with the prescribed area being adjacent to a front end of the vehicle,

in the parallel parking view mode the faux representation of the outer surface includes a representation of the one of the passenger'"'"'s side of the vehicle or the driver'"'"'s side of the vehicle looking horizontally from one end of the vehicle with the prescribed area being adjacent to the one of the passenger'"'"'s side or the driver'"'"'s side of the vehicle, and

in the backup mode the faux representation of the outer surface includes a representation of the rear bumper fascia looking from one side thereof with the prescribed area being adjacent to a rear end of the vehicle,

the controller being further provided with predetermined dimensions corresponding to physical dimensions of the vehicle body structure, and the images representing the underside section of the vehicle body structure are generated based upon the predetermined dimensions, and

the controller being further configured to receive inputted modified dimensions such that in response to the modified dimensions being received, the predetermined dimensions are replaced with the modified dimensions and the images representing the underside section of the vehicle body structure are generated based upon the modified dimensions.

2. The vehicle object detection system according to claim 1, wherein

the controller is further configured to re-determine the distance between the outer surface of the vehicle body structure and the object in response to movement of the vehicle body structure relative to the object, and display the re-determined distance between the outer surface of the vehicle body structure and the object.

3. The vehicle object detection system according to claim 1, wherein

the sensing devices include at least one video camera.

4. The vehicle object detection system according to claim 1, wherein

the sensing devices include a detection and ranging system.

5. The vehicle object detection system according to claim 4, wherein

the sensing devices further include at least one video camera.

6. The vehicle object detection system according to claim 1, wherein

the sensing devices include a plurality of video cameras mounted to the vehicle body structure;

and

the controller is further configured to display on the video display in an all around view monitor mode in which an overhead composite view including a representation of the vehicle body structure with superimposed video images of areas around the vehicle body structure and further display the object with the distance superimposed between the object and the vehicle body structure.

7. The vehicle object detection system according to claim 1, wherein

the video display is located within the passenger compartment.

8. The vehicle object detection system according to claim 1, wherein

the video display is located within a side view mirror fixed to an outer surface of a vehicle door of the vehicle body structure.

9. The vehicle object detection system according to claim 1, wherein

the sensing devices are further configured to detect a plurality of objects within the prescribed area adjacent to the outer surface of the vehicle body structure, and

the controller is further configured to process further object information received from the sensing device, determine the distance between the outer surface of the vehicle body structure and each of the plurality of objects, and display on the video display a representation of the plurality of objects and the distances between the outer surface of the vehicle body structure and each of the plurality of objects.

10. The vehicle object detection system according to claim 1, wherein

the controller is further configured to display on the video display the numeric distance between the outer surface and the object in a first color indicating the numeric distance is greater than a first distance.

11. The vehicle object detection system according to claim 10, wherein

the controller is further configured to display on the video display the numeric distance between the outer surface and the object in a second color indicating the numeric distance is less than a first distance but greater than a second distance smaller than the first distance.

12. The vehicle object detection system according to claim 11, wherein

the controller is further configured to display on the video display the numeric distance between the outer surface and the object in a second color indicating the numeric distance is less than the second distance but greater than a third distance smaller than the second distance.

13. The vehicle object detection system according to claim 1, wherein

the controller is further configured determine distances between the outer surface of the vehicle body structure and a plurality of surfaces of a multi-surface object including determining a first distance between the outer surface of the vehicle body structure and a first surface of the object, and determining a second distance between the outer surface of the vehicle body structure and a second surface of the object and further configured to display the first distance adjacent the representation of the first surface of the object, and display the second distance adjacent the representation of the second surface of the object.

14. The vehicle object detection system according to claim 1, wherein

in the parallel parking view mode the faux representation of the outer surface of the vehicle body structure displayed on the video display includes a faux image of a tire of the vehicle body structure.

15. A vehicle object detection system comprising:

a vehicle body structure defining a passenger compartment and having an outer surface, the vehicle body structure defining a vehicle longitudinal direction;

a plurality of sensing devices configured to detect an object within a prescribed area adjacent to the outer surface of the vehicle body structure;

a video display viewable from within the passenger compartment configured to display images representing the prescribed area adjacent to the outer surface of the vehicle body structure; and

a controller configured to process object information received from the plurality of sensing devices, determine the distance between the outer surface of the vehicle body structure and the object, and display on the video display a faux representation of the object, a faux representation of the outer surface of the vehicle body structure and a numeric representation of the distance between the outer surface of the vehicle body structure and the object, the controller being further configured to switch between operating the video display in each of a plurality of display modes including a side view mode, a parallel parking view mode and a backup mode, such that

in the side view mode the faux representation of the outer surface includes a faux representation of the front bumper fascia looking from one side thereof the vehicle with a faux representation of the prescribed area being adjacent to a front end of the vehicle,

in the parallel parking view mode the faux representation of the outer surface includes a faux representation of the one of the passenger'"'"'s side of the vehicle or the driver'"'"'s side of the vehicle looking in a horizontal direction parallel to the vehicle longitudinal direction from one end of the vehicle with a faux representation of the prescribed area being adjacent to the one of the passenger'"'"'s side or the driver'"'"'s side of the vehicle, and

in the backup mode the faux representation of the outer surface includes a faux representation of the rear bumper fascia looking from one side thereof with a faux representation of the prescribed area being adjacent to a rear end of the vehicle.

16. The vehicle object detection system according to claim 15, wherein

the faux representation of the outer surface of the vehicle body structure displayed on the video display includes a faux image of a tire of the vehicle body structure.

18. The vehicle object detection system according to claim 15, wherein the controller being further configured to automatically operate the video display in response to the vehicle operating at a speed of below 10 mph.

17. A vehicle object detection system comprising:

a vehicle body structure defining a passenger compartment and having an outer surface;

a plurality of sensing devices configured to detect a plurality of objects within a prescribed area adjacent to the outer surface of the vehicle body structure;

a video display viewable from within the passenger compartment configured to display images representing the prescribed area adjacent to the outer surface of the vehicle body structure;

an eye gaze camera configured to capture images of a vehicle operator'"'"'s eye; and

a controller configured to process object information received from the plurality of sensing devices, determine the distance between the outer surface of the vehicle body structure and the plurality of objects, process images captured by the eye gaze camera and correlate aim of the vehicle operator'"'"'s eye to one object of the plurality of objects and display on the video display a faux representation of the plurality of objects, a faux representation of the outer surface of the vehicle body structure and a numeric representation of the distance between the outer surface of the vehicle body structure and the one object, the controller being further configured to switch between operating the video display in each of a plurality of display modes including a side view mode, a parallel parking view mode and a backup mode, such that

in the side view mode the faux representation of the outer surface includes a faux representation of the front bumper fascia looking from one lateral side thereof the vehicle with the prescribed area in a faux representation thereof being adjacent to a front end of the vehicle,

in the parallel parking view mode the faux representation of the outer surface includes a faux representation of the one of the passenger'"'"'s side of the vehicle or the driver'"'"'s side of the vehicle looking in a horizontal direction from one end of the vehicle with the prescribed area in a faux representation thereof being adjacent to the one of the passenger'"'"'s side or the driver'"'"'s side of the vehicle, and

in the backup mode the faux representation of the outer surface includes a faux representation of the rear bumper fascia looking from one side thereof with the prescribed area in a faux representation thereof being adjacent to a rear end of the vehicle.