Vehicle drive assist system

• US 20060287825A1
• Filed: 08/15/2006
• Published: 12/21/2006
• Est. Priority Date: 06/25/1999
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: Shimizu, Toshihiro, Sakiyama, Kazuhiro, Sako, Kazuya
• Granted Patent: US 7,640,107 B2
• Time in Patent Office: Days
• US Class Current: 701/216
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/179 Distances to obstacles or vehicles
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2370/11 Graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2370/152 Displays
• CPC Class Codes: B60K 2370/179 Distances to obstacles or vehicles
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60Q 1/484 for showing outline of vehicle
• CPC Class Codes: B60Q 9/005 using a video camera
• CPC Class Codes: B60Q 9/007 providing information about the distance to an obstacle, e.g. varying sound
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/106 : using night vision cameras
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/301 : combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 : combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/305 : merging camera image with lines or icons
• CPC Class Codes: B60R 2300/306 : using a re-scaling of images
• CPC Class Codes: B60R 2300/607 : from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/70 : characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/8053 : for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8086 : for vehicle path indication
• CPC Class Codes: B60T 2201/10 : Automatic or semi-automatic parking aid systems
• CPC Class Codes: B60T 2210/32 : Vehicle surroundings
• CPC Class Codes: B60W 2050/146 : Display means
• CPC Class Codes: B60W 30/06 : Automatic manoeuvring for parking
• CPC Class Codes: B62D 15/0275 : by overlaying a vehicle path based on present steering angle over an image without processing that image
• CPC Class Codes: B62D 15/028 : Guided parking by providing commands to the driver, e.g. acoustically or optically
• CPC Class Codes: G01C 21/005 : with correlation of navigation data from several sources, e.g. map or contour matching G01C21/30 takes precedence
• CPC Class Codes: G01C 21/3602 : Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera

Abstract

A vehicle drive assist system comprises a camera for picking up an image of an area existing in an advancing direction of a vehicle; display means for displaying the image picked up by the camera; steering angle detecting means for detecting a steering angle for steering the vehicle; traveling path predicting means for predicting a traveling path of the vehicle on the basis of the steering angle detected by the steering angle detecting means; and drive assist means for overlaying on the display means drive assist information containing the vehicle predictive traveling path predicted by the traveling path predicting means and guide lines prolonged from the lines defining the width of the vehicle body on the image of the area existing in the vehicle advancing direction.

Claims

1. A vehicle parking assist device comprising:

a plurality of cameras to cover different photographing areas from each other, thereby to pick up a scene around the vehicle;

display means for displaying images picked up by the cameras, the display means having a display screen; and

drive assist means for dividing the display screen of the display means into a plurality of display areas, and displaying the images by the plurality of cameras on the display areas divided, thereby effecting a drive assist.

2. The vehicle drive assist device according to claim 1, further comprising:

drive condition detecting means for detecting a vehicle drive condition,

wherein the drive assist means selectively changes a display in accordance with the vehicle drive condition detected by the drive condition detecting means.

3. The vehicle drive assist device according to claim 1, wherein the drive assist means overlays the vehicle in simplified form on the images picked up by the plurality of cameras and displayed on the screen of the display means.

4. The vehicle drive assist device according to claim 1, wherein the drive assist means moves a display position of the vehicle on the display screen according to an image from the camera.

5. The vehicle drive assist device according to claim 3, wherein the drive assist means operates to display directions and photographing areas covered by the cameras when the vehicle is displayed in simplified form.

6. The vehicle drive assist device according to claim 1, the vehicle drive assist device mounted in the vehicle having a car-carried device including a navigation device and/or audio device,

wherein the drive assist means for dividing the display screen of the display means into a plurality of segmental display areas, and the images from the plurality of cameras and an image from the car-carried device are displayed on the segmental display areas, thereby effecting the drive assist.

7. The vehicle drive assist device according to claim 1, wherein the drive assist means changes the images from the plurality of cameras to be displayed on the display screen at the predetermined time interval.

8. The vehicle drive assist device according to claim 7, wherein the drive assist means uses a wipe to change the images.

9. The vehicle drive assist device according to claim 1, wherein one of the plurality of cameras is for picking up a scene of a side area of the vehicle, and the drive assist means operates to display a side image concerning a direction indicator, being interconnected with an operation of the direction indicator.

10. The vehicle drive assist device according to claim 1, wherein the drive assist means changes the images one to another in accordance with the steering angle of turn of a steering wheel for steering the vehicle.

11. The vehicle drive assist device according to claim 10, wherein the drive assist means changes a condition of dividing the screen of the display means in accordance with a steering angle of the steering wheel.

12. The vehicle drive assist device according to claim 1, further comprising an obstacle sensor for detecting presence or absence of an obstacle on a vehicle traveling path,

wherein when the obstacle sensor detects the obstacle, the drive assist means causes the display means to display a sensing direction of the obstacle sensor.

13. The vehicle drive assist device according to claim 12, wherein when the obstacle sensor detects an obstacle, the drive assist means causes the display means to display an image from the camera picking up a sensing direction of the obstacle sensor.

14. The vehicle drive assist device according to claim 12, wherein when the obstacle sensor detects the obstacle, the drive assist means causes the display means to shift a display position of the image from the camera picking up the sensing direction of the obstacle sensor, to the center of the screen of the display means or to expand the display.

15. The vehicle drive assist device according to claim 12, wherein the drive assist means causes the display means to overlay an alarm on a display of the sensing direction of the obstacle sensor.

16. The vehicle drive assist device according to claims 1, wherein when adjacent images of the cameras adjacently disposed are simultaneously displayed, the drive assist means adjusts the display areas and positions of the adjacent images to connect the adjacent images continuously with each other.

17. The vehicle drive assist device according to claim 1, wherein the plurality of cameras are disposed to take scenes of the front, front left, front right, back or rear left and back or rear right areas of the vehicle.

18. The vehicle drive assist device according to claim 17, wherein the drive assist means divides the display screen of the display means into upper and lower display areas, and causes the display means to display an image in front of the vehicle on the central region of the upper portion of the screen, images of front left and front right images on the left and right display areas of the upper display area, and an image of the rear area of the vehicle on the central area of the lower display area of the display screen, images of the rear left and rear right on the left and right display areas of the lower display area of the display screen of the display means.

19. The vehicle drive assist device according to claim 17, wherein the drive assist means causes the display means to display an image selected from the images picked up by the plurality of cameras.

20. The vehicle drive assist device according to claim 17, wherein the drive assist means causes the display the images output from the plurality of cameras having the photographing areas successively in scrolling manner.

21. The vehicle drive assist device according to claim 1, wherein the display means includes a touch panel, and the drive assist means changes an image display condition according to an input to the touch panel.

22. The vehicle drive assist device according to claim 21, wherein according to the input to the touch panel, the drive assist means enlarges and displays an image at an input position at a predetermined time, and after the predetermined time elapses, the drive assist means put back the image enlarged and displays the image on the display screen.