Vehicle image display system and method

• US 10,436,600 B2
• Filed: 03/10/2016
• Issued: 10/08/2019
• Est. Priority Date: 03/26/2015
• Status: Expired due to Fees

• Current Assignee: Image Co., Ltd. (Daiichi Sankyo Company Limited), Shuichi Tayama
• Original Assignee: Image Co., Ltd. (Daiichi Sankyo Company Limited)
• Inventors: Tayama, Shuichi, Watanabe, Yukio
• Primary Examiner(s): Wu, Yanna
• Application Number:
  US15/559,290
• Publication Number:
  US 20180058879A1
• Time in Patent Office: 1,307 Days
• Field of Search: None
• CPC Class Codes: B60K 2360/175 Autonomous driving
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/184 Displaying the same information on different displays
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 21/00 Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks safety belts or body harnesses in vehicles B60R22/00; devices, apparatus or methods for life-saving in general A62B; safety devices for propulsion unit control specially adapted for, or arranged in, vehicles B60K28/00; seats constructed to protect the occupant from the effect of abnormal g-forces, e.g. crash or safety seats, B60N2/42; energy-absorbing arrangements for hand wheels for steering vehicles B62D1/11; energy-absorbing arrangements for vehicle steering columns B62D1/19; harnessing in aircraft B64D25/00
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B60W 30/14 Adaptive cruise control
• CPC Class Codes: B60W 30/16 Control of distance between vehicles, e.g. keeping a distance to preceding vehicle
• CPC Class Codes: B60W 30/18163 Lane change; Overtaking manoeuvres
• CPC Class Codes: B60W 60/0011 : involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles
• CPC Class Codes: G01C 21/26 : specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/3676 : Overview of the route on the road map
• CPC Class Codes: G06T 11/60 : Editing figures and text; Combining figures or text
• CPC Class Codes: G08G 1/16 : Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G09B 29/00 : Maps; Plans; Charts; Diagrams, e.g. route diagram star maps G09B27/04; devices for holding or supporting maps A47B97/02; for computing purposes G06G1/14, G09B1/16; display boards G09F
• CPC Class Codes: G09B 29/10 : Map spot or coordinate position indicators; Map reading aids optical projection apparatus per se G03B
• CPC Class Codes: G09G 2380/10 : Automotive applications

Abstract

In a vehicle image display system, a travel behavior of an own vehicle during automated driving to be subsequently performed is previously noticed to an occupant with display to be recognized intuitively and instantaneously. A vehicle image display system includes a first display device that uses a front windshield as a display screen and a second display device as a monitor device mounted on a dashboard, and displays, on a display screen of each display device, a moving image of a virtual image of the own vehicle travelling on an arrow of a symbol image indicating a travel course for lane change as having the arrow as a trajectory therefor so as to visually provide prior notice of the lane change to the occupant when the own vehicle in the automated driving system is about to perform the lane change as being deviated from a scheduled travel course.

Claims

1. A vehicle image display system for an automated driving system including an automated driving control unit for controlling an accelerating system, a steering system, and a braking system of an own vehicle to cause the own vehicle to travel with automated driving along a previously-set scheduled travel route to a destination in accordance with a scheduled travel behavior, the automated driving control unit controlling the own vehicle to perform an unscheduled travel behavior different from the scheduled travel behavior based on latest traffic information and a travel information of the own vehicle, the vehicle image display system comprising:

a display device configured to display a picture image visually indicating the scheduled travel behavior on a screen of the own vehicle for an occupant of the own vehicle; and

a display control unit configured to generate a first symbol image indicating a scheduled travel course on a scheduled road during an automated driving by the automated driving control unit based on the travel information of the own vehicle from the automated driving control unit, and to control the display device to display the first symbol image on the screen in real time,

wherein the display control unit is configured to generate a second symbol image indicating an unscheduled travel course deviating from the scheduled travel course based on the travel information of the own vehicle and an instruction received from the automated driving control unit when the automated driving control unit is trying to cause the own vehicle to perform the unscheduled travel behavior, and to control the display device to display the second symbol image on the screen in which the second symbol image is superimposed on the first symbol image,

the display control unit is configured to generate the picture image indicating the own vehicle traveling in accordance with the scheduled travel course and to control the display device to display the picture image superimposed on the first symbol image,

the display control unit is configured to generate a virtual image indicating a virtual vehicle of the own vehicle virtually traveling on the unscheduled travel course and to control the display device to display the virtual image superimposed on the second symbol image at an end point of the unscheduled travel course, wherein the virtual image is an image of a real vehicle,

the display control unit is configured to control the display device so that, for travelling the virtual vehicle along the unscheduled travel course, the virtual image is superimposed on the second symbol image and the virtual vehicle traveling on the unscheduled travel course is repeatedly displayed as a moving image at a speed faster than that of the own vehicle on the first symbol image for visually providing a prior notice of the unscheduled travel behavior to the occupant, and

the display control unit is configured to control the display device such that;

the second symbol image is superimposed on the first symbol image to display the unscheduled travel route different from the scheduled travel route, the virtual image is superimposed on the second symbol image, and the picture image is superimposed on the first symbol image, the second symbol image, and the virtual image,

when the own vehicle travels in accordance with the unscheduled travel behavior, the virtual image is moved along the second symbol image to gradually approach from an end point to a leading point of the second symbol image, and

the virtual image is displayed after a lane change is previously noticed to the occupant to perform the unscheduled travel behavior until the lane change is completed, and is erased after the lane change is completed.

2. The vehicle image display system according to claim 1, wherein each of the first and second symbol images has a shape of an arrow mark, which is tapered from an own vehicle side toward a front side of the own vehicle, and

the display control unit is configured to control the display device to display ends of the first and second symbol images on the own vehicle side overlapping each other, each of the ends of the first and second symbol images on the own vehicle side being a starting point of the arrow mark.

3. The vehicle image display system according to claim 1, wherein the display device includes a head-up display device for applying a front windshield of the own vehicle as the screen, and

the display control unit is configured to control the display device to position the picture image with respect to an actual scenery viewed through the front windshield serving as a background image, based on the travel information of the own vehicle received from the automated driving control unit.

4. The vehicle image display system according to claim 1, further comprising:

a camera mounted on the own vehicle for capturing a scenery of a front side of the own vehicle,

wherein the display device includes a monitor device mounted on a dashboard of the own vehicle and connected to the camera, and

the display control unit is configured to display the moving image on the display device in real time with the scenery of the front side of the own vehicle captured by the camera as a background image, and to position the picture image with respect to the scenery based on the travel information of the own vehicle received from the automated driving control unit.

5. The vehicle image display system according to claim 1, wherein the unscheduled travel behavior is defined as performing the lane change for moving the own vehicle to a lane different from the lane on the scheduled travel course, parking/stopping of the own vehicle in a parking space out of the scheduled travel course, or making a U-turn to move the own vehicle in a direction opposite to a previous traveling direction of the own vehicle as being deviated from the scheduled travel course on a road previously set along the travel route by the automated driving system, and

the end point of the unscheduled travel course on the second symbol image is defined as a location on the lane different from the lane on the scheduled travel course in performing the lane change, the parking space in the parking/stopping of the own vehicle, and a U-turn location on a lane for traveling in the direction opposite to the previous traveling direction in making the U-turn.

6. The vehicle image display system according to claim 5, wherein the unscheduled travel behavior includes a temporary stop on the unscheduled travel course when performing the lane change, parking/stopping, or making the U-turn.

7. The vehicle image display system according to claim 1, wherein the display control unit is configured to control the display device

to display the picture image indicating the own vehicle to follow the second symbol image after the own vehicle starts traveling on the unscheduled travel course, and

to erase the picture image indicating the virtual vehicle of the own vehicle displayed at the end point of the unscheduled travel course when the own vehicle is at the end point of the unscheduled travel course.

8. An automated driving system comprising:

the vehicle image display system according to claim 1, and

the automated driving control unit for controlling the accelerating system, the steering system, and the braking system of the own vehicle to cause the own vehicle to travel with automated driving along the previously-set scheduled travel route to the destination in accordance with the scheduled travel behavior, the automated driving control unit controlling the own vehicle to perform the unscheduled travel behavior that is different from the scheduled travel behavior based on the latest traffic information and the travel information of the own vehicle.