Vehicular display control device

• US 10,800,258 B2
• Filed: 07/26/2018
• Issued: 10/13/2020
• Est. Priority Date: 03/31/2014
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Tauchi, Makiko, Tanaka, Kimiaki, Kamiya, Akira
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Edwards, Tyler B
• Application Number:
  US16/045,783
• Publication Number:
  US 20180354365A1
• Time in Patent Office: 810 Days
• CPC Class Codes: B60K 2360/179 Distances to obstacles or vehicles
• CPC Class Codes: B60K 2360/188 Displaying information using colour changes
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0183 Adaptation to parameters characterising the motion of the vehicle
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G05D 1/0231 using optical position detecting means position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/165 : for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G09G 2320/0233 : Improving the luminance or brightness uniformity across the screen
• CPC Class Codes: G09G 2340/10 : Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 : Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 5/003 : Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

A vehicular display control device includes: a display control unit for controlling a display device to superimpose an image on a surrounding view of the vehicle; and a sensor operation detecting unit for detecting whether an obstacle sensor detecting an obstacle around the vehicle is in operation. When the obstacle sensor is in operation, the display control unit: transforms a detection target area, which falls in a detection range of the obstacle sensor and expands from the vehicle to a periphery along a road surface, into a detection target image represented from a viewpoint of a driver of the vehicle; and displays a transformed image to be superimposed on the surrounding view of the vehicle.

Claims

1. A vehicular display control device comprising:

a display control unit for controlling a display device that displays an image so as to be superimposed on a surrounding view of the vehicle;

a relative position specifying unit for specifying a relative position of an obstacle with respect to the vehicle when an obstacle sensor for detecting the obstacle around the vehicle detects the obstacle; and

a relative speed specifying unit for specifying a relative speed of the obstacle with respect to the vehicle when the obstacle sensor detects the obstacle, wherein;

the display device displays an obstacle notification image to be superimposed on an area of the surrounding view of the vehicle;

the area of the surrounding view is disposed in a direction corresponding to the relative position of the obstacle specified by the relative position specifying unit;

the display control unit changes a display mode of the obstacle notification image according to the relative speed of the obstacle specified by the relative speed specifying unit when the display device displays the obstacle notification image;

the vehicle switches between an autonomous driving mode for automatically performing at least one of a steering operation and an acceleration-deceleration operation and a non-autonomous driving mode for performing both the steering operation and the acceleration-deceleration operation in accordance with a driving operation of the driver;

the display control unit displays the detection target image when the vehicle is in the autonomous driving mode; and

the display control unit does not display the detection target image when the vehicle is in the non-autonomous driving mode.

2. The vehicular display control device according to claim 1, wherein:

when the obstacle sensor is in operation, the display control unit displays a detection target image to be superimposed on the surrounding view of the vehicle;

the detection target image is defined by representing a detection target area, which falls in a detection range of the obstacle sensor, and expands from the vehicle to a periphery along a road surface, from a viewpoint of a driver of the vehicle;

when the relative position of the obstacle specified by the relative position specifying unit is within the detection target area, the display control unit displays the obstacle notification image in a boundary area with changing the display mode of the obstacle notification image according to the relative speed of the obstacle; and

the boundary area is disposed in the detection target image, and located in the direction corresponding to the relative position of the obstacle.

3. The vehicular display control device according to claim 2, wherein:

as the relative position of the obstacle specified by the relative position specifying unit is closer to the vehicle, the display control unit increases a ratio between the boundary area and the detection target image, and displays the boundary area.

4. The vehicular display control device according to claim 2, wherein:

the display control unit changes a color of the boundary area in the detection target image to be different from a color of the detection target image other than the boundary area, and displays the boundary area.

5. The vehicular display control device according to claim 2, wherein:

the display control unit displays the obstacle notification image including an arc-like ripple, which expands from the direction in accordance with the relative position of the obstacle, in the boundary area of the detection target image.

6. The vehicular display control device according to claim 5, wherein:

when the display control unit displays the arc-like ripple in the boundary area, the display control unit displays the arc-like ripple so as to be seen as if the arc-like ripple moves in an expanding direction of the arc-like ripple;

when the display control unit displays the arc-like ripple in the boundary area, the display control unit displays the arc-like ripple so as to be narrower an interval between adjacent wave patterns of the arc-like ripple as the relative speed of the obstacle specified by the relative speed specifying unit increases; and

when the obstacle specified by the relative position specifying unit is located on an opposite traffic lane to the vehicle, the display control unit does not display the arc-like ripple with respect to the obstacle located on the opposite traffic lane.

7. The vehicular display control device according to claim 2, wherein:

the vehicle switches between an autonomous driving mode for automatically performing at least one of a steering operation and an acceleration-deceleration operation and a non-autonomous driving mode for performing both the steering operation and the acceleration-deceleration operation in accordance with a driving operation of the driver;

when the vehicle is in the autonomous driving mode, and the relative position of the obstacle specified by the relative position specifying unit is within the detection target area, the display control unit displays the detection target image, and displays the boundary area with changing the display mode of the boundary area in the detection target image; and

when the vehicle is in the non-autonomous driving mode, and the relative position of the obstacle specified by the relative position specifying unit is within the detection target area, the display control unit does not display the detection target image but displays an image indicative of a presence of the obstacle in the direction in accordance with the relative position of the obstacle.

8. The vehicular display control device according to claim 1, further comprising:

a selection unit for selecting a range, in which the detection target image expands, from a plurality of range stages based on an input operation of the driver, wherein;

the display control unit displays the detection target image, on the display device, in the range selected by the selection unit so as to be superimposed on the surrounding view of the vehicle.

9. The vehicular display control device according to claim 1, further comprising:

a vehicle speed specifying unit for specifying a speed of the vehicle, wherein;

the display control unit expands a range of the detection target image not beyond the detection range of the obstacle sensor as the vehicle speed specified by the vehicle speed specifying unit increases, and displays the detection target image; and

the display control unit narrows the range of the detection target image as the vehicle speed specified by the vehicle speed specifying unit decreases, and displays the detection target image.

10. The vehicular display control device according to claim 1, wherein:

the display device is a head-up display device; and

the display control unit displays the image using the head-up display device, so as to be superimposed on a view seen from the driver of the vehicle, through a windshield of the vehicle.

11. A vehicular display control device comprising:

a display control unit for controlling a display device that displays an image so as to be superimposed on a surrounding view of a vehicle;

a relative position specifying unit for specifying a relative position of an obstacle with respect to the vehicle when an obstacle sensor for detecting the obstacle disposed around the vehicle detects the obstacle; and

a relative speed specifying unit for specifying a relative speed of the obstacle with respect to the vehicle when the obstacle sensor detects the obstacle, wherein;

the display control unit controls the display device to display an obstacle notification image so as to be superimposed at an area of the surrounding view of the vehicle located in a direction in accordance with the relative position of the object specified by the relative position specifying unit; and

when displaying the obstacle notification image, the display control unit changes a display shape of the obstacle notification image in accordance with the relative speed of the obstacle specified by the relative speed specifying unit.

12. The vehicular display control device according to claim 11, wherein:

when displaying the obstacle notification image, the display control unit changes the display shape of the obstacle notification image in accordance with the relative speed of the obstacle in a direction different from a travelling direction of the obstacle.

13. The vehicular display control device according to claim 11, wherein:

the area of the surrounding view of the vehicle is disposed between the vehicle and the obstacle.