Vehicular display control device

• US 10,065,503 B2
• Filed: 03/30/2015
• Issued: 09/04/2018
• Est. Priority Date: 03/31/2014
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Tauchi, Makiko, Tanaka, Kimiaki, Kamiya, Akira
• Primary Examiner(s): Rao, Anand S
• Assistant Examiner(s): Edwards, Tyler B
• Application Number:
  US15/128,570
• Publication Number:
  US 20170106750A1
• Time in Patent Office: 1,254 Days
• Field of Search: None
• CPC Class Codes: B60K 2360/179 Distances to obstacles or vehicles
• CPC Class Codes: B60K 2360/188 Displaying information using colour changes
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0183 Adaptation to parameters characterising the motion of the vehicle
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G05D 1/0231 using optical position detecting means position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/165 : for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G09G 2320/0233 : Improving the luminance or brightness uniformity across the screen
• CPC Class Codes: G09G 2340/10 : Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 : Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 5/003 : Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

A vehicular display control device includes: a display control unit for controlling a display device to superimpose an image on a surrounding view of the vehicle; and a sensor operation detecting unit for detecting whether an obstacle sensor detecting an obstacle around the vehicle is in operation. When the obstacle sensor is in operation, the display control unit: transforms a detection target area, which falls in a detection range of the obstacle sensor and expands from the vehicle to a periphery along a road surface, into a detection target image represented from a viewpoint of a driver of the vehicle; and displays a transformed image to be superimposed on the surrounding view of the vehicle.

Claims

1. A vehicular display control device comprising:

a display control unit for controlling a display device that is mounted in a vehicle and displays an image so as to be superimposed on a surrounding view of the vehicle;

a sensor operation detecting unit for detecting whether an obstacle sensor is in operation, the obstacle sensor being mounted in the vehicle and detecting an obstacle disposed around the vehicle;

a relative position specifying unit for specifying a relative position of the obstacle with respect to the vehicle when the obstacle sensor detects the obstacle; and

a relative speed specifying unit for specifying a relative speed of the obstacle with respect to the vehicle when the obstacle sensor detects the obstacle, wherein;

when the sensor operation detecting unit detects that the obstacle sensor is in operation, the display control unit;

transforms a detection target area, which falls in a detection range of the obstacle sensor and expands from the vehicle to a periphery along a road surface, into a detection target image represented from a viewpoint of a driver of the vehicle; and

displays a transformed image on the display device so as to be superimposed on the surrounding view of the vehicle;

when the relative position of the obstacle, which is specified by the relative position specifying unit, is within the detection target area, the display control unit;

changes a display mode of a boundary area, which is disposed in the detection target image and located in a direction in accordance with the relative position of the object; and

displays the boundary area;

the display control unit displays an arc-like ripple, which expands from the direction in accordance with the relative position of the obstacle, in the boundary area of the detection target image;

when the display control unit displays the arc-like ripple in the boundary area, the display control unit displays the arc-like ripple so as to be seen as if the arc-like ripple moves in an expending direction of the arc-like ripple; and

when the display control unit displays the arc-like ripple in the boundary area, the display control unit displays the arc-like ripple so as to be narrower an interval between adjacent wave patterns of the arc-like ripple as the relative speed of the obstacle, which is specified by the relative speed specifying unit, increases.

2. The vehicular display control device according to claim 1, wherein:

the vehicle switches between an autonomous driving mode for automatically performing at least one of a steering operation and an acceleration-deceleration operation and a non-autonomous driving mode for performing both the steering operation and the acceleration-deceleration operation in accordance with a driving operation of the driver;

when the vehicle is in the autonomous driving mode, and the relative position of the obstacle, which is specified by the relative position specifying unit, is within the detection target area, the display control unit displays the detection target image, changes the display mode of the boundary area in the detection target image, and displays the boundary area; and

when the vehicle is in the non-autonomous driving mode, and the relative position of the obstacle, which is specified by the relative position specifying unit, is within the detection target area, the display control unit does not display the detection target image but displays an image indicative of a presence of the obstacle in the direction in accordance with the relative position of the obstacle.

3. The vehicular display control device according to claim 1, wherein:

as the relative position of the obstacle, which is specified by the relative position specifying unit, is closer to the vehicle, the display control unit increases a ratio between the boundary area and the detection target image, and displays the boundary area, the display mode of which is changed.

4. The vehicular display control device according claim 1, wherein:

the display control unit changes a color of the boundary area in the detection target image to be different from a color of the detection target image other than the boundary area, and displays the boundary area.

5. The vehicular display control device according to claim 1, wherein:

the vehicle switches between an autonomous driving mode for automatically performing at least one of a steering operation and an acceleration-deceleration operation and a non-autonomous driving mode for performing both the steering operation and the acceleration-deceleration operation in accordance with a driving operation of the driver;

the display control unit displays the detection target image when the vehicle is in the autonomous driving mode; and

the display control unit does not display the detection target image when the vehicle is in the non-autonomous driving mode.

6. The vehicular display control device according to claim 1, further comprising:

a selection unit for selecting a range, in which the detection target image expands, from a plurality of range stages based on input operation of the driver, wherein;

the display control unit displays the detection target image, on the display device, in the range selected by the selection unit so as to be superimposed on the surrounding view of the vehicle.

7. The vehicular display control device according to claim 1, further comprising:

a vehicle speed specifying unit for specifying a speed of the vehicle, wherein;

the display control unit expands a range of the detection target image not beyond the detection range of the obstacle sensor as the vehicle speed specified by the vehicle speed specifying unit increases, and displays the detection target image; and

the display control unit narrows the range of the detection target image as the vehicle speed specified by the vehicle speed specifying unit decreases, and displays the detection target image.

8. The vehicular display control device according to claim 1, wherein:

the display device is a head-up display device; and

the display control unit displays the image using the head-up display device, so as to be superimposed on a view seen from the driver of the vehicle, through a windshield of the vehicle.

9. A vehicular display control device comprising:

a display control unit for controlling a display device that is mounted in a vehicle and displays an image so as to be superimposed on an image of a surrounding view of the vehicle;

a sensor operation detecting unit for detecting whether an obstacle sensor is in operation, the obstacle sensor being mounted in the vehicle and detecting an obstacle disposed around the vehicle; and

a relative position specifying unit for specifying a relative position of the obstacle with respect to the vehicle when the obstacle sensor detects the obstacle, wherein;

when the sensor operation detecting unit detects that the obstacle sensor is in operation, the display control unit;

transforms a detection target area, which falls in a detection range of the obstacle sensor and expands from the vehicle to a periphery along a road surface, into a detection target image represented from a viewpoint of a driver of the vehicle; and

displays a transformed image on the display device so as to be superimposed on the surrounding view of the vehicle;

when the relative position of the obstacle, which is specified by the relative position specifying unit, is within the detection target area, the display control unit;

changes a display mode of a boundary area, which is disposed in the detection target image and located in a direction in accordance with the relative position of the object; and

displays the boundary area;

the vehicle switches between an autonomous driving mode for automatically performing at least one of a steering operation and an acceleration-deceleration operation and a non-autonomous driving mode for performing both the steering operation and the acceleration-deceleration operation in accordance with a driving operation of the driver;

when the vehicle is in the autonomous driving mode, and the relative position of the obstacle, which is specified by the relative position specifying unit, is within the detection target area, the display control unit displays the detection target image, changes the display mode of the boundary area in the detection target image, and displays the boundary area; and

when the vehicle is in the non-autonomous driving mode, and the relative position of the obstacle, which is specified by the relative position specifying unit, is within the detection target area, the display control unit does not display the detection target image but displays an image indicative of a presence of the obstacle in the direction in accordance with the relative position of the obstacle.

10. The vehicular display control device according to claim 9, wherein:

the display control unit displays an arc-like ripple, which expands from the direction in accordance with the relative position of the obstacle, in the boundary area of the detection target image.

11. The vehicular display control device according to claim 10, wherein:

when the display control unit displays the arc-like ripple in the boundary area, the display control unit displays the arc-like ripple so as to be seen as if the arc-like ripple moves in an expending direction of the arc-like ripple;

the vehicular display control device further comprising;

a relative speed specifying unit for specifying a relative speed of the obstacle with respect to the vehicle when the obstacle sensor detects the obstacle, wherein;

when the display control unit displays the arc-like ripple in the boundary area, the display control unit displays the arc-like ripple so as to be narrower an interval between adjacent wave patterns of the arc-like ripple as the relative speed of the obstacle, which is specified by the relative speed specifying unit, increases.