DISPLAY DEVICE FOR VEHICLE AND CONTROL METHOD THEREOF

• US 20170187963A1
• Filed: 07/11/2016
• Published: 06/29/2017
• Est. Priority Date: 12/24/2015
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: LEE, Jaeho, KIM, Ilwan, CHOI, Sunghwan
• Granted Patent: US 10,924,679 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators

Abstract

A display device for a vehicle, and including a camera configured to acquire an image around the vehicle; a display unit configured to display a graphic image on a windshield of the vehicle; and a processor configured to detect at least one object included in the acquired image viewed by a driver of the vehicle, determine information of the detected object comprising a position and size of an area of the windshield in which the object is viewed, and a type of the object, and control the display unit to display the graphic image on an area of the windshield based on the determined information of the object.

Claims

1. A display device for a vehicle, the display device comprising:

a camera configured to acquire an image around the vehicle;

a display unit configured to display a graphic image on a windshield of the vehicle; and

a processor configured to;

detect at least one object included in the acquired image viewed by a driver of the vehicle,

determine information of the detected object comprising a position and size of an area of the windshield in which the object is viewed, and a type of the object, and

control the display unit to display the graphic image on an area of the windshield based on the determined information of the object.

2. The display device for the vehicle according to claim 1, wherein the processor is configured to control the display unit to display an amount of information that is included in the graphic image based on the detected object.

3. The display device for the vehicle according to claim 1, wherein the detected object includes at least one of another vehicle, a traffic sign, and a pedestrian included in the acquired image viewed by the driver, and

wherein the processor is configured to control the display unit to display the graphic image on a windshield area excluding a transparent area in which the detected object is viewed.

4. The display device for the vehicle according to claim 3, wherein the graphic image is a navigation image illustrating a route of the vehicle, and

wherein the processor is configured to:

set, as a first display area, a projected area in which a driving road on which the vehicle drives is viewed,

set, as a second display area, a projected area in which an upper area of the driving road is viewed, and

control the display unit to display the navigation image in the first display area or in the second display area.

5. The display device for the vehicle according to claim 4, wherein the processor is configured to:

control the display unit to display the navigation image in the first display area when a size of the first display area is equal to or larger than a predetermined size, and

control the display unit to display the navigation image in the second display area when the size of the first display area is smaller than the predetermined size.

6. The display device for the vehicle according to claim 4, wherein the processor is configured to:

control the display unit to display the navigation image in the first display area when a distance to a front vehicle driving in front of the vehicle is equal to or longer than a predetermined distance, and

control the display unit to display the navigation image in the second display area when the distance to the front vehicle is shorter than the predetermined distance.

7. The display device for the vehicle according to claim 4, wherein the processor is configured to:

control the display unit to display the navigation image using a carpet image in the first display area, and

control the display unit to display the navigation image using an arrow image in the second display area.

8. The display device for the vehicle according to claim 1, wherein the processor is configured to:

decrease a size of the graphic image or an amount of information on the graphic image when there is a lot of traffic in the acquired image viewed by the driver, and

increase the size of the graphic image or the amount of information on the graphic image when there is little traffic in the acquired image viewed by the driver.

9. The display device for the vehicle according to claim 1, wherein the processor is configured to:

control the display unit to display the graphic image including a navigation image and surrounding traffic information when a speed of the vehicle is lower than a predetermined speed, and

control the display unit to display only the navigation image when the speed of the vehicle is equal to or higher than the predetermined speed.

10. The display device for the vehicle according to claim 1, wherein the processor is configured to control the display unit to display a first graphic image indicating a position of a collision risk object on the windshield in response to the collision risk object being detected from a blind spot.

11. The display device for the vehicle according to claim 10, wherein the processor is configured to control the display unit to display a second graphic image representing a risk of collision on edges of the windshield in response to the collision risk object being detected.

12. The display device for the vehicle according to claim 1, wherein the processor is configured to control the display unit to display an overlap graphic image to overlap an area in which the detected object is viewed.

13. The display device for the vehicle according to claim 12, wherein the overlap graphic image is an image for warning of lane departure of the vehicle and displayed to overlap a lane on a departure prediction point.

14. The display device for the vehicle according to claim 12, wherein the overlap graphic image is an image for warning of a collision risk object included in the acquired image viewed by the driver and displayed to overlap the collision risk object.

15. The driver assistance apparatus according to claim 14, wherein the processor is configured to detect a gaze of the driver, and

control the display unit to display the graphic image indicating the collision risk object in a windshield area corresponding to the detected gaze direction of the driver when the gaze direction mismatches a direction of the collision risk object.

16. The display device for the vehicle according to claim 1, wherein the detected object is a front vehicle, and

wherein the processor is configured to control the display unit to display the graphic image in an area of the windshield in which the front vehicle is viewed, when a size of the area of the windshield in which the front vehicle is viewed is equal to or larger than a predetermined size.

17. The display device for the vehicle according to claim 1, wherein the processor is configured to:

control the display unit to display, by a first graphic image, a carpet image showing a route of the vehicle, in a windshield area in which a driving road is viewed, and

control the display unit to display, by an arrow image, a second graphic image near the object, when the carpet image is hidden by the object.

18. The display device for the vehicle according to claim 1, wherein the processor is configured to control the display unit to display a first graphic image highlighting a collision risk object and display remaining graphic images excluding the first graphic image to be relatively lower than the first graphic image in level of identification, when the collision risk object is detected from objects included in the acquired image viewed by the driver.

19. A method of controlling a display device for a vehicle, the method comprising:

acquiring, via a camera, an image around the vehicle;

displaying, via a display unit, a graphic image on a windshield of the vehicle;

detecting, via a processor, at least one object included in the acquired image viewed by a driver of the vehicle;

determining, via the processor, information of the detected object comprising a position and size of an area of the windshield in which the object is viewed, and a type of the object; and

displaying, via the display unit, the graphic image on an area of the windshield based on the determined information of the object.

20. The method according to claim 19, further comprising:

displaying an amount of information that is included in the graphic image based on the detected object.