Method for displaying information to vehicle driver

• US 10,315,573 B2
• Filed: 07/09/2018
• Issued: 06/11/2019
• Est. Priority Date: 02/19/2014
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Bongwald, Olaf
• Primary Examiner(s): Duley, Janese
• Application Number:
  US16/029,753
• Publication Number:
  US 20180312111A1
• Time in Patent Office: 337 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/404 triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8086 for vehicle path indication
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence

Abstract

A method for displaying information to a driver of a vehicle includes disposing a camera at a vehicle and disposing a bimodal display at a display region at a windshield of the vehicle. Responsive at least in part to determination that gaze of the driver is not at the display area or gaze of the driver is at the display region and the driver is not focusing at the display region for the threshold period of time, the bimodal display operates in a first mode, where the bimodal display is transmissive of visible light therethrough. Responsive at least in part to determination that gaze of the driver is at the display region and the driver is focusing at the display region for the threshold period of time, the bimodal display operates in the second mode, where images derived from captured image data are displayed at the display region.

Claims

1. A method for displaying information to a driver of a vehicle, said method comprising:

disposing a camera at a vehicle so as to have a field of view exterior of the equipped vehicle, wherein the camera is operable to capture image data;

disposing a bimodal display at a display region at a windshield of the vehicle that is viewable by a driver of the vehicle when the driver is normally operating the vehicle, wherein the bimodal display is operable in a first mode and a second mode, and wherein, when the bimodal display operates in the first mode, the bimodal display at the display region is transmissive of visible light therethrough, and wherein, when the bimodal display operates in the second mode, images derived from image data captured by the camera are displayed at the display region;

providing a driver monitor operable to determine a gaze of the driver of the equipped vehicle;

providing a controller that controls the bimodal display responsive at least in part to the driver monitor;

determining, via the driver monitor, when the gaze of the driver is at the display region and when the driver is focusing at the display region for a threshold period of time;

with the equipped vehicle being driven by the driver, and responsive at least in part to determination by the driver monitor that (i) gaze of the driver is not at the display region or (ii) gaze of the driver is at the display region and the driver is not focusing at the display region for the threshold period of time, the bimodal display operates in the first mode;

with the equipped vehicle being driven, and responsive at least in part to determination by the driver monitor that (i) gaze of the driver of the vehicle is at the display region and (ii) the driver is focusing at the display region for the threshold period of time, changing operation of the bimodal display, via the controller, from the first mode to the second mode; and

with the bimodal display operating in the second mode, displaying images at the display region that are derived from image data captured by the camera.

2. The method of claim 1, wherein, responsive at least in part to determination by the driver monitor that the gaze of the driver is not at the display region, the bimodal display operates in the first mode.

3. The method of claim 1, wherein, responsive at least in part to determination by the driver monitor that the gaze of the driver is at the display region and the driver is not focusing at the display region for the threshold period of time, the bimodal display operates in the first mode.

4. The method of claim 1, wherein the camera comprises a rearward viewing camera having a rearward field of view, and wherein the controller automatically changes operation of the bimodal display to the second mode when the equipped vehicle is executing a reversing maneuver.

5. The method of claim 1, wherein the bimodal display is disposed at a central region of the windshield of the equipped vehicle.

6. The method of claim 1, wherein the bimodal display comprises a projector in the vehicle and remote from the display region, and wherein the projector, when the bimodal display is operating in the second mode, projects images onto the windshield at the display region, and wherein the bimodal display comprises an element at the windshield that changes from a transparent state to a non-transparent state when the bimodal display changes operation from the first mode to the second mode.

7. The method of claim 6, comprising darkening, via the bimodal display, of a background of the display region when the bimodal display is operating in the second mode.

8. The method of claim 7, comprising changing, via the controller, and responsive at least in part to determination that the gaze of the driver is not at the display region, operation of the bimodal display to the first mode, wherein the projector is deactivated and the display region is changed to the transparent state when operation of the bimodal display changes to the first mode.

9. The method of claim 1, wherein the camera comprises a rearward viewing camera having a field of view rearward of the vehicle, and wherein the controller is operable to change operation of the bimodal display from the first mode to the second mode when the vehicle is driven forwardly.

10. The method of claim 1, wherein the bimodal display comprises a display screen disposed at the display region at an interior surface of the windshield.

11. The method of claim 10, wherein the display screen comprises (i) a first display portion that, when the bimodal display is operating in the second mode, displays images derived from captured image data and (ii) a second display portion that, when the bimodal display is operating in the second mode, displays navigation information.

12. The method of claim 11, comprising controlling, via the controller, and with the vehicle being driven forwardly, and responsive at least in part to determination that the gaze of the driver of the vehicle is at a second display region corresponding to the second display portion for a threshold period of time, the second display portion of the display screen to display navigation information.

13. The method of claim 12, comprising automatically controlling, via the controller, the second display portion to display navigation information when the vehicle is approaching a waypoint of a programmed route of the equipped vehicle.

14. The method of claim 1, wherein the driver monitor comprises an in-cabin camera having a field of view that encompasses the head of the driver of the equipped vehicle.

15. A method for displaying information to a driver of a vehicle, said method comprising:

disposing a camera at a rear portion of a vehicle so as to have a field of view exterior and rearward of the equipped vehicle, wherein the camera is operable to capture image data;

disposing a bimodal display at a display region at a windshield of the vehicle that is viewable by a driver of the vehicle when the driver is normally operating the vehicle, wherein the bimodal display is operable in a first mode and a second mode, and wherein, when the bimodal display operates in the first mode, the bimodal display at the display region is transmissive of visible light therethrough, and wherein, when the bimodal display operates in the second mode, images derived from image data captured by the camera are displayed at the display region;

providing a driver monitor operable to determine a gaze of the driver of the equipped vehicle;

providing a controller that controls the bimodal display responsive at least in part to the driver monitor;

determining, via the driver monitor, when the gaze of the driver is at the display region and when the driver is focusing at the display region for a threshold period of time;

with the equipped vehicle being driven by the driver, and responsive at least in part to determination by the driver monitor that (i) gaze of the driver is not at the display region or (ii) gaze of the driver is at the display region and the driver is not focusing at the display region for the threshold period of time, the bimodal display operates in the first mode;

with the equipped vehicle being driven, and responsive at least in part to determination by the driver monitor that (i) gaze of the driver of the vehicle is at the display region and (ii) the driver is focusing at the display region for the threshold period of time, changing operation of the bimodal display, via the controller, from the first mode to the second mode;

with the bimodal display operating in the second mode, displaying images at the display region that are derived from image data captured by the camera;

wherein the controller is operable to change operation of the bimodal display from the first mode to the second mode when the vehicle is driven forwardly; and

wherein the controller automatically changes operation of the bimodal display to the second mode when the equipped vehicle is executing a reversing maneuver.

16. The method of claim 15, wherein the bimodal display comprises a display screen disposed at the display region at an interior surface of the windshield.

17. The method of claim 16, comprising darkening, via the bimodal display, of a background of the display region when the bimodal display is operating in the second mode.

18. A method for displaying information to a driver of a vehicle, said method comprising:

disposing a camera at a vehicle so as to have a field of view exterior of the equipped vehicle, wherein the camera is operable to capture image data;

disposing a bimodal display at a display region at a windshield of the vehicle that is viewable by a driver of the vehicle when the driver is normally operating the vehicle, wherein the bimodal display is operable in a first mode and a second mode, and wherein, when the bimodal display operates in the first mode, the bimodal display at the display region is transmissive of visible light therethrough, and wherein, when the bimodal display operates in the second mode, images derived from image data captured by the camera are displayed at the display region;

providing a driver monitor operable to determine a gaze of the driver of the equipped vehicle;

providing a controller that controls the bimodal display responsive at least in part to the driver monitor;

determining, via the driver monitor, when the gaze of the driver is at the display region and when the driver is focusing at the display region for a threshold period of time;

with the equipped vehicle being driven by the driver, and responsive at least in part to determination by the driver monitor that (i) gaze of the driver is not at the display region or (ii) gaze of the driver is at the display region and the driver is not focusing at the display region for the threshold period of time, the bimodal display operates in the first mode;

with the equipped vehicle being driven, and responsive at least in part to determination by the driver monitor that (i) gaze of the driver of the vehicle is at the display region and (ii) the driver is focusing at the display region for the threshold period of time, changing operation of the bimodal display, via the controller, from the first mode to the second mode;

with the bimodal display operating in the second mode, displaying images at the display region that are derived from image data captured by the camera;

wherein the bimodal display comprises (i) a first display portion that, when the bimodal display is operating in the second mode, displays images derived from captured image data, and (ii) a second display portion that, when the bimodal display is operating in the second mode, displays navigation information; and

darkening, via the bimodal display, a background of the display region when the bimodal display is operating in the second mode.

19. The method of claim 18, comprising controlling, via the controller, and with the vehicle being driven forwardly, and responsive at least in part to determination that the gaze of the driver of the vehicle is at a second display region corresponding to the second display portion for a threshold period of time, the second display portion of the bimodal display to display navigation information.

20. The method of claim 19, comprising automatically controlling, via the controller, the second display portion to display navigation information when the vehicle is approaching a waypoint of a programmed route of the equipped vehicle.