Vehicle vision system with display

• US 10,017,114 B2
• Filed: 02/17/2015
• Issued: 07/10/2018
• Est. Priority Date: 02/19/2014
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Bongwald, Olaf
• Primary Examiner(s): Duley, Janese
• Application Number:
  US14/623,690
• Publication Number:
  US 20150232030A1
• Time in Patent Office: 1,239 Days
• Field of Search: None
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/404 triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8086 for vehicle path indication
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence

Abstract

A vision system of a vehicle includes a camera, a display unit and a controller. The camera is disposed at a vehicle and has a field of view exterior of the vehicle. The camera is operable to capture image data. The display unit includes a display screen disposed at a display area at a windshield of the vehicle. The display unit is electrically changeable from a non-display state to a display state. When the vehicle is being driven, the controller, responsive to a determination that the gaze of the driver of the vehicle is at the display area for a threshold period of time, changes the display unit from its non-display state to its display state. When in its display state, the display unit displays images at said display screen that are derived from captured image data.

Claims

1. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle equipped with said vision system, said camera having a field of view exterior of the equipped vehicle, wherein said camera is operable to capture image data;

a display unit comprising a display screen disposed at a display area at a windshield of the equipped vehicle that is viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle, wherein said display unit is electrically changeable from a non-display state, wherein said display screen is transmissive of visible light therethrough, to a display state, wherein images derived from captured image data are displayed at said display screen;

a driver monitor operable to determine a gaze of the driver of the equipped vehicle;

a controller operable to control said display unit responsive to said driver monitor;

wherein, when the equipped vehicle is being driven, said controller, responsive to a determination by said driver monitor that the gaze of the driver of the equipped vehicle is at the display area for a threshold period of time, changes said display unit from its non-display state to its display state, and wherein, when in its display state, said display unit displays images at said display screen that are derived from captured image data; and

wherein, when in the non-display state with said display screen transmissive of visible light therethrough, and with the gaze of the driver being at the display area for less than the threshold period of time, the driver viewing the display area views through said display screen and the windshield to see exterior of the vehicle.

2. The vision system of claim 1, wherein said controller, responsive to a determination that the gaze of the driver is not at the display area, changes said display unit to its non-display state.

3. The vision system of claim 1, wherein said camera comprises a rearward viewing camera having a rearward field of view and wherein said controller automatically changes said display unit to said display state when the equipped vehicle is executing a reversing maneuver.

4. The vision system of claim 1, wherein said display unit is disposed at an interior surface of a windshield of the equipped vehicle.

5. The vision system of claim 1, wherein said driver monitor is operable to determine a gaze direction and focal distance of the gaze of the driver to determine when the driver is focusing at the display area or at a location outside of the equipped vehicle.

6. The vision system of claim 1, wherein said display unit comprises a projector in the equipped vehicle and remote from said display screen, and wherein said projector, when said display unit is in its display state, projects images onto said display screen, and wherein said display screen comprises an element that electrically changes from a transparent state to a non-transparent state when said display unit changes from its non-display state to its display state.

7. The vision system of claim 6, wherein said display screen, when in its non-transparent state, provides darkening of a background of the display area, and wherein said controller, responsive to a determination that the gaze of the driver is not at the display area, changes said display unit to its non-display state and wherein said projector is deactivated and said display screen is changed to its transparent state when said display unit changes to its non-display state.

8. The vision system of claim 1, wherein said display unit comprises a retinal display.

9. The vision system of claim 1, wherein said display unit comprises heads-up display.

10. The vision system of claim 1, wherein said camera comprises a rearward viewing camera having a field of view rearward of the equipped vehicle and wherein said controller is operable to change said display unit from its non-display state to its display state when the equipped vehicle is driven forwardly.

11. The vision system of claim 1, wherein said display screen comprises (i) a first display portion that, when said display unit is in its display state, displays images derived from captured image data and (ii) a second display portion that, when said display unit is in its display state, displays navigation information.

12. The vision system of claim 11, wherein, with the equipped vehicle being driven forwardly, said controller, responsive to a determination that the gaze of the driver of the equipped vehicle is at a display region corresponding to said second display portion for a threshold period of time, changes said second display portion of said display screen to display navigation information.

13. The vision system of claim 12, wherein said controller is operable to automatically change said second display portion to display navigation information when the equipped vehicle is approaching a waypoint of a programmed route of the equipped vehicle.

14. The vision system of claim 1, wherein said driver monitor comprises an in-cabin camera having a field of view that encompasses the head of the driver of the equipped vehicle.

15. A vision system of a vehicle, said vision system comprising:

a rearward viewing camera disposed at a vehicle equipped with said vision system, said rearward viewing camera having a field of view rearward of the equipped vehicle, wherein said rearward viewing camera is operable to capture image data;

a display unit comprising a display screen disposed at a display area at a windshield of the equipped vehicle that is viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle, wherein said display unit is electrically changeable from a non-display state, wherein said display screen is transmissive of visible light therethrough, to a display state, wherein images derived from captured image data are displayed at said display screen;

a driver monitor operable to determine a gaze of the driver of the equipped vehicle, wherein said driver monitor comprises an in-cabin camera having a field of view that encompasses the head of the driver of the equipped vehicle;

a controller operable to control said display unit responsive to said driver monitor;

wherein, when the equipped vehicle is being driven, said controller, responsive to a determination by said driver monitor that the gaze of the driver of the equipped vehicle is at the display area for a threshold period of time, changes said display unit from its non-display state to its display state, and wherein, when in its display state, said display unit displays images at said display screen that are derived from captured image data;

wherein, when in the non-display state with said display screen transmissive of visible light therethrough, and with the gaze of the driver being at the display area for less than the threshold period of time, the driver viewing the display area views through said display screen and the windshield to see exterior of the vehicle; and

wherein said controller automatically changes said display unit to its display state when the equipped vehicle is executing a reversing maneuver.

16. The vision system of claim 15, wherein said display unit comprises a projector in the equipped vehicle and remote from said display screen, and wherein said projector, when said display unit is in its display state, projects images onto said display screen, and wherein said display screen comprises an element that electrically changes from a transparent state to a non-transparent state when said display unit changes from its non-display state to its display state.

17. The vision system of claim 16, wherein said controller, responsive to a determination that the gaze of the driver is not at the display area, changes said display unit to its non-display state and wherein said projector is deactivated and said display screen is changed to its transparent state when said display unit changes to its non-display state.

18. A vision system of a vehicle, said vision system comprising:

a rearward viewing camera disposed at a vehicle equipped with said vision system, said rearward viewing camera having a field of view rearward of the equipped vehicle, wherein said rearward viewing camera is operable to capture image data;

a display unit comprising a display screen disposed at a display area at a windshield of the equipped vehicle that is viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle, wherein said display unit is electrically changeable from a transparent state, wherein said display screen is transmissive of visible light therethrough, to a display state, wherein images derived from captured image data are displayed at said display screen;

a driver monitor operable to determine a gaze of the driver of the equipped vehicle;

a controller operable to control said display unit responsive to said driver monitor;

wherein, when the equipped vehicle is being driven, said controller, responsive to a determination by said driver monitor that the gaze of the driver of the equipped vehicle is at the display area for a threshold period of time, changes said display unit from its non-display state to its display state, and wherein, when in its display state, said display unit displays images at said display screen that are derived from captured image data;

wherein, when in the non-display state with said display screen transmissive of visible light therethrough, and with the gaze of the driver being at the display area for less than the threshold period of time, the driver viewing the display area views through said display screen and the windshield to see exterior of the vehicle;

wherein said controller automatically changes said display unit to its display state when the equipped vehicle is executing a reversing maneuver; and

wherein said controller is operable to change said display unit from its non-display state to its display state when the equipped vehicle is driven forwardly.

19. The vision system of claim 18, wherein said controller, responsive to a determination that the gaze of the driver is not at the display area, changes said display unit to its non-display state, and wherein said display unit comprises a projector, and wherein said projector, when said display unit is in its display state, projects images onto said display screen, and wherein said display screen comprises an element that electrically changes from a transparent state to a non-transparent state when said display unit changes from its non-display state to its display state.

20. The vision system of claim 19, wherein said display screen, when in its non-transparent state, provides darkening of a background of the display area.