ENHANCED ROAD VISION ON FULL WINDSHIELD HEAD-UP DISPLAY

• US 20100253540A1
• Filed: 06/19/2009
• Published: 10/07/2010
• Est. Priority Date: 04/02/2009
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations Incorporated (Motors Liquidation Co. GUC Trust)
• Inventors: Szczerba, Joseph F., Seder, Thomas A., Cui, Dehua
• Granted Patent: US 8,704,653 B2
• Time in Patent Office: Days
• US Class Current: 340/905
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G01S 13/723 by using numerical data
• CPC Class Codes: G01S 13/86 Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 13/87 Combinations of radar systems, e.g. primary radar and secondary radar
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 2013/9316 combined with communication equipment with other vehicles or with base stations
• CPC Class Codes: G01S 2013/9318 Controlling the steering
• CPC Class Codes: G01S 2013/93185 Controlling the brakes
• CPC Class Codes: G01S 2013/9319 Controlling the accelerator
• CPC Class Codes: G01S 2013/932 using own vehicle data, e.g. ground speed, steering wheel direction
• CPC Class Codes: G01S 2013/9321 Velocity regulation, e.g. cruise control
• CPC Class Codes: G01S 2013/9322 using additional data, e.g. driver condition, road state or weather data
• CPC Class Codes: G01S 2013/9325 : for inter-vehicle distance regulation, e.g. navigating in platoons
• CPC Class Codes: G01S 2013/93271 : in the front of the vehicles
• CPC Class Codes: G01S 7/22 : Producing cursor lines and indicia by electronic means
• CPC Class Codes: G02B 2027/0118 : comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 : comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 : comprising information/image processing systems
• CPC Class Codes: G02B 27/01 : Head-up displays
• CPC Class Codes: G06F 18/253 : of extracted features
• CPC Class Codes: G06V 10/806 : of extracted features
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/165 : for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: G08G 1/168 : Driving aids for parking, e.g. acoustic or visual feedback on parking space

Abstract

A method to selectively project graphical images upon a transparent windscreen head up display of a vehicle based upon a need for enhanced vision includes monitoring informational inputs describing an operational environment for the vehicle, processing the informational inputs to generate display requirements, generating the graphical images to be projected based upon the display requirements, and projecting the graphical images upon the transparent windscreen head up display. Processing of the informational inputs can include determining the need for enhanced vision based upon the informational inputs and generating the display requirements based upon the informational inputs and the need for enhanced vision.

Claims

1. Method to selectively project graphical images upon a transparent windscreen head up display of a vehicle based upon a need for enhanced vision, the method comprising:

monitoring informational inputs describing an operational environment for the vehicle;

processing the informational inputs to generate display requirements, the processing comprising;

determining the need for enhanced vision based upon the informational inputs; and

generating the display requirements based upon the informational inputs and the need for enhanced vision;

generating the graphical images to be projected based upon the display requirements; and

projecting the graphical images upon the transparent windscreen head up display.

2. The method of claim 1, wherein determining the need for enhanced vision comprises:

determining a measure of visual conditions based upon the monitored informational inputs;

comparing the measure of visual conditions to a threshold visual condition; and

indicating the need for enhanced vision based upon the comparing.

3. The method of claim 2, wherein monitoring informational inputs comprises monitoring sensor inputs describing a lane geometry;

and

wherein the generating the graphical images comprises generating lines indicating lane boundaries based upon the monitored sensor input describing the lane geometry.

4. The method of claim 3, wherein monitoring sensor inputs describing lane geometry comprises:

monitoring a vehicle coordinate position through a GPS device;

utilizing the monitored vehicle coordinate position to locate the vehicle with a map database; and

determining the lane geometry based upon based upon the location of the vehicle.

5. The method of claim 3, wherein monitoring sensor inputs describing lane geometry comprises:

monitoring sensor inputs describing a view in front of the vehicle; and

determining the lane geometry based upon the monitored sensor inputs.

6. The method of claim 5, wherein monitoring sensor inputs comprises monitoring visual images from a camera device.

7. The method of claim 5, wherein monitoring sensor inputs comprises monitoring infrared images from an infrared sensor device.

8. The method of claim 3, wherein generating the graphical images further comprises generating graphical images describing the monitored informational inputs.

9. The method of claim 1, wherein determining the need for enhanced vision comprises:

monitoring data related to an occupant eye location;

analyzing the monitored data to identify a pattern consistent with trying to find obscured lane markers; and

determining the need for enhanced vision based upon identifying the pattern consistent with trying to find obscured lane markers; and

wherein generating the graphical images comprises generating lines indicating lane boundaries.

10. The method of claim 1, wherein determining the need for enhanced vision comprises:

analyzing the monitored informational inputs to identify a situation likely to surprise; and

indicating a need for enhanced vision based upon identifying the situation likely to surprise.

11. The method of claim 1, further comprising

monitoring data related to an occupant eye location;

and

wherein generating the graphical images to be projected based upon the display requirements includes registering the graphical images based upon the monitored data related to the occupant eye location.

12. System to display graphical images upon a windscreen of a vehicle, selectively enhancing a view through the windscreen, the system comprising:

the windscreen comprising a transparent windscreen head up display;

a device monitoring a measure of visual conditions;

a device monitoring informational inputs describing an operational environment for the vehicle;

an enhanced vision system manager configured to;

compare the measure of visual conditions to a threshold visual condition; and

when the comparison of the measure of visual conditions to a threshold visual condition indicates impaired visual conditions, generate display requirements based upon the informational inputs;

a graphics system generating the graphical images to be displayed based upon the display requirements; and

a graphics projection system communicating with the graphics system and displaying the graphical images.

13. The system of claim 12, wherein the graphical images comprise a lane boundary.

14. The system of claim 12, wherein the graphical images comprise a road edge.

15. The system of claim 12, wherein the graphical images comprise an indication of a target vehicle position.

16. The system of claim 12, wherein the graphical images comprise an indication of a pedestrian position.

17. The system of claim 12, wherein the enhanced vision system system manager is further configured to determine an importance of the generated display requirements;

and

wherein the graphical images include a description of determined importance.

18. The system of claim 12, further comprising an occupant eye location sensing system;

and

wherein the graphics system generating the graphical images to be displayed based upon the display requirements includes registration of the graphical images to the windscreen based upon data from the occupant eye location sensing system.

19. An apparatus to selectively display registered graphics upon a substantially transparent head up display of a vehicle enhancing a view through the substantially transparent head up display, the apparatus comprising:

a system manager configured to;

monitor sensor inputs describing a road surface in front of the vehicle;

monitor a measure of visual conditions;

determine a need for enhancing the view based upon the measure of visual conditions; and

when the need for enhancing the view is determined, generate display requirements describing the road surface based upon the monitored sensor inputs; and

a graphics system generating the registered graphical images based upon the display requirements.

20. The apparatus of claim 19, wherein the system manager is further configured to determine an importance of the monitored sensor inputs;

and

wherein determining the need for enhancing the view based upon the measure of visual conditions is further based upon the importance of the monitored sensor inputs.