Dynamic information presentation on full windshield head-up display

• US 8,692,739 B2
• Filed: 09/22/2011
• Issued: 04/08/2014
• Est. Priority Date: 09/22/2011
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Mathieu, Roy J., Szczerba, Joseph F., Seder, Thomas A., Cui, Dehua
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US13/239,667
• Publication Number:
  US 20130076787A1
• Time in Patent Office: 929 Days
• Field of Search: 345/7, 345/156, 701/1
• US Class Current: 345/7
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays

Abstract

A method to dynamically register a graphic representing essential vehicle information onto a driving scene of a subject vehicle utilizing a substantially transparent windscreen head up display includes monitoring subject vehicle information and identifying the essential vehicle information based on the monitored subject vehicle information. The graphic representing the essential vehicle information is determined and determining, and a preferred location for the graphic upon the substantially transparent windscreen head up display is dynamically registering in accordance with minimizing an operator'"'"'s head movement and eye saccades for viewing the graphic. The graphic is displayed upon the substantially transparent windscreen head up display based upon the preferred location.

Claims

1. Method to dynamically register a graphic representing essential vehicle information onto a driving scene of a subject vehicle utilizing a substantially transparent windscreen head up display, comprising:

monitoring subject vehicle information;

monitoring a location and an orientation of the subject vehicle and monitoring a subject vehicle operational environment;

identifying the essential vehicle information based on the monitored subject vehicle information;

determining a reference view point based on the monitored location and orientation of the subject vehicle and the subject vehicle operational environment, wherein the reference view point corresponds to an identified salient driving scene feature concerning operation of the subject vehicle that should be viewed by an operator of the subject vehicle through the windscreen head up display;

determining the graphic representing the essential vehicle information;

monitoring data related to an operator'"'"'s eye location;

determining a preferred operator gaze location based on the operator'"'"'s eye location and the reference view point, the preferred operator gaze location representing a location upon the windscreen head up display at which the operator should be gazing;

estimating the operator'"'"'s gaze location based on the data related to the operator'"'"'s eye location, the operator'"'"'s gaze location corresponding to a point where the operator'"'"'s eyes are focused;

dynamically registering a preferred location for the graphic upon the substantially transparent windscreen head up display based upon the operator'"'"'s gaze location and the preferred operator gaze location in accordance with minimizing an operator'"'"'s head movement and eye saccades for viewing the graphic, the preferred location of the graphic dynamically emulating movement of the operator'"'"'s gaze location; and

displaying the graphic upon the substantially transparent windscreen head up display based upon the preferred location;

wherein when the preferred location of the graphic is between the operator'"'"'s gaze location and the reference view point corresponding to the identified salient driving scene feature, one of

dynamically adjusting the preferred location to a viewing location upon the substantially transparent windscreen head up display not between the operator'"'"'s gaze location and the salient driving scene feature, and

decreasing illumination of the graphic displayed upon the substantially transparent windscreen head up display.

2. The method of claim 1 wherein identifying the essential vehicle information comprises an operator specification of essential vehicle information.

3. The method of claim 1 wherein identifying the essential vehicle information further comprises dynamically updating the essential vehicle information based on transitions in the monitored subject vehicle information.

4. The method of claim 1 wherein monitoring subject vehicle information comprises monitoring at least one of the subject vehicle'"'"'s speed, engine speed, transmission state, engine coolant temperature, fuel economy, battery SOC, oil level, tire pressure, odometer mileage and wheel slip.

5. The method of claim 1 wherein monitoring subject vehicle information comprises:

monitoring a road geometry and monitoring a location and an orientation of the subject vehicle; and

determining a distance to an approaching maneuver point based on the monitored road geometry and the monitored location and orientation of the subject vehicle.

6. The method of claim 1 wherein monitoring subject vehicle information comprises monitoring at least one of road hazards, navigation information, safety information, location and orientation of the subject vehicle, estimated time of arrival, audio information, a view from behind the subject vehicle, location and orientation of traffic vehicles, lap times, lap splits, laps remaining and informational race flags.

7. The method of claim 1 wherein monitoring subject vehicle information comprises:

monitoring a location and an orientation of each of a plurality of traffic vehicles;

monitoring a location and an orientation of the subject vehicle; and

determining a position of the subject vehicle and each of the plurality of traffic vehicles based on the monitored location and orientation of the subject vehicle and each of the plurality of traffic vehicles.

8. The method of claim 1 wherein the preferred location of the graphic is offset from the preferred operator gaze location and within a foveal view of the operator'"'"'s gaze location.

9. The method of claim 1 further comprising:

monitoring the operator'"'"'s gaze location, wherein the preferred location of the graphic is further based upon a distance between the operator'"'"'s gaze location and the preferred operator'"'"'s gaze location.

10. The method of claim 1 wherein displaying the graphic upon the substantially transparent windscreen head up display based upon the preferred location comprises displaying the graphic at a location upon the substantially transparent windscreen head up display offset from the preferred location based on an operator input.

11. The method of claim 1 further comprising:

monitoring subject vehicle operation and a location and orientation of the subject vehicle based on the monitored subject vehicle information;

determining a historical subject vehicle operation profile and a preferred subject vehicle operation profile based on the monitored subject vehicle operation and the monitored subject vehicle location and orientation; and

comparing the historical subject vehicle operation profile and the preferred subject vehicle operation profile.

12. Method to dynamically register graphics onto a driving scene of a subject vehicle utilizing a substantially transparent windscreen head up display, comprising:

monitoring subject vehicle information;

identifying essential and non-essential vehicle information based on the monitored subject vehicle information, wherein the essential and non-essential vehicle information are operator specified;

monitoring a location and an orientation of the subject vehicle and monitoring a subject vehicle operational environment;

determining a reference view point based on the monitored location and orientation of the subject vehicle and the subject vehicle operational environment, wherein the reference view point corresponds to an identified salient driving scene feature concerning operation of the subject vehicle that should be viewed by an operator of the subject vehicle through the windscreen head up display;

determining a first graphic representing the essential vehicle information;

determining a second graphic representing the non-essential vehicle information;

monitoring an operator'"'"'s eye location;

determining a preferred operator gaze location based on the operator'"'"'s eye location and the reference view point, the preferred operator gaze location representing a location upon the windscreen head up display at which the operator should be gazing;

estimating the operator'"'"'s gaze location based on the monitored eye location, the operator'"'"'s gaze location corresponding to a point where the operator'"'"'s eyes are focused;

dynamically registering a preferred location for the first graphic upon the substantially transparent windscreen head up display based upon the operator'"'"'s gaze location and the preferred operator gaze location in accordance with minimizing the operator'"'"'s head movement and eye saccades for viewing the graphic, the preferred location of the graphic dynamically emulating movement of the operator'"'"'s gaze location;

registering a fixed-location for the second graphic upon the substantially transparent windscreen head up display; and

displaying the first and second graphic upon the substantially transparent windscreen head up display;

wherein when the preferred location of the graphic is between the operator'"'"'s gaze location and the reference view point corresponding to the identified salient driving scene feature, one of

dynamically adjusting the preferred location to a viewing location upon the substantially transparent windscreen head up display not between the operator'"'"'s gaze location and the salient driving scene feature, and

decreasing illumination of the first graphic displayed upon the substantially transparent windscreen head up display.

13. The method of claim 12 further comprising:

when the identified salient feature is within a predetermined viewing area of the registered fixed-location of the second graphic, decreasing illumination of the second graphic.