AUGMENTED ROAD SCENE ILLUSTRATOR SYSTEM ON FULL WINDSHIELD HEAD-UP DISPLAY

• US 20120169861A1
• Filed: 12/29/2010
• Published: 07/05/2012
• Est. Priority Date: 12/29/2010
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Szczerba, Joseph F., Seder, Thomas A., Cui, Dehua
• Granted Patent: US 8,633,979 B2
• Time in Patent Office: Days
• US Class Current: 348/78
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A method to dynamically register a graphic on a driving scene of a vehicle utilizing a graphic projection display includes monitoring a user input indicated to a portion of the graphic projection display, determining a graphic representing a user-defined content based on the monitored user input indicated to the portion of the graphic projection display, dynamically registering a location of the graphic upon the graphic projection display corresponding to the driving scene of the vehicle, and displaying the graphic upon the graphic projection display.

Claims

1. Method to dynamically register a graphic on a driving scene of a vehicle utilizing a graphic projection display, comprising:

monitoring a user input indicated to a portion of the graphic projection display;

determining a graphic representing a user-defined content based on the monitored user input indicated to the portion of the graphic projection display;

dynamically registering a location of the graphic upon the graphic projection display corresponding to the driving scene of the vehicle; and

displaying the graphic upon the graphic projection display.

2. The method of claim 1 wherein the graphic projection display comprises a substantially transparent windscreen head-up display comprising a pixelated field of view enabling graphic view from a limited direction comprising one of light emitting particles or microstructures over a predefined region of the windscreen permitting luminescent display in the limited direction while permitting vision therethrough.

3. The method of claim 1 wherein the graphic projection display comprises one of a touch screen display, a human machine interface display, a non-transparent component and a display monitor.

4. The method of claim 3 further comprising:

projecting an image of a view corresponding to the driving scene of the vehicle upon the graphic projection display.

5. The method of claim 1 wherein the graphic representing the user-defined content comprises a highlighted trace graphic illustrating movement of the monitored user-input.

6. The method of claim 1 wherein the graphic describing the user-defined content comprises a registered graphic capable of manipulation based on the monitored user-input.

7. The method of claim 1 wherein the graphic representing the user-defined content comprises a textual graphic.

8. The method of claim 1 further comprising:

determining a feedback graphic illustrating movement of the monitored user input indicated to the portion of the graphic projection display;

dynamically registering a location of the feedback graphic upon the graphic projection display corresponding to the driving scene of the vehicle; and

displaying the feedback graphic upon the graphic projection display.

9. The method of claim 8 wherein the feedback graphic is a content-specific graphic.

10. The method of claim 1 further comprising monitoring an occupant eye location;

and

wherein dynamically registering a location of the graphic upon the graphic projection display corresponding to the driving scene is based upon the occupant eye location.

11. The method of claim 10 further comprising:

monitoring an operator gaze location;

dynamically updating the graphic representing the user-defined content based on the operator gaze location; and

wherein dynamically updating the graphic representing the user-defined content comprises increasing emphasis to the graphic based on an increasing distance between the operator gaze location and the location at which the graphic is registered upon the graphic projection display;

wherein dynamically updating the graphic representing the user-defined content comprises decreasing emphasis to the graphic based on a decreasing distance between the operator gaze location and the location at which the graphic is registered upon the graphic projection display.

12. The method of claim 1 wherein monitoring the user input indicated to the portion of the graphic projection display comprises:

monitoring a location and an orientation of a hand of the user;

processing an optical image of hand movement of the user based on the monitored location and orientation of the hand of the user; and

wherein the optical image of the hand movement provides a gesture-based user interface for determining the graphic representing the user-defined content.

13. The method of claim 1 wherein monitoring the user input indicated to the portion of the graphic projection display comprises:

receiving touch gestures of a hand of the user upon a touch screen, the touch gestures indicated to the portion of the graphic projection display; and

wherein the received touch gestures provides a touch-based user interface for determining the graphic representing the user-defined content.

14. The method of claim 1 wherein monitoring the user input indicated to the portion of the graphic projection display comprises:

receiving user manipulations at a controller device, the user manipulations indicated to the portion of the graphic projection display; and

wherein the received user manipulations provides a controller-based interface for determining the graphic representing the user-defined content.

15. The method of claim 1 wherein monitoring the user input indicated to the portion of the graphic projection display comprises:

receiving user keystrokes at a keyboard device, the user keystrokes indicated to the portion of the graphic projection display; and

wherein the received key strokes provides a key-based interface for determining the graphic representing the user-defined content.

16. Method to project a viewer-defined dynamically registered graphic upon a substantially transparent windscreen head-up display corresponding to the driving scene of the vehicle, comprising:

monitoring a user input indicated to a portion of the substantially transparent windscreen head-up display;

determining a viewer-defined dynamically registered graphic to be projected upon the substantially transparent windscreen head-up display corresponding to the driving scene based upon the user input; and

projecting the graphic upon the substantially transparent windscreen head-up display;

wherein the substantially transparent windscreen head up display comprises a pixelated field of view enabling graphic view from a limited direction comprising one of light emitting particles or microstructures over a predefined region of the windscreen permitting luminescent display in the limited direction while permitting vision therethrough.

17. The method of claim 16 wherein the viewer-defined dynamically registered graphic comprises a first viewer-defined dynamically registered graphic based upon a first viewer location;

and

further comprising;

determining a second viewer-defined dynamically registered graphic based upon the user input and a second viewer location; and

projecting the second graphic upon the substantially transparent windscreen head-up display.

18. The method of claim 17 wherein the first viewer-defined dynamically registered graphic based upon the first viewer location is further based upon utilizing the pixelated field of view enabling graphic view from a first limited direction oriented toward the first viewer location;

and

wherein the second viewer-defined dynamically registered graphic based upon the user input and the second viewer location is further based upon utilizing the pixelated field of view enabling graphic view from a second limited direction oriented toward the second viewer location.

19. The method of claim 17 further comprising:

monitoring a first viewer eye location; and

monitoring a second viewer eye location;

wherein the first viewer-defined dynamically registered graphic based upon the user input and the first viewer location is further based upon the first viewer eye location;

wherein the second viewer-defined dynamically registered graphic based upon the user input and the second viewer location is further based upon the second viewer eye location.

20. System to dynamically register a graphic on a driving scene of a vehicle utilizing a graphic projection display, comprising:

an enhanced vision system system manager;

monitoring a user input indicated to a portion of the graphic projection display;

determining a graphic representing a user-defined content based on the monitored user input indicated to the portion of the graphic projection display;

dynamically registering a location of the graphic upon the graphic projection display corresponding to the driving scene of the vehicle;

a graphics system generating the graphic representing the user-defined graphic; and

a graphics projection system communicating with the graphics system and displaying the graphic representing the user-defined content upon the graphic projection display.