AUGMENTED REALITY HUD DISPLAY METHOD AND DEVICE FOR VEHICLE

• US 20160163108A1
• Filed: 09/06/2015
• Published: 06/09/2016
• Est. Priority Date: 12/08/2014
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Original Assignee: Hyundai Motor Company (Hyundai Motor Group)
• Inventors: Kim, Sung Un
• Granted Patent: US 9,690,104 B2
• Time in Patent Office: Days
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 7/04 Display arrangements
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

An augmented reality head-up display (HUD) display method for a vehicle includes: detecting a position of an object outside of the vehicle at which a driver of the vehicle is looking; detecting a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle; extracting augmented reality HUD display coordinates of the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position; correcting one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye, the error correction parameters varying from one another; receiving the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye; and displaying augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.

Claims

1. An augmented reality head-up display (HUD) display method for a vehicle, the method comprising:

detecting a position of an object outside of the vehicle at which a driver of the vehicle is looking;

detecting a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle;

extracting augmented reality HUD display coordinates of the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position;

correcting one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye, the error correction parameters varying from one another;

receiving the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye; and

displaying augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.

2. The method of claim 1, wherein the correcting of the one or more errors comprises:

detecting a position of a plurality of objects outside of the vehicle;

setting a first correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a first object of the plurality of objects and one or more errors in the augmented reality HUD display coordinates of the eye while the driver is viewing the first object; and

setting a second correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a second object of the plurality of objects and the augmented reality HUD display coordinates of the eye while the driver is viewing the second object,

wherein the first object is an external object that is a first distance away from the eye of the driver, the second object is an external object that is a second distance away from the eye of the driver that is shorter than the first distance, and the second correction parameter is set to a lower error correction value than the first correction parameter.

3. The method of claim 1, further comprising:

detecting the position of the object using a radar sensor or a lidar sensor.

4. The method of claim 1, further comprising:

detecting the position of the eye using a camera.

5. The method of claim 1, wherein the correcting of the one or more errors comprises:

low-pass filtering the one or more errors in the augmented reality HUD display coordinates of the object and the one or more errors in the augmented reality HUD display coordinates of the eye,

wherein a cut-off frequency given as a first correction parameter for the low-pass filtering is lower than a cut-off frequency given as a second correction parameter for the low-pass filtering.

6. The method of claim 1, wherein HUD display information corresponding to the external object information includes speed information of the object or navigation information of the object.

7. The method of claim 6, wherein the navigation information includes turn-by-turn (TBT) information.

8. An augmented reality HUD display device for a vehicle, the device comprising:

an object detection sensor detecting a position of an object outside of the vehicle at which a driver of the vehicle is looking;

an eye position detector detecting a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle;

an augmented reality display coordinates extractor extracting a augmented reality HUD display coordinates the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position;

an error correction module correcting one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye, the error correction parameters varying from one another; and

a graphics display unit receiving, from the error correction module, the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye and displaying augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.

9. The device of claim 8, wherein:

the object detection sensor detects a position of a plurality of objects outside of the vehicle; and

the error correction module sets a first correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a first object of the plurality of objects and one or more errors in augmented reality HUD display coordinates of the eye while the driver is viewing the first object and a second correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a second object of the plurality of objects and augmented reality HUD display coordinates of the eye while the driver is viewing the second object,

wherein the first object is an external object that is a first distance away from the eye of the driver, the second object is an external object that is a second distance away from the eye of the driver that is shorter than the first distance, and the second correction parameter is set to a lower error correction value than the first correction parameter.

10. The device of claim 8, wherein the object detection sensor includes a radar sensor or a lidar sensor.

11. The device of claim 8, wherein the eye position detector includes a camera.

12. The device of claim 8, wherein the error correction module includes a low-pass filter, and a cut-off frequency given as a first correction parameter for the low-pass filter is lower than a cut-off frequency given as a second correction parameter for the low-pass filter.

13. The device of claim 8, wherein HUD display information corresponding to the external object information includes speed information of the object or navigation information of the object.

14. The device of claim 13, wherein the navigation information includes TBT information.

15. A non-transitory computer readable medium containing program instructions for an augmented reality HUD display method for a vehicle, the computer readable medium comprising:

program instructions that detect a position of an object outside of the vehicle at which a driver of the vehicle is looking;

program instructions that detect a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle;

program instructions that extract augmented reality HUD display coordinates of the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position;

program instructions that correct one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye, the error correction parameters varying from one another;

program instructions that receive the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye; and

program instructions that display augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.