AUGMENTED REALITY DISPLAY SYSTEM AND METHOD FOR VEHICLE

• US 20120154441A1
• Filed: 12/14/2011
• Published: 06/21/2012
• Est. Priority Date: 12/16/2010
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Kim, Jin Woo
• Granted Patent: US 9,075,563 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G08G 1/09623 Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle G08G1/0967 takes precedence
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2380/10 Automotive applications

Abstract

A system includes a head front display device, an eye position tracking camera to track movement of a driver'"'"'s irises, a front view camera to take a picture of a front view of the driver, a head front display device controller to implement at least one of an angle change, forward movement, backward movement, upward movement, downward movement, leftward movement, and rightward movement of the head front display device, an image adjuster to adjust an object displayed on the head front display device in association with an object of an actual view seen through the front window of the vehicle based on positions of the driver'"'"'s irises obtained through the eye position tracking camera and an image of the front view obtained by the front view camera, and a display unit controlled by the image adjuster and configured to display information on the head front display device.

Claims

1. An augmented reality display system for a vehicle, comprising:

a head front display device using a transparent display positioned between a driver and a front window;

an eye position tracking camera configured to track movement of a driver'"'"'s irises;

a front view camera configured to take a picture of a front view of the driver;

a head front display device controller configured to implement at least one of an angle change, forward movement, backward movement, upward movement, downward movement, leftward movement, and rightward movement of the head front display device;

an image adjuster configured to adjust an object displayed on the head front display device in association with an object of an actual view seen through the front window of the vehicle based on positions of the driver'"'"'s irises obtained through the eye position tracking camera and an image of the front view obtained by the front view camera; and

a display unit controlled by the image adjuster and configured to display information on the head front display device.

2. The augmented reality display system according to claim 1, wherein the eye position tracking camera is installed at a position in front of and facing the driver.

3. The augmented reality display system according to claim 1, wherein the front view camera is installed above a driver'"'"'s head or in front of the driver.

4. The augmented reality display system according to claim 1, wherein the eye position tracking camera learns the positions of the driver'"'"'s irises recognized by the eye position tracking camera and a relative iris position when the driver sees four or more lattice points displayed on the head front display device, and recognizes the positions of the driver'"'"'s irises based on a learning result.

5. The augmented reality display system according to claim 1, wherein the image adjuster adjusts the object displayed on the head front display device by adjusting a shape, size, or position of the object displayed on the head front display device in association with the object in the actual view.

6. An augmented reality display method for a vehicle for operating a head front display device using a transparent display positioned between a driver and a front window, the method comprising:

tracking movement of a driver'"'"'s irises;

taking a picture of a front view of the driver;

adjusting a shape, size, or position of an object displayed on the head front display device in association with positions of the driver'"'"'s irises and an actual object in the front view; and

displaying an object whose image is adjusted on the head front display device.

7. The augmented reality display method according to claim 6, wherein the tracking of the movement of the driver'"'"'s irises is performed using an eye position tracking camera installed at a position in front of and facing the driver.

8. The augmented reality display method according to claim 6, wherein the taking the picture of the front view of the driver is performed using a front view camera installed above a driver'"'"'s head or in front of the driver.