TRANSPARENT DISPLAY DEVICE AND CONTROL METHOD THEREFOR

• US 20160291691A1
• Filed: 11/15/2013
• Published: 10/06/2016
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: LEE, Gunho
• Granted Patent: US 9,990,034 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

Disclosed is a transparent display device. A transparent display device according to one embodiment displays a predetermined image through a transparent display panel and senses the direction of the line of sight of a person gazing at the transparent display panel, thereby displaying detailed information of an object on the transparent display panel if the line of sight of the person is directed toward the object positioned on the rear surface of the transparent display panel.

Claims

1. A transparent display device, comprising:

a first transparent display panel being implemented by a see-through display and displaying an image;

a first gaze detection sensor detecting gaze of a person looking at the first transparent display panel; and

a controller configured to analyze the gaze of the person and when the gaze of the person is directed toward an object located on the rear surface of the first transparent display panel, display detailed information of the object on the first transparent display panel.

2. The device of claim 1, wherein the controller is configured to display an indicator on the first transparent display panel when the person'"'"'s gaze is directed to the object and to control detailed information of the object to be displayed on the first transparent display panel when the person'"'"'s gaze is directed to the indicator.

3. The device of claim 2, wherein, when the person'"'"'s gaze is not directed to the indicator or detailed information of the object for a predetermined time period, the controller is configured to control to disappear the indicator or detailed information of the object displayed on the first transparent display panel.

4. The device of claim 1, wherein, when the person'"'"'s gaze is directed to any one of a plurality of objects located on a rear surface of the first transparent display panel, the controller is configured to control the first transparent display panel to display a first indicator of a first object to which the person'"'"'s gaze is directed on the first transparent display panel and a second indicator guiding the person'"'"'s gaze to a second object related to the first object on the first transparent display panel.

5. The device of claim 4, wherein, when the person'"'"'s gaze is directed to the first indicator, the controller is configured to display detailed information of the first object on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, to display detailed information of the second object on the first transparent display panel.

6. The device of claim 5, wherein, when the person'"'"'s gaze is not directed to the first indicator, the second indicator, detailed information of the first object, or detailed information of the second object for a predetermined time period, the controller is configured to control to disappear the first indicator, the second indicator, detailed information of the first object, or detailed information of the second object displayed on the first transparent display panel from the first transparent display panel.

7. The device of claim 1, further comprising a second transparent display panel disposed on the front surface, rear surface, left-side surface, right-side surface, upper surface, or lower surface of the first transparent display panel, implemented by a see-through display and displaying an image.

8. The device of claim 7, wherein, when the person'"'"'s gaze is directed to a first object located in the rear surface of the first transparent display panel, a first indicator of the first object is displayed on the first transparent display panel, and when the person'"'"'s gaze is directed to a second object located in the rear surface of the second transparent display panel, a second indicator of the second object is displayed on the second transparent display panel.

9. The device of claim 8, wherein, when the person'"'"'s gaze is directed to the first indicator, detailed information of the first object is displayed on the first transparent display panel, and when the person'"'"'s gaze is directed to the second indicator, detailed information not the second object is displayed on the second transparent display panel.

10. The device of claim 9, wherein, when the person'"'"'s gaze is not directed to the first indicator or detailed information of the first object for a predetermined time period, the first indicator or detailed information of the first object displayed on the first transparent display panel is controlled to disappear, and when the person'"'"'s gaze is not directed to the second indicator or detailed information of the second object for a predetermined time period, the second indicator or detailed information of the second object displayed on the transparent display panel is controlled to disappear.

11. The device of claim 1, further comprising a mirror display panel disposed in the rear surface of the first transparent display panel, implemented by a see-through display and displaying an image.

12. The device of claim 11, wherein, when the person'"'"'s gaze is directed to the front of the object through the first transparent display panel, a first indicator of the object is displayed on the first transparent display panel and when the person'"'"'s gaze is directed to the rear surface of the object through the mirror display panel, a second indicator of the object is displayed on the mirror display panel.

13. The device of claim 12, wherein, when the person'"'"'s gaze is directed to the first indicator, detailed information of the object is displayed on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, detailed information of the object is displayed on the mirror display panel.

14. The device of claim 13, wherein, when the person'"'"'s gaze is not directed to the first indicator or detailed information of the object displayed on the first transparent display panel for a predetermined time period, the first indicator or detailed information displayed on the first transparent display panel is controlled to disappear and when the person'"'"'s gaze is not directed to the second indicator or detailed information of a second object displayed on the mirror display panel for a predetermined time period, the second indicator displayed on the second transparent display panel or detailed information of the second object displayed on the mirror display panel is controlled to disappear.

15. The device of claim 1, further comprising a second transparent display panel disposed in the rear surface of the first transparent display panel, implemented by a see-through display, and displaying an image;

and

a second gaze detection sensor detecting a gaze direction of a person looking at the second transparent display panel.

16. The device of claim 15, wherein, when the person'"'"'s gaze is directed to the object through the first transparent display panel, a first indicator of the object is displayed on the first transparent display panel and when the person'"'"'s gaze is directed to the object through the second transparent display panel, a second indicator of the second object is displayed on the second transparent display panel.

17. The device of claim 16, wherein, when the person'"'"'s gaze is directed to the first indicator, detailed information of the object is displayed on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, detailed information of the object is displayed on the second transparent display panel.

18. The device of claim 17, wherein, when the person'"'"'s gaze is not directed to the first indicator or detailed information of an object displayed on the first transparent display panel for a predetermined time period, the first indicator or detailed information of the object displayed on the first transparent display panel is controlled to disappear and when the person'"'"'s gaze is not directed to the second indicator or detailed information of an object displayed on the second transparent display panel for a predetermined time period, the second indicator or detailed information of an object displayed on the second transparent display panel is controlled to disappear.

19. The device of claim 1, further comprising a gaze direction determination unit calculating position coordinates of a person and gaze direction of the person by analyzing a gaze direction of the person detected by the first gaze detection sensor, wherein the controller is configured to determine to which the person'"'"'s gaze is directed on the basis of position coordinates of the person and gaze direction of the person.

20. A method for controlling a transparent display device comprising a first transparent display panel being implemented by a see-through display and displaying an image, the method comprising:

detecting a gaze direction of a person looking at a first transparent display panel by the first gaze detection sensor; and

analyzing the gaze direction of the person and when the gaze of the person is directed toward an object located on the rear surface of the first transparent display panel, displaying detailed information of the object on the first transparent display panel.

21. The method of claim 20, wherein the analyzing and displaying comprises:

displaying an indicator on the first transparent display panel when the person'"'"'s gaze is directed to the object;

displaying detailed information of the object on the first transparent display panel when the person'"'"'s gaze is directed to the indicator; and

controlling to disappear the indicator or detailed information of the object displayed on the first transparent display panel when the person'"'"'s gaze is not directed to the indicator or detailed information of the object for a predetermined time period.

22. The method of claim 20, wherein the analyzing and displaying comprises:

when the person'"'"'s gaze is directed to any one of a plurality of objects located in the rear surface of the first transparent display panel, displaying a first indicator of a first object to which the person'"'"'s gaze is directed on the first transparent display panel, and at the same time, displaying on the first transparent display panel a second indicator guiding the person'"'"'s gaze to a second object related to the first object;

when the person'"'"'s gaze is directed to the first indicator, displaying detailed information of the first object on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, displaying detailed information of the second object on the first transparent display panel; and

when the person'"'"'s gaze is not directed to the first indicator, the second indicator, detailed information of the first object, or detailed information of the second object for a predetermined time period, controlling to disappear the first indicator, the second indicator, detailed information of the first object, or detailed information of the second object displayed on the first transparent display panel.

23. The method of claim 20, wherein the transparent display device further comprises a second transparent display panel disposed on the front surface, rear surface, left-side surface, right-side surface, upper surface, or lower surface of the first transparent display panel, implemented by a see-through display, and displaying an image, and

wherein the analyzing and displaying comprises:

when the person'"'"'s gaze is directed to a first object disposed on the rear surface of the first transparent display panel, displaying a first indicator of the first object on the first transparent display panel and when the person'"'"'s gaze is directed to a second object disposed on the rear surface of the second transparent display panel, displaying a second indicator of the second object on the second transparent display panel;

when the person'"'"'s gaze is directed to the first indicator, displaying detailed information of the first object on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, displaying detailed information of the second object on the second transparent display panel; and

when the person'"'"'s gaze is not directed to the first indicator or detailed information of the first object for a predetermined time period, controlling to disappear the first indicator or detailed information of the first object displayed on the first transparent display panel and when the person'"'"'s gaze is not directed to the second indicator or detailed information of the second object for a predetermined time period, controlling to disappear the second indicator or detailed information of the second object displayed on the second transparent display panel.

24. The method of claim 20, wherein the transparent display device further comprises a mirror display panel implemented by a mirror and displaying an image, and

wherein the analyzing and displaying comprises:

when the person'"'"'s gaze is directed to the front of the object through the first transparent display panel, displaying a first indicator of the object on the first transparent display panel and when the person'"'"'s gaze is directed to the rear surface of the object through the mirror display panel, displaying a second indicator of the object on the mirror display panel;

when the person'"'"'s gaze is directed to the first indicator, displaying detailed information of the object on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, displaying detailed information of the object on the mirror display panel;

when the person'"'"'s gaze is not directed to the first indicator or detailed information of an object displayed on the first transparent display panel for a predetermined time period, controlling to disappear the first indicator or detailed information of an object displayed on the first transparent display panel; and

when the person'"'"'s gaze is not directed to the second indicator or detailed information of a second object displayed on the mirror display panel for a predetermined time period, controlling to disappear the second indicator displayed on the second transparent display panel or detailed information of the second object displayed on the mirror display panel.

25. The method of claim 20, wherein the transparent display device further comprises:

a second transparent display panel disposed on the rear surface of the first transparent display panel, implemented by a see-through display, and displaying an image; and

a second gaze detection sensor detecting a gaze direction of a person looking at the second transparent display panel, and

wherein the analyzing and displaying comprises;

when the person'"'"'s gaze is directed to the object through the first transparent display panel, displaying a first indicator of the object on the first transparent display panel and when the person'"'"'s gaze is directed to the object through the second transparent display panel, displaying a second indicator of the second object to the second transparent display panel;

when the person'"'"'s gaze is directed to the first indicator, displaying detailed information of the object on the first transparent display panel and when the person'"'"'s gaze is directed to the second indicator, displaying detailed information of the object on the second transparent display panel;

when the person'"'"'s gaze is not directed to the first indicator or detailed information of an object displayed on the first transparent display panel for a predetermined time period, controlling the first indicator or detailed information of an object displayed on the first transparent display panel to disappear; and

when the person'"'"'s gaze is not directed to the second indicator or detailed information of an object displayed on the second transparent display panel for a predetermined time period, controlling the second indicator or detailed information of an object displayed on the second transparent display panel to disappear.