Transparent display apparatus for displaying information of danger element, and method thereof

• US 9,767,693 B2
• Filed: 07/03/2013
• Issued: 09/19/2017
• Est. Priority Date: 07/10/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Han-sung, Lee, Chang-soo, Lee, Geun-ho
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): LI, CE LI
• Application Number:
  US13/934,451
• Publication Number:
  US 20140019005A1
• Time in Patent Office: 1,539 Days
• Field of Search: 701 36, 701300, 701301, 345 7, 345958, 340435, 340436, 340903, 180232
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G08G 1/0962 having an indicator mounted inside the vehicle, e.g. giving voice messages
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A transparent display apparatus which is used in a transportation apparatus includes: a communication unit which receives surrounding situation information, a controller which recognizes surrounding objects using the surrounding situation information, and determines a danger element that is likely to collide with the transportation apparatus using characteristics of the surrounding objects and a movement characteristic of the transportation apparatus, and a transparent display which displays information for informing a user of the danger element. Accordingly, a surrounding situation can be effectively presented.

Claims

1. A transparent display apparatus which is used in a vehicle, the transparent display apparatus comprising:

a transparent display;

a communication unit which receives surrounding situation information;

a detector which detects at least one gaze direction of a user in the vehicle; and

a controller which determines a danger element located in an area adjacent to the vehicle based on the at least one gaze direction of the user detected by the detector and the surrounding situation information, the danger element including a first object having at least a portion of the first object hidden by a second object as an obstacle in the detected at least one gaze direction of the user,

wherein the controller;

determines, from among regions of the transparent display, a first region through which the first object is located corresponding to the detected at least one gaze direction of the user, and a second region through which the second object is located corresponding to the detected at least one gaze direction of the user; and

determines that the second object is the obstacle when the first and second regions corresponding to the detected at least one gaze direction of the user at least partially overlap to determine that the first object has at least the portion of the first object hidden by the second object.

2. The transparent display apparatus as claimed in claim 1, wherein the controller:

recognizes surrounding objects in the area adjacent to the vehicle based on the surrounding situation information,

determines a field of view of the user according to the detected at least one gaze direction of the user,

determines, from among the surrounding objects, the first object to be at least partially hidden by the second object as the obstacle, when the first object is at least partially hidden by the second object within the field of view of the user, to thereby determine the first object as the danger element, and

determines a display location of the notification information on the area of the transparent display associated with the actual location of the first object.

3. The transparent display apparatus as claimed in claim 2, wherein the controller displays the notification information regarding the danger element at least partially hidden by the obstacle and the different types of the notification information according to a dangerous level of the danger element, from among regions of the transparent display, on a region through which the obstacle is seen.

4. The transparent display apparatus as claimed in claim 2, wherein the controller displays the notification information from among regions of the transparent display, on a region corresponding to the detected at least one gaze direction of the user.

5. The transparent display apparatus as claimed in claim 1, wherein the controller adjusts at least one of a color, a size, a display time, a display location, a blink state, a font, and a text thickness of the notification information, which is displayed on the transparent display according to a characteristic of the danger element.

6. The transparent display apparatus as claimed in claim 1, wherein the notification information regarding the danger element is displayed as at least one graphic object which represents at least one of a location of the danger element, a kind of the danger element, a distance between the vehicle and the danger element, an approach speed of the danger element, and an estimated collision time.

7. The transparent display apparatus as claimed in claim 1, wherein the surrounding situation information is information on surrounding objects which are located in the area adjacent to the vehicle, comprising a current location of the vehicle.

8. The transparent display apparatus as claimed in claim 1, wherein, when the vehicle enters a location, the communication unit receives the surrounding situation information of the location from an external server which manages the location,

wherein the transparent display comprises a windshield of the vehicle.

9. The transparent display apparatus as claimed in claim 1, wherein the controller determines a movement characteristic of the vehicle, the movement characteristic of the vehicle comprising at least whether the vehicle is moved based on a change in a location of the vehicle, a moving direction, moving speed, a future moving location, and determines the danger element using the movement characteristic of the vehicle and the information.

10. The transparent display apparatus as claimed in claim 1, wherein the controller:

controls the transparent display to provide notification information associated with a location of the first object as the danger element at least partially hidden by the second object as the obstacle.

11. A method for displaying of a transparent display apparatus comprising a transparent display to be used in a vehicle, the method comprising:

receiving surrounding situation information;

detecting at least one gaze direction of a user in the vehicle;

determining a danger element located in an area adjacent to the vehicle, based on the detected at least one gaze direction of the user through the transparent display and on the surrounding situation information, the danger element including a first object that is at least partially hidden by a second object as an obstacle in the detected at least one gaze direction of the user; and

controlling the transparent display to provide notification information regarding the danger element and different types of notification information on an area of the transparent display associated with an actual location of the first object having at least a portion of the object hidden by the second object as the obstacle,

wherein the determining the danger element comprises;

determining, from among regions of the transparent display, a first region through which the first object is located corresponding to the detected at least one gaze direction of the user, and a second region through which the second object is located corresponding to the detected at least one gaze direction of the user; and

determining that the second object is the obstacle when determined that the first and second regions corresponding to the detected at least one gaze direction of the user at least partially overlap to determine that the first object has at least the portion of the first object hidden by the second object.

12. The method as claimed in claim 11, wherein the determining the danger element comprises:

recognizing surrounding objects in the area adjacent to the vehicle based on the surrounding situation information,

determining a field of view of the user according to the detected at least one gaze direction of the user through the transparent display,

determining, from among the surrounding objects, the first object to be at least partially hidden by the second object as the obstacle, when the first object is at least partially hidden by the second object within the field of view of the user, to thereby determine the first object as the danger element, and

determining a display location of the notification information on the area of the transparent display associated with the actual location of the first object.

13. The method as claimed in claim 12, further comprising displaying on the transparent display the notification information regarding the danger element and the different types of the notification information according to the dangerous level of the danger element,

wherein the displaying on the transparent display the notification information regarding the danger element and the different types of the notification information according to the dangerous level of the danger element comprises displaying the notification information regarding the danger element at least partially hidden by the obstacle and the different types of the notification information according to the dangerous level of the danger element, from among regions of the transparent display, on a region through which the obstacle is seen from among all regions of the transparent display.

14. The method as claimed in claim 12, further comprising displaying on the transparent display the notification information, wherein the displaying on the transparent display the notification information comprises displaying the notification information regarding the danger element from among regions of the transparent display, on a region corresponding to the detected at least one gaze direction of the user.

15. The method as claimed in claim 11, further comprising adjusting at least one of a color, a size, a display time, a display location, a blink state, a font, and a text thickness of the notification information, which is displayed on the transparent display according to a characteristic of the danger element.

16. The method as claimed in claim 11, wherein the notification information the notification information regarding the danger element is displayed as at least one graphic object which represents at least one of a location of the danger element, a kind of the danger element, a distance between the transportation apparatus and the danger element, an approach speed of the danger element, and an estimated collision time.

17. The method as claimed in claim 11, wherein the surrounding situation information is information on surrounding objects which are located in the area adjacent to the vehicle, comprising a current location of the vehicle.

18. The method as claimed in claim 11, wherein, when the vehicle enters a location, the surrounding situation information of the location is received from an external server which manages the location,

wherein the transparent display comprises a windshield of the vehicle.

19. The method as claimed in claim 11, wherein the determining the danger element comprises determining a movement characteristic of the vehicle, the movement characteristic of the vehicle comprising at least whether the vehicle is moved based on a change in a location of the vehicle, moving direction, moving speed, and a future moving location, and determining the danger element using the movement characteristic of the vehicle and the information.

20. The method as claimed in claim 11, further comprising

controlling the transparent display to provide notification information regarding the danger element and different types of notification information associated with a location of the first object at least partially hidden by the second object as the obstacle.

21. A user terminal apparatus comprising:

an interface which is connectible with a vehicle;

a communication unit which receives surrounding situation information;

a detector which detects at least one gaze direction of a user in the vehicle; and

a controller which;

determines a danger element located in an area adjacent to the vehicle based on the at least one gaze direction of the user detected by the detector and on the surrounding situation information, the danger element including a first object having at least a portion of the object hidden by a second object as an obstacle in the detected at least one gaze direction of the user, and

provide notification information regarding the danger element,

wherein the controller;

determines, from among regions of the transparent display, a first region through which the first object is located corresponding to the detected at least one gaze direction of the user, and a second region through which the second object is located corresponding to the detected at least one gaze direction of the user; and

determines that the second object is the obstacle when the first and second regions corresponding to the detected at least one gaze direction of the user at least partially overlap to determine that the first object has at least the portion of the first object hidden by the second object.

22. The user terminal apparatus as claimed in claim 21, wherein, when the vehicle is connected to the user terminal apparatus through the interface, the controller:

determines a location of the vehicle using a GPS chip provided in the user terminal apparatus,

recognizes surrounding objects in the area adjacent to the vehicle based on the surrounding situation information, and

determines, from among the surrounding objects, the first object to be at least partially hidden by the second object as the obstacle, when the first object is at least partially hidden by the second object within the field of view of the user, to thereby determine the first object as the danger element, and

determines a display location of the notification information regarding the danger element.

23. A method for displaying of a user terminal apparatus, the method comprising:

receiving surrounding situation information;

detecting at least one gaze direction of a user in the vehicle;

determining a danger element located in an area adjacent to the vehicle based on the detected at least one gaze direction of the user and on the surrounding situation information, the danger element including a first object having at least a portion of the first object hidden by a second object as an obstacle in the detected at least one gaze direction of the user; and

providing notification information regarding the danger element,

wherein the determining the danger element comprises;

determining, from among regions of the transparent display, a first region through which the first object is located corresponding to the detected at least one gaze direction of the user, and a second region through which the second object is located corresponding to the detected at least one gaze direction of the user; and

determining that the second object is the obstacle when determined that the first and second regions corresponding to the detected at least one gaze direction of the user at least partially overlap to determine that the first object has at least the portion of the first object hidden by the second object.

24. A non-transitory computer-readable recording medium storing one or more programs to implement the method of claim 23.

25. A method for displaying a danger element on a transparent display apparatus used in a vehicle comprising a transparent display, the method comprising:

receiving surrounding situation information of the vehicle;

detecting at least one gaze direction of a user in the vehicle;

determining a danger element located in an area adjacent to the vehicle based on the detected at least one gaze direction of the user and on the surrounding situation information, the danger element including a first object having at least a portion of the first object hidden by a second object as an obstacle in the detected at least one gaze direction of the user; and

wherein the determining the danger element comprises;

determining, from among regions of the transparent display, a first region through which the first object is located corresponding to the detected at least one gaze direction of the user, and a second region through which the second object is located corresponding to the detected at least one gaze direction of the user; and

determining that the second object is the obstacle when determined that the first and second regions corresponding to the detected at least one gaze direction of the user at least partially overlap to determine that the first object has at least the portion of the first object hidden by the second object.