System and method for providing augmented reality notification

• US 9,773,412 B2
• Filed: 07/14/2015
• Issued: 09/26/2017
• Est. Priority Date: 07/17/2014
• Status: Active Grant

• Current Assignee: Hyundai Motor Company (Hyundai Motor Group), Kia Corp.
• Original Assignee: Thinkware Corporation
• Inventors: Yoon, Min Ji, Jeong, Ye Seul, Shin, Youn Joo, Heo, Won Jun
• Primary Examiner(s): Blount, Eric M
• Application Number:
  US14/799,237
• Publication Number:
  US 20160019786A1
• Time in Patent Office: 805 Days
• Field of Search: 340905, 701400, 701410, 701418, 701436, 701439, 345633
• CPC Class Codes: G08G 1/0962 having an indicator mounted inside the vehicle, e.g. giving voice messages

Abstract

A system and a method for providing augmented reality (AR) notification are provided. The system includes a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on an AR driving image and a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element.

Claims

1. A system for providing augmented reality (AR) notification, the system comprising:

a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on an AR driving image; and

a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element,

wherein the recognizing unit recognizes a driving state associated with a current driving speed of a vehicle, and

wherein the display element comprises a pattern applied to the ground region and the controller adjusts the pattern which is applied to the ground region based on the driving state independently of a user-selected route, wherein the pattern of only the ground region of the AR driving image is visually changed, and wherein the controller adjusts the pattern based on the current driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the current driving speed.

2. The system of claim 1, wherein the recognizing unit detects a horizon from the driving image and recognizes the ground region relative to the horizon.

3. The system of claim 1, wherein the recognizing unit detects a line from the driving image and recognizes the ground region relative to a vanishing point of the line.

4. The system of claim 1, wherein the display element maintains transparency for the driving image.

5. The system of claim 1, wherein the recognizing unit compares a current driving speed of a vehicle with the speed limit of a road on which the vehicle is being driven to recognize whether the vehicle is speeding, and

wherein when the current driving speed is in a speeding driving state which is over the speed limit, the controller expresses the ground region with a red color.

6. The system of claim 1, wherein the recognizing unit recognizes attributes of a road on which a vehicle is being driven relative to a current position of the vehicle, and

wherein when the vehicle enters a zone designated as a caution section, the controller expresses the ground region with a yellow color.

7. The system of claim 1, wherein the controller adjusts the pattern which is moving in accordance with the driving speed to stop when the vehicle is driven in a global positioning system (GPS) shadow section where the GPS functionality of the vehicle is unstable.

8. The system of claim 1, further comprising:

a sensing unit configured to sense a turn point which is located in a certain distance ahead,

wherein the controller exposes destination information on a position of the turn point on the driving image.

9. The system of claim 8, wherein the controller expresses a rotation direction at the turn point and a remaining distance to the turn point on the position of the turn point.

10. The system of claim 8, wherein the controller expresses an effect in which the destination information is inversely expanded according to a remaining distance to the turn point and disappears at a time point when a vehicle passes through the turn point.

11. A method for providing augmented reality (AR) notification, implemented with a computer, the method comprising:

recognizing a ground region, which is a region corresponding to the ground, on an AR driving image; and

adding a display element to the ground region and expressing notification associated with driving through the display element,

wherein the recognizing recognizes a driving state associated with a current driving speed of a vehicle, and

wherein adding the display element comprises adjusting a pattern which is applied to the ground region based on the driving state independently of a user-selected route, wherein the pattern of only the ground region of the AR driving image is visually changed, and wherein the pattern is adjusted based on the current driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the current driving speed.

12. The method of claim 11, wherein the recognizing of the ground region comprises:

detecting a horizon from the driving image; and

recognizing the ground region relative to the horizon.

13. The method of claim 11, further comprising:

sensing a turn point which is located in a certain distance ahead,

wherein the expressing of the notification comprises;

exposing destination information on a position of the turn point on the driving image.

14. The method of claim 13, wherein the expressing of the notification comprises:

expressing destination information, including a rotation direction at the turn point and a remaining distance to the turn point, on the position of the turn point; and

expressing an effect in which the destination information is inversely expanded according to a remaining distance to the turn point and disappears at a time point when a vehicle passes through the turn point.

15. A non-transitory computer-readable medium to control a computer system, storing an instruction for controlling provision of notification, comprising:

recognizing a ground region, which is a region corresponding to the ground, on an augmented reality (AR) driving image; and

adding a display element to the ground region and expressing notification associated with driving through the display element,

wherein the recognizing recognizes a driving state associated with a current driving speed of a vehicle, and

wherein adding the display element comprises adjusting a pattern which is applied to the ground region based on the driving state independently of a user-selected route, wherein the pattern of only the ground region of the AR driving image is visually changed, and wherein the pattern is adjusted based on the current driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the current driving speed.