Eyewear-type terminal and method for controlling the same

• US 9,921,073 B2
• Filed: 02/04/2015
• Issued: 03/20/2018
• Est. Priority Date: 06/26/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Rhee, Jeongyoon, Kim, Taeseong, Lee, Taekyoung, Jang, Yujune
• Primary Examiner(s): HARRISON, CHANTE E
• Application Number:
  US14/614,222
• Publication Number:
  US 20150379360A1
• Time in Patent Office: 1,140 Days
• Field of Search: 345 7, 345 8, 348113, 348115, 348116
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G01C 21/3644 Landmark guidance, e.g. using POIs or conspicuous other objects
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

An eyewear-type mobile terminal includes a camera; an output unit configured to output road guide information; and a controller configured to: acquire information about a current position; cause the output unit to output the road guide information for a route from the current position to a destination; cause the camera to acquire visual information in real-time while the road guide information is output; and update the road guide information in real-time based on the acquired visual information.

Claims

1. An eyewear-type mobile terminal, comprising:

a camera;

a display; and

a controller configured to;

acquire information about a current position;

acquire road guide information for a route from the current position to a destination;

cause the display to display the acquired road guide information in real-time;

detect user'"'"'s non-recognition information indicating that a user does not recognize a direction toward the destination while the road guide information is displayed;

cause the camera to acquire visual information corresponding to a user'"'"'s eyeline direction in real-time in response to the detected user'"'"'s non-recognition information;

recognize an object having a largest-sized text among a plurality of objects included in the acquired visual information;

detect a difference between a direction of the recognized object and the direction toward the destination;

generate guide information informing the direction toward the destination based on the difference between the direction of the recognized object and the direction toward the destination; and

cause the display to display the generated guide information at a position adjacent to the recognized object.

2. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

update the road guide information in real-time based on the position of the recognized object; and

cause the display to display the updated road guide information with reference to the position of the recognized object.

3. The eyewear-type mobile terminal of claim 1, wherein the generated guide information displayed on the display includes turn-by-turn information.

4. The eyewear-type mobile terminal of claim 3, further comprising an audio output unit, wherein the controller is further configured to cause the audio output unit to output the generated guide information as a voice.

5. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the display to apply a highlight effect to the recognized object within the acquired visual information.

6. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the display to display an indicator at a periphery of the recognized object.

7. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to detect the user'"'"'s non-recognition information when a user'"'"'s head movement is recognized to be equal or similar to a preset movement pattern after the road guide information is output.

8. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when the mobile terminal is repeatedly moved more than a preset number of times at a specific section among a plurality of sections included in the road guide information within a preset period of time.

9. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when a moving speed of the mobile terminal is equal or similar to a preset speed while the road guide information is output.

10. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when a moving direction of the mobile terminal is changed a preset number of times within a preset time period while the road guide information is output.

11. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when a user'"'"'s heart rate is out of a reference range while the road guide information is output.

12. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

search a passing spot located at a specific direction in response to a user'"'"'s gesture indicating the specific direction and the passing spot; and

update the route from the current position to the searched passing spot.