EYEWEAR-TYPE TERMINAL AND METHOD FOR CONTROLLING THE SAME

• US 20150379360A1
• Filed: 02/04/2015
• Published: 12/31/2015
• Est. Priority Date: 06/26/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: RHEE, Jeongyoon, KIM, Taeseong, LEE, Taekyoung, JANG, Yujune
• Granted Patent: US 9,921,073 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G01C 21/3644 Landmark guidance, e.g. using POIs or conspicuous other objects
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

An eyewear-type mobile terminal includes a camera; an output unit configured to output road guide information; and a controller configured to: acquire information about a current position; cause the output unit to output the road guide information for a route from the current position to a destination; cause the camera to acquire visual information in real-time while the road guide information is output; and update the road guide information in real-time based on the acquired visual information.

Claims

1. An eyewear-type mobile terminal, comprising:

a camera;

an output unit; and

a controller configured to;

acquire information about a current position;

acquire road guide information for a route from the current position to a destination;

cause the camera to acquire visual information in real-time; and

cause the output unit to output the acquired road guide information in real-time using the acquired visual information.

2. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

recognize an object included in the acquired visual information; and

update the output road guide information in real-time based on the recognized object.

3. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

recognize an object having a preset feature point among a plurality of objects included in the acquired visual information; and

update the output road guide information in real-time based on the recognized object.

4. The eyewear-type mobile terminal of claim 3, wherein the object is an object having a highest chroma, an object having a largest area or size, an object having a largest-sized text, a nearest object from the current position, or a combination thereof.

5. The eyewear-type mobile terminal of claim 3, wherein the controller is further configured to:

detect the preset feature point of the recognized object; and

update the output road guide information based on the detected preset feature point.

6. The eyewear-type mobile terminal of claim 5, wherein the detected preset feature point is one of a color, a shape, or text of the recognized object or a combination thereof.

7. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

detect users non-recognition information while the road guide information is output; and

cause the camera to acquire the visual information based on the detected user'"'"'s non-recognition information.

8. The eyewear-type mobile terminal of claim 7, wherein the controller is further configured to detect the user'"'"'s non-recognition information when a users head movement is recognized to be equal or similar to a preset movement pattern after the road guide information is output.

9. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when the mobile terminal is repeatedly moved more than a preset number of times at a specific section among a plurality of sections included in the road guide information within a preset period of time.

10. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when a moving speed of the mobile terminal is equal or similar to a preset speed while the road guide information is output.

11. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when a moving direction of the mobile terminal is changed a preset number of times within a preset time period while the road guide information is output.

12. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the camera to acquire the visual information when a user'"'"'s heart rate is out of a reference range while the road guide information is output.

13. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

search a passing spot located at a specific direction in response to a user'"'"'s gesture indicating the specific direction and the passing spot; and

update the route from the current position to the searched passing spot.

14. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the output unit to output proposed guide information to a second destination based on current time and moving time to the second destination.

15. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

determine that a users biological signal is out of a reference range while the road guide information is output; and

cause the output unit to output proposed guide information for a detour based on the determined users biological signal.

16. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

determine that a peripheral brightness is less than a reference value while the road guide information is output; and

cause the output unit to output proposed guide information for a new route that detours the route based on the determination.

17. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

determine that a moving speed of the mobile terminal is less than a reference speed while the road guide information is output; and

cause the output unit to output proposed guide information for a new route that detours the route based on the determination.

18. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to:

detect a number of persons included in the acquired visual information while the road guide information is output; and

cause the output unit to output proposed guide information for a new route that detours the route when the detected number is less than a reference value.

19. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the output unit to output proposed guide information for a new route that detours the route when a direction of the mobile terminal is changed by a preset number of times within a preset time period.

20. The eyewear-type mobile terminal of claim 1, wherein the controller is further configured to cause the output unit to output a highlight effect to a preset habitual route-deviation spot when the current position is close to the preset habitual route-deviation spot while the road guide information is output.