EYEWEAR TYPE TERMINAL AND CONTROL METHOD THEREOF

• US 20150338652A1
• Filed: 10/28/2014
• Published: 11/26/2015
• Est. Priority Date: 05/26/2014
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: LIM, Gukchan, JOO, Wonseok, PARK, Jongseok, KWON, Chohee, PARK, Mijin
• Granted Patent: US 9,563,057 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof

Abstract

An eyewear type terminal includes a camera, an infrared light emitting part, a display unit and a controller. The camera obtains a first image using at least one image sensor. The infrared light emitting part is disposed to be spaced apart from the camera at a predetermined distance, and transmits infrared light using at least one infrared light emitting device. The display unit displays the first image and a marker moving along a first input signal on the first image, when the infrared light emitting part is driven. The controller obtains a second image of an object existing in the area where the marker is displayed using the at least one infrared light emitting part and the camera, when a second input signal is sensed, and outputs visual information related to the obtained second image to be adjacent to the object.

Claims

1. An eyewear type terminal, comprising:

a frame shaped to be wearable on a user'"'"'s head;

a camera coupled to the frame and configured to obtain an image;

an infrared light emitting part coupled to the frame and configured to emit infrared light;

a display coupled to the frame and configured to output an image; and

a controller configured to;

cause the display to display a first image obtained via the camera;

activate the infrared light emitting part and cause the display to display the emitted infrared light as a movable marker over the first image in response to a first input;

cause the display to display a second image comprising a selected object on which the marker is positioned in response to a second input; and

cause the display to display information related to the selected object.

2. The eyewear type terminal of claim 1, wherein the controller is further configured to:

cause the display to display the marker at a predetermined position of the display in response to the first input;

select the object when the marker is moved from the predetermined position to the object; and

cause the display to display the second image distinguishably from the first image such that the selected object is identified by the marker within the second image.

3. The eyewear type terminal of claim 2, wherein, in response to a third input received while the second image and the information related to the selected object are displayed, the controller is further configured to:

cause the display to display the second image and the information related to the selected object at a first area of the display; and

cause the display to display a second marker on a second area of the display such that an additional object displayed in the second area is selectable when the second marker is placed over the additional object.

4. The eyewear type terminal of claim 2, wherein the controller is further configured to cause the display to display an indicator related to a zoom-in or zoom-out function of the camera when the first image is displayed.

5. The eyewear type terminal of claim 1, wherein the controller is further configured to change at least a position or a size of an selection area associated with the displayed marker according to user input comprising a gesture, at least the position or the size changed based on the gesture.

6. The eyewear type terminal of claim 5, wherein the controller is further configured to select an additional object or deselect the selected object based on at least the changed position or the changed size of the selection area.

7. The eyewear type terminal of claim 1, wherein:

the selected object is tagged with the marker such that the marker follows the object when the selected object moves on the display; and

the controller is further configured to cause the display to display an indicator when the selected object is not displayed, the indicator indicating that the selected object is out of a predetermined range, the indicator further indicating an estimated position of the selected object that moved out of the display such that the selected object and the marker are re-displayable when the camera is redirected to the position indicated by the indicator.

8. The eyewear type terminal of claim 1, further comprising a wireless communication unit, wherein:

the controller is further configured to receive the information related to the selected object via the wireless communication unit; and

the information comprises at least installation information of an application associated with the selected object, guidance information of a process related to the selected object, or position information of the selected object.

9. The eyewear type terminal of claim 1, wherein the information indicates that no information is available with regard to the selected object and the controller is further configured to cause the display to stop displaying the marker when the selected object is not recognized.

10. The eyewear type terminal of claim 1, wherein the controller is further configured to cause the display to stop displaying the information and to display additional information related to the selected object in response to user input received while the information is displayed.

11. The eyewear type terminal of claim 1, wherein:

the controller is further configured to cause the display to display the marker in a shape corresponding to a type of the information such that the marker is displayed in a different shape when a different type of information is displayed; and

the type of the information comprises at least a type related to a person or a type related to a thing.

12. The eyewear type terminal of claim 1, wherein the infrared light emitting part comprises:

an infrared light emitting device configured to generate the infrared light;

a lens configured to receive the generated infrared light and convert the received infrared light into parallel light; and

a window configured to emit the converted parallel light received from the lens,

wherein a shape of the marker is changeable according to a structure and a shape of the window.

13. The eyewear type terminal of claim 1, wherein the infrared light emitting part comprises a plurality of infrared light emitting parts and at least one of the plurality of infrared light emitting parts is detachable from the frame.

14. The eyewear type terminal of claim 13, wherein the controller is further configured to cause the display to display a plurality of markers in the first image such that a plurality of objects in the first image are selectable with the plurality of markers, each of the plurality of markers corresponding to respective infrared light emitted from one of the plurality of infrared light emitting parts.

15. The eyewear type terminal of claim 1, wherein the controller is further configured to cause storing of the second image and the information related to the selected object in a memory.

16. The eyewear type terminal of claim 15, wherein the controller is further configured to cause the display to display:

a third image obtained via the camera; and

a notification notifying that the object is recognized in the third image based on the stored second image and information related to the object.

17. The eyewear type terminal of claim 15, wherein the controller is further configured to:

receive updated information with respect to the stored second image and information; and

update the stored information related to the selected object based on the received updated information.

18. The eyewear type terminal of claim 1, wherein the controller is further configured to cause the display to display detailed information associated with the displayed information in response to user input received via the displayed information, the detailed information displayed on the display in addition to the displayed information.

19. The eyewear type terminal of claim 1, wherein the controller is further configured to cause the display to display a second marker in addition to the marker already displayed on the display in response to a third input received while the maker is displayed on the selected object.

20. The eyewear type terminal of claim 19, wherein the controller is further configured to:

track the selected object when the selected object moves on the display; and

select a second object when the second marker is placed on the second object.