Glass type terminal having three-dimensional input device and screen control method thereof

• US 9,658,452 B2
• Filed: 09/04/2014
• Issued: 05/23/2017
• Est. Priority Date: 10/15/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Sukjin, Joo, Younghun, Woo, Sungho, Kwon, Jonghun, Lim, Gukchan, Kim, Seonghyok
• Primary Examiner(s): MA, CALVIN
• Application Number:
  US14/477,481
• Publication Number:
  US 20150103021A1
• Time in Patent Office: 992 Days
• Field of Search: 345 8, 345173, 345174
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/0339 Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Abstract

Disclosed are a glass type terminal capable of supporting gestures using one finger or two fingers by providing a three-dimensional input device at a temple hinged to a rim of a lens, and an input method thereof. For three-dimensional touch inputs, the temple is configured to have an upper surface, a lower surface, an inner side surface and an outer side surface provided touch sensor, respectively. Upon sensing of a touch input applied onto said one or more surfaces of the temple using one finger or two fingers, a screen displayed on a lens is controlled in correspondence to the sensed touch input. Under such configuration, a user can control the screen in a more convenient manner.

Claims

1. A terminal configured to be worn on a head of a user as eyewear, comprising:

a lens coupled to a frame;

an arm coupled to a frame and having a plurality of sides comprising an upper side, a lower side opposite from the upper side, an inner side disposed to face the head of the user, and an outer side opposite the inner side;

a touch sensor located on or in at least two different sides of the plurality of sides of the arm; and

a controller operatively connected to the touch sensor and configured to control the terminal to display a screen on the lens based on touches to the touch sensor,

wherein the touch sensor comprises transmit-electrodes arranged in a lengthwise direction of the arm, and receive-electrodes arranged in a widthwise direction of the arm, and

wherein a bundle of the receive-electrodes are arranged on the inner side of the arm and a bundle of the transmit-electrodes are arranged at an inner corner region on the outer side of the arm.

2. The terminal of claim 1,

wherein the lens comprises

a single lens configured to display the screen for one eye of the user wearing the terminal, or

a pair of lenses configured to display the screen for two eyes of the user wearing the terminal.

3. The terminal of claim 1, wherein the touch sensor comprises one or more touch patterns.

4. The terminal of claim 1,

wherein one of the at least two different sides is an inner side of the arm facing the head of the user, and

wherein the controller is configured to determine whether the terminal is or is not currently being worn by the user based on an input detected by at least a portion of the touch sensor located on or in the inner side of the arm.

5. The terminal of claim 1,

wherein the at least two different sides includes at least two of an upper side, a lower side, or an outer side of the arm relative to the user when the terminal is worn on the head of the user, and

wherein the controller is configured to control the screen based on touches detected on the at least two of the upper side, the lower side, or the outer side of the arm.

6. The terminal of claim 1,

wherein a relatively smaller number of transmit electrodes arranged in the lengthwise direction are located on an inner side of the arm than are located on another side of the plurality of sides.

7. The terminal of claim 1, further comprising:

a camera operatively connected to the controller and configured to capture a still or moving picture; and

a movement sensor operatively connected to the controller and configured to sense a movement of the user'"'"'s head,

wherein the controller is configured to;

enter a still or moving picture capture mode upon sensing that the user touches each of the at least two different sides for a predetermined time;

enlarge or contract a preview image of an object to be captured by the camera upon sensing that the user simultaneously moves the touches to each of the at least two different sides in opposite directions;

focus the object to be captured according to a sensed moving direction of the user'"'"'s head while touching each of the at least two different sides; and

capture the object upon sensing that the user removes the touches from each of the at least two different sides.

8. The terminal of claim 1, wherein the controller is configured to

display a main menu on an upper region of the screen upon sensing that a touch on a first side of the at least two different sides is moved along the first side,

display a sub menu on the screen upon sensing that a touch on a second side of the at least two different sides is moved along the second side, and

display both of the main menu and the sub menu on the screen upon sensing that touches to the first and second sides are simultaneously moved in opposite directions the along the first and second sides, respectively.

9. The terminal of claim 8, wherein the controller is configured to integrate a function of the main menu and a function of the sub menu upon sensing a movement of the touches to the first and second sides to a third side of the at least two different sides.

10. The terminal of claim 1, wherein the controller is configured to display a gesture guide on the screen upon sensing that the terminal is placed on the user'"'"'s head initially or after a predetermined period of non-use, or upon sensing that the arm is lifted up and moved down via touches to the at least two different sides.

11. The terminal of claim 1, wherein the controller is configured to

display a first menu on an upper region of the screen upon sensing a touch on a first side of the at least two different sides,

display a second menu on a lower region of the screen upon sensing a touch on a second side of the at least two different sides, and

one of

scroll the first and second menus upon sensing that the touches to the first and second sides are simultaneously moved in opposite directions the along the first and second sides, respectively, or

scroll a corresponding one of the first and second menus upon sensing that one of the touches to the first and second sides is moved while the other of the touches to the first and second sides is held stationary.

12. A method for operating a terminal configured to be worn on a head of a user as eyewear, the terminal including a lens coupled to a frame, an arm coupled to a frame and having a plurality of sides, a touch sensor located on or in at least two different sides of the plurality of sides, a camera configured to capture a still or moving picture, a movement sensor configured to sense a movement of the user'"'"'s head;

and a controller operatively connected to the touch sensor and the movement sensor, the method comprising;

controlling the terminal to display a screen on the lens based on touches to the touch sensor,

entering a capture mode when touches are detected to each of the at least two different sides for a predetermined length of time;

enlarging or contracting a preview image of an object to be captured by the camera when the detected touches to the at least two different sides are moved in opposite directions;

focusing the object to be captured according to a direction of movement of the user'"'"'s head detected by the movement sensor while the touches to each of the at least two different sides are maintained; and

capturing an image of the object when the touches to each of the at least two different sides are removed,

wherein the plurality of sides of the arm comprise an upper side, a lower side opposite from the upper side, an inner side arranged to face a head of the user, and an outer side opposite from the inner side.

13. The method of claim 12, wherein one of the at least two different sides is an inner side of the arm facing the head of the user, the method further comprising:

determining whether the terminal is or is not currently being worn by the user based on an input detected by at least a portion of the touch sensor.

14. The method of claim 12, wherein the at least two different sides includes at least two of an upper side, a lower side, or an outer side of the arm relative to the user when the terminal is worn on the head of the user, the method further comprising:

controlling the screen based on touches detected on the at least two of the upper side, the lower side, or the outer side of the arm.

15. The method of claim 12, further comprising:

displaying a main menu on an upper region of the screen upon sensing that a touch on a first side of the at least two different sides is moved along the first side;

displaying a sub menu on the screen upon sensing that a touch on a second side of the at least two different sides is moved along the second side; and

displaying both of the main menu and the sub menu on the screen upon sensing that touches to the first and second sides are simultaneously moved in opposite directions the along the first and second sides, respectively.

16. The method of claim 15, further comprising:

integrating a function of the main menu and a function of the sub menu upon sensing a movement of the touches to the first and second sides to a third side of the at least two different sides.

17. The method of claim 12, further comprising:

displaying a gesture guide on the screen upon sensing that the terminal is placed on the user'"'"'s head initially or after a predetermined period of non-use, or upon sensing that the arm is lifted up and moved down via touches to the at least two different sides.

18. The method of claim 12, further comprising:

displaying a first menu on an upper region of the screen upon sensing a touch on a first side of the at least two different sides;

displaying a second menu on a lower region of the screen upon sensing a touch on a second side of the at least two different sides; and

scrolling the first and second menus upon sensing that the touches to the first and second sides are simultaneously moved in opposite directions the along the first and second sides, respectively, or

scrolling a corresponding one of the first and second menus upon sensing that one of the touches to the first and second sides is moved while the other of the touches to the first and second sides is held stationary.