METHOD FOR CONTROLLING TOUCH SCREEN BY DETECTING POSITION OF LINE OF SIGHT OF USER

• US 20160224111A1
• Filed: 09/15/2014
• Published: 08/04/2016
• Est. Priority Date: 10/15/2013
• Status: Abandoned Application

• Current Assignee: ESTsoft Corp.
• Original Assignee: ESTsoft Corp.
• Inventors: KIM, Jangjoong
• Application Number:
  US15/029,351
• Publication Number:
  US 20160224111A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention relates to a method for controlling a touch screen by detecting the position of the line of sight of a user and, more particularly, to a method for controlling a touch screen by detecting the position of the line of sight of a user, whereby a camera detects the position of the line of sight of the user in a touch screen terminal having the camera attached thereto, and the screen is changed in accordance with the operation of an input means that touches the periphery of the position of the line of sight. In accordance with the present invention, there is an effect that the user can enlarge or reduce the screen even with only one input means and rotate the screen after touching the screen for a certain period of time.

Claims

1. A method of controlling a touch screen by sensing a position of a line of sight, as a method of sensing a position of a line of sight 30 of a user in a touch screen type user terminal 100 attached with a camera 108 and controlling the screen to be changed in accordance with an operation of an input means 20, the method comprising:

a first step of recognizing a pupil 10 of the user from an image photographed through the camera 108, by a control unit;

a second step of grasping a position of the line of sight 30 that the pupil 10 of the user is looking at on a display 104 of the user terminal 100, by the control unit;

a third step of grasping a position of a handling point 40 contacting with the input means 20 if the user contacts with the display 104 using the input means 20;

a fourth step of sensing a change in the position of the handling point 40 by the control unit if the user moves the input means 20 while contacting with the display 104; and

a fifth step of controlling the screen to reduce an image displayed on the display 104 if the handling point 40 is getting close to the line of sight 30 and enlarge the image displayed on the display 104 if the handling point 40 is getting away from the line of sight 30, by the control unit.

2. A method of controlling a touch screen by sensing a position of a line of sight, as a method of sensing a position of a line of sight 30 of a user in a touch screen type user terminal 100 attached with a camera 108 and controlling the screen to be changed in accordance with an operation of an input means 20, the method comprising:

a first step of recognizing a pupil 10 of the user from an image photographed through the camera 108, by a control unit;

a second step of grasping a position of the line of sight 30 that the pupil 10 of the user is looking at on a display 104 of the user terminal 100, by the control unit;

a third step of grasping a position of a handling point 40 contacting with the input means 20 if the user contacts with the display 104 using the input means 20;

a fourth step of switching the user terminal 100 to a screen rotation mode by the control unit if the user touches the input means 20 to the handling point 40 for a predetermined time or more; and

a fifth step of rotating an image displayed on the display 104 in a direction the same as a direction of moving the input means 20 if the user moves the input means 20 around the line of sight 30.

3. The method according to claim 2, wherein the fifth step includes the steps of:

forming an imaginary circle around the position of the line of sight 30; and

rotating the image clockwise or counterclockwise as much as a rotation angle of a radius connecting the line of sight 30 and the handling point 40, if the user moves the handling point 40 positioned on a circumference of the imaginary circle.