MOBILE TERMINAL AND METHOD OF CONTROLLING THE MOBILE TERMINAL

• US 20140340334A1
• Filed: 04/22/2014
• Published: 11/20/2014
• Est. Priority Date: 05/15/2013
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: CHO, Kyoungmin
• Granted Patent: US 9,170,647 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4367 Establishing a secure communication between the client and a peripheral device or smart card
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

Disclosed is the mobile terminal including a display to display a first screen information, a user tracking device to detect that a user'"'"'s stare with respect to a connected external electronic apparatus is within a predetermined range with the display serving as a reference, and a controller to receive a second screen information from the connected external electronic apparatus based on the detected user'"'"'s stare, and the controller to control the display to simultaneously display the received second screen information and the first screen information.

Claims

1. A mobile terminal comprising:

a display to display a first screen information;

a user tracking device to detect that a user'"'"'s stare with respect to a connected external electronic apparatus is within a predetermined range with the display serving as a reference; and

a controller to receive a second screen information from the connected external electronic apparatus based on the detected user'"'"'s stare, and the controller to control the display to simultaneously display the received second screen information and the first screen information.

2. The mobile terminal of claim 1, wherein the user tracking device to detect a movement of the user'"'"'s stare by using a first signal and a second signal,

the first signal corresponding to whether or not to detect a user'"'"'s eye received from the external electronic apparatus, and

the second signal corresponding to whether or not to detect the user'"'"'s eye based on at least one sensor at the mobile terminal.

3. The mobile terminal of claim 1, wherein the display includes a first region and a second region distinguishable from the first region, and

wherein when the detected user'"'"'s stare is moved to within the predetermined range with the display, the controller to control the display such that the first screen information is displayed on the first region of the display and the second screen information is displayed on the second region of the display.

4. The mobile terminal of claim 3, wherein the controller to designate the second region of the display, based on a touch input, and the controller to control the display such that the second screen information is displayed at the designated second region.

5. The mobile terminal of claim 3, further comprising:

an inclination detection device to detect an inclination of the mobile terminal, and wherein the controller to determine the second region of the display based on the detected user'"'"'s stare and the detected inclination of the mobile terminal.

6. The mobile terminal of claim 1, wherein when the second screen information is displayed on the display and the detected user'"'"'s stare remains, for a prescribed time, on a region that displays the first screen information, the controller to control the display to remove the second screen information.

7. The mobile terminal of claim 1, wherein when the second screen information is displayed on the display and the detected user'"'"'s stare remains on a region that displays the second screen information, the controller to control the display to display the second screen information on substantially all screen regions of the display.

8. The mobile terminal of claim 1, wherein in response at a first touch at a region that displays the second screen information, the controller to reduce the second screen information and display the reduced second screen information, and

in response to a second touch to the second screen information, the controller to control the display such that the second screen information is displayed on substantially all screen regions of the display.

9. The mobile terminal of claim 1, wherein in response to an event that occurs while the second screen information is displayed, the controller to switch the first screen information and the second screen information to a screen information relating to the event, or to display an icon for switching to the screen information.

10. The mobile terminal of claim 1, wherein when the detected user'"'"'s stare within the predetermined range with the display is moved to a screen of the connected external electronic apparatus, the controller to transmit the first information to the connected external electronic apparatus.

11. The mobile terminal of claim 10, wherein when the first screen information is transmitted to the connected external electronic apparatus and an event occurs at the mobile terminal, the controller to transmit event data corresponding to the event to the connected external electronic apparatus when the mobile terminal is in a normal mode, and the controller to transmit only a notification message relating to an occurrence of the event to the connected external electronic apparatus when the mobile terminal is in a user protection mode.

12. The mobile terminal of claim 1, wherein when the second screen information is displayed on the display, an input mode of the mobile terminal is entered, and the controller to control the display such that at least one part of a region on which the second screen information is displayed is switched to a region into which information is input, and the information input to the region is displayed on the second screen information such that the region to input information overlaps the second screen information.

13. The mobile terminal of claim 1, wherein when a predetermined time is exceeded after the user'"'"'s stare is detected with respect to the connected external electronic apparatus to be within the predetermined range with the display, the controller to provide a first wireless signal to the connected external electronic apparatus, the first wireless signal to convert at least one of a screen and a sound of the connected external electronic apparatus into a deactivated state.

14. A method of controlling a mobile terminal, the method comprising:

displaying first screen information on a display;

connecting to an external electronic apparatus;

detecting that a user'"'"'s stare with respect to the connected external electronic apparatus is within a predetermined range with the display;

receiving a second screen information from the connected external electronic apparatus based on the detected user'"'"'s stare; and

simultaneously displaying the received second screen information and the first screen information.

15. The method of claim 14, further comprising:

displaying the second screen information on substantially all screen regions of the display when the user'"'"'s detected stare remains on a region that displays the second screen information; and

removing the second screen information from the display when the user'"'"'s stare remains on a region that displays the first screen information, for a predetermined time, when the second screen information is displayed on the display.

16. The method of claim 14, wherein the first screen information is displayed on a first region of the display and the second screen information is displayed on a second screen region of the display.

17. The method of claim 16, further comprising designating the second region of the display, based on a touch input, and controlling the display such that the second screen information is displayed on the designated second region.

18. The method of claim 16, further comprising:

detecting an inclination of the mobile terminal, and

determining the second region based on the detected user'"'"'s stare and the detected inclination of the mobile terminal.

19. The method of claim 14, further comprising removing the second screen information when the detected user'"'"'s stare remains, for a prescribed time, on a region that displays the first screen information.

20. The method of claim 14, further comprising displaying the second screen information on substantially all screen regions of the display when the detected user'"'"'s stare remains on a region that displays the second screen information.

21. The method of claim 14, further comprising:

reducing the second screen information in response to a first touch to a region that displays the second screen information, and

displaying the second screen information on substantially all screen regions of the display in response to a second touch to the second screen information.

22. The method of claim 14, further comprising switching the first screen information and the second screen information to a screen information relating to the event in response to an event occurring in a state in which the second screen information is displayed on the display.

23. The method of claim 14, further comprising transmitting the first screen information to the connected external electronic apparatus when the detected user'"'"'s stare is moved to a screen of the connected external electronic apparatus.

24. The method of claim 23, further comprising transmitting event data corresponding to an event to the connected external electronic apparatus when in a normal mode, and transmitting only a notification message relating to an occurrence of the event to the connected external electronic apparatus when in a user protection mode.

25. The method of claim 14, wherein when a predetermined time is exceeded after it is detected that the user'"'"'s stare with respect to the connected external electronic apparatus is within the predetermined range with the display, transmitting a first wireless signal to the connected external electronic apparatus, the first wireless signal to convert at least one of a screen and a sound of the connected external electronic apparatus into a deactivated state.

26. A mobile terminal comprising:

a display to display a first screen information; and

a controller to detect that a user'"'"'s eye viewing with respect to a connected electronic device is within a predetermined range with the display serving as a reference, and in response to the detected user'"'"'s eye viewing, the controller to control the display to simultaneously display the second screen information received from the connected electronic device and the first screen information.

27. The mobile terminal of claim 26, wherein the controller to detect a movement of the user'"'"'s eye viewing by using a first signal and a second signal,

the first signal corresponding to whether or not to detect a user'"'"'s eye received from the electronic device, and

the second signal corresponding to whether or not to detect the user'"'"'s eye based on at least one sensor at the mobile terminal.

28. The mobile terminal of claim 26, wherein the display includes a first region and a second region distinguishable from the first region, and

wherein when the detected user'"'"'s eye viewing is moved to within the predetermined range with the display, the controller to control the display such that the first screen information is displayed on the first region of the display and the second screen information is displayed on the second region of the display.

29. The mobile terminal of claim 28, wherein the controller to designate the second region of the display, based on a touch input, and the controller to control the display such that the second screen information is displayed on the designated second region.

30. The mobile terminal of claim 28, further comprising:

an inclination detection device to detect an inclination of the mobile terminal, and wherein the controller to determine the second region of the display based on the detected user'"'"'s eye viewing and the detected inclination of the mobile terminal.

31. The mobile terminal of claim 26, wherein when the second screen information is displayed on the display and the detected user'"'"'s eye viewing remains, for a prescribed time, on a region that displays the first screen information, the controller to control the display to remove the second screen information.

32. The mobile terminal of claim 26, wherein when the second screen information is displayed on the display and the detected user'"'"'s eye viewing remains on a region that displays the second screen information, the controller to control the display to display the second screen information on substantially all screen regions of the display.