APPARATUS AND METHOD FOR ADAPTIVELY MAGNIFYING GRAPHIC USER INTERFACES ON DISPLAY

• US 20200133391A1
• Filed: 10/25/2019
• Published: 04/30/2020
• Est. Priority Date: 10/31/2018
• Status: Active Grant

• Current Assignee: NHN Corporation
• Original Assignee: NHN Corporation
• Inventors: Lee, Dong Jin
• Granted Patent: US 10,996,750 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors

Abstract

A mobile device comprises a display panel configured to display a plurality of graphic user interfaces including one or more first type graphic user interfaces and/or one or more second type graphic user interfaces; one or more sensors configured to detect a position of a user; and one or more processors configured to: calculate a relative inclination of the display panel with respect to the position of the user based on the position of the user detected by the sensor, and change sizes of the first type graphic user interfaces among the plurality of graphic user interfaces based on the relative inclination of the display panel. The first type graphic user interfaces are pre-designated among the plurality of graphic user interfaces and stored in memory, and the processors are configured to magnify the sizes of the first type graphic user interfaces according to the relative inclination of the display panel.

Claims

1. A mobile device comprising:

a display panel configured to display a plurality of graphic user interfaces including one or more first type graphic user interfaces and/or one or more second type graphic user interfaces;

one or more sensors configured to detect a position of a user; and

one or more processors configured to;

calculate a relative inclination of the display panel with respect to the position of the user based on the position of the user detected by the sensor, and

change sizes of the first type graphic user interfaces among the plurality of graphic user interfaces based on the relative inclination of the display panel.

2. The mobile device of claim 1, wherein the sensors include an eye detection sensor configured to detect a position of the user'"'"'s eye with respect to the display panel.

3. The mobile device of claim 1, wherein the first type graphic user interfaces are pre-designated among the plurality of graphic user interfaces and stored in a memory, and the processors are configured to magnify the sizes of the first type graphic user interfaces according to the relative inclination of the display panel.

4. The mobile device of claim 2, wherein the one or more processors are configured to calculate the relative inclination of the display panel using the position of the user'"'"'s eye.

5. The mobile device of claim 4, wherein the one or more processors calculate an angle between a first line and a second line as the relative inclination,

wherein the first line is a line segment connecting a predetermined position of the display panel and the position of the user'"'"'s eye, and the second line is perpendicular to a surface of the display panel.

6. The mobile device of claim 5, wherein the one or more processors are configured to determine an magnification display area on which the first type graphic user interfaces are to be displayed, based on the calculated relative inclination of the display panel, magnify the first type graphic user interfaces according to the calculated relative inclination of the display panel and display the magnified first type graphical users on the determined magnification display area.

7. The mobile device of claim 6, wherein the one or more processors are configured to compare the relative inclination of the display panel with a threshold value, and magnify the first type graphic user interfaces in response to a comparison result that the relative inclination of the display panel is above the threshold value.

8. The mobile device of claim 7, wherein the one or more processors are configured to, in response to the comparison result that the relative inclination of the display panel is above the threshold value, determine whether the second type graphic user interfaces are displayed on the magnification display area, and replace the second type graphic user interfaces, displayed on the magnification display area, with the first type graphic user interfaces.

9. The mobile device of claim 7, wherein the one or more processors are configured to, in response to the comparison result that the relative inclination of the display panel is above the threshold value, determine whether the second type graphic user interfaces are displayed on the magnification display area, deactivate the second type graphic user interfaces, displayed on the magnification display area, and display the first type graphic user interfaces on the magnification display area by overlaying the second type graphic user interfaces, displayed on the magnification display area, with the first type graphic user interfaces.

10. The mobile device of claim 7, wherein the one or more processors are configured to control the display panel to display the second type of graphic user interface on the magnification display area in response to a comparison result that the relative inclination of the display panel is equal to or less than the threshold value.

11. The mobile device of claim 8, wherein the one or more processors are configured to restore the second type graphic user interfaces, replaced with the first type graphic user interfaces, to the magnification display area in response to a comparison result that the relative inclination of the display panel is changed to be equal or less than the threshold value.

12. The mobile device of claim 6, wherein the one or more processors are configured to determine an area of the display panel closest to the position of the user'"'"'s eye as the magnification display area.

13. A method for adaptively magnifying a graphic user interface, the method performed by a mobile device comprising a display panel, one or more sensors and one or more processors, the method comprising:

displaying, by the display panel, a plurality of graphic user interfaces including one or more first type graphic user interfaces and/or one or more second type graphic user interfaces;

detecting a position of a user'"'"'s eye by the one or more sensors;

receiving, by the one or more processors, the position of the user'"'"'s eye from the one or more sensors and calculating, by the one or more processors, a relative inclination of the display panel with respect to the position of the user'"'"'s eye based on the position of the user'"'"'s eye detected by the one or more sensors; and

changing, by the one or more processors, sizes of the first type graphic user interfaces based on the relative inclination of the display panel among the plurality of graphic user interfaces.

14. The method according to claim 13, wherein the first type graphic user interfaces are predefined to be magnified among the plurality of graphic user interface and stored in a memory.

15. The method of claim 13, wherein the one or more processors calculate an angle between a first line and a second line as the relative inclination of the display panel,

wherein the first line is a line segment connecting a predetermined position of the display panel and the position of the user'"'"'s eye, and the second line is perpendicular to a surface of the display panel.

16. The method of claim 13, wherein the changing, by the one or more processors, the sizes of the first type graphic user interfaces comprises:

determining a magnification display area on which the first type graphic user interfaces are to be displayed, based on the relative inclination of the display panel;

magnifying the first type graphic user interfaces according to the relative inclination of the display panel; and

displaying the magnified first type graphical user interfaces on the magnification display area.

17. The method of claim 16, wherein the magnifying the first type graphic user interfaces comprises comparing the relative inclination of the display panel with a threshold value,

wherein the one or more processors magnify the first type graphic user interfaces when the relative inclination of the display panel is above the threshold value.

18. The method of claim 17, wherein the magnifying the first type graphic user interfaces comprises:

determining, when the relative inclination of the display panel is determined to be greater than or equal to the threshold value, whether the second type of graphic user interfaces are displayed on the magnification display area; and

replacing the second type graphic user interfaces, displayed on the magnification display area, with the first type graphic user interfaces.

19. The method of claim 17, wherein the magnifying the first type graphic user interfaces further comprises:

determining, when the relative inclination of the display panel is determined to be greater than or equal to the threshold value, whether the second type of graphic user interfaces are displayed on the magnification display area; and

deactivating the second type graphic user interfaces, displayed on the magnification display area, and displaying the first type graphic user interfaces on the magnification display area by overlaying the second type graphic user interfaces, displayed on the magnification display area, with the first type graphic user interfaces.

20. The method of claim 13, wherein the one more processors determine an area of the display panel closest to the position of the user'"'"'s eye as the magnification display area.