METHOD AND DEVICE FOR CONTROLLING USER INTERFACE BASED ON USER'S GESTURE

• US 20090265627A1
• Filed: 08/21/2008
• Published: 10/22/2009
• Est. Priority Date: 04/17/2008
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kwon, Youk, KIM, Joo Min
• Granted Patent: US 9,582,049 B2
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

A mobile device and a method for controlling a user interface of the mobile device are disclosed. According to an embodiment, the method includes detecting a movement of the mobile device as applied by a user'"'"'s gesture, scrolling at least one of a page displayed on the display and a selection point on the display according to the detected movement of the mobile device, determining whether a selectable item displayed within the page is positioned on the selection point of the display, and selecting the selectable item in response to a predetermined event, once the determining step determines that the selectable item is positioned on the selection point of the display.

Claims

1. A method for controlling a user interface of a mobile device including a display, the method comprising:

detecting a movement of the mobile device as applied by a user'"'"'s gesture;

scrolling at least one of a page displayed on the display and a selection point on the display according to the detected movement of the mobile device;

determining whether a selectable item displayed within the page is positioned on the selection point of the display; and

selecting the selectable item in response to a predetermined event, once the determining step determines that the selectable item is positioned on the selection point of the display.

2. The method according to claim 1, wherein the scrolling is performed, when the mobile device is moved by the user'"'"'s gesture made while the user presses a button on the mobile device.

3. The method according to claim 1, wherein the selectable item is a hyperlink, and the selecting step includes connecting the mobile device to the hyperlink through a network.

4. The method according to claim 1, wherein the selectable item is a virtual button.

5. The method according to claim 4, wherein the virtual button is associated with playing a motion picture or audio data.

6. The method according to claim 1, further comprising:

indicating, on the display, that the selectable item is ready to be selected.

7. The method according to claim 1, wherein the scrolling step includes at least one of the following:

performing a zooming in/out operation on a portion of the page currently displayed on the display, according to a movement of the mobile device; and

flipping through other pages according to a movement of the mobile device.

8. The method according to claim 7, further comprising:

displaying, on a portion of the display, a guide window for indicating the actual area currently displayed on the display with respect to the entire page or a plurality of pages.

9. The method according to claim 1, wherein the predetermined event is one of the following:

shaking of the mobile device;

elapsing of a predetermined time duration after the selectable item is positioned on the selection point of the display;

receiving a touch of a designated virtual button displayed on the display;

or receiving a selection of a designated physical button on the mobile device.

10. The method according to claim 1, wherein the movement of the mobile device includes at least one of rolling, pitching, yawing, and transition.

11. The method according to claim 1, wherein the display includes a touch screen.

12. The method according to claim 1, wherein in the scrolling step, only the page is scrollable while the selection point is fixed on the display.

13. The method according to claim 1, wherein in the scrolling step, the selection point is visible to a user.

14. The method according to claim 1, wherein in the scrolling step, the selection point is invisible to a user.

15. A method of controlling a user interface of a mobile device, the method comprising:

detecting a movement of the mobile device as applied by a user'"'"'s gesture;

scrolling a page displayed on a display of the mobile device according to the detected movement of the mobile device;

determining when at least a part of an input area of the display is in contact with or overlapping an input window of the page displayed on the display; and

activating a user interface based on the determination result.

16. The method according to claim 15, wherein the scrolling is performed, when the mobile device is moved by the user'"'"'s gesture made while the user presses a button on the mobile device.

17. The method according to claim 15, wherein in the scrolling step, the input window is scrolled according the movement of the mobile device while the input area is fixed on the display.

18. The method according to claim 15, wherein the input area is visible to a user.

19. The method according to claim 15, wherein the input area is invisible to a user.

20. The method according to claim 15, wherein the movement of the mobile device includes at least one of rolling, pitching, yawing, and transition.

21. The method according to claim 15, further comprising:

indicating to a user when at least the part of the input area of the display is in contact with or overlapping the input window of the page displayed on the display.

22. The method according to claim 15, wherein the activating the user interface comprises:

displaying a virtual text input panel.

23. The method according to claim 22, further comprising:

removing the displayed virtual text input panel in response to a movement of the mobile device as applied by a predetermined gesture of the user.

24. The method according to claim 23, wherein the predetermined gesture includes tilting the mobile device, shaking the mobile device at least once, pressing a virtual button on the display, pressing a physical button on the mobile device, or touching an area of the display in a certain manner.

25. The method according to claim 22, wherein the virtual text input panel comprises a virtual keyboard or a note recognition panel.

26. The method according to claim 15, wherein the scrolling step includes at least one of the following:

performing a zooming in/out operation on a portion of the page currently displayed on the display, according to a movement of the mobile device; and

flipping through other pages according to a movement of the mobile device.

27. The method according to claim 26, further comprising:

displaying, on a portion of the display, a guide window for indicating the actual area currently displayed on the display with respect to the entire page or a plurality of pages.

28. A method for controlling a display of a mobile device, the method comprising:

detecting a movement of the mobile device as applied by a user'"'"'s gesture;

scrolling a page on the display according to the movement of the mobile device; and

displaying, on the display, a guide window in addition to the page currently displayed on the display, the guide window including a miniature of the page currently displayed on the display.

29. The method according to claim 28, wherein the movement of the mobile device includes at least one of rolling, pitching, yawing, and transition.

30. A mobile device comprising:

a display;

a detector configured to detect a movement of the mobile device as applied by a user'"'"'s gesture; and

a controller, by controlling the display, configured to scroll at least one of a page displayed on the display and a selection point on the display according to the detected movement of the mobile device;

to determine whether a selectable item displayed within the page is positioned on the selection point of the display; and

to select the selectable item in response to a predetermined event, once the controller determines that the selectable item is positioned on the selection point of the display.

31. A mobile device comprising:

a display;

a user interface;

a detector configured to detect a movement of the mobile device as applied by a user'"'"'s gesture; and

a controller, by controlling the display, configured to scroll a page displayed on the display according to the detected movement of the mobile device;

to determine when at least a part of an input area of the display is in contact with or overlapping an input window of the page displayed on the display; and

to activate the user interface based on this determination result.

32. A mobile device comprising:

a display;

a detector configured to detect a movement of the mobile device as applied by a user'"'"'s gesture; and

a controller, by controlling the display, configured to scroll a page on the display according to the movement of the mobile device; and

to display, on the display, a guide window in addition to the page currently displayed on the display, the guide window including a miniature of the page currently displayed on the display.