KEYBOARD BASED GRAPHICAL USER INTERFACE NAVIGATION

• US 20100169818A1
• Filed: 12/29/2008
• Published: 07/01/2010
• Est. Priority Date: 12/29/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hughes, Rebecca, McCowan, Michael S., Martineau, James
• Granted Patent: US 8,527,894 B2
• Time in Patent Office: Days
• US Class Current: 715/773
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04897 Special input arrangements or commands for improving display capability

Abstract

A computer-implemented method of navigating a GUI can include, responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard includes a plurality of virtual keys. The method can include, for each virtual key, associating the virtual key with a region of the first layer including an area of the GUI beneath the virtual key. The method can include mapping each virtual key with a physical key of a physical keyboard communicatively linked with a computer rendering the GUI and, responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key. A level of magnification for the selected region can be increased within the first layer while keeping the virtual keyboard sizing constant.

Claims

1. A computer-implemented method of navigating a graphical user interface (GUI), the method comprising:

responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys;

for each virtual key, associating the virtual key with a region of the first layer comprising an area of the GUI beneath the virtual key;

mapping each virtual key with a physical key of a physical keyboard communicatively linked with a computer rendering the GUI; and

responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant.

2. The computer-implemented method of claim 1, wherein responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises:

for each virtual key, associating the virtual key with a sub-region of the magnified selected region within the first layer beneath the virtual key; and

responsive to a subsequent user input selecting a physical key of the physical keyboard, selecting the sub-region of the magnified selected region corresponding to the selected physical key and increasing a level of magnification for the selected sub-region within the first layer while keeping the virtual keyboard sizing constant.

3. The computer-implemented method of claim 1, wherein increasing a level of magnification for the selected region further comprises redrawing the GUI with the selected region centered beneath the virtual keyboard and at a higher level of magnification, wherein the selected region occupies a greater area of a display than was occupied at the lower level of magnification.

4. The computer-implemented method of claim 1, further comprising:

responsive to receiving a user input, assigning one of a plurality of programmatic actions to each physical key of the physical keyboard; and

responsive to a user input selecting a physical key mapped to a virtual key above an icon within the first layer, initiating the assigned programmatic action on the icon.

5. The computer-implemented method of claim 4, further comprising determining that the virtual key is above the icon and, in response, changing an appearance of the virtual key to indicate that a selection of the physical key corresponding to the virtual key initiates the programmatic action upon the icon.

6. The computer-implemented method of claim 4, further comprising determining that the virtual key is above the icon and, in response, changing an appearance of the virtual key to indicate the virtual key is above the graphic representation of the object within the first layer.

7. The computer-implemented method of claim 4, wherein responsive to a user input selecting a physical key mapped to a virtual key above the icon, initiating the assigned programmatic action on the icon further comprises removing the virtual keyboard subsequent to the user input selecting the physical key.

8. The computer-implemented method of claim 1, wherein the virtual keyboard is a facsimile of at least a portion of the physical keyboard.

9. The computer-implemented method of claim 1, wherein responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys further comprises displaying the virtual keyboard in a semi-transparent form, wherein the GUI located within the first layer is not obscured subsequent to overlaying of the virtual keyboard.

10. The computer-implemented method of claim 1, wherein responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises receiving a user input defining the level of magnification for the selected region within the first layer.

11. A computer-implemented method of performing programmatic actions through a graphical user interface (GUI), the method comprising:

responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys;

for each virtual key, associating the virtual key with a region of the first layer comprising an area of the GUI beneath the virtual key;

mapping each virtual key with a physical key of a physical keyboard communicatively linked with a computer rendering the GUI; and

responsive to a user input selecting a physical key mapped to a virtual key above an icon within the region of the first layer associated with the virtual key, initiating a programmatic action on the icon.

12. The computer-implemented method of claim 11, wherein responsive to a user input selecting a physical key mapped to a virtual key above an icon within the region of the first layer associated with the virtual key, initiating a programmatic action on icon further comprises, responsive to receiving a user input, assigning one of a plurality of programmatic actions to each physical key of the physical keyboard.

13. The computer-implemented method of claim 11, wherein responsive to a user input selecting a physical key mapped to a virtual key above an icon within the region of the first layer associated with the virtual key, initiating a programmatic action on the icon further comprises for each virtual key of the virtual keyboard, determining whether the virtual key is above an icon within the first layer.

14. The computer-implemented method of claim 11, further comprising, responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant.

15. The computer-implemented method of claim 14, wherein responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises:

for each virtual key, associating the virtual key with a sub-region of the magnified selected region within the first layer beneath the virtual key; and

responsive to a subsequent user input selecting a physical key of the physical keyboard, selecting a sub-region of the magnified selected region corresponding to the selected physical key and increasing a level of magnification for the selected sub-region within the first layer while keeping the virtual keyboard sizing constant.

16. A computer program product comprising:

a computer-usable medium comprising computer-usable program code that navigates a graphical user interface (GUI) responsive to inputs from a physical keyboard, the computer-usable medium comprising;

computer-usable program code that, responsive to a user input initiating a navigation mode, overlays, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys;

computer-usable program code that, for each virtual key, associates the virtual key with a region of the first layer comprising an area of the GUI beneath the virtual key;

computer-usable program code that maps each virtual key with a physical key of the physical keyboard communicatively linked with a computer rendering the GUI; and

computer-usable program code that, responsive to a user input selecting a physical key of the physical keyboard, selects a region corresponding to the selected physical key and increases a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant.

17. The computer program product of claim 16, wherein the computer-usable program code that, responsive to a user input selecting a physical key of the physical keyboard, selects a region corresponding to the selected physical key and increases a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises:

computer-usable program code that, for each virtual key, associates the virtual key with a sub-region of the magnified selected region within the first layer beneath the virtual key; and

computer-usable program code that, responsive to a subsequent user input selecting a physical key of the physical keyboard, selects a sub-region of the magnified selected region corresponding to the selected physical key and increases a level of magnification for the selected sub-region within the first layer while keeping the virtual keyboard sizing constant.

18. The computer program product of claim 16, wherein the computer-usable program code that, responsive to a user input selecting a physical key of the physical keyboard, selects a region corresponding to the selected physical key and increases a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises computer-usable program code that redraws the GUI with the selected region centered beneath the virtual keyboard and at a higher level of magnification, wherein the selected region occupies a greater area of a display than was occupied at the lower level of magnification.

19. The computer program product of claim 16, wherein the computer-usable medium further comprises:

computer-usable program code that, responsive to receiving a user input, assigns one of a plurality of programmatic actions to each physical key of the physical keyboard; and

computer-usable program code that, responsive to a user input selecting a physical key mapped to a virtual key above an icon within the first layer, initiates the assigned programmatic action on the icon.

20. The computer program product of claim 19, wherein the computer-usable medium further comprises computer-usable program code that determines that the virtual key is above the icon and, in response, changes an appearance of the virtual key to indicate that selection of the physical key corresponding to the virtual key initiates the programmatic action upon the object.