Keyboard based graphical user interface navigation

• US 8,527,894 B2
• Filed: 12/29/2008
• Issued: 09/03/2013
• Est. Priority Date: 12/29/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hughes, Rebecca, Martineau, James, McCowan, Michael S.
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): BASOM, BLAINE T
• Application Number:
  US12/344,605
• Publication Number:
  US 20100169818A1
• Time in Patent Office: 1,709 Days
• Field of Search: 715/773, 715/822, 715/827, 715/831, 715/840, 345/168, 345/160
• US Class Current: 715/773
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04897 Special input arrangements or commands for improving display capability

Abstract

A computer-implemented method of navigating a GUI can include, responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard includes a plurality of virtual keys. The method can include, for each virtual key, associating the virtual key with a region of the first layer including an area of the GUI beneath the virtual key. The method can include mapping each virtual key with a physical key of a physical keyboard communicatively linked with a computer rendering the GUI and, responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key. A level of magnification for the selected region can be increased within the first layer while keeping the virtual keyboard sizing constant.

Claims

1. A computer-implemented method of navigating a graphical user interface (GUI), the method comprising:

responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys;

for each virtual key, associating the virtual key with a region of the first layer comprising an area of the GUI beneath the virtual key;

mapping each virtual key with a physical key of a physical keyboard communicatively linked with a computer rendering the GUI;

responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant, and assigning one of a plurality of programmatic actions to each physical key of the physical keyboard;

determining that a virtual key is above an icon within the first layer and, in response, changing an appearance of the virtual key to indicate that a selection of a physical key mapped to the virtual key initiates a programmatic action upon the icon; and

responsive to a user input selecting the physical key mapped to the virtual key above the icon, initiating the assigned programmatic action on the icon.

2. The computer-implemented method of claim 1, wherein responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises:

for each virtual key, associating the virtual key with a sub-region of the magnified selected region within the first layer beneath the virtual key; and

responsive to a subsequent user input selecting a physical key of the physical keyboard, selecting the sub-region of the magnified selected region corresponding to the selected physical key and increasing a level of magnification for the selected sub-region within the first layer while keeping the virtual keyboard sizing constant.

3. The computer-implemented method of claim 1, wherein increasing a level of magnification for the selected region further comprises redrawing the GUI with the selected region centered beneath the virtual keyboard and at a higher level of magnification, wherein the selected region occupies a greater area of a display than was occupied at the lower level of magnification.

4. The computer-implemented method of claim 1, further comprising, in response to determining that the virtual key is above the icon changing the appearance of the virtual key to indicate the virtual key is above a graphic representation of an object within the first layer.

5. The computer-implemented method of claim 1, wherein responsive to a user input selecting a physical key mapped to a virtual key above the icon, initiating the assigned programmatic action on the icon further comprises removing the virtual keyboard subsequent to the user input selecting the physical key.

6. The computer-implemented method of claim 1, wherein the virtual keyboard is a facsimile of at least a portion of the physical keyboard.

7. The computer-implemented method of claim 1, wherein responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys further comprises displaying the virtual keyboard in a semi-transparent form, wherein the GUI located within the first layer is not obscured subsequent to overlaying of the virtual keyboard.

8. The computer-implemented method of claim 1, wherein responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises receiving a user input defining the level of magnification for the selected region within the first layer.

9. A computer-implemented method of performing programmatic actions through a graphical user interface (GUI), the method comprising:

responsive to a user input initiating a navigation mode, overlaying, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys;

for each virtual key, associating the virtual key with a region of the first layer comprising an area of the GUI beneath the virtual key;

mapping each virtual key with a physical key of a physical keyboard communicatively linked with a computer rendering the GUI;

responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant, and assigning one of a plurality of programmatic actions to each physical key of the physical keyboard;

determining that a virtual key is above an icon within the first layer and, in response, changing an appearance of the virtual key to indicate the virtual key is above a graphic representation of an object within the first layer; and

responsive to a user input selecting the physical key mapped to the virtual key above the icon, initiating the assigned programmatic action on the icon.

10. The computer-implemented method of claim 9, wherein responsive to a user input selecting a physical key mapped to a virtual key above the icon, initiating the assigned programmatic action on the icon further comprises for each virtual key of the virtual keyboard, determining whether the virtual key is above an icon within the first layer.

11. The computer-implemented method of claim 9, wherein responsive to a user input selecting a physical key of the physical keyboard, selecting a region corresponding to the selected physical key and increasing a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises:

for each virtual key, associating the virtual key with a sub-region of the magnified selected region within the first layer beneath the virtual key; and

responsive to a subsequent user input selecting a physical key of the physical keyboard, selecting a sub-region of the magnified selected region corresponding to the selected physical key and increasing a level of magnification for the selected sub-region within the first layer while keeping the virtual keyboard sizing constant.

12. A computer program product comprising:

a computer-usable storage device having stored thereon computer-usable program code that navigates a graphical user interface (GUI) responsive to inputs from a physical keyboard, the computer-usable program code comprising;

computer-usable program code that, responsive to a user input initiating a navigation mode, overlays, atop of the GUI located within a first layer, a virtual keyboard within a second layer, wherein the virtual keyboard comprises a plurality of virtual keys;

computer-usable program code that, for each virtual key, associates the virtual key with a region of the first layer comprising an area of the GUI beneath the virtual key;

computer-usable program code that maps each virtual key with a physical key of the physical keyboard communicatively linked with a computer rendering the GUI; and

computer-usable program code that, responsive to a user input selecting a physical key of the physical keyboard, selects a region corresponding to the selected physical key and increases a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant, and assigns one of a plurality of programmatic actions to each physical key of the physical keyboard;

computer-usable program code that determines a virtual key is above an icon within the first layer and, in response, changes an appearance of the virtual key to indicate that a selection of a physical key mapped to the virtual key initiates a programmatic action upon the icon; and

computer-usable program code that, responsive to a user input selecting the physical key mapped to the virtual key above the icon, initiates the assigned programmatic action on the icon.

13. The computer program product of claim 12, wherein the computer-usable program code that, responsive to a user input selecting a physical key of the physical keyboard, selects a region corresponding to the selected physical key and increases a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises:

computer-usable program code that, for each virtual key, associates the virtual key with a sub-region of the magnified selected region within the first layer beneath the virtual key; and

computer-usable program code that, responsive to a subsequent user input selecting a physical key of the physical keyboard, selects a sub-region of the magnified selected region corresponding to the selected physical key and increases a level of magnification for the selected sub-region within the first layer while keeping the virtual keyboard sizing constant.

14. The computer program product of claim 12, wherein the computer-usable program code that, responsive to a user input selecting a physical key of the physical keyboard, selects a region corresponding to the selected physical key and increases a level of magnification for the selected region within the first layer while keeping the virtual keyboard sizing constant further comprises computer-usable program code that redraws the GUI with the selected region centered beneath the virtual keyboard and at a higher level of magnification, wherein the selected region occupies a greater area of a display than was occupied at the lower level of magnification.

15. The computer program product of claim 12, wherein the computer-usable program code further comprises computer-usable program code that, in response to determining that the virtual key is above the icon changes the appearance of the virtual key to indicate the virtual key is above a graphic representation of an object within the first layer.