Methods and apparatus for dynamically adapting a virtual keyboard

• US 9,507,519 B2
• Filed: 12/08/2011
• Issued: 11/29/2016
• Est. Priority Date: 12/08/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Bilgen, Aras, Ketrenos, James
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): Distefano, Gregory A
• Application Number:
  US13/994,830
• Publication Number:
  US 20130283195A1
• Time in Patent Office: 1,818 Days
• Field of Search: 715/767, 715/773
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

In one example embodiment, a mobile computing device displays at least part of an electronic form containing input objects to accept user input. A virtual keyboard module parses the form to discover attributes of the input objects and automatically determines whether the form includes a command button or other non-textual input object, based on results of the parsing. In response to discovering that the form includes a non-textual input object, the virtual keyboard module automatically adds a corresponding non-textual virtual keyboard component to a virtual keyboard, and the virtual keyboard module displays the virtual keyboard with the added non-textual virtual keyboard component on the display of the mobile device. The added non-textual virtual keyboard component may be configured to allow a user to invoke, from the virtual keyboard, a function associated with the corresponding non-textual input object in the form. Other embodiments are described and claimed.

Claims

1. A method for providing a dynamically customized virtual keyboard, the method comprising:

in a first portion of a display of a mobile computing device, displaying at least part of an electronic form containing input objects to accept user input;

displaying a virtual keyboard in a second portion of the display, wherein the second portion of the display is distinct from the first portion of the display, and wherein the virtual keyboard comprises at least a first alphabetic button to enable a user to enter a first alphabetic character and a second alphabetic button to enable the user to enter a second alphabetic character;

automatically parsing the electronic form to discover attributes of at least one of the input objects in the electronic form;

automatically determining whether the electronic form includes a non-textual input object, based on results of the parsing; and

in response to discovering that the electronic form includes a non-textual input object, automatically adding a corresponding non-textual virtual keyboard component to the virtual keyboard;

wherein displaying the virtual keyboard comprises displaying the virtual keyboard with the first and second alphabetic buttons and with the added non-textual virtual keyboard component in the second portion of the display; and

wherein the added non-textual virtual keyboard component is configured to allow a user to invoke, from the virtual keyboard, a function associated with the corresponding non-textual input object in the electronic form.

2. A method according to claim 1, wherein:

the non-textual input object in the electronic form comprises a command button; and

the added non-textual virtual keyboard component in the virtual keyboard comprises a corresponding command button configured to allow the user to invoke, from the virtual keyboard, the function associated with the command button in the electronic form.

3. A method according to claim 1, wherein the non-textual input object in the electronic form comprises an object from the group consisting of a command button and a list box.

4. A method according to claim 1, wherein:

the operation of displaying at least part of the electronic form in the first portion of the display comprises displaying a first part of the electronic form that does not include the non-textual input object in the first portion of the display; and

the operation of displaying the virtual keyboard in the second portion of the display comprises displaying the virtual keyboard with the added non-textual virtual keyboard component in the second portion of the display, while the first part of the electronic form that does not include the non-textual input object is displayed in the first portion of the display.

5. A method according to claim 4, further comprising:

enabling the user to interact with the non-textual input object in the electronic form indirectly, via the virtual keyboard, even though the non-textual input object resides in a second, undisplayed part of the electronic form.

6. A method according to claim 1, wherein the electronic form comprises an input screen generated by a software application.

7. A method according to claim 6, wherein the software application comprises a web browser.

8. A method according to claim 1, wherein:

the operation of parsing the electronic form comprises discovering two or more input objects in the electronic form; and

the method further comprises automatically adding one or more navigation control buttons to the virtual keyboard in response to discovering two or more input objects in the electronic form.

9. A method according to claim 8, further comprising:

detecting that the user has selected one of the added navigation control buttons in the virtual keyboard;

in response, automatically moving focus to a different input object;

automatically determining whether the different input object is being presented in the display; and

in response to determining that the different input object is not being presented in the display, automatically scrolling the electronic form in the display, to cause the different input object to be presented in the display.

10. A method according to claim 9, wherein:

the two or more input objects comprise a first textual input field and a second textual input field; and

the operation of automatically moving focus to a different input object comprises automatically moving focus from the first textual input field to the second textual input field.

11. A method according to claim 1, wherein the method further comprises:

adding, to the virtual keyboard, a virtual keyboard component configured to cause, in response to user interaction with said virtual keyboard component, a list of input objects from the electronic form to be displayed in the virtual keyboard.

12. A method according to claim 11, further comprising:

detecting that the user has selected one of the input objects from the list displayed in the virtual keyboard; and

in response, automatically moving focus to the selected input object.

13. A method according to claim 11, further comprising:

detecting that the user has selected one of the input objects from the list displayed in the virtual keyboard;

in response, automatically moving focus to the selected input object;

automatically determining whether the selected input object is being presented in the display; and

in response to determining that the selected input object is not being presented in the display, automatically scrolling the electronic form in the display, to cause the selected input object to be presented in the display.

14. At least one non-transitory machine accessible medium comprising:

instructions that, when executed by a mobile computing device, enable the mobile computing device to perform operations comprising;

in a first portion of a display of the mobile computing device, displaying at least part of an electronic form containing input objects to accept user input;

displaying a virtual keyboard in a second portion of the display, wherein the second portion of the display is distinct from the first portion of the display, and wherein the virtual keyboard comprises at least a first alphabetic button to enable a user to enter a first alphabetic character and a second alphabetic button to enable the user to enter a second alphabetic character;

automatically parsing the electronic form to discover attributes of at least one of the input objects in the electronic form;

automatically determining whether the electronic form includes a non-textual input object, based on results of the parsing; and

in response to discovering that the electronic form includes a non-textual input object, automatically adding a corresponding non-textual virtual keyboard component to the virtual keyboard;

wherein displaying the virtual keyboard comprises displaying the virtual keyboard with the first and second alphabetic buttons and with the added non-textual virtual keyboard component in the second portion of the display; and

wherein the added non-textual virtual keyboard component is configured to allow a user to invoke, from the virtual keyboard, a function associated with the corresponding non-textual input object in the electronic form.

15. At least one non-transitory machine accessible medium according to claim 14, wherein:

the non-textual input object in the electronic form comprises a command button; and

the added non-textual virtual keyboard component in the virtual keyboard comprises a corresponding command button configured to allow the user to invoke, from the virtual keyboard, the function associated with the command button in the electronic form.

16. At least one non-transitory machine accessible medium according to claim 14, wherein the non-textual input object in the electronic form comprises an object from the group consisting of a command button and a list box.

17. At least one non-transitory machine accessible medium according to claim 14, wherein:

the operation of displaying at least part of the electronic form in the first portion of the display comprises displaying a first part of the electronic form that does not include the non-textual input object in the first portion of the display; and

the operation of displaying the virtual keyboard in the second portion of the display comprises displaying the virtual keyboard with the added non-textual virtual keyboard component in the second portion of the display, while the first part of the electronic form that does not include the non-textual input object is displayed in the first portion of the display.

18. At least one non-transitory machine accessible medium according to claim 17, wherein the instructions enable the mobile computing device to perform further operations comprising:

enabling the user to interact with the non-textual input object in the electronic form indirectly, via the virtual keyboard, even though the non-textual input object resides in a second, undisplayed part of the electronic form.

19. At least one non-transitory machine accessible medium according to claim 14, wherein the instructions enable the mobile computing device to perform further operations comprising:

adding, to the virtual keyboard, a virtual keyboard component configured to cause, in response to user interaction with said virtual keyboard component, a list of input objects from the electronic form to be displayed in the virtual keyboard.

20. At least one non-transitory machine accessible medium according to claim 19, wherein the instructions enable the mobile computing device to perform further operations comprising:

detecting that the user has selected one of the input objects from the list displayed in the virtual keyboard;

in response, automatically moving focus to the selected input object;

automatically determining whether the selected input object is being presented in the display; and

in response to determining that the selected input object is not being presented in the display, automatically scrolling the electronic form in the display, to cause the selected input object to be presented in the display.

21. A mobile computing device comprising:

a processor;

a display responsive to the processor;

at least one local storage device responsive to the processor; and

instructions in the local storage device that, when executed by the mobile computing device, enable the mobile computing device to perform operations comprising;

in a first portion of the display, displaying at least part of an electronic form containing input objects to accept user input;

displaying a virtual keyboard in a second portion of the display, wherein the second portion of the display is distinct from the first portion of the display, and wherein the virtual keyboard comprises at least a first alphabetic button to enable a user to enter a first alphabetic character and a second alphabetic button to enable the user to enter a second alphabetic character;

automatically parsing the electronic form to discover attributes of at least one of the input objects in the electronic form;

automatically determining whether the electronic form includes a non-textual input object, based on results of the parsing; and

in response to discovering that the electronic form includes a non-textual input object, automatically adding a corresponding non-textual virtual keyboard component to the virtual keyboard;

wherein displaying the virtual keyboard comprises displaying the virtual keyboard with the first and second alphabetic buttons and with the added non-textual virtual keyboard component in the second portion of the display; and

wherein the added non-textual virtual keyboard component is configured to allow a user to invoke, from the virtual keyboard, a function associated with the corresponding non-textual input object in the electronic form.

22. A mobile computing device according to claim 21, wherein:

the non-textual input object in the electronic form comprises a command button; and

the added non-textual virtual keyboard component in the virtual keyboard comprises a corresponding command button configured to allow the user to invoke, from the virtual keyboard, the function associated with the command button in the electronic form.

23. A mobile computing device according to claim 21, wherein the non-textual input object in the electronic form comprises an object from the group consisting of a command button and a list box.

24. A mobile computing device according to claim 21, wherein:

the operation of displaying at least part of the electronic form in the first portion of the display comprises displaying a first part of the electronic form that does not include the non-textual input object in the first portion of the display; and

the operation of displaying the virtual keyboard in the second portion of the display comprises displaying the virtual keyboard with the added non-textual virtual keyboard component in the second portion of the display, while the first part of the electronic form that does not include the non-textual input object is displayed in the first portion of the display.

25. A mobile computing device according to claim 24, wherein the instructions enable the mobile computing device to perform further operations comprising:

enabling the user to interact with the non-textual input object in the electronic form indirectly, via the virtual keyboard, even though the non-textual input object resides in a second, undisplayed part of the electronic form.

26. A mobile computing device according to claim 21, wherein the instructions enable the mobile computing device to perform further operations comprising:

adding, to the virtual keyboard, a virtual keyboard component configured to cause, in response to user interaction with said virtual keyboard component, a list of input objects from the electronic form to be displayed in the virtual keyboard.

27. A mobile computing device according to claim 26, wherein the instructions enable the mobile computing device to perform further operations comprising:

detecting that the user has selected one of the input objects from the list displayed in the virtual keyboard;

in response, automatically moving focus to the selected input object;

automatically determining whether the selected input object is being presented in the display; and

in response to determining that the selected input object is not being presented in the display, automatically scrolling the electronic form in the display, to cause the selected input object to be presented in the display.