USER INTERFACE CONTROL USING A KEYBOARD

• US 20160195936A1
• Filed: 03/14/2016
• Published: 07/07/2016
• Est. Priority Date: 02/26/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: LaFave, Harper, Hodges, Stephen, Scott, James, Izadi, Shahram, Molyneaux, David, Villar, Nicolas, Butler, David Alexander, Hazas, Mike
• Granted Patent: US 9,851,809 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof

Abstract

User interface control using a keyboard is described. In an embodiment, a user interface displayed on a display device is controlled using a computer connected to a keyboard. The keyboard has a plurality of alphanumeric keys that can be used for text entry. The computer receives data comprising a sequence of key-presses from the keyboard, and generates for each key-press a physical location on the keyboard. The relative physical locations of the key-presses are compared to calculate a movement path over the keyboard. The movement path describes the path of a user'"'"'s digit over the keyboard. The movement path is mapped to a sequence of coordinates in the user interface, and the movement of an object displayed in the user interface is controlled in accordance with the sequence of coordinates.

Claims

1. A method of operating a user interface, the method comprising:

receiving, at the computer, data comprising one or more key-presses from a keyboard;

determining whether the data is associated with an existing touch point;

when the data is not associated with an existing touch point, determine that multi-touch input is present;

mapping the multi-touch input to coordinates in the user interface; and

controlling the user interface in accordance with the multi-touch input.

2. A method according to claim 1, wherein determining whether the data is associated with the existing touch point comprises:

determining whether the data is associated with any key adjacent to one or more keys associated with the existing touch point.

3. A method according to claim 2, wherein determining whether the data is associated with the existing touch point further comprises:

determining the data is not associated with the existing touch point when the data is not associated with any key adjacent to one or more keys associated with the existing touch point.

4. A method according to claim 2, wherein determining whether the data is associated with the existing touch point further comprises:

determining the data is associated with the existing touch point when the data is associated with any key adjacent to one or more keys associated with the existing touch point.

5. A method according to claim 1, further comprising deleting the existing touch point after a time period elapses without receiving input.

6. A method according to claim 1, further comprising updating a set of keys associated with the existing touch point.

7. A method according to claim 1, wherein the keyboard is an alphanumeric keyboard.

8. A method according to claim 1, wherein the computer is a mobile telephone.

9. A computer system comprising:

a keyboard;

a display displaying a user interface; and

a processor configured to;

receive data comprising one or more key-presses from the keyboard;

determine whether the data is associated with an existing touch point;

when the data is not associated with an existing touch point, determine that multi-touch input is present;

map the multi-touch input to coordinates in the user interface; and

control the user interface in accordance with the multi-touch input.

10. A computer system according to claim 9, wherein the processor being configured to determine whether the data is associated with the existing touch point includes the processor being configured to determine whether the data is associated with any key adjacent to one or more keys associated with the existing touch point.

11. A computer system according to claim 10, wherein the processor being configured to determine whether the data is associated with the existing touch point includes the processor being configured to determine the data is not associated with the existing touch point when the data is not associated with any key adjacent to one or more keys associated with the existing touch point.

12. A computer system according to claim 10, wherein the processor being configured to determine whether the data is associated with the existing touch point includes the processor being configured to determine the data is associated with the existing touch point when the data is associated with any key adjacent to one or more keys associated with the existing touch point.

13. A computer system according to claim 9, wherein the processor is further configured to delete the existing touch point after a time period elapses without receiving input.

14. A computer system according to claim 9, wherein the processor is further configured to update a set of keys associated with the existing touch point.

15. A computer system according to claim 9, wherein the keyboard is an alphanumeric keyboard.

16. A computer system according to claim 9, wherein the computer is a mobile telephone.

17. A tangible storage medium storing computer-readable instructions that when executed by one or more processors produce actions comprising:

receiving, at a computer, data comprising one or more key-presses from a keyboard;

determining whether the data is associated with an existing touch point;

when the data is not associated with an existing touch point, determine that multi-touch input is present;

mapping the multi-touch input to coordinates in a user interface; and

controlling the user interface in accordance with the multi-touch input.

18. A tangible storage medium according to claim 17, wherein determining whether the data is associated with the existing touch point comprises:

determining whether the data is associated with any key adjacent to one or more keys associated with the existing touch point.

19. A tangible storage medium according to claim 18, wherein determining whether the data is associated with the existing touch point further comprises:

determining the data is not associated with the existing touch point when the data is not associated with any key adjacent to one or more keys associated with the existing touch point.

20. A tangible storage medium according to claim 18, wherein determining whether the data is associated with the existing touch point further comprises:

determining the data is associated with the existing touch point when the data is associated with any key adjacent to one or more keys associated with the existing touch point.