User interface control using a keyboard

• US 9,851,809 B2
• Filed: 03/14/2016
• Issued: 12/26/2017
• Est. Priority Date: 02/26/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: LaFave, Harper, Hodges, Stephen, Scott, James, Izadi, Shahram, Molyneaux, David, Villar, Nicolas, Butler, David Alexander, Hazas, Mike
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US15/069,593
• Publication Number:
  US 20160195936A1
• Time in Patent Office: 652 Days
• Field of Search: 345156-178, 178 1801- 1807, 178 2001- 2004
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof

Abstract

User interface control using a keyboard is described. In an embodiment, a user interface displayed on a display device is controlled using a computer connected to a keyboard. The keyboard has a plurality of alphanumeric keys that can be used for text entry. The computer receives data comprising a sequence of key-presses from the keyboard, and generates for each key-press a physical location on the keyboard. The relative physical locations of the key-presses are compared to calculate a movement path over the keyboard. The movement path describes the path of a user'"'"'s digit over the keyboard. The movement path is mapped to a sequence of coordinates in the user interface, and the movement of an object displayed in the user interface is controlled in accordance with the sequence of coordinates.

Claims

1. A computer system comprising:

a keyboard;

a display displaying a user interface; and

a processor configured to;

receive data comprising one or more key-activations from the keyboard;

determine that the data is not associated with an existing touch point location on the keyboard;

based on determining that the data is not associated with the existing touch point location on the keyboard, determine that multi-touch input is present; and

control the user interface in accordance with the multi-touch input.

2. A computer system according to claim 1, wherein the processor being configured to determine whether the data is associated with the existing touch point location on the keyboard includes the processor being configured to determine whether the data is associated with any key adjacent to one or more keys associated with the existing touch point location on the keyboard.

3. A computer system according to claim 2, wherein the processor being configured to determine whether the data is associated with the existing touch point location on the keyboard includes the processor being configured to determine the data is not associated with the existing touch point location on the keyboard when the data is not associated with any key adjacent to one or more keys associated with the existing touch point location on the keyboard.

4. A computer system according to claim 2, wherein the processor being configured to determine whether the data is associated with the existing touch point location on the keyboard includes the processor being configured to determine the data is associated with the existing touch point location on the keyboard when the data is associated with any key adjacent to one or more keys associated with the existing touch point location on the keyboard.

5. A computer system according to claim 1, wherein the processor is further configured to delete the existing touch point location on the keyboard after a time period elapses without receiving input.

6. A computer system according to claim 1, wherein the processor is further configured to update a set of keys associated with the existing touch point location on the keyboard.

7. A computer system according to claim 1, wherein the keyboard is an alphanumeric keyboard.

8. A computer system according to claim 1, wherein the computer system is a mobile telephone.

9. A tangible storage medium storing computer-readable instructions that when executed by one or more processors produce actions comprising:

receiving, at a computer, data comprising one or more key-activations from a keyboard;

determining that the data is not associated with an existing touch point location on the keyboard;

when the data is not associated with the existing touch point location on the keyboard, determine that multi-touch input is present; and

controlling a user interface in accordance with the multi-touch input.

10. A tangible storage medium according to claim 9, wherein determining whether the data is associated with the existing touch point location on the keyboard comprises:

determining whether the data is associated with any key adjacent to one or more keys associated with the existing touch point.

11. A tangible storage medium according to claim 10, wherein determining whether the data is associated with the existing touch point location on the keyboard further comprises:

determining the data is not associated with the existing touch point location on the keyboard when the data is not associated with any key adjacent to one or more keys associated with the existing touch point location on the keyboard.

12. A method of operating a user interface, the method comprising:

receiving, at a computer, data comprising one or more key-activations from a keyboard;

determining that the data is not associated with an existing touch point location on a keyboard;

based on the data not being associated with the existing touch point location on the keyboard, determining that multi-touch input is present; and

controlling the user interface in accordance with the multi-touch input.

13. A method according to claim 12, wherein determining whether the data is associated with the existing touch point location on the keyboard comprises:

determining whether the data is associated with any key adjacent to one or more keys associated with the existing touch point location on the keyboard.

14. A method according to claim 13, wherein determining whether the data is associated with the existing touch point location on the keyboard further comprises:

determining the data is not associated with the existing touch point location on the keyboard when the data is not associated with any key adjacent to one or more keys associated with the existing touch point location on the keyboard.

15. A method according to claim 13, wherein determining whether the data is associated with the existing touch point location on the keyboard further comprises:

determining the data is associated with the existing touch point location on the keyboard when the data is associated with any key adjacent to one or more keys associated with the existing touch point on the keyboard.

16. A method according to claim 12, further comprising deleting the existing touch point location on the keyboard after a time period elapses without receiving input.

17. A method according to claim 12, further comprising updating a set of keys associated with the existing touch point location on the keyboard.

18. A method according to claim 12, wherein the keyboard is an alphanumeric keyboard.

19. A method according to claim 12, wherein the computer is a mobile telephone.

20. The method of claim 12, further comprising mapping the multi-touch input to coordinates in the user interface.