Computer interaction based upon a currently active input device

• US 20060209016A1
• Filed: 03/17/2005
• Published: 09/21/2006
• Est. Priority Date: 03/17/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Jarrett, Robert J., Keely, Leroy B., Fox, Eric B., Rimas-Ribikauskas, Emily K.
• Granted Patent: US 7,802,202 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Described is a computer-implemented system and method that dynamically detects which input device (e.g., pen or mouse) is currently in use, and based on the device, varies a program'"'"'s user interaction model to better optimize the user'"'"'s ability to interact with the program via that input device. A tablet input subsystem receives pen and touch data, and also obtains keyboard and mouse data. The subsystem analyzes the data and determines which input device is currently active. The active device is mapped to an interaction model, whereby different user interface appearances, behaviors and the like may be presented to the user to facilitate improved interaction. For example, a program may change the size of user interface elements to enable the user to more accurately scroll and make selections. Timing, tolerances and thresholds may change. Pen hovering can become active, and interaction events received at the same location can be handled differently.

Claims

1. In a computing device, a computer-implemented method, comprising:

detecting, dynamically during runtime, which input device of a plurality of input devices of the computing device is a currently active input device; and

modifying a user interaction model based on the currently active device.

2. The method of claim 1 wherein detecting which input device is the currently active input device comprises identifying the input device based on received input data.

3. The method of claim 1 wherein detecting which input device is a currently active device comprises detecting input data from at least two devices, and selecting as the currently active device an input device that was most recently used.

4. The method of claim 1 wherein detecting which input device is a currently active device comprises detecting input data from at least two devices, and selecting as the currently active device an input device that is providing input after a threshold time.

5. The method of claim 1 wherein modifying the user interaction model comprises providing visible, audible and/or tactile feedback to a user.

6. The method of claim 1 wherein modifying the user interaction model comprises changing an appearance of a cursor and/or a user interface element.

7. The method of claim 1 wherein modifying the user interaction model comprises changing a size of a user interface element to cover a different interactive area, wherein the element comprises at least one element of a set, the set containing, a scrollbar user interface element, a menu selection user interface element, a button user interface element, an icon user interface element, text, a link, a radio button user interface element, and a check box user interface element.

8. The method of claim 1 wherein modifying the user interaction model comprises changing at least one data value of a set of data, the set including appearance, timing, tolerance and threshold data.

9. The method of claim 1 wherein modifying the user interaction model comprises handling input received at a same location differently based upon the currently active device.

10. The method of claim 1 wherein detecting which input device of the plurality of input devices is the currently active input device comprises, selecting an input device from the plurality, the plurality including at least two of, a touch digitizer, a pen digitizer, a mouse, a keyboard, a microphone, a camera and a television-style remote control device.

11. A computer-readable medium having computer-executable instructions, which when executed perform the process of claim 1.

12. A computer-readable medium having computer-executable instructions, which when executed perform steps, comprising:

outputting a user interface from a program;

receiving user input directed to the user interface via a first user input device;

receiving user input directed to the user interface via a second user input device; and

modifying the user interface output from the program based on a detected change from the first user input device to the second user input device.

13. The computer-readable medium of claim 12 wherein modifying the user interface comprises providing visible, audible and/or tactile feedback to a user.

14. The computer-readable medium of claim 12 wherein modifying the user interface comprises changing an appearance of a cursor.

15. The computer-readable medium of claim 12 wherein modifying the user interface comprises changing a size of a user interface element to cover a different interactive area.

16. The computer-readable medium of claim 12 wherein modifying the user interface comprises changing at least one data value of a set of data, the set including timing, tolerance and threshold data.

17. The computer-readable medium of claim 12 wherein modifying the user interface comprises handling input received at a same location differently based upon the currently active device.

18. In a computing device, a system comprising:

an executing program with which a user interacts via one of a plurality of interaction models;

a plurality of input devices;

means for selecting one of the plurality of input devices as a currently active input device; and

means for mapping an interaction model to the currently active input device.

19. The system of claim 18 wherein one input device comprises a pen digitizer, and another input device comprises a mouse, and wherein the interaction model that is mapped to the pen digitizer attempts to optimize for pen input based upon whether a user is right-handed or left-handed.

20. The system of claim 18 wherein one input device comprises a pen digitizer, and another input device comprises a mouse, and wherein the interaction model that is mapped to the pen digitizer modifies at least one user interface element based on detecting pen hover.