Method and system for providing modifier key behavior through pen gestures

• US 20060209014A1
• Filed: 03/16/2005
• Published: 09/21/2006
• Est. Priority Date: 03/16/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Jarrett, Robert J., Davis, Shawna J., Russo, Thomas P., Duncan, Richard J., Keely, Leroy B., Viji, Sriram, Rimas-Ribikauskas, Emily K., Pennington, Ernest L. II
• Granted Patent: US 7,477,233 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Described is a system and method in which pen gestures cause a mode to be entered in which a computing device acts as if a modifier key (e.g., Control, Alt, or Shift) was being pressed. This is accomplished by a pen driver sending a modifier key down to the keyboard and mouse input subsystem. Modifier key behavior is thus provided, including at times when a keyboard is not readily available. While in the modifier key mode, additional gestures can be input, including a gesture that results in the computing device acting as if multiple modifier keys are pressed. Also, while in the mode, visual feedback may be provided to indicate the mode is active. The mode may be exited by sending a corresponding modifier key up, and the exit may be triggered in various ways, including by other gestures, mouse or pen events, and certain keyboard input.

Claims

1. In a computing device, a computer-implemented method comprising:

detecting a gesture indicative of a mode change; and

changing an operating mode of the computing device in response to the gesture.

2. The method of claim 1 wherein changing the operating mode comprises taking action to simulate a modifier key being held down.

3. The method of claim 2 further comprising, detecting another gesture corresponding to another modifier key, and in response, taking action to simulate the other modifier key being held down.

4. The method of claim 2 further comprising, detecting another event corresponding to the modifier key, and in response, taking action to simulate the modifier key being released.

5. The method of claim 4 wherein the other event results from at least one operation of a set of operations, the set including, detecting another gesture, detecting a pen down event, detecting a pen-up event, detecting a physical keyboard event, and detecting a soft keyboard event.

6. The method of claim 1 further comprising, outputting a visible indication representative of the operating mode change.

7. The method of claim 6 further comprising, delaying prior to outputting the visible indication.

8. The method of claim 6 wherein changing an operating mode comprises taking action to simulate a modifier key being held down, and wherein outputting the visible indication includes outputting data that identifies the modifier key.

9. The method of claim 6 wherein outputting the visible indication comprises, detecting the position of a mouse pointer, and positioning the visible indication based on the position of the mouse pointer such that the visible indication appears to move with the mouse pointer.

10. The method of claim 6 further comprising, detecting user interaction with the visible indication, and changing a state of modifier key behavior based on the interaction.

11. The method of claim 1 wherein changing the operating mode comprises sending key down data to an input subsystem that is configured to received keyboard input, and further comprising, detecting an action that indicates the changed operating mode should be exited, and in response to the action, sending key up data to the input subsystem.

12. A computer-readable medium having computer-executable instructions, which when executed perform the method of claim 1.

13. A computer-readable medium having computer-executable instructions, which when executed perform steps, comprising:

detecting a gesture indicative of a modifier key;

sending modifier key down data to an input subsystem that is configured to received keyboard input;

outputting a visible indication representative of the modifier key down data having been sent; and

detecting an action that indicates that modifier key up data should be sent to the input subsystem, and in response, sending key up data to the input subsystem.

14. The computer-readable medium of claim 13 having further computer-executable instructions, comprising, detecting another gesture corresponding to another modifier key, and in response, sending other modifier key down data to the input subsystem.

15. The computer-readable medium of claim 13 having further computer-executable instructions, comprising, delaying prior to outputting the visible indication.

16. The computer-readable medium of claim 13 having further computer-executable instructions, comprising, detecting the position of a mouse pointer, and wherein outputting the visible indication comprises positioning the visible indication based on the position of the mouse pointer such that the visible indication appears to move with the mouse pointer.

17. In a computing device having a program, a system comprising:

an input subsystem that processes keyboard and mouse input, including modifying keyboard and mouse input when at least one modifier key is in a down state; and

a gesture management mechanism coupled to the input subsystem to provide data to the input subsystem to put a modifier key in a down state upon detection of a gesture corresponding to the modifier key.

18. The system of claim 17 further comprising means for outputting a visible indication when the modifier key is in a down state.

19. The system of claim 18 further comprising means for monitoring the input subsystem so as to output the visible indication in response to the modifier key being down from non-gesture means, and means for delaying the output of the visible indication until the modifier key is in a down state for a threshold time.

20. The system of claim 17 wherein the gesture management mechanism recognizes the gesture corresponding to the modifier key from at least one modifier key gesture of a set, the set containing a Control modifier key gesture, an Alt modifier key gesture, a Shift modifier key gesture, a Windows®

modifier key gesture and an AltGr modifier key gesture.