Method and system for providing modifier key behavior through pen gestures

• US 7,477,233 B2
• Filed: 03/16/2005
• Issued: 01/13/2009
• Est. Priority Date: 03/16/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Pennington, Ernest L. II, Jarrett, Robert J., Davis, Shawna J., Russo, Thomas P., Duncan, Richard J., Keely, Leroy B., Viji, Sriram, Rimas-Ribikauskas, Emily K.
• Primary Examiner(s): Tran; Henry N
• Application Number:
  US11/082,628
• Publication Number:
  US 20060209014A1
• Time in Patent Office: 1,399 Days
• Field of Search: 345/156, 345/157, 345/161, 345/163, 345/168, 345/172, 345/173, 345/179, 715856-864
• US Class Current: 345/156
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Described is a system and method in which pen gestures cause a mode to be entered in which a computing device acts as if a modifier key (e.g., Control, Alt, or Shift) was being pressed. This is accomplished by a pen driver sending a modifier key down to the keyboard and mouse input subsystem. Modifier key behavior is thus provided, including at times when a keyboard is not readily available. While in the modifier key mode, additional gestures can be input, including a gesture that results in the computing device acting as if multiple modifier keys are pressed. Also, while in the mode, visual feedback may be provided to indicate the mode is active. The mode may be exited by sending a corresponding modifier key up, and the exit may be triggered in various ways, including by other gestures, mouse or pen events, and certain keyboard input.

Claims

1. In a computing device, a computer-implemented method comprising:

detecting a first gesture indicative of a first modifier key function, the first gesture being inputted by a pointing device;

sending modifier key down data corresponding to the first modifier key function to an input subsystem that is configured to receive keyboard input; and

in response, changing an operating mode of the computing device such that the first modifier key function is applied to input received subsequent to the first gesture.

2. The method of claim 1 further comprising, detecting an action that indicates the changed operating mode should be exited, and in response to the action, sending key up data corresponding to the first modifier key function to the input subsystem such that the first modifier key function is not applied to subsequent input.

3. The method of claim 1 further comprising:

detecting a second gesture indicative of a second modifier key function, the second gesture being inputted by a pointing device, and in response, sending modifier key down data corresponding to the second modifier key function to the input subsystem; and

changing the operating mode of the computing device such that the first modifier key function and the second modifier key function are applied to input received subsequent to the second gesture.

4. The method of claim 1 further comprising:

detecting an event corresponding to the first modifier key function, and in response, sending modifier key up data corresponding to the first modifier key function to the input subsystem such that the first modifier key function is not applied to subsequent input.

5. The method of claim 4 wherein the event results from at least one operation of a set of operations, the set including, detecting another gesture, detecting a pen down event, detecting a pen-up event, detecting a physical keyboard event, and detecting a soft keyboard event.

6. The method of claim 1 further comprising, outputting a visible indication representative of the operating mode change.

7. The method of claim 6 further comprising, delaying prior to outputting the visible indication.

8. The method of claim 6 wherein outputting the visible indication includes outputting data that identifies the first modifier key function.

9. The method of claim 6 wherein outputting the visible indication comprises, detecting the position of a mouse pointer, and positioning the visible indication based on the position of the mouse pointer such that the visible indication appears to move with the mouse pointer.

10. The method of claim 6 further comprising, detecting user interaction with the visible indication, and changing a state of the operating mode based on the interaction.

11. A computer storage medium having stored computer-executable instructions, which when executed perform steps, comprising:

detecting a first gesture indicative of a first modifier key function, the first gesture being inputted by a pointing device;

sending modifier key down data corresponding to the first modifier key function to an input subsystem that is configured to receive keyboard input; and

in response, changing an operating mode of the computing device such that the first modifier key function is applied to input received subsequent to the first gesture.

12. A computer storage medium of claim 11 having further computer-executable instructions, comprising:

outputting a visible indication representative of the modifier key down data having been sent; and

detecting an action that indicates that modifier key up data corresponding to the first modifier key function should be sent to the input subsystem, and in response, sending key up data corresponding to the first modifier key function to the input subsystem such that the first modifier key function is not applied to subsequent input.

13. The computer storage medium of claim 12 having further computer-executable instructions, comprising, delaying prior to outputting the visible indication.

14. The computer storage medium of claim 12 having further computer-executable instructions, comprising, detecting the position of a mouse pointer, and wherein outputting the visible indication comprises positioning the visible indication based on the position of the mouse pointer such that the visible indication appears to move with the mouse pointer.

15. The computer storage medium of claim 11 having further computer-executable instructions, comprising:

detecting a second gesture indicative of a second modifier key function, the second gesture being inputted by a pointing device, and in response, sending modifier key down data corresponding to the second modifier key function to the input subsystem; and

changing the operating mode of the computing device such that the first modifier key function and the second modifier key function are applied to input received subsequent to the second gesture.

16. In a computing device having a program, a system comprising:

a processor in communication with an input subsystem that processes keyboard and mouse input; and

a memory in communication with the processor and storing executable instruction which when executed by the processor implement a method for providing data to the input subsystem to change an operating mode of the computing device upon detection of a gesture corresponding to a modifier key function, the method comprising;

detecting a first gesture indicative of a first modifier key function, the first gesture being inputted by a pointing device;

sending modifier key down data corresponding to the first modifier key function to the input subsystem; and

in response, changing an operating mode of the computing device such that the first modifier key function is applied to input received subsequent to the first gesture.

17. The system of claim 16 wherein the memory further stores instructions for outputting a visible indication representative of the modifier key down data having been sent.

18. The system of claim 17 wherein outputting the visible indication is delayed for a threshold time after sending the modifier key down data.

19. The system of claim 16 wherein the modifier key function comprises one of the following:

a Control modifier key function, an Alt modifier key function, a Shift modifier key function, a Windows®

modifier key function, and an AltGr modifier key function.