Processing for distinguishing pen gestures and dynamic self-calibration of pen-based computing systems

• US 20060227116A1
• Filed: 04/08/2005
• Published: 10/12/2006
• Est. Priority Date: 04/08/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Dodge, Steven P., Townsend, Reed, Zotov, Alexander J.
• Granted Patent: US 7,577,925 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and computer-readable media process and distinguish user input device gestures, such as gestures input via a pen in a pen-based computing system, e.g., to quickly and reliably distinguish between electronic ink entry, single taps, double taps, press-and-hold actions, dragging operations, and the like. Systems, methods, and computer-readable media also are provided for dynamically calibrating a computer system, e.g., calibrating a displayed input panel view based on input data recognized and received by a digitizer. Such systems and methods may operate without entering a dedicated or special calibration application, program, or routine.

Claims

1. A method, comprising:

running an application program on a computer system;

sending a gesture profile from the application program to an operating system of the computer system, wherein the gesture profile defines an expected input gesture type for at least a first portion of an input panel for the application program, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type; and

setting at least one gesture recognition parameter for use when receiving user input directed to the first portion of the input panel based on the sent gesture profile.

2. A method according to claim 1, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

3. A method according to claim 1, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

4. A method according to claim 1, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

5. A method according to claim 1, wherein the input panel includes a second portion independent of or at least partially included within the first portion, and the method further includes:

sending a second gesture profile from the application program to the operating system, wherein the second gesture profile defines a second expected input gesture type for the second portion of the input panel, wherein the second expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type; and

setting at least one gesture recognition parameter for use when receiving user input directed toward the second portion of the input panel based on the sent second gesture profile.

6. A method according to claim 1, wherein the gesture recognition parameter includes at least one member selected from the group of:

a minimum pen movement threshold distance, a maximum pen movement threshold distance, a minimum pen-down threshold time, a maximum pen-down threshold time, a minimum consecutive pen-down spacing threshold distance, a maximum consecutive pen-down spacing threshold distance, a minimum consecutive pen-down time difference threshold, and a maximum consecutive pen-down time difference threshold.

7. A method according to claim 1, wherein the gesture profile is sent in response to user input directed toward or received at the first portion of the input panel.

8. A method according to claim 1, wherein the computer system is a pen-based computing system and the user input is pen input.

9. A computer-readable medium including computer-executable instructions stored thereon for performing the method of claim 1.

10. A method, comprising:

running an application program on a computer system, wherein at least a portion of an input panel associated with the application program is displayed by the computer system, and wherein the input panel includes at least a first input portion and a second input portion;

receiving user input through the input panel;

determining if the user input is directed toward one of the first input portion or the second input portion;

sending a gesture profile from the application program to an operating system of the computer system at least when it is determined that the user input is directed toward one of the first input portion or the second input portion, wherein the gesture profile includes a first gesture profile when the user input is determined to be directed toward the first input portion, and wherein the gesture profile includes a second gesture profile when the user input is determined to be directed toward the second input portion; and

setting at least one gesture recognition parameter based on the sent gesture profile.

11. A method according to claim 10, wherein the sent gesture profile is the first gesture profile, wherein the first gesture profile defines an expected input gesture type for the first portion of the input panel, and wherein the expected input gesture type includes at least one member selected from the group of:

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type.

12. A computer-readable medium including computer-executable instructions stored thereon for performing the method of claim 10.

13. A system, comprising:

an input system for receiving user input; and

a processor system programmed and adapted to;

(a) run an application program, (b) receive a gesture profile from the application program, wherein the gesture profile defines an expected input gesture type for at least a first portion of an input panel for the application program, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type, and (c) set at least one gesture recognition parameter for use when receiving user input directed to the first portion of the input panel based on the gesture profile.

14. A system according to claim 13, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

15. A system according to claim 13, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

16. A system according to claim 13, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

17. A system according to claim 13, wherein the input panel includes a second portion independent of or at least partially included within the first portion, and wherein the processor system is further programmed and adapted to:

(d) receive a second gesture profile from the application program, wherein the second gesture profile defines a second expected input gesture type for the second portion of the input panel, wherein the second expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type, and (e) set at least one gesture recognition parameter for use when receiving user input directed toward the second portion of the input panel based on the second gesture profile.

18. A system according to claim 13, wherein the gesture recognition parameter includes at least one member selected from the group of:

a minimum pen movement threshold distance, a maximum pen movement threshold distance, a minimum pen-down threshold time, a maximum pen-down threshold time, a minimum consecutive pen-down spacing threshold distance, a maximum consecutive pen-down spacing threshold distance, a minimum consecutive pen-down time difference threshold, and a maximum consecutive pen-down time difference threshold.

19. A system according to claim 13, wherein the application program sends the gesture profile in response to user input directed toward or received at the first portion of the input panel.

20. A system according to claim 13, wherein the system is a pen-based computing system and the user input is pen input.

21-38. -38. (canceled)