Processing for distinguishing pen gestures and dynamic self-calibration of pen-based computing systems

• US 7,577,925 B2
• Filed: 04/08/2005
• Issued: 08/18/2009
• Est. Priority Date: 04/08/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Dodge, Steven P., Townsend, Reed, Zotov, Alexander J.
• Primary Examiner(s): HAILU, TADESSE
• Application Number:
  US11/101,647
• Publication Number:
  US 20060227116A1
• Time in Patent Office: 1,593 Days
• Field of Search: 715/863, 715/700, 345/173, 345/178, 345/156, 345/179, 382/186, 382/187
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and computer-readable media process and distinguish user input device gestures, such as gestures input via a pen in a pen-based computing system, e.g., to quickly and reliably distinguish between electronic ink entry, single taps, double taps, press-and-hold actions, dragging operations, and the like. Systems, methods, and computer-readable media also are provided for dynamically calibrating a computer system, e.g., calibrating a displayed input panel view based on input data recognized and received by a digitizer. Such systems and methods may operate without entering a dedicated or special calibration application, program, or routine.

Claims

1. A method implemented in a computing system, comprising:

running an application program on a computer system, the application program having associated therewith a gesture profile, the gesture profile defining an expected input gesture type to be received from the application for a pen input device and for a first portion of an input panel, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type in the first portion of an input panel, an excluded input gesture type in the first portion of an input panel, a preferential expected input gesture type in the first portion of an input panel, or a non-preferential expected input gesture type in the first portion an input panel,

the application program having associated therewith a second gesture profile, profile defining a second expected input gesture type to be received from the application for the pen input device and for a second portion of an input panel, wherein the second expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type in the second portion of an input panel, an excluded input gesture type in the second portion of an input panel, a preferential expected input gesture type in the second portion of an input panel, or a non-preferential expected input gesture type in the second portion an input panel, wherein the second expected input gesture type is different from the expected input gesture type;

sending the gesture profile from the application program to an operating system of the computer system;

sending the second gesture profile from the application program to the operating system of the computer system;

at the operating system using the gesture profile to set at least one gesture recognition parameter for use when receiving user input from a pen input device directed to the first portion of the input panel;

at the operating system receiving a user input from a pen input device from the application program directed to the first portion of the input panel; and

at the operating system using the set at least one gesture recognition parameter in handling the user input.

2. A method according to claim 1, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

3. A method according to claim 1, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

4. A method according to claim 1, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

5. A method according to claim 1, wherein the input panel includes a second portion independent of or at least partially included within the first portion, and

wherein the method further comprises setting at least one gesture recognition parameter for use when receiving user input directed toward the second portion of the input panel based on the sent second gesture profile.

6. A method according to claim 1, wherein the gesture recognition parameter includes at least one member selected from the group of:

a minimum pen movement threshold distance, a maximum pen movement threshold distance, a minimum pen-down threshold time, a maximum pen-down threshold time, a minimum consecutive pen-down spacing threshold distance, a maximum consecutive pen-down spacing threshold distance, a minimum consecutive pen-down time difference threshold, and a maximum consecutive pen-down time difference threshold.

7. A method according to claim 1, wherein the gesture profile is sent in response to user input directed toward or received at the first portion of the input panel.

8. A method according to claim 1, wherein the computer system is a pen-based computing system and the user input is pen input.

9. A computer-readable storage medium comprising computer-executable instructions stored thereon, the computer-executable instructions when executed by a computing system causing the computing system to perform a method, the method comprising:

running an application program on a computer system, the application program having associated therewith a gesture profile, the gesture profile defining an expected input gesture type to be received from the application for a pen input device and for a first portion of an input panel, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type in the first portion of an input panel, an excluded input gesture type in the first portion of an input panel, a preferential expected input gesture type in the first portion of an input panel, or a non-preferential expected input gesture type in the first portion an input panel,

the application program having associated therewith a second gesture profile, profile defining a second expected input gesture type to be received from the application for the pen input device and for a second portion of an input panel, wherein the second expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type in the second portion of an input panel, an excluded input gesture type in the second portion of an input panel, a preferential expected input gesture type in the second portion of an input panel, or a non-preferential expected input gesture type in the second portion an input panel, wherein the second expected input gesture type is different from the expected input gesture type;

sending the gesture profile from the application program to an operating system of the computer system;

sending the second gesture profile from the application program to the operating system of the computer system;

at the operating system using the gesture profile to set at least one gesture recognition parameter for use when receiving user input from a pen input device directed to the first portion of the input panel;

at the operating system receiving a user input from a pen input device from the application program directed to the first portion of the input panel; and

at the operating system using the set at least one gesture recognition parameter in handling the user input.

10. A method implemented in a computing system, comprising:

running an application program on a computer system, wherein at least a portion of an input panel associated with the application program is displayed by the computer system, and wherein the input panel includes at least a first input portion and a second input portion, the application program having associated therewith a gesture profile, the gesture profile comprising a first gesture profile for user inputs directed toward the first input portion, and the gesture profile comprising a second gesture profile for user inputs directed toward the second input portion, the gesture profile defining an expected input gesture type to be received from the application, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type, wherein the second gesture profile identifies an input gesture type different from an input gesture type identified in the first gesture profile;

receiving user input through the input panel;

determining if the user input is directed toward one of the first input portion or the second input portion;

sending the second gesture profile from the application program to the operating system of the computer system;

sending the gesture profile from the application program to the operating system of the computer system at least when it is determined that the user input is directed toward one of the first input portion or the second input portion,

at the operating system using the sent gesture profile to set at least one gesture recognition parameter;

at the operating system receiving a user input from the application program directed to the first portion of the input panel; and

at the operating system using the set at least one gesture recognition parameter in handling a user input.

11. A method according to claim 10, wherein the sent gesture profile is the first gesture profile, wherein the first gesture profile defines an expected input gesture type for the first portion of the input panel, and wherein the expected input gesture type includes at least one member selected from the group of:

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type.

12. A computer-readable storage medium comprising computer-executable instructions stored thereon, the computer-executable instructions when executed by a computing system causing the computing system to perform a method, the method comprising:

running an application program on a computer system, wherein at least a portion of an input panel associated with the application program is displayed by the computer system, and wherein the input panel includes at least a first input portion and a second input portion, the application program having associated therewith a gesture profile, the gesture profile comprising a first gesture profile for user inputs directed toward the first input portion, and the gesture profile comprising a second gesture profile for user inputs directed toward the second input portion, the gesture profile defining an expected input gesture type to be received from the application, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type, wherein the second gesture profile identifies an input gesture type different from an input gesture type identified in the first gesture profile;

receiving user input through the input panel;

determining if the user input is directed toward one of the first input portion or the second input portion;

sending the second gesture profile from the application program to the operating system of the computer system;

sending the gesture profile from the application program to the operating system of the computer system at least when it is determined that the user input is directed toward one of the first input portion or the second input portion,

at the operating system using the sent gesture profile to set at least one gesture recognition parameter;

at the operating system receiving a user input from the application program directed to the first portion of the input panel; and

at the operating system using the set at least one gesture recognition parameter in handling a user input.

13. A system, comprising:

an input system for receiving user input; and

a processor system programmed and adapted to;

run an application program, the application program having associated therewith a gesture profile, the gesture profile defining an expected input gesture type to be received from the application for a pen input device and for a first portion of an input panel, wherein the expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type in the first portion of an input panel, an excluded input gesture type in the first portion of an input panel, a preferential expected input gesture type, and a non-preferential expected input gesture type in the first portion of an input panel,

the application program having associated therewith a second gesture profile, profile defining a second expected input gesture type to be received from the application for the pen input device and for a second portion of an input panel, wherein the second expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type in the second portion of an input panel, an excluded input gesture type in the second portion of an input panel, a preferential expected input gesture type in the second portion of an input panel, or a non-preferential expected input gesture type in the second portion an input panel, wherein the second expected input gesture type is different from the expected input gesture type;

sense an input gesture by the user for the application program;

determine a target location of the gesture on an input panel;

receive at the operating system a gesture profile from the application program based on the target location,

set at the operating system at least one gesture recognition parameter for use when receiving user input directed to the first portion of the input panel based on the gesture profile; and

use at the operating system the set at least one gesture recognition parameter in handling the user input.

14. A system according to claim 13, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

15. A system according to claim 13, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

16. A system according to claim 13, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

17. A system according to claim 13, wherein the first portion of the input panel includes the second portion independent of or at least partially included within the first portion, and wherein the processor system is further programmed and adapted to:

(d) receive a second gesture profile from the application program, wherein the second gesture profile defines a second expected input gesture type for the second portion of the input panel, wherein the second expected input gesture type includes at least one member selected from the group of;

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type, and (e) set at least one gesture recognition parameter for use when receiving user input directed toward the second portion of the input panel based on the second gesture profile.

18. A system according to claim 13, wherein the gesture recognition parameter includes at least one member selected from the group of:

a minimum pen movement threshold distance, a maximum pen movement threshold distance, a minimum pen-down threshold time, a maximum pen-down threshold time, a minimum consecutive pen-down spacing threshold distance, a maximum consecutive pen-down spacing threshold distance, a minimum consecutive pen-down time difference threshold, and a maximum consecutive pen-down time difference threshold.

19. A system according to claim 13, wherein the application program sends the gesture profile in response to user input directed toward or received at the first portion of the input panel.

20. A system according to claim 13, wherein the system is a pen-based computing system and the user input is pen input.