PROCESSING FOR DISTINGUISHING PEN GESTURES AND DYNAMIC SELF-CALIBRATION OF PEN-BASED COMPUTING SYSTEMS

• US 20100017758A1
• Filed: 07/09/2009
• Published: 01/21/2010
• Est. Priority Date: 04/08/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Alexander J. Zotov, Reed Townsend, Steven P. Dodge
• Inventors: Dodge, Steven P., Townsend, Reed, Zotov, Alexander J.
• Granted Patent: US 8,539,383 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and computer-readable media process and distinguish user input device gestures, such as gestures input via a pen in a pen-based computing system, e.g., to quickly and reliably distinguish between electronic ink entry, single taps, double taps, press-and-hold actions, dragging operations, and the like. Systems, methods, and computer-readable media also are provided for dynamically calibrating a computer system, e.g., calibrating a displayed input panel view based on input data recognized and received by a digitizer. Such systems and methods may operate without entering a dedicated or special calibration application, program, or routine.

Claims

1. A system, comprising:

an input system for receiving user input; and

a processor system programmed and adapted to;

(a) run an application program, (b) render at least a portion of an input panel associated with the application program, wherein the input panel includes at least a first input portion and a second input portion, (c) determine if the user input is directed toward one of the first input portion or the second input portion, (d) receive a gesture profile from the application program at least when it is determined that the user input is directed toward one of the first input portion or the second input portion, wherein the gesture profile includes a first gesture profile when the user input is determined to be directed toward the first input portion, and wherein the gesture profile includes a second gesture profile when the user input is determined to be directed toward the second input portion, and (c) set at least one gesture recognition parameter based on the gesture profile.

2. A system according to claim 1, wherein the gesture profile is the first gesture profile, wherein the first gesture profile defines an expected input gesture type for the first portion of the input panel, and wherein the expected input gesture type includes at least one member selected from the group of:

an exclusive expected input gesture type, an excluded input gesture type, a preferential expected input gesture type, and a non-preferential expected input gesture type.

3. A system according to claim 1, wherein the user input is received via a user'"'"'s finger in contact with a touch screen of the input system.

4. A method, comprising:

receiving plural user inputs directed toward a first target located at a first position of an input panel;

determining first offset data for at least some of the plural user inputs directed toward the first target, wherein the first offset data indicates a difference in at least one of distance or direction between a visual location of the first target on a display device and a hardware location on a digitizer corresponding to the visual location of the first target;

receiving plural user inputs directed toward a second target located at a second position of the input panel;

determining second offset data for at least some of the plural user inputs directed toward the second target, wherein the second offset data indicates a difference in at least one of distance or direction between a visual location of the second target on the display device and a hardware location on the digitizer corresponding to the visual location of the second target;

determining if the first offset data differs from the second offset data by more than a threshold amount; and

changing at least some calibration data associated with the second position of the input panel in at least some instances when the first offset data differs from the second offset data by more than the threshold amount.

5. A method according to claim 4, wherein the plural user inputs directed toward the first target are received without entering a dedicated or special calibration application, program, or routine.

6. A method according to claim 5, wherein the plural user inputs directed toward the second target are received without entering a dedicated or special calibration application, program, or routine.

7. A method according to claim 4, wherein the plural user inputs directed toward the first target are received without entering a dedicated or special calibration application, program, or routine.

8. A method according to claim 4, wherein at least a portion of the plural user inputs are received via contact from a user'"'"'s finger with the input panel.

9. A computer-readable medium having stored thereon executable instructions that when executed by a system cause the system to perform a method, the method comprising:

receiving plural user inputs directed toward a first target located at a first position of an input panel;

determining first offset data for at least some of the plural user inputs directed toward the first target, wherein the first offset data indicates a difference in at least one of distance or direction between a visual location of the first target on a display device and a hardware location on a digitizer corresponding to the visual location of the first target;

receiving plural user inputs directed toward a second target located at a second position of the input panel;

determining second offset data for at least some of the plural user inputs directed toward the second target, wherein the second offset data indicates a difference in at least one of distance or direction between a visual location of the second target on the display device and a hardware location on the digitizer corresponding to the visual location of the second target;

determining if the first offset data differs from the second offset data by more than a threshold amount; and

changing at least some calibration data associated with the second position of the input panel in at least some instances when the first offset data differs from the second offset data by more than the threshold amount.

10. A method, comprising:

collecting offset data based on plural user inputs directed toward plural portions of an input panel, wherein the offset data indicates a difference in at least one of distance or direction between a visual location of a target on a display device for an individual user input and a hardware location on a digitizer corresponding to the respective visual location of the respective target of the respective individual user input, and wherein the plural user inputs are received without entering a dedicated or special calibration application, program, or routine; and

determining whether to change calibration data associated with at least one portion of the input panel based on the offset data.

11. A method according to claim 10, further comprising:

changing calibration data associated with a first portion of the input panel.

12. A method according to claim 11, wherein the calibration data associated with the first portion of the input panel is changed when the offset data associated with the first portion of the input panel differs by more than a threshold amount from the offset data associated with one or more other portions of the input panel.

13. A method according to claim 10, wherein collecting offset data based on plural user inputs directed toward plural portions of an input panel comprises receiving user input received via contact from a user'"'"'s finger with the input panel.

14. A computer-readable medium having stored thereon executable instructions that when executed by a system cause the system to perform a method, the method comprising:

collecting offset data based on plural user inputs directed toward plural portions of an input panel, wherein the offset data indicates a difference in at least one of distance or direction between a visual location of a target on a display device for an individual user input and a hardware location on a digitizer corresponding to the respective visual location of the respective target of the respective individual user input, and wherein the plural user inputs are received without entering a dedicated or special calibration application, program, or routine; and

determining whether to change calibration data associated with at least one portion of the input panel based on the offset data.

15. A system, comprising:

an input system, including a digitizer, for receiving user input directed toward a first target located at a first position of an input panel and for receiving user input directed toward a second target located at a second position of the input panel;

a display device for visually displaying at least a portion of the input panel; and

a processor system programmed and adapted to;

(a) determine first offset data for at least some of the user input directed toward the first target, wherein the first offset data indicates a difference in at least one of distance or direction between a visual location of the first target on the display device and a hardware location on the digitizer corresponding to the visual location of the first target, (b) determine second offset data for at least some of the user input directed toward the second target, wherein the second offset data indicates a difference in at least one of distance or direction between a visual location of the second target on the display device and a hardware location on the digitizer corresponding to the visual location of the second target;

(c) determine if the first offset data differs from the second offset data by more than a threshold amount, and (d) change at least some calibration data associated with the second position of the input panel in at least some instances when the first offset data differs from the second offset data by more than the threshold amount.

16. A system according to claim 15, wherein the user input directed toward the first target is received without entering a dedicated or special calibration application, program, or routine.

17. A system according to claim 16, wherein the user input directed toward the second target are received without entering a dedicated or special calibration application, program, or routine.

18. A system according to claim 15, wherein the user input directed toward the second target are received without entering a dedicated or special calibration application, program, or routine.

19. A system according to claim 15, wherein the input system for receiving user input is adapted to receive inputs via user'"'"'s finger contact with the input panel.

20. A system, comprising:

an input system, including a digitizer, for receiving user input directed toward plural portions of an input panel;

a display device for displaying at least a portion of the input panel; and

a processor system programmed and adapted to;

(a) collect offset data based on the user input, wherein the offset data indicates a difference in at least one of distance or direction between a visual location of a target on the display device for an individual user input and a hardware location on the digitizer corresponding to the respective visual location of the respective target for the respective individual user input, and wherein the user input is received without entering a dedicated or special calibration application, program, or routine, and (b) determine whether to change calibration data associated with at least one portion of the input panel based on the offset data.

21. A system according to claim 20, wherein the processor system is further programmed and adapted to change calibration data associated with a first portion of the input panel.

22. A system according to claim 21, wherein the processor system is further programmed and adapted to change calibration data associated with the first portion of the input panel when the offset data associated with the first portion of the input panel differs by more than a threshold amount from the offset data associated with one or more other portions of the input panel.

23. The system according to claim 20, wherein the input system for receiving user input is adapted to receive inputs via user'"'"'s finger contact with the input panel.