Processing for distinguishing pen gestures and dynamic self-calibration of pen-based computing systems

• US 9,588,590 B2
• Filed: 08/12/2013
• Issued: 03/07/2017
• Est. Priority Date: 04/08/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Zotov, Alexander J., Townsend, Reed, Dodge, Steven P.
• Primary Examiner(s): Hailu, Tadeese
• Application Number:
  US13/964,294
• Publication Number:
  US 20130326432A1
• Time in Patent Office: 1,303 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and computer-readable media process and distinguish user input device gestures, such as gestures input via a pen in a pen-based computing system, e.g., to quickly and reliably distinguish between electronic ink entry, single taps, double taps, press-and-hold actions, dragging operations, and the like. Systems, methods, and computer-readable media also are provided for dynamically calibrating a computer system, e.g., calibrating a displayed input panel view based on input data recognized and received by a digitizer. Such systems and methods may operate without entering a dedicated or special calibration application, program, or routine.

Claims

1. A system, comprising:

an input system configured to receive input; and

a processor coupled to memory, the memory having stored thereon executable instructions that when executed by the processor cause the processor to;

run an application program,

render at least a portion of an input panel associated with the application program, wherein the input panel includes at least a first input portion and a second input portion;

determine whether the input is directed toward one of the first input portion or the second input portion;

receive a gesture profile from the application program at least based on a determination that the input is directed toward one of the first input portion or the second input portion, wherein;

the gesture profile includes a first gesture profile in response to determining that the input is directed toward the first input portion,

the gesture profile includes a second gesture profile in response to determining that the input is directed toward the second input portion,

the first gesture profile defines an expected input type for the first portion and the second gesture profile defines an expected input type for the second input portion, and

for each of the first gesture profile and the second gesture profile, the expected input gesture type comprises at least one of a preferential expected input gesture type, and a non-preferential expected input gesture type; and

set at least one gesture recognition parameter based on the gesture profile.

2. The system of claim 1, wherein, for each of the first gesture profile and the second gesture profile, the expected input gesture type includes at least one member selected from the group of:

an exclusive expected input gesture type and an excluded input gesture type.

3. The system of claim 2, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

4. The system of claim 2, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

5. The system of claim 1, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

6. The system of claim 1, wherein the input is received via a user'"'"'s finger in contact with a touch screen of the input system.

7. A method, comprising:

running an application program on a computing device;

rendering at least a portion of an input panel associated with the application program, wherein the input panel includes at least a first input portion and a second input portion;

determining whether an input is directed toward one of the first input portion or the second input portion;

receiving a gesture profile from the application program at least based on a determination that the input is directed toward one of the first input portion or the second input portion, wherein

the gesture profile includes a first gesture profile in response to determining that the input is directed toward the first input portion,

the gesture profile includes a second gesture profile in response to determining that the input is directed toward the second input portion,

the first gesture profile defines an expected input type for the first portion and the second gesture profile defines an expected input type for the second input portion, and

for each of the first gesture profile and the second gesture profile, the expected input gesture type comprises at least one of a preferential expected input gesture type, and a non-preferential expected input gesture type; and

setting at least one gesture recognition parameter based on the gesture profile.

8. The method of claim 7, wherein, for each of the first gesture profile and the second gesture profile, the expected input gesture type includes at least one member selected from the group of:

an exclusive expected input gesture type and an excluded input gesture type.

9. The method of claim 8, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

10. The method of claim 8, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

11. The method of claim 7, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

12. The method of claim 7, wherein the input is received via a user'"'"'s finger in contact with a touch screen communicatively connected with the computing device.

13. A computer readable storage medium comprising computer executable instructions that when executed by a computing device, cause said computing device to perform operations comprising

running an application program;

rendering at least a portion of an input panel associated with the application program, wherein the input panel includes at least a first input portion and a second input portion;

determining whether an input is directed toward one of the first input portion or the second input portion;

receiving a gesture profile from the application program at least based on a determination that the input is directed toward one of the first input portion or the second input portion, wherein

the gesture profile includes a first gesture in response to determining that the input is directed toward the first input portion,

the gesture profile includes a second gesture in response to determining that the input is directed toward the second input portion,

the first gesture profile defines an expected input type for the first portion and the second gesture profile defines an expected input type for the second input portion, and

for each of the first gesture profile and the second gesture profile, the expected input gesture type comprises at least one of a preferential expected input gesture type and a non-preferential expected input gesture type; and

setting at least one gesture recognition parameter based on the gesture profile.

14. The computer readable storage medium of claim 13, wherein, for each of the first gesture profile and the second gesture profile, the expected input gesture type includes at least one member selected from the group of:

an exclusive expected input gesture type and an excluded input gesture type.

15. The computer readable storage medium of claim 14, wherein the exclusive expected input gesture type includes at least one member selected from the group of:

exclusive tap input and exclusive electronic ink input.

16. The computer readable storage medium of claim 13, wherein the preferential expected input gesture type includes at least one member selected from the group of:

preference for a tap input over electronic ink input, preference for a tap input over a dragging operation input, preference for a tap input over a press-and-hold operation input, preference for a single tap input directed toward two separate input panel portions over a double tap input directed toward a single input panel portion, preference for a press-and-hold operation input over electronic ink input, preference for electronic ink input over tap input, and preference for a press-and-hold operation input over a dragging operation input.

17. The computer readable storage medium of claim 14, wherein the excluded input gesture type includes at least one member selected from the group of:

electronic ink input not possible, tap input not possible, double tap input not possible, and a dragging operation input not possible.

18. The computer readable storage medium of claim 13, wherein the input is received via a user'"'"'s finger in contact with a touch screen.

19. The computer readable storage medium of claim 13, wherein the input is pen input.