Detection of a dwell gesture by examining parameters associated with pen motion

• US 7,256,773 B2
• Filed: 06/09/2003
• Issued: 08/14/2007
• Est. Priority Date: 06/09/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lerner, Matt, Somji, Shiraz, Kolmykov-Zotov, Alexander J.
• Primary Examiner(s): Lefkowitz; Sumati
• Assistant Examiner(s): Beck; Alexander S.
• Application Number:
  US10/456,632
• Publication Number:
  US 20040246240A1
• Time in Patent Office: 1,527 Days
• Field of Search: 345/179
• US Class Current: 345/179
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and computer-readable media are used to determine whether specific electronic pen gestures with respect to pen-based computing systems should be processed as “press-and-hold” gestures (e.g., to activate right mouse button click actions). Such methods may include: (a) measuring two different parameters associated with pen interaction or orientation with respect to a digitizer during a pen-down event; and (b) determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the measured parameters. In some instances, if the systems and methods cannot immediately determine whether a press-and-hold gesture is intended, measurements may be made again (as many times as necessary or until a time-out occurs) such that the determining step can be performed one or more additional times taking into consideration the additional parameter measurement data collected since the original parameter measurements. Additionally, standards for determining whether a dwell gesture constitutes a press-and-hold gesture may be set and/or adjusted, taking into consideration features associated with a specific user'"'"'s use of the pen-based computing system (e.g., customization of standards based on model user input and/or a user'"'"'s past performance of press-and-hold actions).

Claims

1. A method, comprising:

(a) measuring values of a first parameter associated with pen interaction or orientation with respect to a digitizer over a first predetermined time period during a pen-down event;

(b) measuring values of a second parameter associated with pen interaction or orientation with respect to the digitizer over the first predetermined time period during the pen-down event, wherein the second parameter differs from the first parameter;

(c) comparing the first parameter values and the second parameter values to predetermined parameter values corresponding to a press-and-hold gesture;

(d) at the end of the first predetermined time period, based on said comparison, determining whether (i) the pen-down event constitutes a press-and-hold gesture, (ii) the pen-down event does not constitute a press-and-hold gesture, or (iii) the first and the second parameter values provide insufficient data for determining whether the pen-down event constitutes a press-and-hold gesture;

(e) when the first and the second parameter values provide insufficient data for determining whether the pen-down event constitutes a press-and-hold gesture in the first predetermined time period, repeating at least steps (a), (b), and (c) over a second predetermined time period with additional data collected relating to the first parameter and the second parameter since the previous measurings during steps (a) and (b); and

(f) when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture.

2. A method according to claim 1, wherein at least one of the first parameter and the second parameter comprises a pen steadiness parameter based on a plurality of pen steadiness measurements taken for a plurality of time intervals.

3. A method according to claim 1, wherein the first parameter comprises a pen steadiness parameter based on a steadiness factor.

4. A method according to claim 1, wherein at least one of the first parameter and the second parameter includes a stroke width to height ratio.

5. A method according to claim 4, wherein when the stroke width to height ratio exceeds a predetermined value, the pen-down event is determined not to constitute a press-and-hold gesture.

6. A method according to claim 1, wherein the determining whether the pen-down event constitutes a press-and-hold gesture is based, at least in part, on the previous measurements during steps (a) and (b).

7. A method according to claim 1, further comprising:

adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

8. A method according to claim 1, further comprising:

setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

9. A method according to claim 1, wherein at least one of the first parameter and the second parameter includes at least one member selected from the group of:

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

10. A method according to claim 1, wherein measuring the first parameter and measuring the second parameter over the first predetermined time period comprises performing a plurality of measurements of the first parameter and the second parameter at multiple time intervals during the first predetermined time period.

11. A system, comprising:

a digitizer for receiving input; and

a processor for;

(a) measuring values of a first parameter associated with pen interaction or orientation with respect to the digitizer over a first predetermined time period during a pen-down event, (b) measuring values of a second parameter associated with pen interaction or orientation with respect to the digitizer over the first predetermined time period during the pen-down event, wherein the second parameter differs from the first parameter, (c) comparing the first parameter values and the second parameter values to predetermined parameter values corresponding to a press-and-hold gesture, (d) at the end of the first predetermined time period, based on said comparison, determining whether (i) the pen-down event constitutes a press-and-hold gesture, (ii) the pen-down event does not constitute a press-and-hold gesture, or (iii) the first and the second parameter values provide insufficient data for determining whether the pen-down event constitutes a press-and-hold gesture;

(e) when the first and the second parameter values provide insufficient data for determining whether the pen-down event constitutes a press-and-hold gesture in the first predetermined time period, repeating at least steps (a), (b), and (c) over a second predetermined time period with additional data collected relating to the first parameter and the second parameter since the previous measurings during steps (a) and (b), and (f) when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture.

12. A system according to claim 11, wherein at least one of the first parameter and the second parameter comprises a pen steadiness parameter based on a plurality of pen steadiness measurements taken for a plurality of time intervals.

13. A system according to claim 11, wherein the first parameter comprises a pen steadiness parameter based on a steadiness factor.

14. A system according to claim 11, wherein at least one of the first parameter and the second parameter includes a stroke width to height ratio.

15. A system according to claim 14, wherein when the stroke width to height ratio exceeds a predetermined value, the processor determines that the pen-down event does not constitute a press-and-hold gesture.

16. A system according to claim 11, wherein the determining whether the pen-down event constitutes a press-and-hold gesture is based, at least in part, on the previous measurements during steps (a) and (b).

17. A system according to claim 11, further comprising:

means for adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

18. A system according to claim 11, further comprising:

means for setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

19. A system according to claim 11, wherein at least one of the first parameter and the second parameter includes at least one member selected from the group of:

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

20. A system according to claim 11, wherein measuring the first parameter and measuring the second parameter over the first predetermined time period comprises performing a plurality of measurements of the first parameter and the second parameter at multiple time intervals during the first predetermined time period.

21. A computer-readable medium including computer-executable instructions stored thereon for performing a method, comprising:

(a) measuring values of a first parameter associated with pen interaction or orientation with respect to a digitizer over a first predetermined time period during a pen-down event;

(b) measuring values of a second parameter associated with pen interaction or orientation with respect to the digitizer over the first predetermined time period during the pen-down event, wherein the second parameter differs from the first parameter;

(c) comparing the first parameter values and the second parameter values to predetermined parameter values corresponding to a press-and-hold gesture;

(d) at the end of the first predetermined time period, based on said comparison, determining whether (i) the pen-down event constitutes a press-and-hold gesture, (ii) the pen-down event does not constitute a press-and-hold gesture, or (iii) the first and the second parameter values provide insufficient data for determining whether the pen-down event constitutes a press-and-hold gesture;

(e) when the first and the second parameter values provide insufficient data for determining whether the pen-down event constitutes a press-and-hold gesture in the first predetermined time period, repeating at least steps (a), (b), and (c) over a second predetermined time period with additional data collected relating to the first parameter and the second parameter since the previous measurings during steps (a) and (b); and

(f) when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture.

22. A computer-readable medium according to claim 21, wherein at least one of the first parameter and the second parameter comprises a pen steadiness parameter based on a plurality of pen steadiness measurements taken for a plurality of time intervals.

23. A computer-readable medium according to claim 21, wherein the first parameter comprises a pen steadiness parameter based on a steadiness factor.

24. A computer-readable medium according to claim 21, wherein at least one of the first parameter and the second parameter includes a stroke width to height ratio.

25. A computer-readable medium according to claim 24, wherein when the stroke width to height ratio exceeds a predetermined value, the pen-down event is determined not to constitute a press-and-hold gesture.

26. A computer-readable medium according to claim 21, wherein the determining whether the pen-down event constitutes a press-and-hold gesture is based, at least in part, on the previous measurements during steps (a) and (b).

27. A computer-readable medium according to claim 21, wherein the method further comprises adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

28. A computer-readable medium according to claim 21, wherein the method further comprises setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

29. A computer-readable medium according to claim 21, wherein at least one of the first parameter and the second parameter includes at least one member selected from the group of:

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

30. A computer-readable medium according to claim 21, wherein measuring the first parameter and measuring the second parameter over the first predetermined time period comprises performing a plurality of measurements of the first parameter and the second parameter at multiple time intervals during the first predetermined time period.

31. A method, comprising:

performing a first plurality of measurements over a first predetermined time period of at least one parameter associated with pen interaction with respect to a digitizer during a pen-down event;

after completion of the first predetermined time period, determining based on the first plurality of measurements if the pen-down event constitutes a press-and-hold gesture;

when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture; and

when the pen-down event is determined to provide insufficient data to determine if the event constitutes a press-and-hold gesture, performing the additional steps of;

performing a second plurality of measurements over a second predetermined time period of the at least one parameter during the pen-down event; and

after completion of the second predetermined time period, determining based at least in part on the second plurality of measurements whether the pen-down event constitutes a press-and-hold gesture.

32. The method of claim 31, wherein the at least one parameter includes a pen steadiness parameter based on a plurality of pen steadiness measurements taken for a plurality of time intervals.

33. The method of claim 31, wherein the at least one parameter includes a pen steadiness parameter based on a steadiness factor.

34. The method of claim 31, wherein the at least one parameter includes a stroke width to height ratio.

35. The method of claim 31, wherein after completion of the second predetermined time period, the determining if the pen-down event constitutes a press-and-hold gesture is based at least in part on the first plurality of measurements and the second plurality of measurements.

36. The method of claim 31, wherein the determining if the pen-down event constitutes a press-and-hold gesture is based at least in part on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

37. The method of claim 31, further comprising:

setting at least one standard for determining if the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

38. The method of claim 31, wherein the at least one parameter includes at least one member selected from the group of:

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

39. The method of claim 31, wherein the at least one parameter includes a pen angle parameter.

40. The method of claim 31, wherein the at least one parameter includes a pen pressure parameter.

41. A computer-readable medium including computer-executable instructions stored thereon for performing a method, comprising:

performing a first plurality of measurements over a first predetermined time period of at least one parameter associated with pen interaction with respect to a digitizer during a pen-down event;

after the completion of the first predetermined time period, determining based on the first plurality of measurements if the pen-down event constitutes a press-and-hold gesture;

when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture; and

when the pen-down event is determined to provide insufficient data to determine if the event constitutes a press-and-hold gesture, performing the additional steps of;

performing a second plurality of measurements over a second predetermined time period of the at least one parameter during the pen-down event; and

after completion of the second predetermined time period, determining based at least in part on the second plurality of measurements whether the pen-down event constitutes a press-and-hold gesture.

42. The computer-readable medium of claim 41, wherein the at least one parameter includes a pen steadiness parameter based on a plurality of pen steadiness measurements taken for a plurality of time intervals.

43. The computer-readable medium of claim 41, wherein the at least one parameter includes a pen steadiness parameter based on a steadiness factor.

44. The computer-readable medium of claim 41, wherein the at least one parameter includes a stroke width to height ratio.

45. The computer-readable medium of claim 41, wherein after completion of the second predetermined time period, the determining if the pen-down event constitutes a press-and-hold gesture is based at least in part on the first plurality of measurements and the second plurality of measurements.

46. The computer-readable medium of claim 41, wherein the determining if the pen-down event constitutes a press-and-hold gesture is based at least in part on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

47. The computer-readable medium of claim 41, further comprising:

setting at least one standard for determining if the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

48. The computer-readable medium of claim 41, wherein the at least one parameter includes at least one member selected from the group of:

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

49. The computer-readable medium of claim 41, wherein the at least one parameter includes a pen angle parameter.

50. The computer-readable medium of claim 41, wherein the at least one parameter includes a pen pressure parameter.

51. A system, comprising:

a digitizer for receiving input; and

a processor for;

performing a first plurality of measurements over a first predetermined time period of at least one parameter associated with pen interaction with respect to a digitizer during a pen-down event;

after the completion of the first predetermined time period, determining based on the first plurality of measurements if the pen-down event constitutes a press-and-hold gesture;

when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture; and

when the pen-down event is determined to provide insufficient data to determine if the event constitutes a press-and-hold gesture, performing the additional steps of;

performing a second plurality of measurements over a second predetermined time period of the at least one parameter during the pen-down event; and

after completion of the second predetermined time period, determining based at least in part on the second plurality of measurements whether the pen-down event constitutes a press-and-hold gesture.

52. The system of claim 51, wherein the at least one parameter includes a pen steadiness parameter based on a plurality of pen steadiness measurements taken for a plurality of time intervals.

53. The system of claim 51, wherein the at least one parameter includes a pen steadiness parameter based on a steadiness factor.

54. The system of claim 51, wherein the at least one parameter includes a stroke width to height ratio.

55. The system of claim 51, wherein after completion of the second predetermined time period, the determining if the pen-down event constitutes a press-and-hold gesture is based at least in part on the first plurality of measurements and the second plurality of measurements.

56. The system of claim 51, wherein the determining if the pen-down event constitutes a press-and-hold gesture is based at least in part on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

57. The system of claim 51, the processor further sets at least one standard for determining if the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

58. The system of claim 51, wherein the at least one parameter includes at least one member selected from the group of:

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

59. The system of claim 51, wherein the at least one parameter includes a pen angle parameter.

60. The system of claim 51, wherein the at least one parameter includes a pen pressure parameter.