Detection of a dwell gesture by examining parameters associated with pen motion

• US 20040246240A1
• Filed: 06/09/2003
• Published: 12/09/2004
• Est. Priority Date: 06/09/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lerner, Matt, Somji, Shiraz, Kolmykov-Zotov, Alexander J.
• Granted Patent: US 7,256,773 B2
• Time in Patent Office: Days
• US Class Current: 345/179
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems, methods, and computer-readable media are used to determine whether specific electronic pen gestures with respect to pen-based computing systems should be processed as “press-and-hold” gestures (e.g., to activate right mouse button click actions). Such methods may include: (a) measuring two different parameters associated with pen interaction or orientation with respect to a digitizer during a pen-down event; and (b) determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the measured parameters. In some instances, if the systems and methods cannot immediately determine whether a press-and-hold gesture is intended, measurements may be made again (as many times as necessary or until a time-out occurs) such that the determining step can be performed one or more additional times taking into consideration the additional parameter measurement data collected since the original parameter measurements. Additionally, standards for determining whether a dwell gesture constitutes a press-and-hold gesture may be set and/or adjusted, taking into consideration features associated with a specific user'"'"'s use of the pen-based computing system (e.g., customization of standards based on model user input and/or a user'"'"'s past performance of press-and-hold actions).

Claims

1. A method, comprising:

measuring a first parameter associated with pen interaction or orientation with respect to a digitizer during a pen-down event;

measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter; and

determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter.

2. A method according to claim 1, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

3. A method according to claim 1, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

4. A method according to claim 3, wherein the information regarding stroke size includes a stroke width to height ratio.

5. A method according to claim 4, wherein when the stroke width to height ratio exceeds a predetermined value, the pen-down event is determined not to constitute a press-and-hold gesture.

6. A method according to claim 1, wherein when the pen-down event is not determined to constitute a press-and-hold gesture, the method further comprises:

measuring the first parameter a second time;

measuring the second parameter a second time; and

determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the second measurings of the first parameter and the second parameter.

7. A method according to claim 1, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the pen-down event is determined, in at least some instances, to constitute a selection action.

8. A method according to claim 1, further comprising:

adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

9. A method according to claim 1, further comprising:

setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

10. A method according to claim 1, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

11. A method according to claim 1, further comprising:

determining whether the pen-down event is continuing; and

determining that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.

12. A method, comprising:

(a) measuring a first parameter associated with pen interaction or orientation with respect to a digitizer during a pen-down event;

(b) measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter;

(c) determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter;

(d) when the pen-down event is not determined to constitute a press-and-hold gesture, determining whether the pen-down event potentially may constitute a press-and-hold gesture;

(e) when the pen-down event is determined to potentially constitute a press-and-hold gesture, repeating at least steps (a), (b), and (c) with additional data collected relating to the first parameter and the second parameter since the previous measurings during steps (a) and (b); and

(f) when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture.

13. A method according to claim 12, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

14. A method according to claim 12, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

15. A method according to claim 14, wherein the information regarding stroke size includes a stroke width to height ratio.

16. A method according to claim 15, wherein when the stroke width to height ratio exceeds a predetermined value, the pen-down event is determined not to constitute a press-and-hold gesture.

17. A method according to claim 12, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the pen-down event is determined, in at least some instances, to constitute a selection action.

18. A method according to claim 12, further comprising:

adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

19. A method according to claim 12, further comprising:

setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

20. A method according to claim 12, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

21. A method according to claim 12, further comprising:

determining whether the pen-down event is continuing; and

determining that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.

22. A system, comprising:

a digitizer for receiving input; and

a processor for;

(a) measuring a first parameter associated with pen interaction or orientation with respect to the digitizer during a pen-down event, (b) measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter, and (c) determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter.

23. A system according to claim 22, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

24. A system according to claim 22, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

25. A system according to claim 24, wherein the information regarding stroke size includes a stroke width to height ratio.

26. A system according to claim 25, wherein when the stroke width to height ratio exceeds a predetermined value, the processor determines that the pen-down event does not constitute a press-and-hold gesture.

27. A system according to claim 22, wherein when the pen-down event is not determined to constitute a press-and-hold gesture, the processor further:

(d) measures the first parameter a second time, (e) measures the second parameter a second time, and (f) determines whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the second measurements of the first parameter and the second parameter.

28. A system according to claim 22, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the processor determines, in at least some instances, that the pen-down event constitutes a selection action.

29. A system according to claim 22, further comprising:

means for adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

30. A system according to claim 22, further comprising:

means for setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

31. A system according to claim 22, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

32. A system according to claim 22, wherein the processor further:

(d) determines whether the pen-down event is continuing, and (e) determines that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.

33. A system, comprising:

a digitizer for receiving input; and

a processor for;

(a) measuring a first parameter associated with pen interaction or orientation with respect to the digitizer during a pen-down event, (b) measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter, (c) determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter, (d) when the pen-down event is not determined to constitute a press-and-hold gesture, determining whether the pen-down event potentially may constitute a press-and-hold gesture, (e) when the pen-down event is determined to potentially constitute a press-and-hold gesture, repeating at least steps (a), (b), and (c) with additional data collected relating to the first parameter and the second parameter since the previous measurings during steps (a) and (b), and (f) when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture.

34. A system according to claim 33, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

35. A system according to claim 33, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

36. A system according to claim 35, wherein the information regarding stroke size includes a stroke width to height ratio.

37. A system according to claim 36, wherein when the stroke width to height ratio exceeds a predetermined value, the processor determines that the pen-down event does not constitute a press-and-hold gesture.

38. A system according to claim 33, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the processor determines, in at least some instances, that the pen-down event constitutes a selection action.

39. A system according to claim 33, further comprising:

means for adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

40. A system according to claim 33, further comprising:

means for setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

41. A system according to claim 33, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

42. A system according to claim 33, wherein the processor further:

(g) determines whether the pen-down event is continuing, and (h) determines that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.

43. A computer-readable medium including computer-executable instructions stored thereon for performing a method, comprising:

measuring a first parameter associated with pen interaction or orientation with respect to a digitizer during a pen-down event;

measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter; and

determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter.

44. A computer-readable medium according to claim 43, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

45. A computer-readable medium according to claim 43, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

46. A computer-readable medium according to claim 45, wherein the information regarding stroke size includes a stroke width to height ratio.

47. A computer-readable medium according to claim 46, wherein when the stroke width to height ratio exceeds a predetermined value, the pen-down event is determined not to constitute a press-and-hold gesture.

48. A computer-readable medium according to claim 43, wherein when the pen-down event is not determined to constitute a press-and-hold gesture, the method further comprises:

measuring the first parameter a second time;

measuring the second parameter a second time; and

determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the second measurings of the first parameter and the second parameter.

49. A computer-readable medium according to claim 43, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the pen-down event is determined, in at least some instances, to constitute a selection action.

50. A computer-readable medium according to claim 43, wherein the method further comprises adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

51. A computer-readable medium according to claim 43, wherein the method further comprises setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

52. A computer-readable medium according to claim 43, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

53. A computer-readable medium according to claim 43, wherein the method further comprises:

determining whether the pen-down event is continuing; and

determining that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.

54. A computer-readable medium including computer-executable instructions stored thereon for performing a method, comprising:

(a) measuring a first parameter associated with pen interaction or orientation with respect to a digitizer during a pen-down event;

(b) measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter;

(c) determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter;

(d) when the pen-down event is not determined to constitute a press-and-hold gesture, determining whether the pen-down event potentially may constitute a press-and-hold gesture;

(e) when the pen-down event is determined to potentially constitute a press-and-hold gesture, repeating at least steps (a), (b), and (c) with additional data collected relating to the first parameter and the second parameter since the previous measurings during steps (a) and (b); and

(f) when the pen-down event is determined to constitute a press-and-hold gesture, processing the event as a press-and-hold gesture.

55. A computer-readable medium according to claim 54, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

56. A computer-readable medium according to claim 54, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

57. A computer-readable medium according to claim 56, wherein the information regarding stroke size includes a stroke width to height ratio.

58. A computer-readable medium according to claim 57, wherein when the stroke width to height ratio exceeds a predetermined value, the pen-down event is determined not to constitute a press-and-hold gesture.

59. A computer-readable medium according to claim 54, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the pen-down event is determined, in at least some instances, to constitute a selection action.

60. A computer-readable medium according to claim 54, wherein the method further comprises adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

61. A computer-readable medium according to claim 54, wherein the method further comprises setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

62. A computer-readable medium according to claim 54, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

63. A computer-readable medium according to claim 54, wherein the method further comprises:

determining whether the pen-down event is continuing; and

determining that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.

64. A system, comprising:

means for measuring a first parameter associated with pen interaction or orientation with respect to a digitizer during a pen-down event;

means for measuring a second parameter associated with pen interaction or orientation with respect to the digitizer during the pen-down event, wherein the second parameter differs from the first parameter; and

means for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the first parameter and the second parameter.

65. A system according to claim 64, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

a pen steadiness parameter;

a stroke width;

a stroke height;

a stroke width to height ratio;

a pen pressure parameter;

a pen angle with respect to the digitizer;

a pen movement direction;

a pen movement velocity; and

a pen movement acceleration.

66. A system according to claim 64, wherein the first parameter includes a pen steadiness parameter and the second parameter includes information regarding stroke size.

67. A system according to claim 66, wherein the information regarding stroke size includes a stroke width to height ratio.

68. A system according to claim 67, wherein when the stroke width to height ratio exceeds a predetermined value, the means for determining determines that the pen-down event does not constitute a press-and-hold gesture.

69. A system according to claim 64, wherein when the pen-down event is not determined to constitute a press-and-hold gesture:

the means for measuring the first parameter measures the first parameter a second time;

the means for measuring the second parameter measures the second parameter a second time; and

the means for determining determines whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on the second measurings of the first parameter and the second parameter.

70. A system according to claim 64, wherein when the pen-down event is determined to not constitute a press-and-hold gesture, the pen-down event is determined, in at least some instances, to constitute a selection action.

71. A system according to claim 64, further comprising:

means for adjusting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based on previous determinations of whether previous pen-down events constituted press-and-hold gestures.

72. A system according to claim 64, further comprising:

means for setting at least one standard for determining whether the pen-down event constitutes a press-and-hold gesture based, at least in part, on model user press-and-hold gesture input.

73. A system according to claim 64, wherein at least one of the first parameter or the second parameter includes at least one member selected from the group of:

pen movement in the X direction;

pen movement in the Y direction;

pen movement in the Z direction;

pen pressure normal to the digitizer;

pen pressure tangent to the digitizer;

pen button pressure;

pen X direction tilt orientation;

pen Y direction tilt orientation;

pen azimuth orientation;

pen altitude orientation;

pen twist orientation;

pen pitch rotation;

pen roll rotation;

pen yaw rotation;

velocity or acceleration of pen movement in the X direction;

velocity or acceleration of pen movement in the Y direction;

velocity or acceleration of pen movement in the Z direction;

change in pen pressure normal to the digitizer;

change in pen pressure tangent to the digitizer;

change in pen button pressure;

change in pen X direction tilt orientation;

change in pen Y direction tilt orientation;

change in pen azimuth orientation;

change in pen altitude orientation;

change in pen twist orientation;

change in pen pitch rotation;

change in pen roll rotation; and

change in pen yaw rotation.

74. A system according to claim 64, further comprising:

means for determining whether the pen-down event is continuing, wherein the means for determining determines that the pen-down event did not constitute a press-and-hold gesture when the pen-down event is discontinued before the event is determined to constitute a press-and-hold gesture.