Distinguishing gestures from handwriting in a pen based computer by size discrimination

• US 5,862,256 A
• Filed: 06/14/1996
• Issued: 01/19/1999
• Est. Priority Date: 06/14/1996
• Status: Expired due to Term

• Current Assignee: Tomtom Global Assets BV (TomTom NV)
• Original Assignee: International Business Machines Corporation
• Inventors: Zetts, John Mark, Desrosiers, Maurice Roger
• Primary Examiner(s): SHALWALA, BIPIN H
• Application Number:
  US08/665,129
• Time in Patent Office: 949 Days
• Field of Search: 382/181, 382/182, 382/184, 382/185, 382/186, 382/187, 382/189, 382/190, 382/192, 382/194, 382/198, 382/229, 382/202, 345/173, 345/179, 345/358
• US Class Current: 382/187
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction

Abstract

To distinguish between gestures and handwriting, the pen subsystem examines the size of the user'"'"'s writing. The user may set the gesture versus text size according to his/her handwriting style. In this manner, the user knows exactly how large to make the gestures. If the user declines to customize the setting, the pen subsystem can query other user settings that indicate approximate size of the user'"'"'s handwriting. A third choice available the system dynamically determine and track the size of handwriting. This would allow multiple users to serially use the computer without having to change settings.

Claims

1. A method for distinguishing between gesture and handwriting input in a pen based computer, comprising the steps of:

detecting a set of strokes from a pen input device to the computer;

calculating a size of each of the strokes;

categorizing the set of strokes as gesture input if a predetermined number of the strokes exceeds a gesture threshold size; and

categorizing the set of strokes as handwriting input if the predetermined number of strokes does not exceed the gesture threshold size.

2. The method as recited in claim 1 further comprising the step of allowing the user to manually set the gesture threshold size.

3. The method as recited in claim 2 further comprising the step of using a default gesture threshold size if the user has not manually set the gesture threshold size.

4. The method as recited in claim 2 further comprising the steps of:

querying an application resident in the computer for information concerning handwriting input settings; and

calculating a default gesture threshold size if the user has not manually set the gesture threshold size based on the handwriting input settings.

5. The method as recited in claim 2 further comprising the steps of:

analyzing handwriting input for a user of the computer system for an average size of handwriting input; and

calculating a default gesture threshold size based on the average size of handwriting input.

6. The method as recited in claim 5 further comprising the steps of:

storing a user id with the calculated default gesture threshold size; and

repeating the analyzing, calculating and storing steps for a second user so that a plurality of users may have individual calculated default gesture threshold sizes.

7. The method as recited in claim 5 wherein the analyzing step further comprises the steps of:

drawing a bounding box around each set of strokes which are recognized as a text character;

combining the bounding boxes of each text character in a given word into a single word bounding box;

measuring a height of a plurality of word bounding boxes; and

averaging the heights of the word bounding boxes for an average handwriting height.

8. The method as recited in claim 7 wherein the user inputs handwriting along a diagonal line.

9. The method as recited in claim 5 wherein extraneous strokes are omitted from the analyzing step.

10. The method as recited in claim 1 wherein all strokes must exceed the gesture threshold size for the set of strokes to be categorized as gesture input.

11. The method as recited in claim 1 wherein a last input stroke of a set of strokes must be smaller than a tap threshold size for the set of strokes to be categorized as gesture input.

12. A system including processor, memory, display and pen input device for distinguishing between gesture and handwriting input further comprising:

means for detecting a set of strokes from a pen input device to the computer;

means for calculating a size of each of the strokes;

means for categorizing the set of strokes as gesture input if a predetermined number of the strokes exceeds a gesture threshold size; and

means for categorizing the set of strokes as handwriting input if the predetermined number of the strokes does not exceed the gesture threshold size.

13. The system as recited in claim 12 further comprising:

means for allowing the user to manually set the gesture threshold size; and

means for using a default gesture threshold size if the user has not manually set the gesture threshold size.

14. The system as recited in claim 13 further comprising:

means for querying an application resident in the computer for information concerning handwriting input settings; and

means for calculating a default gesture threshold size if the user has not manually set the gesture threshold size based on the handwriting input settings.

15. The system as recited in claim 13 further comprising:

means for analyzing handwriting input for a user of the computer system for an average size of handwriting input; and

means for calculating a default gesture threshold size based on the average size of handwriting input.

16. The system as recited in claim 15 further comprising:

means for storing a user id with the calculated default gesture threshold size; and

wherein a second user'"'"'s handwriting is processed by the analyzing, calculating and storing means so that a plurality of users may have individual calculated default gesture threshold sizes.

17. The system as recited in claim 15 wherein the analyzing means further comprises:

means for drawing a bounding box around each set of strokes which are recognized as a text character;

means for combining the bounding boxes of each text character in a given word into a single word bounding box;

means for measuring a height of a plurality of word bounding boxes; and

means for averaging the heights of the word bounding boxes for an average handwriting height.

18. The system as recited in claim 17 wherein the user inputs handwriting along a diagonal line.

19. The system as recited in claim 15 wherein extraneous strokes are omitted from the analyzing step.

20. The system as recited in claim 12 wherein all strokes must exceed the gesture threshold size for the set of strokes to be categorized as gesture input.

21. A computer program product in a computer readable medium for distinguishing between gesture and handwriting input to a computer further comprising:

means for detecting a set of strokes from a pen input device to the computer;

means for calculating a size of each of the strokes;

means for categorizing the set of strokes as gesture input if a predetermined number of the strokes exceeds a gesture threshold size; and

means for categorizing the set of strokes as handwriting input if the predetermined number of the strokes does not exceed the gesture threshold size.

22. The product as recited in claim 21 further comprising:

means for allowing the user to manually set the gesture threshold size; and

means for using a default gesture threshold size if the user has not manually set the gesture threshold size.

23. The product as recited in claim 22 further comprising:

means for querying an application resident in the computer for information concerning handwriting input settings; and

means for calculating a default gesture threshold size if the user has not manually set the gesture threshold size based on the handwriting input settings.

24. The product as recited in claim 22 further comprising:

means for analyzing handwriting input for a user of the computer system for an average size of handwriting input; and

means for calculating a default gesture threshold size based on the average size of handwriting input.

25. The product as recited in claim 24 further comprising:

means for storing a user id with the calculated default gesture threshold size; and

wherein a second user'"'"'s handwriting is processed by the analyzing, calculating and storing means so that a plurality of users may have individual calculated default gesture threshold sizes.

26. The product as recited in claim 24 wherein the analyzing means further comprises:

means for drawing a bounding box around each set of strokes which are recognized as a text character;

means for combining the bounding boxes of each text character in a given word into a single word bounding box;

means for measuring a height of a plurality of word bounding boxes; and

means for averaging the heights of the word bounding boxes for an average handwriting height.

27. The product as recited in claim 26 wherein the user inputs handwriting along a diagonal line.

28. The product as recited in claim 27 wherein extraneous strokes are omitted from the analyzing step.

29. The product as recited in claim 21 wherein all strokes must exceed the gesture threshold size for the set of strokes to be categorized as gesture input.

30. The product as recited in claim 21 wherein a last input stroke of a set of strokes must be smaller than a tap threshold size for the set of strokes to be categorized as gesture input.