Distinguishing gestures from handwriting in a pen based computer by stroke analysis
First Claim
1. A method of distinguishing between handwriting and gesture input to a pen based computer system, comprising the steps of:
- detecting a set of strokes input by a stylus to the computer system;
prior to recognition, sequentially analyzing the set of strokes for either a first set of characteristics indicative of a handwriting input or a second set of characteristics indicative of a gesture input;
prior to recognition, after analyzing each stroke, for either the first or the second set of characteristics of all analyzed strokes, categorizing the set of strokes as gesture or handwriting input; and
based on whether the set of strokes is categorized as gesture or handwriting input, Performing gesture recognition or handwriting recognition on the set of strokes to recognize the set of strokes as a particular gesture or handwriting.
2 Assignments
0 Petitions
Accused Products
Abstract
Pre-recognition analysis on stroke characteristics such as the count, size and position of each stroke in real-time as it is drawn improves recognition accuracy. After each stroke, the set of strokes is weighted toward handwriting or gesture. The system uses a gesture threshold size to distinguish between gestures and handwriting. The system also uses the stroke count to distinguish between the two inputs, relying on the knowledge of the allowable number of strokes in a gesture. The count information may also be used in conjunction with the stroke size information to weight the set of strokes between gestures handwriting. Once the stroke size crosses a gesture vs. text size threshold, the result is weighted toward gestures. By examining the `white space` between strokes and the juxtaposition of the strokes, a gesture vs. text determination can be made with high accuracy.
-
Citations
31 Claims
-
1. A method of distinguishing between handwriting and gesture input to a pen based computer system, comprising the steps of:
-
detecting a set of strokes input by a stylus to the computer system; prior to recognition, sequentially analyzing the set of strokes for either a first set of characteristics indicative of a handwriting input or a second set of characteristics indicative of a gesture input; prior to recognition, after analyzing each stroke, for either the first or the second set of characteristics of all analyzed strokes, categorizing the set of strokes as gesture or handwriting input; and based on whether the set of strokes is categorized as gesture or handwriting input, Performing gesture recognition or handwriting recognition on the set of strokes to recognize the set of strokes as a particular gesture or handwriting. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system including processor, memory, display and, pen input device for distinguishing between handwriting and gesture input, comprising:
-
a handwriting recognition engine for recognizing pen input as handwriting input; a gesture recognition engine for recognizing pen input as gesture input; means for detecting a set of strokes input by a stylus to the computer system; means for sequentially analyzing the set of strokes for a first or a second set of characteristics respectively indicative of a handwriting input or a gesture input prior to recognition; means responsive to analyzing each stroke for either the first or the second set of characteristics of all analyzed strokes for categorizing the set of strokes as gesture or handwriting input prior to recognition; and means for sending the set of strokes to one or both of the handwriting recognition engine or the gesture recognition engine for recognizing the set of strokes as a particular handwriting or gesture on the basis of the categorization. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23)
-
-
24. A computer program product in a computer readable memory for distinguishing between handwriting and gesture input to a computer comprising:
-
means for detecting a set of strokes input by a stylus to the computer system; means for sequentially analyzing each of the strokes either for a first set of characteristics indicative of a handwriting input or a second set of chracteristics indicative a gesture input prior to recognition; means for categorizing the set of strokes as gesture or handwriting input for either the first or the second set of characteristics of all analyzed strokes and prior to recognition; and means responsive to categorization of the set of strokes as gesture or handwriting input for performing gesture recognition or handwriting recognition on the set of strokes to recognize the set of strokes as a particular gesture or handwriting. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31)
-
Specification