Methods and processes for recognition of electronic ink strokes
First Claim
1. A method of providing structure recognition to a node-link diagram formed by a plurality of digital ink strokes drawn on a canvas of an electronic device by an input device, the method comprising:
- grouping related digital ink strokes into multiple hypotheses reflecting structured interpretation of the digital ink strokes in a group, wherein;
structured interpretation of ink strokes comprises determining related ink strokes based on similarity of characteristics of the ink strokes;
a hypothesis represents an interpretation of the digital ink stroke groups as a specific object type;
computing confidence scores for the multiple hypotheses, each hypothesis having an intrinsic score and a support-context score, wherein;
the intrinsic score is based on similarity between digital ink strokes of the digital ink stroke group and defined criteria for the specific object type interpretation represented by the hypothesis;
the support-context score is based on the confidence score of surrounding digital ink strokes;
applying constraints among the hypotheses;
searching hypotheses under the applied constraints for a collectively high scoring assignment; and
accepting the hypothesis with the collectively high scoring assignment as a representation of the node-link diagram, wherein structure information is provided to the digital ink strokes of the node-link diagram, making the node-link diagram electronically editable.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and process provides structure recognition to a node-link diagram formed by a plurality of digital ink strokes drawn on a canvas of an electronic device by an input device. The method and process include grouping related strokes into multiple hypotheses reflecting structure interpretations of the strokes in a group. Confidence scores are computed for the multiple hypotheses based on local evidence regarding the strokes of the stroke groups and surrounding strokes. Constraints are applied among the hypotheses, and a collectively high scoring assignment of accept/reject values of the hypotheses are determined under the applied constraints. The hypotheses with collectively high scoring assignments are accepted as a representation of the node-link diagram, where structure information is provided to the strokes of the node-link diagram, making the node-link diagram electronically editable.
54 Citations
23 Claims
-
1. A method of providing structure recognition to a node-link diagram formed by a plurality of digital ink strokes drawn on a canvas of an electronic device by an input device, the method comprising:
-
grouping related digital ink strokes into multiple hypotheses reflecting structured interpretation of the digital ink strokes in a group, wherein; structured interpretation of ink strokes comprises determining related ink strokes based on similarity of characteristics of the ink strokes; a hypothesis represents an interpretation of the digital ink stroke groups as a specific object type; computing confidence scores for the multiple hypotheses, each hypothesis having an intrinsic score and a support-context score, wherein; the intrinsic score is based on similarity between digital ink strokes of the digital ink stroke group and defined criteria for the specific object type interpretation represented by the hypothesis; the support-context score is based on the confidence score of surrounding digital ink strokes; applying constraints among the hypotheses; searching hypotheses under the applied constraints for a collectively high scoring assignment; and accepting the hypothesis with the collectively high scoring assignment as a representation of the node-link diagram, wherein structure information is provided to the digital ink strokes of the node-link diagram, making the node-link diagram electronically editable. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of recognition of electronic ink strokes drawn on a canvas of an electronic device, the method comprising:
-
fragmenting ink strokes; grouping related digital ink strokes based on similar characteristics of the ink strokes, each digital ink stroke being a member of at least one digital ink stroke group; forming hypotheses of digital ink stroke groups, wherein a hypothesis represents a possible interpretation of the digital ink stroke group as a specific object type; forming a lattice of hypotheses, wherein; a complex by hypothesis is composed of at least one support hypothesis; complex hypotheses represent interpretation of digital ink strokes as a complex object type; a support hypothesis represents interpretation of digital ink strokes as simpler object type; computing a confidence scores for each hypothesis, the confidence score having an intrinsic score and a support-context scores; the intrinsic score is based on similarity between the digital ink strokes of the digital ink stroke groups and defined criteria for the specific object type interpretation represented by the hypothesis; the support-context score of support hypotheses is assigned a predetermined value; the support-context score of complex hypotheses is assigned a value equal to the minimum of the intrinsic score and the support-context confidence scores of the support hypotheses minus an epsilon value; applying constraints among the hypotheses; searching hypotheses under the applied constraints for a collectively high scoring confidence score; and accepting the hypothesis with the collectively high scoring confidence score as a representation of the node-link diagram, wherein structure information is provided to the digital ink strokes of the node-link diagram, making the node-link diagram electronically editable. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A method for providing structure recognition to a node-link diagram formed by a plurality of electronic ink strokes drawn on a canvas of an electronic device by an input device, the method comprising:
-
grouping related electronic ink strokes together as electronic ink stroke groups; forming multiple hypotheses reflecting structural interpretations for the electronic ink stroke groups, wherein; structural interpretation comprises determining related electronic ink strokes based on similarity of characteristics of the electronic ink strokes; a hypothesis represents an interpretation of the electronic ink stroke groups as a specific object type; applying intrinsic confidence scores for the multiple hypotheses based on similarity between electronic ink strokes of the electronic ink stroke groups and defined criteria for the specific object type; applying context-based confidence scores to the multiple hypotheses in accordance with interacting support between electronic ink stroke groups; applying constraints among the hypotheses; searching for hypotheses having the an acceptable score; and accepting the hypotheses to the node-link diagram, wherein structure information is provided to the electronic ink strokes of the node-link diagram, making the node-link diagram electronically editable.
-
Specification