Engine support for parsing correction user interfaces

• US 8,020,119 B2
• Filed: 12/14/2007
• Issued: 09/13/2011
• Est. Priority Date: 12/14/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chou, Victoria H., Ye, Ming, Raghupathy, Sashi
• Primary Examiner(s): Bautista; Xiomara L
• Application Number:
  US11/956,631
• Publication Number:
  US 20090158219A1
• Time in Patent Office: 1,369 Days
• Field of Search: 715/700, 715/727, 715/764, 715/765, 715/808, 715/809, 715/810, 715/841, 715/843, 715/835, 715/846, 715/863, 345/156, 345/173, 345/179, 382/177, 382/186, 382/187, 382/202, 382/229
• US Class Current: 715/863
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation

Abstract

A parsing system provides a parsed document to a user application labeling the document with indication symbols according to a scheme associated with the parsing results. Users are enabled to insert correction indicators such as handwritten gestures, icon selections, menu item selections, and the like in conjunction with the indication symbols. The document is re-analyzed performing the requested corrections such as line or block separations, line, block, word connections, etc. The operations provide support for the engine stack of the parsing system while accommodating independent user interfaces employed by the users. Insertion of correction indicators and subsequent re-analysis for correction may be performed upon user signal, in an iterative manner, or continuously.

Claims

1. A method to be executed at least in part in a computing device to provide engine support for parsing correction user interfaces, the method comprising:

parsing data based on ink entries;

labeling parsed data with indicator symbols specifying at least one from a set of;

a position, a grouping, a relationship, and a type of parsed data;

presenting the labeled parsed data to a user for corrective actions, the corrective actions comprising employing an order of correction to support the correction of a most annoying error in the parsed data before the correction of other errors in the parsed data, regardless of a structure involving the most annoying error, to minimize a number of operations needed for the corrective actions;

receiving correction indicators from the user;

re-parsing the labeled data based on a context of the received correction indicators with existing parsing results; and

presenting the corrected parsed data to the user.

2. The method of claim 1, wherein re-parsing the labeled data includes processing correction indicators in an arbitrary order for increased user flexibility and selecting an appropriate propagation for minimizing a number of corrections.

3. The method of claim 1, wherein the correction indicators include at least one from a set of:

handwritten correction gestures, corrective action icons, drop-down menu items, pop-up menu items, and marking wheel items.

4. The method of claim 3, wherein a number and a type of correction indicators are selected such that a cognitive load on the user is minimized.

5. The method of claim 1, further comprising:

preserving a correction history when receiving the correction indicators from the user such that the correction history is respected and conflicts are resolved during re-parsing of the labeled data.

6. The method of claim 5, wherein the conflicts are resolved according to a time stamp of each correction indicator.

7. The method of claim 1, further comprising:

employing a heuristic parsing algorithm for parsing correction indicators if the correction indicators include handwritten gestures, wherein the heuristic algorithm tests for different gesture types based on an order of their frequency and latches onto a gesture type that passes the test.

8. The method of claim 1, wherein the data includes text and drawings, and wherein the indicator symbols are selected according to an intuitive scheme arranged to distinguish between elements of the text and the drawings.

9. The method of claim 1, wherein the receiving of the correction indicators, re-parsing of the labeled data, and presenting of the corrected data process is at least one from a set of:

a one-time process triggered by user indication, an iterative process repeated until stopped by the user, and a continuous process repeated until stopped by the user.

10. A computing device arranged to provide engine support for parsing correction user interfaces, the computing device comprising:

a user application with a user interface for accepting ink entries and displaying parsing results to a user;

a parsing platform configured to;

parse data comprising at least one of text and drawings based on ink entries;

label the parsed data with indicator symbols according to a predefined intuitive scheme for reducing a cognitive load on the user, the indicator symbols specifying at least one from a set of;

a position, a grouping, a relationship, and a type of parsed data;

provide the labeled parsed data to the user application for corrective actions, the corrective actions comprising employing an order of correction to support the correction of a most annoying error in the parsed data before the correction of other errors in the parsed data, regardless of a structure involving the most annoying error, to minimize a number of operations needed for the corrective actions;

receive correction indicators from the user application in form of handwritten gestures;

re-parse the labeled data based on a context of the received correction indicators with existing parsing results; and

provide the corrected parsed data to the user application for presentation to the user.

11. The computing device of claim 10, wherein the correction indicators in form of the handwritten gestures include:

a line gesture for one of connecting and dividing parsed data structures whose grouping is visualized by their spans;

a boundary symbol for separating parsed data structures whose grouping is one dimensional; and

a boundary removal symbol for merging separate parsed data structures whose grouping is one dimensional.

12. The computing device of claim 11, wherein the correction indicators in form of the handwritten gestures further include:

a set of data structure selection gestures; and

a set of characters representing commands for one of grouping and separating selected data structures.

13. The computing device of claim 11, wherein the correction indicators in form of the handwritten gestures further include another set of characters representing commands associated with parsing operations.

14. The computing device of claim 10, wherein the receiving of correction indicators, re-parsing of the labeled data, and providing of the corrected data process is iterative, and wherein each gesture that is parsed as active is re-parsed and re-applied during each re-parse.

15. The computing device of claim 10, wherein the parsing platform is a hosted parsing service interacting with a plurality of user applications executed in a number of computing devices.

16. A computer-readable storage device with instructions encoded thereon which, when executed by a computing device, will cause the computing device to perform a method to provide engine support for parsing correction user interfaces, the method comprising:

receiving data comprising text and drawings from a user application based on ink entries from a user;

parsing the received data in a tree structure following an order of lines, writing regions, and words;

if a high level node in the tree structure is pinned, preserving its grouping such that remaining branches of the tree structure are treated as sub-branches and each sub-branch is parsed independently;

labeling parsed data with indicator symbols according to a predefined color and shape scheme specifying at least one from a set of;

a position, a grouping, a relationship, and a type of parsed data;

providing the labeled parsed data to the user application;

receiving correction indicators comprising a set of gestures and a set of stroke-set hints from the user application;

re-parsing the labeled data based on a context of the received correction indicators with existing parsing results;

providing the corrected parsed data to the user application; and

repeating the receiving the correction indicators, re-parsing the labeled data, and providing the corrected parsed data process until a stop indication is received from the user application.

17. The computer-readable storage device of claim 16, wherein a stroke-set hint is created by clicking on an indicator button and inserting a symbol gesture.

18. The computer-readable storage device of claim 16, wherein the set of gestures and the set of stroke-set hints are unified.