System and method for editing a hand-drawn table in ink input

• US 7,412,094 B2
• Filed: 03/30/2005
• Issued: 08/12/2008
• Est. Priority Date: 09/21/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Li, Yantao, Wang, Xianfang, Chen, Tongxian, Wang, Jian, Liu, Youjun
• Primary Examiner(s): Mariam; Daniel G
• Application Number:
  US11/095,452
• Publication Number:
  US 20060061776A1
• Time in Patent Office: 1,231 Days
• Field of Search: 382/181, 382185-189, 382/203, 382/209, 382/218, 382/224, 382/151, 382/287, 382/294, 715/509, 715/517, 715/530, 715/227, 715/243, 715/255
• US Class Current: 382/181
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 40/177 of tables; using ruled lines
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A system and method for editing ink objects recognized in ink input is provided. An ink parser may recognize an ink object in ink input and then an ink editing user interface may edit the ink object recognized by the ink parser. The ink parser may include a chart detector, shape recognizer, and various ink object recognizers such as a chart recognizer, a list detector and a table detector. The various ink object recognizers may recognize particular ink objects. The ink editing user interface may edit the ink object recognized by the ink parser. The ink editing user interface may include a chart editor, list editor, table editor, mode switcher, and a visualizer. The mode switcher may switch the ink editing system between inking mode and ink editing mode.

Claims

1. A computer system for editing ink input, comprising:

an ink parser for recognizing a hand-drawn table in ink input;

a table editor operably coupled to the ink parser for editing the hand-drawn table recognized by the ink parser;

an alignment detector for detecting the initial alignment of one or more elements within the recognized hand-drawn table, the initial alignment indicating the element'"'"'s position within a cell of the table;

a receiver for receiving an indication that one or more elements within the recognized hand-drawn table is to be aligned in accordance with the indication, each element being aligned with respect to the element'"'"'s position in a cell of the table;

an aligning module for aligning the one or more elements within the recognized hand-drawn table in accordance with the indication; and

a mode recognizer operably coupled to the table editor for switching between inking mode for receiving ink input and ink editing mode for editing the hand-drawn table recognized in the ink input.

2. The system of claim 1 wherein the ink parser comprises an operably coupled table detector for detecting the table within ink input.

3. The system of claim 1 wherein the ink parser comprises an operably coupled shape recognizer having a container recognizer and a connector recognizer.

4. A method in a computer system for editing ink input, comprising:

receiving ink input;

parsing the ink input;

performing table recognition for an ink object in the ink input;

switching to an editing mode to edit the table;

editing the table by performing an ink editing operation;

detecting the initial alignment of one or more elements within the recognized hand-drawn table, the initial alignment indicating the element'"'"'s position within a cell of the table;

receiving an indication that one or more elements within the recognized hand-drawn table is to be aligned in accordance with the indication, each element being aligned with respect to the element'"'"'s position in a cell of the table;

aligning the one or more elements within the recognized hand-drawn table in accordance with the indication; and

regenerating the ink representing the edited table.

5. The method of claim 4 further comprising:

performing table detection to detect the table in the ink input;

performing cell detection to detect one or more cells in the ink input; and

creating a bounding box around one or more of the cells in the table.

6. The method of claim 4 wherein editing the table by performing an ink editing operation comprises resizing a cell in the table.

7. The method of claim 6, wherein resizing a cell in the table further comprises resizing the strokes of each of the elements within the cell such that the strokes are resized proportionately to the change in cell size.

8. The method of claim 6, wherein resizing a row in the table further comprises resizing the strokes of each of the elements within the row such that the strokes are resized proportionately to the change in row size.

9. The method of claim 6, wherein resizing a column in the table further comprises resizing the strokes of each of the elements within the column such that the strokes are resized proportionately to the change in column size.

10. The method of claim 4 wherein editing the table by performing an ink editing operation comprises resizing a row in the table.

11. The method of claim 4 wherein editing the table by performing an ink editing operation comprises resizing a column in the table.

12. The method of claim 4 wherein editing the table by performing an ink editing operation comprises displaying a representation of each of the elements in the recognized table in a chart, each representation corresponding to an interpretation of the elements'"'"' contents.

13. The method of claim 4 further comprising switching to inking mode to receive additional ink input.

14. A computer-readable memory having computer-executable instructions for performing the method of claim 4.

15. The method of claim 4, wherein at least one of the elements in the hand-drawn table has a different initial alignment than at least one other element.

16. The method of claim 5, wherein each of the elements in the table is aligned in accordance with the indication, regardless of the elements'"'"' initial alignment.

17. The method of claim 4, wherein the indication indicates that the one or more elements are to be vertically aligned within each element'"'"'s respective cell in the table.

18. The method of claim 4, wherein the indication indicates that the one or more elements are to be horizontally aligned within each element'"'"'s respective cell in the table.

19. The method of claim 4, wherein the indication indicates that the one or more elements are to be both vertically and horizontally aligned within each element'"'"'s respective cell in the table.

20. A computer system for editing ink input, comprising:

means for receiving ink input;

means for parsing the ink input;

means for performing table recognition for an ink object in the ink input;

means for switching to an editing mode to edit the table;

means for editing the table by performing an ink editing operation;

means for detecting the initial alignment of one or more elements within the recognized hand-drawn table, the initial alignment indicating the element'"'"'s position within a cell of the table;

means for receiving an indication that one or more elements within the recognized hand-drawn table is to be aligned in accordance with the indication, each element being aligned with respect to the element'"'"'s position in a cell of the table;

means for aligning the one or more elements within the recognized hand-drawn table in accordance with the indication; and

means for regenerating the ink representing the edited table.