System and method for editing a hand-drawn chart in ink input

• US 7,394,935 B2
• Filed: 03/30/2005
• Issued: 07/01/2008
• Est. Priority Date: 09/21/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Li, Yantao, Wang, Xianfang, Chen, Tongxian, Wang, Jian
• Primary Examiner(s): Mariam; Daniel G
• Application Number:
  US11/096,037
• Publication Number:
  US 20060061780A1
• Time in Patent Office: 1,189 Days
• Field of Search: 382/181, 382185-189, 382/203, 382/209, 382/218, 382/224, 715/509, 715/517, 715/5, 715/227, 715/243, 715/255
• US Class Current: 382/181
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A system and method for editing ink objects recognized in ink input is provided. An ink parser may recognize an ink object in ink input and then an ink editing user interface may edit the ink object recognized by the ink parser. The ink parser may include a chart detector, shape recognizer, and various ink object recognizers such as a chart recognizer, a list detector and a table detector. The various ink object recognizers may recognize particular ink objects. The ink editing user interface may edit the ink object recognized by the ink parser. The ink editing user interface may include a chart editor, list editor, table editor, mode switcher, and a visualizer. The mode switcher may switch the ink editing system between inking mode and ink editing mode.

Claims

1. A computer system for editing ink input, comprising:

an ink parser for recognizing a hand-drawn chart in ink input;

a chart editor operably coupled to the ink parser for editing the hand-drawn chart recognized by the ink parser;

a receiver for receiving an indication that a container within a recognized chart has been moved, the moved container being connected to at least one other container with a connector of a specified type;

a reflowing module for reflowing the connector from the moved container to the other container based on the type of connector; and

a mode recognizer operably coupled to the chart editor for switching between inking mode for receiving ink input and ink editing mode for editing the hand-drawn chart recognized in the ink input.

2. The system of claim 1 wherein the ink parser comprises an operably coupled chart detector having a container detector for detecting the containers within ink input and a connector detector for detecting the connectors within ink input.

3. The system of claim 1 wherein the ink parser comprises a chart recognizer for recognizing a hand-drawn chart in ink input.

4. A method in a computer system for editing ink input, comprising:

receiving ink input;

parsing the ink input;

performing chart recognition for an ink object in the ink input;

switching to an editing mode to edit the chart;

editing the chart by performing an ink editing operation;

receiving an indication that a container within a recognized chart has been moved, the moved container being connected to at least one other container with a connector of a specified type;

reflowing the connector from the moved container to the other container based on the type of connector; and

regenerating the ink representing the edited chart.

5. The method of claim 4 further comprising performing shape recognition to recognize containers and connectors detected within the ink input.

6. The method of claim 4 wherein editing the chart by performing an ink editing operation comprises creating a bounding box for the chart and receiving an indication that the bounding box for the chart is selected.

7. The method of claim 4 wherein editing the chart by performing an ink editing operation comprises displaying resize selection handles for drawing parts of the chart and receiving an indication that one of the selection handles for the drawing parts of the chart is selected.

8. The method of claim 4 wherein editing the chart by performing an ink editing operation comprises creating a bounding box for a container in the chart and receiving an indication that the bounding box for the container in the chart is selected.

9. The method of claim 4 wherein editing the chart by performing an ink editing operation comprises moving a container in the chart to another position in the chart.

10. The method of claim 4 further comprising switching to inking mode to receive additional ink input.

11. A computer-readable memory having computer-executable instructions for performing the method of claim 4.

12. The method of claim 4, wherein the relative positions between the joint points and the containers remain unchanged.

13. The method of claim 4, further comprising generating a new backbone in the reflowed connector such that the new backbone comprises the minimal Manhattan distance between the backbone'"'"'s start and end points.

14. The method of claim 4, wherein the ink editing operation comprises regularizing the chart by changing common connectors of the chart to normal connectors, the regularizing including reflowing one or more connectors such that the line segments between the start and end point of a backbone are either horizontal or vertical.

15. The method of claim 4, wherein, if the connector type is normal, the connector is reflowed such that the connector comprises one or more horizontal and/or vertical line segments linking the moved container to the other container.

16. The method of claim 4, wherein, if the connector type is common, the connector is reflowed such that the connector comprises a curved line segment that conforms based on the moved position of the moved container, such that the curved line segment links the moved container to the other container.

17. The method of claim 4, wherein, if the connector type is straight, the connector is reflowed such that the connector comprises a straight line segment that conforms based on the moved position of the moved container, such that the straight line segment links the moved container to the other container.

18. A method in a computer system for editing ink input, comprising:

receiving ink input;

parsing the ink input;

performing chart recognition for an ink object in the ink input;

switching to an editing mode to edit the chart;

editing the chart by performing an ink editing operation, wherein the ink editing operation includes;

deforming a backbone of a connector linking a moved container of the chart; and

regenerating the strokes of the connector; and

regenerating the ink representing the edited chart.

19. The method of claim 18, wherein deforming the backbone of the connector comprises performing normal connector deformation.

20. The method of claim 18 wherein deforming the backbone of the connector comprises performing straight connector deformation.