Method and apparatus for creating and editing node-link diagrams in pen computing systems

• US 20080232690A1
• Filed: 03/23/2007
• Published: 09/25/2008
• Est. Priority Date: 03/23/2007
• Status: Active Grant

• Current Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Saund, Eric, Ruiz, Jaime G.
• Granted Patent: US 8,014,607 B2
• Time in Patent Office: Days
• US Class Current: 382/187
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps

Abstract

A method and system provides intelligent node-link diagram creation and editing, including an electronic display device having a surface on which a writing and/or drawing canvas is provided. An input device permits writing and/or drawing of electronic ink strokes, and a computing device is in operative association with the electronic display and the input device, and has stored therein for operation in connection with actions of the input device, a user interface (UI). The UI includes a graphical user interface (GUI) module, which controls input and display of the ink strokes applied to the canvas by the input device, and a recognition module which interprets the ink strokes by performance of structure recognition operations.

Claims

1. a system for intelligent node-link diagram creation and editing:

comprising;

an electronic display device having a surface on which a writing and/or drawing canvas is provided;

an input device for writing and/or drawing electronic ink strokes; and

a computing device, in operative association with the electronic display and the input device, and having stored therein for operation in connection with actions by the input device, a user interface (UI) including,

a graphical user interface (GUI) module which controls input and display of the ink strokes applied to the canvas by the input device, and

a recognition module which interprets the ink strokes by performance of structure recognition operations.

2. The system according to claim 1, wherein the GUI module and recognition module are configured to employ an inferred mode protocol, to address ambiguous ink strokes.

3. The system according to claim 1, further including,

an unprocessed strokes queue for holding unprocessed ink strokes and for passing the unprocessed strokes between the GUI module and the recognition module, and

a processed strokes queue for holding processed ink strokes and for passing the processed strokes between the GUI module and the recognition module.

4. The system according to claim 1, further including,

an interface between the GUI module and recognition module for passing of selection operations and command operations therebetween.

5. The system according to claim 1, wherein the input device configured to enter ink strokes, is further configured to select ink strokes, and specify commands to be performed on selected ink strokes, without selecting a mode of operation prior to entering the ink strokes.

6. The system according to claim 5, further including a pop-up button positioned near an ink stroke input by the input device, when the system determines the meaning of the input ink stroke is ambiguous and selection or non-selection of the pop-up button eliminates the ambiguity.

7. The system according to claim 1, wherein the GUI module and recognition module operate to automatically determine the ink strokes on the canvas as part of a node-link diagram.

8. The system according to claim 1, wherein the node-link diagram is a concept map.

9. The system according to claim 1, wherein the GUI and Recognition modules operate asynchronously with respect to each other.

10. The system according to claim 1, wherein the intelligent editing includes intelligent selection by use of tapping actions, encircling actions and scratchout actions.

11. The system according to claim 1, wherein the node-link diagram includes both text and graphics.

22. The method according to claim 11, wherein the node-link diagram includes both text and graphics.

12. A method for intelligent node-link diagrams creation and editing comprising:

generating a writing and/or drawing canvas on a surface of an electronic display device;

inputting writing and/or drawing electronic ink strokes by use of an input device;

detecting the input ink strokes by a user interface (UI) stored on a computing device;

controlling the input and display of the ink strokes by a graphical user interface (GUI) of the user interface (UI); and

interpreting the ink strokes by use of structured recognition operations, undertaken by a recognition module.

13. The method according to claim 12, further including,

applying an inferred mode protocol to address ambiguous ink strokes entered on the canvas by the input device.

14. The method according to claim 12, further including:

providing unprocessed ink strokes to an unprocessed strokes queue;

passing the unprocessed ink strokes on the unprocessed strokes queue between the GUI module and the recognition module;

providing processed ink strokes to a processed strokes queue; and

passing the processed ink strokes between the GUI module and the recognition module.

15. The method according to claim 12, further including,

passing selection operations and command operations between the GUI module and the recognition module by a system interface.

16. The method according to claim 12, wherein in addition to entering the ink strokes by use of the input device, further including:

selecting ink strokes by the input device, and

specifying commands to be performed on selected ink strokes by the input device, wherein the entering, selecting and specifying commands occur without selecting a mode of operation prior to the entering of the ink strokes.

17. The method according to claim 16, further including,

determining an intended meaning of the ink stroke input by the input device is ambiguous;

and

displaying a pop-up button positioned near the ink stroke determined to be ambiguous, wherein selection or non-selection of the pop-up button eliminates the ambiguity.

18. The method according to claim 12, further including,

automatically determining by the system, the ink strokes on the canvas are part of a node-link diagram.

19. The method according to claim 12, wherein the node-link diagram is a concept map.

20. The method according to claim 12, wherein the GUI and Recognition modules operate asynchronously with respect to each other.

21. The method according to claim 12, wherein the intelligent editing includes intelligent selection by use of tapping actions, encircling actions and scratchout actions.

23. An article of manufacture comprising:

a computer usable medium having computer readable program code embedded therein for the creating and editing of node-link diagrams;

a graphical user interface (GUI) module configured to control input and display of electronic ink strokes applied by an input device;

a recognition module configured to interpret the ink strokes input by the input device by performing structure recognition operations; and

an interface for passing selection operations and command operations between the GUI module and recognition module.