Method and system for displaying and linking ink objects with recognized text and objects

• US 7,079,713 B2
• Filed: 06/28/2002
• Issued: 07/18/2006
• Est. Priority Date: 06/28/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Simmons, Alex J.
• Primary Examiner(s): Dang, Duy M.
• Application Number:
  US10/186,463
• Publication Number:
  US 20040001649A1
• Time in Patent Office: 1,481 Days
• Field of Search: 382/119, 382/175, 382/176, 382/187, 382188-189, 382202-203, 382/291, 382/292, 382229-231, 382/309, 382/311
• US Class Current: 382/321
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A user interface can display electronic ink in one section of a display device and corresponding recognized or converted text in another section of the display device that was generated from a electronic ink recognition system. Each page of electronic ink and each corresponding page of converted or recognized text are linked to one another. In other words, each page of electronic ink can be displayed only with its corresponding page of converted or recognized text until a command or message is received that editing of the converted or recognized text has been completed. Once the command or message is received that editing of the converted or recognized text has been completed, then the link between an electronic ink page and its corresponding converted text page is broken. This means that the converted text page can now be saved independently of its corresponding electronic ink page.

Claims

1. A computer-implemented method for editing recognized electronic ink documents, comprising the steps of:

receiving input from an interface;

converting the input from the interface into a page of electronic ink;

displaying the page of electronic ink on a display device;

converting the page of electronic ink into a page of text;

linking the page of text to the page of electronic ink;

displaying the text on the display device adjacent to the page of electronic ink;

unlinking the page of text from the page of electronic ink in response to receiving an edit completion command;

editing a page of text that is part of a group of pages;

unlinking the edited page from its corresponding electronic ink; and

saving the edited page separate from the group of remaining unedited pages.

2. The method of claim 1, further comprising the steps of:

selecting a word in the page of text;

in response to selecting a word in the page of text, selecting a corresponding word in the page of electronic ink.

3. The method of claim 1, further comprising the steps of:

selecting a word in the page of electronic ink,

in response to selecting a word in the page of electronic ink, selecting a corresponding word in the page of text.

4. The method of claim 1, further comprising the steps of:

highlighting a word in the page of text;

in response to selecting a word in the page of text, highlighting a corresponding word in the page of electronic ink.

5. The method of claim 1, further comprising the steps of:

receiving edits for the text from the interface; and

displaying the edits on the display device.

6. The method of claim 1, further comprising the steps of:

comparing the text to a dictionary; and

displaying the text with an indicator if the text does not match a word in the dictionary.

7. The method of claim 1, further comprising the step of displaying a menu comprising a ranked list of alternate words in response to a selection of a word in the page of text on the display device.

8. The method of claim 1, further comprising the step of displaying a menu comprising a list of options for editing a selected word.

9. The method of claim 8, wherein the list of options comprises one of changing a classification of electronic ink corresponding to a selected word in the page of text, adding a selected word to a dictionary, cutting a selected word from the page of text, copying a selected word from the page of text, and pasting another word over a selected word in the page of text.

10. The method of claim 1, further comprising the steps of:

displaying a splitting mechanism for separating one or more words in the page of text; and

receiving input defining a break point for one or more words.

11. The method of claim 10, further comprising the step of redisplaying a word in the page of text with one or more spaces that correspond to the break point.

12. The method of claim 10, further comprising the step of redisplaying a word in the page of electronic ink with one or more spaces that correspond to the break point.

13. A computer-implemented method for editing text pages generated from pages of electronic ink, comprising the steps of:

linking a page of text to a page of electronic ink;

displaying the page of text on the display device adjacent to the page of electronic ink;

unlinking the page of text from the page of electronic ink in response to receiving an edit completion command;

displaying a menu comprising a list of options for editing a selected word; and

receiving input relating to the menu;

editing a page of text that is part of a group of pages;

unlinking the edited page from its corresponding electronic ink; and

saving the edited page separate from the group of remaining unedited pages.

14. The method of claim 13, further comprising the step of:

receiving edits for the text from the interface; and

displaying the edits on the display device.

15. The method of claim 13, further comprising the steps of:

displaying a splitting mechanism for separating one or more words in the page of text; and

receiving input defining a break point for one or more words.

16. A computer system for editing electronic ink and text converted from the electronic ink, comprising:

a processing unit;

a memory storage device;

a display device coupled to the processing unit for displaying data; and

a program stored in the memory storage device for providing instructions to the processing unit;

the processing unit responsive to the instructions of the program, operable for

converting a page of electronic ink to a page of text;

linking the page of electronic ink to the page of text;

displaying both pages of the electronic ink and text simultaneously;

receiving edits for the text, wherein the a e of text receiving edits is part of a group of pages;

unlinking the edited page of text from its corresponding electronic ink in response to activation of an edit completion command; and

storing the edited page of text separate from the group of remaining unedited pages.

17. The computer system of claim 16, wherein the processing unit is further operable for

displaying a splitting mechanism for separating one or more words in the page of text;

and

receiving input defining a break point for one or more words.

18. The computer system of claim 16, wherein the processing unit is further operable for

displaying a splitting mechanism for separating one or more words in the page of text;

receiving input defining a break point for one or more words; and

redisplaying a word in the page of text with one or more spaces that correspond to the break point.

19. The computer system of claim 16, wherein the processing unit is further operable for

receiving input for selecting a word;

and

displaying a menu comprising a list of options for editing the selected word, wherein the list of options comprises one of changing a classification of electronic ink corresponding to a selected word in the page of text, adding a selected word to a dictionary, cutting a selected word from the page of text, copying a selected word from the page of text, and pasting another word over a selected word in the page of text.