Entry and editing of electronic ink

• US 7,925,987 B2
• Filed: 06/28/2002
• Issued: 04/12/2011
• Est. Priority Date: 05/14/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Sailor, Richard K., Feldman, Kyril, Zielinski, Tobiasz A., Gounares, Alexander, Dodge, Steve, Torset, Todd A., Goldberg, Arin J., Chambers, Robert L.
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): TRAN, MYLINH T
• Application Number:
  US10/183,990
• Publication Number:
  US 20030215142A1
• Time in Patent Office: 3,210 Days
• Field of Search: 382/246, 382/305, 382/187, 382/311, 382/224, 382/514, 382/119, 715/541, 715/173, 715/778
• US Class Current: 715/778
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A control and its associated programming interface for allowing entry of electronic ink, editing and other manipulation of the ink, and/or recognition of the ink. Ink may be stored in a data structure such as an ink object that permits later retrieval by applications. As is the case with text that may be bolded, underlined, italicized, and the like, the describe control and its programming interface may permit ink information to be manipulated as easily as text, while providing the richness of handwritten ink.

Claims

1. A computer-readable medium storing computer-executable instructions for performing a method, the method comprising:

displaying a user-selectable element associated with a mode switch, said mode switch being associated with an ink edit control programming interface to set operational modes for ink edit control functions to control recognition functionality as applied to ink that is to be displayed, wherein the mode switch is switchable in response to a user selection of the element between a first setting to set a first operational mode and a second setting to set a second operational mode;

receiving user input comprising ink to be displayed;

displaying the received ink; and

determining whether, at the time that the displayed ink was received, a currently existing setting of the mode switch is the first setting or the second setting;

wherein if the second setting is determined to be the currently existing setting of the mode switch at the time that the displayed ink was received, then replacing the displayed ink with displayed recognized text according to the second operational mode, wherein the recognized text is a result of recognition of the displayed ink as text; and

wherein if the first setting is determined to be the currently existing setting of the mode switch at the time that the displayed ink was received, then persistently displaying the displayed ink and not replacing the displayed ink with displayed recognized text, according to the first operational mode.

2. The computer-readable medium of claim 1, wherein the method further comprises storing the ink as an ink object.

3. The computer-readable medium of claim 1, wherein the method further comprises:

receiving user input; and

responsive to the user input, modifying how the ink is displayed by displaying the ink as bold ink or italicized ink.

4. The computer-readable medium of claim 1, wherein the method further comprises waiting a predetermined amount of time, and wherein displaying the recognized ink is performed after the predetermined amount of time expires.

5. The computer-readable medium of claim 4, wherein the predetermined amount of time is in a range of about 100 milliseconds to about 5000 milliseconds.

6. The computer-readable medium of claim 1, wherein the method further comprises receiving a user command, and wherein displaying the recognized ink is performed responsive to receiving the user command.

7. The computer-readable medium of claim 1, wherein the method further comprises:

allowing user formatting of the displayed ink; and

persistently storing the displayed ink and associated formatting in a data structure.

8. A method, comprising:

displaying a user-selectable element associated with a mode switch, said mode switch being associated with an ink edit control programming interface to set operational modes for ink edit control functions to control recognition functionality as applied to ink that is to be displayed, wherein the mode switch is switchable in response to a user selection of the element between a first setting to set a first operational mode and a second setting to set a second operational mode;

receiving user input comprising ink to be displayed;

displaying the received ink; and

determining whether, at the time that the displayed ink was received, a currently existing setting of the mode switch is the first setting or the second setting;

wherein if the second setting is determined to be the currently existing setting of the mode switch at the time that the displayed ink was received, then replacing the displayed ink with displayed recognized text according to the second operational mode, wherein the recognized text is a result of recognition of the displayed ink as text; and

wherein if the first setting is determined to be the currently existing setting of the mode switch at the time that the displayed ink was received, then persistently displaying the displayed ink and not replacing the displayed ink with displayed recognized text, according to the first operational mode.

9. The method of claim 8, further comprising storing the ink as an ink object.

10. The method of claim 8, further comprising:

receiving user input; and

responsive to the user input, modifying how the ink is displayed by displaying the ink as bold ink or italicized ink.

11. The method of claim 8, further comprising waiting a predetermined amount of time, and wherein displaying the recognized ink is performed after the predetermined amount of time expires.

12. The method of claim 11, wherein the predetermined amount of time is in a range of about 100 milliseconds to about 5000 milliseconds.

13. The method of claim 8, further comprising receiving a user command, and wherein displaying the recognized ink is performed responsive to receiving the user command.

14. The method of claim 8, further comprising:

allowing user formatting of the displayed ink; and

persistently storing the displayed ink and associated formatting in a data structure.

15. A method, comprising:

displaying a user-selectable element associated with a mode switch, said mode switch being associated with an ink edit control programming interface to set operational modes for ink edit control functions to control recognition functionality as applied to received ink, wherein the mode switch is switchable in response to a user selection of the element between a first setting to set a first operational mode and a second setting to set a second operational mode;

receiving user input comprising ink; and

determining whether, at the time that the ink was received, a currently existing setting of the mode switch is the first setting or the second setting;

wherein if the first setting is determined to be the currently existing setting of the mode switch at the time that the ink was received, then displaying the received ink according to the first operational mode; and

wherein if the second setting is determined to be the currently existing setting of the mode switch at the time that the ink was received, then displaying recognized text according to the second operational mode, wherein the recognized text is a result of recognition of the received ink as text.

16. The method of claim 15, further comprising storing the ink as an ink object.

17. The method of claim 15, further comprising:

receiving user input; and

responsive to the user input, modifying how the ink is displayed by displaying the ink as bold ink or italicized ink.

18. The method of claim 15, further comprising waiting a predetermined amount of time, and wherein displaying the recognized ink is performed after the predetermined amount of time expires.

19. The method of claim 18, wherein the predetermined amount of time is in a range of about 100 milliseconds to about 5000 milliseconds.

20. The method of claim 15, further comprising receiving a user command, and wherein displaying the recognized ink is performed responsive to receiving the user command.

21. The method of claim 15, further comprising:

allowing user formatting of the displayed ink; and

persistently storing the displayed ink and associated formatting in a data structure.