CONVERTING DIGITAL INK TO SHAPES AND TEXT

• US 20100171754A1
• Filed: 01/07/2009
• Published: 07/08/2010
• Est. Priority Date: 01/07/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hatfield, Larry Tucker, Underhill, Thomas Charles, Russo, Thomas Peter, Biswas, Manoj Kumar, Stojiljkovic, Ivan, Ye, Ming, Raghupathy, Sashi, Hoyer, Crystal Lynn
• Application Number:
  US12/349,517
• Publication Number:
  US 20100171754A1
• Time in Patent Office: Days
• US Class Current: 345/619
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction

Abstract

A shape expressed using digital ink is recognized and a beautified shape is inserted into a document in a native document format. A user interface (“UI”) control is displayed adjacent to the beautified shape which, when selected, will display selectable items for modifying the beautified shape. Insertion of the beautified shape may be undone, the beautified shape may be deleted, and the format of the beautified shape may be modified. Digital ink may also be received that corresponds to text. The digital ink is inserted into a document, displayed, and the text represented by the digital ink is recognized. A UI control is displayed adjacent to the digital ink that will display one or more selectable UI items corresponding to recognition alternates. When selected, the selectable items will cause the text of the corresponding recognition alternate to be inserted into the document.

Claims

1. A computer-readable medium having computer executable instructions stored thereon which, when executed by a computer, cause the computer to:

receive digital ink for insertion into a document;

insert the digital ink into the document;

display the digital ink;

provide the digital ink to a recognition engine;

receive a recognized shape corresponding to the digital ink from the recognition engine;

select a beautified shape expressed in a native document format based on the recognized shape;

insert the beautified shape into the document in place of the digital ink and to display the beautified shape;

display a user interface control adjacent to the beautified shape;

receive a selection of the user interface control; and

to

display one or more selectable items in response to receiving the selection of the user interface control which, when selected, will modify the beautified shape.

2. The computer-readable medium of claim 1, wherein two or more recognized shapes corresponding to the digital ink are identified by the recognition engine, and wherein two or more of the selectable items correspond to the two or more recognized shapes and which, when selected, will cause a corresponding beautified shape expressed in a native document format to be inserted into the document.

3. The computer-readable medium of claim 2, wherein one of the selectable items comprises an item which, when selected, will cause the digital ink to be re-inserted into the document in place of the beautified shape.

4. The computer-readable medium of claim 2, wherein one of the selectable items comprises an item which, when selected, will cause the beautified shape to be deleted.

5. The computer-readable medium of claim 2, wherein the beautified shape comprises a square, and wherein one of the selectable items comprises an item which, when selected, will cause the corners of the square to be rounded.

6. The computer-readable medium of claim 2, wherein the beautified shape comprises a rectangle, and wherein one of the selectable items comprises an item which, when selected, will cause the corners of the rectangle to be rounded.

7. The computer-readable medium of claim 2, wherein the beautified shape comprises a straight line arrow, and wherein one of the selectable items comprises an item which, when selected, will cause the straight line arrow to be replaced with a block arrow.

8. The computer-readable medium of claim 2, wherein one of the selectable items comprises an item which, when selected, will cause a user interface to be provided for setting one or more options relating to the user interface control.

9. A computer-readable medium having computer executable instructions stored thereon which, when executed by a computer, cause the computer to:

receive digital ink for insertion into a document;

insert the digital ink into the document;

display the digital ink;

provide the digital ink to a recognition engine;

receive two or more recognition alternates corresponding to the digital ink from the recognition engine; and

to

display a user interface control adjacent to the digital ink which, when selected, will display one or more selectable items, each of the selectable items corresponding to one of the recognition alternates and which, when selected, will cause the corresponding recognition alternate to be inserted into the document as text.

10. The computer-readable medium of claim 9, comprising further computer executable instructions which, when executed by the computer, will cause the computer to:

receive a selection of one of the selectable items; and

to

insert the text recognition alternate corresponding to the selected item into the document as text.

11. The computer-readable medium of claim 10, wherein the text is inserted into a shape in the document.

12. The computer-readable medium of claim 11, wherein the text is inserted into a text box in the document.

13. The computer-readable medium of claim 9, wherein one of the selectable items comprises an item which, when selected, will cause a user interface to be provided for setting one or more options relating to the user interface control.

14. The computer-readable medium of claim 9, wherein one of the selectable items comprises an item which, when selected, will cause a user interface to be provided for correcting the digital ink.

15. A computer-implemented method for inserting digital ink into a document on a computer having a digitizer, the method comprising executing computer-implemented operations on the computer for:

receiving digital ink for insertion into a document from the digitizer;

inserting the digital ink into the document at the computer;

transforming the digital ink for display at the computer;

provide the digital ink to a recognition engine executing at the computer;

receive a recognized shape corresponding to the digital ink or two or more recognition alternates corresponding to the digital ink from the recognition engine;

in response to receiving the recognized shape from the recognition engine, identifying a beautified shape based on the recognized shape, inserting the beautified shape into the document in place of the digital ink and to display the beautified shape, displaying a first user interface control adjacent to the beautified shape, receiving a selection of the first user interface control and display one or more selectable items in response to receiving the selection of the first user interface control which, when selected, will modify the beautified shape; and

in response to receiving the recognition alternates from the recognition engine, displaying a second user interface control adjacent to the digital ink which, when selected, will display one or more selectable items, each of the selectable items corresponding to one of the recognition alternates and which, when selected, will cause the corresponding recognition alternate to be inserted into the document as text.

16. The method of claim 15, wherein the beautified shape is stored in a native application format for representing shapes.

17. The method of claim 16, wherein two or more beautified shapes corresponding to the digital ink are received from the recognition engine, and wherein two or more of the selectable items correspond to the two or more beautified shapes and which, when selected, will cause the corresponding beautified shape to be inserted into the document.

18. The method of claim 17, further comprising:

receive a selection of one of the selectable items displayed in response to the selection of the second user interface control; and

to

insert the text recognition alternate corresponding to the selected item into the document as text.

19. The method of claim 18, wherein one of the selectable items comprises an item which, when selected, will cause the digital ink to be re-inserted into the document in place of the beautified shape.

20. The method of claim 19, wherein one of the selectable items comprises an item which, when selected, will cause the beautified shape to be deleted.