Correcting recognition results associated with user input

• US 20040021700A1
• Filed: 07/30/2002
• Published: 02/05/2004
• Est. Priority Date: 07/30/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Iwema, Marieke, Lui, Charlton E., Keely, Leroy B., Paulson, Kevin P.
• Granted Patent: US 7,137,076 B2
• Time in Patent Office: Days
• US Class Current: 345/863
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/387 using human interaction, e.g. selection of the best displayed recognition candidate

Abstract

Recognition results associated with handwritten electronic ink, voice recognition results or other forms of user input can be corrected by designating at least a portion of a visual display. Recognition results corresponding to the designated portion, and optionally, additional recognition results to provide context, are displayed. Portions of the displayed recognition results are then selected, and alternate recognition results made available. Alternate recognition results can be chosen, and the selected recognition results modified based upon the chosen alternate. The invention may include different user interfaces.

Claims

1. A method of correcting computer-generated recognition results corresponding to a visual representation, on a display device, of user input to a computer, the method comprising:

receiving a designation of a visual representation;

displaying one or more recognition results corresponding to the designated visual representation;

receiving a selection of at least one recognition result from the displayed recognition results;

displaying alternate recognition results;

receiving a choice of an alternate recognition result; and

modifying the selected recognition result based on the chosen alternate recognition result.

2. The method of claim 1, wherein displaying one or more recognition results corresponding to the designated visual representation comprises displaying multiple text words, and wherein receiving a selection of at least one recognition result comprises receiving a selection of less than all of the multiple text words.

3. The method of claim 1, wherein displaying one or more recognition results corresponding to the designated visual representation further comprises displaying recognition results corresponding to a non-designated visual representation in proximity to the designated visual representation.

4. The method of claim 1, wherein the visual representation comprises graphical representations of handwriting.

5. The method of claim 1, wherein receiving a choice of an alternate recognition result comprises receiving a choice of a recognition result from the displayed alternate recognition results, and wherein modifying the selected recognition result comprises replacing the selected recognition result with the chosen alternate recognition result.

6. The method of claim 1, further comprising:

providing an interface for input of additional information regarding a desired alternate recognition result.

7. The method of claim 6, further comprising receiving input of additional information, and wherein receiving a choice of an alternate recognition result comprises receiving text that has been generated based upon the additional information.

8. The method of claim 1, wherein displaying one or more recognition results corresponding to the designated visual representation further comprises:

displaying in a second manner a recognition result having a higher probability being incorrect than a recognition result displayed in a first manner.

9. The method of claim 8, wherein the recognition result displayed in the second manner comprises text for which a spell-checking process has identified a potential misspelling.

10. The method of claim 8, wherein the recognition result displayed in the second manner comprises text for which a grammar-checking process has identified a potential grammatical error.

11. The method of claim 1, wherein the visual representation comprises ink generated on a portable computing device with a stylus, and wherein at least one of the receiving a designation, receiving a selection and receiving a choice comprises receiving a signal from one of a computer mouse, trackball or keyboard.

12. The method of claim 1, further comprising:

receiving an indication of the subject matter of a recognition result; and

performing additional recognition processes, based upon the indicated subject matter, to generate a revised recognition result.

13. The method of claim 12, further comprising:

displaying the revised recognition result; and

transmitting the revised recognition result to a destination application.

14. The method of claim 2, wherein receiving a selection of at least one recognition result comprises receiving a selection of multiple text words.

15. The method of claim 14, wherein displaying alternate recognition results comprises displaying an alternate recognition result comprising text that is fewer in number of words than the selected multiple text words.

16. The method of claim 1, further comprising:

displaying recognition results incorporating the chosen alternate recognition result;

receiving a second selection of at least one recognition result;

displaying additional alternate recognition results;

receiving a second choice of an alternate recognition result;

modifying the second selected recognition result based on the second chosen alternate recognition result.

17. The method of claim 1, wherein the visual representation comprises electronic ink, and further comprising:

substituting text recognition results for the corresponding ink; and

maintaining the spatial relationship between the substituted text and the remaining electronic ink.

30. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 1.

31. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 2.

32. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 3.

33. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 4.

34. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 5.

35. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 6.

36. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 7.

37. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 8.

38. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 9.

39. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 10.

40. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 11.

41. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 12.

42. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 13.

43. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 14.

44. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 15.

45. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 16.

46. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 17.

18. In a computer system having a display device, a graphical user interface, and a user interface selection device, a method of correcting text associations with electronic ink, comprising:

receiving a designation of ink displayed on the display device;

displaying a dialog on the display device, the dialog having an associated text region and a suggested alternate text region;

displaying text in the associated text region, at least some of the displayed text being associated with the designated ink;

receiving an indication of a selection of at least a portion of the displayed text;

displaying additional text in the suggested alternate text region, the additional text comprising potential alternate text associations for ink corresponding to the selected text;

receiving an indication of a choice of text displayed in the suggested alternate text region; and

associating the chosen text with the ink corresponding to the selected text.

19. The method of claim 18, wherein the dialog further comprises an ink display region, and further comprising:

displaying in the ink display region an image of the ink corresponding to the selected text.

20. The method of claim 18, further comprising:

displaying an indicator within the text region of the selected text.

21. The method of claim 18, further comprising:

displaying a request for additional information regarding desired corrections to selected text.

22. The method of claim 18, further comprising receiving an indication of subject matter of text associated with designated ink.

23. The method of claim 18, further comprising:

receiving an indication to copy text to a destination program.

47. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 18.

24. In a computer system having a display, a graphical user interface, and a user interface selection device, a method comprising:

displaying ink on the display device;

receiving a designation of at least some of displayed ink; and

displaying text associated with the designated ink, the text being displayed in place with the designated ink without obscuring the ink.

25. The method of claim 24, further comprising:

receiving a selection of the displayed text to be corrected;

displaying choices of alternate text for association with the ink corresponding to the selected text;

receiving a choice of text from the alternate text; and

associating the chosen text with the ink corresponding to the selected text.

26. The method of claim 24, further comprising:

displaying designated ink differently than non-designated ink.

27. The method of claim 26, wherein displaying the designated ink differently than non-designated ink comprises one of highlighting the designated ink and surrounding the designated ink with an outline.

28. The method of claim 24, wherein receiving a selection of the displayed text to be corrected comprises receiving an indication that the user interface selection device has contacted the display device in proximity to the selected text or the ink with which the selected text is associated.

29. The method of claim 24, further comprising:

receiving additional user input regarding desired text correction.

48. A computer-readable medium having computer-executable instructions for performing the steps recited in claim 24.