Method and system for displaying handwritten data and recognized symbols

• US 5,710,832 A
• Filed: 12/08/1995
• Issued: 01/20/1998
• Est. Priority Date: 06/17/1991
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Pardikar, Shishir P., Abdala, Luis Fernando Talavera, Eller, Marlin, Berman, Eric Robert
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US08/569,497
• Time in Patent Office: 774 Days
• Field of Search: 382/309, 382/310, 382/311, 382/185-189, 395/792, 395/793, 345/123, 345/124, 345/119
• US Class Current: 382/189
• CPC Class Codes: G06V 10/987 with the intervention of an operator

Abstract

A method and system for training a handwriting recognizer at the time of misrecognition is provided. In a preferred embodiment, a trainer program traps and stores the output from a recognizer. The output includes the recognized symbols mapped to the handwritten data. When training is requested by a user, the trainer displays the handwritten data that was input by the user and the recognized symbols. The user then selects the symbols to train on. In response to the selection, the trainer displays the portion of the handwritten data corresponding to the selected symbols. The user then enters the symbols that the displayed portion of the handwritten data should be recognized as. The trainer then requests the recognizer to train based on the displayed portion of the data and the entered symbols. When training is complete, the trainer requests re-recognition of the handwritten data and displays the newly recognized symbols.

Claims

1. A method in a computer system of displaying handwritten data and symbols, the method comprising:

receiving handwritten data;

receiving symbols that correspond to the handwritten data, in that the handwritten data and the symbols corresponding to the handwritten data each constitute a different expression of the same information;

displaying in a first subwindow a portion of the handwritten data;

displaying in a second subwindow distinct from the first subwindow the symbols that correspond to the displayed portion of the handwritten data while simultaneously displaying the portion of the handwritten data; and

in response to a request to scroll,

displaying another symbol that is adjacent to the previously displayed symbols; and

displaying a portion of the handwritten data that corresponds to the other symbol while simultaneously displaying the other symbol.

2. The method of claim 1 wherein the request to scroll is detected when a pointing device is dragged across the displayed symbols.

3. The method of claim 1 wherein the request to scroll is detected when a pointing device selects a displayed scroll indication.

10. The method of claim 1 wherein the step of receiving symbols includes the step of receiving correspondence information defining the correspondence between each symbol and the portion of handwritten data to which it corresponds, and wherein the step of displaying a portion of the handwritten data that corresponds to the other symbol includes the step of identifying the portion of the handwritten data that corresponds to the other symbol using the received correspondence information.

4. A computer system for displaying handwritten data and symbols, comprising:

means for displaying in a first subwindow a portion of the handwritten data;

means for displaying in a second subwindow distinct from the first subwindow the symbols that correspond to the displayed portion of the handwritten data, in that the handwritten data and the symbols corresponding to the handwritten data each constitute a different expression of the same information, while simultaneously displaying the portion of the handwritten data;

means for displaying another symbol that is adjacent to the previously displayed symbol in response to a request to scroll; and

means for displaying another portion of the handwritten data that corresponds to the other symbol while simultaneously displaying the other symbol.

11. The computer system of claim 4, further comprising means for generating correspondence information defining a correspondence between each symbol and a portion of the handwritten data to which the symbol corresponds, and wherein the means for displaying another portion of the handwritten data uses the correspondence information generated by the correspondence information generating means to identify the handwritten data that corresponds to the other symbol.

5. A method in a computer system for displaying handwritten data and symbols, the method comprising:

displaying a portion of the handwritten data and symbols that correspond to the portion of the handwritten data, in that the handwritten data and the symbols corresponding to the handwritten data each constitute a different expression of the same information, so that the handwritten data and the corresponding symbols are displayed simultaneously, the handwritten data being displayed in a first subwindow and the corresponding symbols being displayed in a second subwindow distinct from the first subwindow; and

scrolling the handwritten data and the corresponding symbols in tandem so that whenever a portion of the handwritten data is displayed, the corresponding symbols are simultaneously displayed.

6. The method of claim 5 wherein scrolling of the handwritten data and the corresponding symbols occurs in response to dragging a pointing device across the displayed symbols.

7. The method of claim 5 wherein the scrolling of the handwritten data and the corresponding symbols occurs in response to selecting a displayed scroll indication with a pointing device.

12. The method of claim 5, further including the step of generating correspondence information defining a correspondence between each symbol and a portion of the handwritten data to which the symbol corresponds, and wherein the scrolling step uses the generated correspondence information to simultaneously display a portion of the handwritten data and the corresponding symbols.

8. A computer-readable memory device whose contents cause a computer system to display handwritten data and symbols by:

receiving handwritten data;

receiving symbols that correspond to the handwritten data, in that the handwritten data and the symbols corresponding to the handwritten data each constitute a different expression of the same information;

displaying a portion of the handwritten data in a first subwindow;

displaying the symbols that correspond to the displayed portion of the handwritten data in a second subwindow distinct from the first subwindow while simultaneously displaying the portion of the handwritten data; and

in response to a request to scroll,

displaying another symbol that is adjacent to the previously displayed symbols; and

displaying a portion of the handwritten data that corresponds to the other symbol while simultaneously displaying the other symbol.

13. The computer-readable memory device of claim 8 wherein the step of receiving symbols includes the step of receiving correspondence information defining the correspondence between each symbol and the portion of handwritten data to which it corresponds, and wherein the step of displaying a portion of the handwritten data that corresponds to the other symbol includes the step of identifying the portion of the handwritten dam that corresponds to the other symbol using the received correspondence information.

9. A computer-readable memory device whose contents cause a computer system to display handwritten data and symbols by:

displaying a portion of the handwritten data and symbols that correspond to the portion of the handwritten data, in that the handwritten data and the symbols corresponding to the handwritten data each constitute a different expression of the same information, so that the handwritten data and the corresponding symbols are displayed simultaneously, the handwritten data being displayed in a first subwindow and the corresponding symbols being displayed in a second subwindow distinct from the first subwindow; and

scrolling the handwritten data and the corresponding symbols in tandem so that whenever a portion of the handwritten data is displayed, the corresponding symbols are simultaneously displayed.

14. The computer-readable memory device of claim 9 wherein the contents of the computer-readable memory device further cause the computer system to generate correspondence information defining a correspondence between each symbol and a portion of the handwritten data to which the symbol corresponds, and wherein the scrolling step uses the generated correspondence information to simultaneously display a portion of the handwritten data and the corresponding symbols.