Graphical user interface for expression recognition

• US 20060062470A1
• Filed: 06/20/2005
• Published: 03/23/2006
• Est. Priority Date: 09/22/2004
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zhang, Dongmei, Sun, Bing, Hou, Xiaohui, Wu, Jiang, Wang, Jian, Zhu, Wenli
• Application Number:
  US11/155,784
• Publication Number:
  US 20060062470A1
• Time in Patent Office: Days
• US Class Current: 382/186
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/387 using human interaction, e.g. selection of the best displayed recognition candidate

Abstract

A mechanism for inputting handwritten mathematical expressions into a computer is described. A user interface includes an input area that receives strokes corresponding to a handwritten mathematical expression, a result display area that displays a mathematical expression recognition result corresponding to the strokes, and a tool area that allows a user to select various tools for operation within the input area and/or the result display area. The mathematical expression recognized result corresponds to a best match to the strokes received from a mathematical expression recognition system. Another interface element allows a user to see the availability of alternative mathematical expression recognition candidates. An additional input feature allows a user to input the mathematical expression recognized result into an application program.

Claims

1. A computer-readable medium including computer-readable instructions for generating a mathematical expression interface for inputting a handwritten mathematical expression, the interface comprising:

an input area configured to receive strokes corresponding to a handwritten mathematical expression;

a result display area configured to display a mathematical expression recognition result corresponding to the strokes; and

a tool area configured to allow for selection of a tool for operation within at least one of the input area and result display area.

2. The computer-readable medium of claim 1, wherein the mathematical expression recognition result corresponds to a best match to the strokes received from a mathematical expression recognition system.

3. The computer-readable medium of claim 1, wherein the interface further includes a first user interface element configured to indicate availability of alternative mathematical expression recognition candidates corresponding to the strokes, and a second user interface configured to display the alternative mathematical expression recognition candidates, wherein the first and second user interfaces are associated with one of the input area and the result display area.

4. The computer-readable medium of claim 3, wherein upon receipt of an input corresponding to selection of an alternative mathematical recognition candidate, the result display area is further configured to replace the mathematical expression recognition result with the alternative mathematical recognition candidate.

5. The computer-readable medium of claim 3, wherein the second user interface is further configured to display an option to reenter at least one stroke.

6. The computer-readable medium of claim 3, wherein the second user interface is further configured to display a second input area.

7. The computer-readable medium of claim 1, wherein the interface further includes an input configured to allow for insertion of the mathematical expression recognition result in the result display area into an application program.

8. The computer-readable medium of claim 1, wherein the tool area is further configured to include an input corresponding to a write tool, an input corresponding to an erase tool, and an input corresponding to a clear all tool.

9. The computer-readable medium of claim 1, wherein the result display area is further configured to receive inputs corresponding to a request to change at least a portion of the mathematical expression recognition result.

10. The computer-readable medium of claim 1, wherein the interface further includes an input configured to initiate a program to recognize strokes corresponding to the handwritten mathematical expression.

11. The computer-readable medium of claim 1, wherein the interface includes a function panel configured to allow for selection of a mathematical operation to correspond to at least a portion of the strokes.

12. The computer-readable medium of claim 11, wherein the function panel is further configured to display a request for entry of information in the input area, wherein the information corresponds to the selected mathematical operation.

13. The computer-readable medium of claim 1, wherein the tool area is further configured to include an input corresponding to a selection tool, wherein the selection tool allows for selection of at least a portion of the strokes.

14. The computer-readable medium of claim 1, wherein the result display area is further configured to display at least one placeholder for a control region associated with a symbol in the mathematical expression recognition result.

15. The computer-readable medium of claim 14, wherein the result display area is further configured to receive inputs corresponding to entry of information into the at least one placeholder.

16. The computer-readable medium of claim 1, wherein the result display area is further configured to receive inputs corresponding to modification of the mathematical expression recognition result.

17. The computer-readable medium of claim 16, wherein an input corresponding to modification of the mathematical expression recognition result includes a change in position of at least a portion of the mathematical expression recognition result.

18. A software architecture stored on one or more computer readable media for processing data representative of a handwritten mathematical expression, comprising:

at least one component configured to generate a mathematical expression interface for inputting a handwritten mathematical expression; and

at least one application program interface to access the component.

19. The software architecture of claim 18, wherein the at least one component is further configured to send a mathematical expression recognition candidate to an application program.

20. A computer-readable medium including computer-readable instructions for generating a mathematical expression input panel for inputting a handwritten mathematical expression, the panel comprising:

an input area configured to receive strokes corresponding to a handwritten mathematical expression;

a tool area configured to allow for selection of a tool for operation within the input area;

a result display area configured to display a mathematical expression recognition candidate corresponding to the strokes;

a candidate menu configured to display at least one alternative mathematical expression recognition candidate corresponding to the strokes upon receipt of an input to display the candidate menu,

wherein the candidate menu is configured as a dropdown menu,

wherein the input to display the candidate menu corresponds to a position of a cursor over a dropdown button associated with the dropdown menu.