Unistrokes for computerized interpretation of handwriting

• US 5,596,656 A
• Filed: 10/26/1995
• Issued: 01/21/1997
• Est. Priority Date: 10/06/1993
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Goldberg, David
• Primary Examiner(s): Razavi, Michael T.
• Assistant Examiner(s): Prikockis, Larry J.
• Application Number:
  US08/548,416
• Time in Patent Office: 453 Days
• Field of Search: 382/185-189, 382/313, 382/315, 382/182, 364/705.03, 364/709.11, 364/709.01, 345/179, 345/175, 345/180-183
• US Class Current: 382/186
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/333 Preprocessing; Feature extraction
• CPC Class Codes: G06V 30/36 Matching; Classification

Abstract

To relax the graphical constraints on the precision of the handwriting that is required for accurate computerized interpretation of handwritten text, the text that is to be interpreted is written in accordance with this invention using symbols that are exceptionally well separated from each other graphically. These symbols preferably define an orthographic alphabet to reduce the time and effort that is required to learn to write text with them at an acceptably high rate. Furthermore, to accommodate "eyes-free" writing of text and the writing of text in spatially constrained text entry fields, the symbols advantageously are defined by unistrokes (as used herein, a "unistroke" is a single, unbroken stroke).

Claims

1. A system for interpreting handwritten text comprising

a user interface including a manually manipulatable pointer for writing mutually independent unistroke symbols in sequential time order and a user controlled signaling mechanism for performing a predetermined, symbol independent, delimiting operation between successive unistroke symbols in said sequential order, some of said unistroke symbols being linear and others being arcuate, each of said unistroke symbols representing a predefined textual component said delimiting operation distinguishing said unistroke symbols from each other totally independent of without reference to their spatial relationship with respect to each other;

a sensor mechanism coupled to said user interface for transforming said unistroke symbols into corresponding ordered lists of spatial coordinates in said sequential order;

a recognition unit coupled to respond to said sensor mechanism for convening said ordered lists of coordinates into corresponding computer recognizable codes in said sequential order, each of said codes representing a corresponding textual component;

a display; and

a character generator coupled to said recognition unit and to said display for writing the textual components defined by said codes on said display in a spatial order that corresponds to the sequential order of said codes.

2. The system of claim 1 wherein

said user interlace further includes a substantially planar writing surface;

said unistroke symbols are written on said writing surface, and

said sensor mechanism transforms each of said unistroke symbols into an ordered list of x,y coordinate pairs.

3. The system of claim 2 wherein

said pointer is a passive device that is manually engaged with, drawn across, and then disengaged from said writing surface to define the geometric shape and direction of each of said unistroke symbols;

and

said writing surface is interfaced with said sensor mechanism for inputting the geometric shape and direction of each of said unistroke symbols to said sensor mechanism.

4. The system of claim 2 wherein

said pointer is manually engaged with, drawn across, and then disengaged from said writing surface to define the geometric shape and direction of each of said unistroke symbols;

said writing surface is interfaced with said sensor mechanism for inputting the geometric shape and direction of each of said unistroke symbols to said sensor mechanism;

said pointer includes a manually operable actuator for entering user commands, said user commands being communicated to said recognition unit for altering the response of said recognition unit to said unistroke symbols at the command of the user.

5. The system of claim 2 wherein

said pointer is an active device that is manually engaged with, drawn across, and then disengaged from said writing surface to define the geometric shape and direction of each of said unistroke symbols;

and

said sensor mechanism is interfaced with said pointer for transforming the geometric shape and direction of each of said unistroke symbols into an ordered list of x,y coordinate pairs.

6. The system of claim 2 wherein

said pointer is manually engaged with, drawn across, and then disengaged from said writing surface to generate data defining the geometric shape and direction of each of said unistroke symbols;

and

said pointer and said writing surface are pressure sensitive devices that are interfaced with said sensor mechanism for feeding the data defining the geometric shape and direction of each of said unistroke symbols into said sensor mechanism.

7. The system of any of claims 2-6 wherein

said pointer is a stylus.

8. The system of claim 2 wherein

said unistroke symbols are delimited from each other in said sequential time order by making and breaking contact between said pointer and said writing surface once for each unistroke symbol.

9. The system of claims 2, 3, 4, 5 or 6 wherein said unistroke symbols are well separated from each other in sloppiness space.

10. A machine implemented method for interpreting handwritten text comprising

writing said text in sequential time order using an alphabet of mutually independent unistroke symbols to spell out said text at an atomic level, each of said unistroke symbols conforming to a respective graphical specification that includes a stroke direction parameter, some of said unistroke symbols having graphical specifications that differ from each other essentially only on the basis of their respective stroke direction parameters, some of said unistroke symbols being linear and others being arcuate;

entering a predetermined, symbol independent delimiter between successive ones of said unistroke symbols in said time order, said delimiter distinguishing successive unistroke symbols from each other without reference to and totally independently of their spatial relationship with respect to each other;

capturing the stroke direction of each of said unistroke symbols as an ordered list of coordinates;

disambiguating said unistroke symbols from each other based upon predetermined criteria, including the stroke directions of the respective symbols.

11. The method of claim 10 wherein said unistroke symbols are well separated from each other in sloppiness space.

12. A handwriting recognition process for pen computers, said process comprising the steps of

correlating unistroke symbols with natural language alphanumeric symbols, each of said unistroke symbols being fully defined by a single continuous stroke that conforms geometrically and directionally to a predetermined graphical specification, some of said unistroke symbols being linear and others being arcuate;

entering user written unistroke symbols into buffer memory in sequential time order, successive ones of said unistroke symbols being delimited from each other by a predetermined, symbol independent delimiting operation, said delimiting operation distinguishing successive unistroke symbols from each other without reference to and totally independently of their spatial relationship with respect to each other;

reading out said unistroke symbols from buffer memory in sequential time order to provide buffered unistroke symbols;

translating each buffered unistroke symbol that correlates with a natural language symbol into said natural language symbol; and

outputting any natural language symbols that are produced by such translating to a utilization device.

13. The handwriting recognition process of claim 12 wherein certain unistroke symbols correlate with natural language alphanumeric symbols, and other unistroke symbols correlate with user invokeable control functions.

14. The handwriting recognition process of claim 13 wherein at least one of said other unistroke symbols correlates with a control function that shifts the correlation of at least some of said certain unistroke symbols from one set of natural language alphanumeric symbols to another set of natural language alphanumeric symbols.

15. The handwriting recognition process of claim 14 wherein said control function shifts said correlation for just one following unistroke symbol and then restores said correlation to an initial state.

16. A machine implemented handwriting recognition process comprising the steps of

correlating natural language symbols with unistroke symbols, where each of said unistroke symbols is fully defined by a single continuous stroke that conforms geometrically and directionally to a predetermined graphical specification, at least certain of said unistroke symbols being arcuate;

writing user selected unistroke symbols in sequential time order while performing a predetermined, symbol independent delimiting operation for delimiting successive ones of said unistroke symbols from each other, said delimiting operation distinguishing successive unistroke symbols from each other without reference to and totally independently of the spatial relationship of said unistroke symbols with respect to each other;

detecting said selected unistroke symbols; and

translating the detected unistroke symbols that are written into said machine into a corresponding natural language representation.